2023-08-26T09:13:06.686 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-26T09:13:06.688 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} --name yuriw-2023-08-25_17:36:25-fs-main-distro-default-smithi --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-08-25_17:36:25-fs-main-distro-default-smithi/7380057 -- /home/teuthworker/archive/yuriw-2023-08-25_17:36:25-fs-main-distro-default-smithi/7380057/orig.config.yaml 2023-08-26T09:13:06.740 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-26T09:13:06.824 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-08-25_17:36:25-fs-main-distro-default-smithi/7380057 branch: main description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: yweinste@redhat.com first_in_suite: false job_id: '7380057' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-08-25_17:36:25-fs-main-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: main ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: e7eb9853fddaf661c68f207346131a7e00d8ed2f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: e7eb9853fddaf661c68f207346131a7e00d8ed2f selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: e7eb9853fddaf661c68f207346131a7e00d8ed2f owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 2135 sha1: e7eb9853fddaf661c68f207346131a7e00d8ed2f sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_e7eb9853fddaf661c68f207346131a7e00d8ed2f/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: e7eb9853fddaf661c68f207346131a7e00d8ed2f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi092.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= smithi188.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 449a1bc2027504e7b3c3d7b30fa4178906581da7 timestamp: 2023-08-25_17:36:25 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2002 2023-08-26T09:13:06.825 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_e7eb9853fddaf661c68f207346131a7e00d8ed2f/qa; will attempt to use it 2023-08-26T09:13:06.826 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_e7eb9853fddaf661c68f207346131a7e00d8ed2f/qa/tasks 2023-08-26T09:13:06.826 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-08-26T09:13:06.828 INFO:teuthology.task.internal:Checking packages... 2023-08-26T09:13:06.850 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash 'e7eb9853fddaf661c68f207346131a7e00d8ed2f' 2023-08-26T09:13:06.851 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-08-26T09:13:06.851 INFO:teuthology.packaging:ref: None 2023-08-26T09:13:06.851 INFO:teuthology.packaging:tag: None 2023-08-26T09:13:06.852 INFO:teuthology.packaging:branch: main 2023-08-26T09:13:06.852 INFO:teuthology.packaging:sha1: e7eb9853fddaf661c68f207346131a7e00d8ed2f 2023-08-26T09:13:06.852 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=main 2023-08-26T09:13:07.104 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-5708.gd50a53f8 2023-08-26T09:13:07.106 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-08-26T09:13:07.114 INFO:teuthology.task.internal:no buildpackages task found 2023-08-26T09:13:07.114 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-08-26T09:13:07.119 INFO:teuthology.task.internal:Saving configuration 2023-08-26T09:13:07.138 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-08-26T09:13:07.145 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-26T09:13:07.173 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi092.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-25_17:36:25-fs-main-distro-default-smithi/7380057', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-26 09:07:58.948811', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-08-26T09:13:07.200 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi188.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-25_17:36:25-fs-main-distro-default-smithi/7380057', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-26 09:07:58.950876', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-08-26T09:13:07.201 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-08-26T09:13:07.207 INFO:teuthology.task.internal:roles: ubuntu@smithi092.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-08-26T09:13:07.207 INFO:teuthology.task.internal:roles: ubuntu@smithi188.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-08-26T09:13:07.208 INFO:teuthology.run_tasks:Running task console_log... 2023-08-26T09:13:07.344 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fee07b13820>, signals=[15]) 2023-08-26T09:13:07.346 INFO:teuthology.run_tasks:Running task internal.connect... 2023-08-26T09:13:07.352 INFO:teuthology.task.internal:Opening connections... 2023-08-26T09:13:07.353 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi092.front.sepia.ceph.com 2023-08-26T09:13:07.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T09:13:07.422 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi188.front.sepia.ceph.com 2023-08-26T09:13:07.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T09:13:07.491 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-08-26T09:13:07.498 DEBUG:teuthology.orchestra.run.smithi092:> uname -m 2023-08-26T09:13:07.519 INFO:teuthology.orchestra.run.smithi092.stdout:x86_64 2023-08-26T09:13:07.520 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release 2023-08-26T09:13:07.578 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="Red Hat Enterprise Linux" 2023-08-26T09:13:07.579 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="8.6 (Ootpa)" 2023-08-26T09:13:07.579 INFO:teuthology.orchestra.run.smithi092.stdout:ID="rhel" 2023-08-26T09:13:07.579 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="fedora" 2023-08-26T09:13:07.579 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="8.6" 2023-08-26T09:13:07.580 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el8" 2023-08-26T09:13:07.580 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-26T09:13:07.580 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31" 2023-08-26T09:13:07.580 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-26T09:13:07.580 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://www.redhat.com/" 2023-08-26T09:13:07.581 INFO:teuthology.orchestra.run.smithi092.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-26T09:13:07.581 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-26T09:13:07.581 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:13:07.581 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-26T09:13:07.581 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-26T09:13:07.582 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-26T09:13:07.582 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-26T09:13:07.582 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2023-08-26T09:13:07.606 DEBUG:teuthology.orchestra.run.smithi188:> uname -m 2023-08-26T09:13:07.626 INFO:teuthology.orchestra.run.smithi188.stdout:x86_64 2023-08-26T09:13:07.626 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release 2023-08-26T09:13:07.685 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="Red Hat Enterprise Linux" 2023-08-26T09:13:07.685 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="8.6 (Ootpa)" 2023-08-26T09:13:07.685 INFO:teuthology.orchestra.run.smithi188.stdout:ID="rhel" 2023-08-26T09:13:07.686 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="fedora" 2023-08-26T09:13:07.686 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="8.6" 2023-08-26T09:13:07.686 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el8" 2023-08-26T09:13:07.686 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-26T09:13:07.686 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31" 2023-08-26T09:13:07.687 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-26T09:13:07.687 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://www.redhat.com/" 2023-08-26T09:13:07.687 INFO:teuthology.orchestra.run.smithi188.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-26T09:13:07.687 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-26T09:13:07.687 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-08-26T09:13:07.688 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-26T09:13:07.688 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-26T09:13:07.688 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-26T09:13:07.688 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-26T09:13:07.689 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server 2023-08-26T09:13:07.714 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-08-26T09:13:07.723 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-08-26T09:13:07.728 INFO:teuthology.task.internal:Checking for old test directory... 2023-08-26T09:13:07.729 DEBUG:teuthology.orchestra.run.smithi092:> test '!' -e /home/ubuntu/cephtest 2023-08-26T09:13:07.732 DEBUG:teuthology.orchestra.run.smithi188:> test '!' -e /home/ubuntu/cephtest 2023-08-26T09:13:07.749 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-08-26T09:13:07.755 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-08-26T09:13:07.756 DEBUG:teuthology.orchestra.run.smithi092:> test -z $(ls -A /var/lib/ceph) 2023-08-26T09:13:07.788 DEBUG:teuthology.orchestra.run.smithi188:> test -z $(ls -A /var/lib/ceph) 2023-08-26T09:13:07.816 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-08-26T09:13:07.866 INFO:teuthology.run_tasks:Running task kernel... 2023-08-26T09:13:07.882 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-08-26T09:13:07.882 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-08-26T09:13:07.883 DEBUG:teuthology.orchestra.run.smithi092:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-26T09:13:07.884 DEBUG:teuthology.orchestra.run.smithi188:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-26T09:13:07.902 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-26T09:13:07.904 DEBUG:teuthology.orchestra.run.smithi092:> uname -r 2023-08-26T09:13:07.905 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-26T09:13:07.906 DEBUG:teuthology.orchestra.run.smithi188:> uname -r 2023-08-26T09:13:07.962 INFO:teuthology.orchestra.run.smithi092.stdout:4.18.0-372.9.1.el8.x86_64 2023-08-26T09:13:07.963 INFO:teuthology.task.kernel:Running kernel on smithi092: 4.18.0-372.9.1.el8.x86_64 2023-08-26T09:13:07.963 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum install -y kernel 2023-08-26T09:13:07.965 INFO:teuthology.orchestra.run.smithi188.stdout:4.18.0-372.9.1.el8.x86_64 2023-08-26T09:13:07.966 INFO:teuthology.task.kernel:Running kernel on smithi188: 4.18.0-372.9.1.el8.x86_64 2023-08-26T09:13:07.966 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum install -y kernel 2023-08-26T09:13:09.169 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-08-26T09:13:09.169 INFO:teuthology.orchestra.run.smithi092.stdout:Unable to read consumer identity 2023-08-26T09:13:09.197 INFO:teuthology.orchestra.run.smithi188.stdout:Updating Subscription Management repositories. 2023-08-26T09:13:09.198 INFO:teuthology.orchestra.run.smithi188.stdout:Unable to read consumer identity 2023-08-26T09:13:10.632 INFO:teuthology.orchestra.run.smithi092.stdout:Copr repo for python3-asyncssh owned by ceph 18 kB/s | 3.5 kB 00:00 2023-08-26T09:13:10.684 INFO:teuthology.orchestra.run.smithi188.stdout:Copr repo for python3-asyncssh owned by ceph 18 kB/s | 3.5 kB 00:00 2023-08-26T09:13:11.383 INFO:teuthology.orchestra.run.smithi092.stdout:Extra Packages for Enterprise Linux 22 MB/s | 16 MB 00:00 2023-08-26T09:13:11.621 INFO:teuthology.orchestra.run.smithi188.stdout:Extra Packages for Enterprise Linux 17 MB/s | 16 MB 00:00 2023-08-26T09:13:14.933 INFO:teuthology.orchestra.run.smithi092.stdout:lab-extras 485 kB/s | 24 kB 00:00 2023-08-26T09:13:15.117 INFO:teuthology.orchestra.run.smithi188.stdout:lab-extras 387 kB/s | 24 kB 00:00 2023-08-26T09:13:15.635 INFO:teuthology.orchestra.run.smithi092.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-08-26T09:13:15.695 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2023-08-26T09:13:15.696 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2023-08-26T09:13:15.696 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2023-08-26T09:13:15.812 DEBUG:teuthology.orchestra.run.smithi092:> echo no | sudo yum reinstall kernel || true 2023-08-26T09:13:15.820 INFO:teuthology.orchestra.run.smithi188.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-08-26T09:13:15.884 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2023-08-26T09:13:15.884 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2023-08-26T09:13:15.885 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2023-08-26T09:13:15.984 DEBUG:teuthology.orchestra.run.smithi188:> echo no | sudo yum reinstall kernel || true 2023-08-26T09:13:16.143 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-08-26T09:13:16.143 INFO:teuthology.orchestra.run.smithi092.stdout:Unable to read consumer identity 2023-08-26T09:13:16.317 INFO:teuthology.orchestra.run.smithi188.stdout:Updating Subscription Management repositories. 2023-08-26T09:13:16.318 INFO:teuthology.orchestra.run.smithi188.stdout:Unable to read consumer identity 2023-08-26T09:13:16.406 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:00:02 ago on Sat 26 Aug 2023 09:13:14 AM UTC. 2023-08-26T09:13:16.450 INFO:teuthology.orchestra.run.smithi092.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-08-26T09:13:16.494 INFO:teuthology.orchestra.run.smithi092.stderr:Error: No packages marked for reinstall. 2023-08-26T09:13:16.540 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum reinstall -y kernel || true 2023-08-26T09:13:16.587 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:00:01 ago on Sat 26 Aug 2023 09:13:15 AM UTC. 2023-08-26T09:13:16.630 INFO:teuthology.orchestra.run.smithi188.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-08-26T09:13:16.664 INFO:teuthology.orchestra.run.smithi188.stderr:Error: No packages marked for reinstall. 2023-08-26T09:13:16.710 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum reinstall -y kernel || true 2023-08-26T09:13:16.871 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-08-26T09:13:16.871 INFO:teuthology.orchestra.run.smithi092.stdout:Unable to read consumer identity 2023-08-26T09:13:17.039 INFO:teuthology.orchestra.run.smithi188.stdout:Updating Subscription Management repositories. 2023-08-26T09:13:17.039 INFO:teuthology.orchestra.run.smithi188.stdout:Unable to read consumer identity 2023-08-26T09:13:17.133 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:00:03 ago on Sat 26 Aug 2023 09:13:14 AM UTC. 2023-08-26T09:13:17.175 INFO:teuthology.orchestra.run.smithi092.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-08-26T09:13:17.195 INFO:teuthology.orchestra.run.smithi092.stderr:Error: No packages marked for reinstall. 2023-08-26T09:13:17.241 DEBUG:teuthology.orchestra.run.smithi092:> rpm -q kernel | sort -rV | head -n 1 2023-08-26T09:13:17.299 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:00:02 ago on Sat 26 Aug 2023 09:13:15 AM UTC. 2023-08-26T09:13:17.322 INFO:teuthology.orchestra.run.smithi092.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-08-26T09:13:17.322 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-08-26T09:13:17.322 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-08-26T09:13:17.323 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-08-26T09:13:17.323 DEBUG:teuthology.orchestra.run.smithi092:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-08-26T09:13:17.342 INFO:teuthology.orchestra.run.smithi188.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-08-26T09:13:17.349 INFO:teuthology.orchestra.run.smithi092.stdout:ttyS1 2023-08-26T09:13:17.362 DEBUG:teuthology.parallel:result is None 2023-08-26T09:13:17.365 INFO:teuthology.orchestra.run.smithi188.stderr:Error: No packages marked for reinstall. 2023-08-26T09:13:17.416 DEBUG:teuthology.orchestra.run.smithi188:> rpm -q kernel | sort -rV | head -n 1 2023-08-26T09:13:17.496 INFO:teuthology.orchestra.run.smithi188.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-08-26T09:13:17.497 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-08-26T09:13:17.497 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-08-26T09:13:17.498 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-08-26T09:13:17.498 DEBUG:teuthology.orchestra.run.smithi188:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-08-26T09:13:17.539 INFO:teuthology.orchestra.run.smithi188.stdout:ttyS1 2023-08-26T09:13:17.557 DEBUG:teuthology.parallel:result is None 2023-08-26T09:13:17.557 INFO:teuthology.run_tasks:Running task internal.base... 2023-08-26T09:13:17.564 INFO:teuthology.task.internal:Creating test directory... 2023-08-26T09:13:17.564 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-26T09:13:17.566 DEBUG:teuthology.orchestra.run.smithi188:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-26T09:13:17.613 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-08-26T09:13:17.620 INFO:teuthology.run_tasks:Running task internal.archive... 2023-08-26T09:13:17.628 INFO:teuthology.task.internal:Creating archive directory... 2023-08-26T09:13:17.629 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-26T09:13:17.631 DEBUG:teuthology.orchestra.run.smithi188:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-26T09:13:17.677 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-08-26T09:13:17.687 INFO:teuthology.task.internal:Enabling coredump saving... 2023-08-26T09:13:17.687 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-26T09:13:17.690 DEBUG:teuthology.orchestra.run.smithi188:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-26T09:13:17.733 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-26T09:13:17.743 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-26T09:13:17.755 INFO:teuthology.orchestra.run.smithi188.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-26T09:13:17.765 INFO:teuthology.orchestra.run.smithi188.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-26T09:13:17.766 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-08-26T09:13:17.774 INFO:teuthology.task.internal:Configuring sudo... 2023-08-26T09:13:17.774 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-26T09:13:17.776 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-26T09:13:17.833 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-08-26T09:13:17.841 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-08-26T09:13:17.842 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-26T09:13:17.844 DEBUG:teuthology.orchestra.run.smithi188:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-26T09:13:17.889 DEBUG:teuthology.orchestra.run.smithi092:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-26T09:13:17.938 DEBUG:teuthology.orchestra.run.smithi092:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-26T09:13:17.997 DEBUG:teuthology.orchestra.run.smithi092:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-26T09:13:18.078 DEBUG:teuthology.orchestra.run.smithi092:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-26T09:13:18.122 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-08-26T09:13:18.123 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-26T09:13:18.196 DEBUG:teuthology.orchestra.run.smithi188:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-26T09:13:18.239 DEBUG:teuthology.orchestra.run.smithi188:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-26T09:13:18.293 DEBUG:teuthology.orchestra.run.smithi188:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-26T09:13:18.378 DEBUG:teuthology.orchestra.run.smithi188:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-26T09:13:18.417 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-08-26T09:13:18.418 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-26T09:13:18.485 DEBUG:teuthology.orchestra.run.smithi092:> sudo service rsyslog restart 2023-08-26T09:13:18.487 DEBUG:teuthology.orchestra.run.smithi188:> sudo service rsyslog restart 2023-08-26T09:13:18.539 INFO:teuthology.orchestra.run.smithi092.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-26T09:13:18.585 INFO:teuthology.orchestra.run.smithi188.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-26T09:13:19.032 INFO:teuthology.run_tasks:Running task internal.timer... 2023-08-26T09:13:19.045 INFO:teuthology.task.internal:Starting timer... 2023-08-26T09:13:19.045 INFO:teuthology.run_tasks:Running task pcp... 2023-08-26T09:13:19.056 INFO:teuthology.run_tasks:Running task selinux... 2023-08-26T09:13:19.064 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-08-26T09:13:19.065 DEBUG:teuthology.orchestra.run.smithi092:> sudo service auditd rotate 2023-08-26T09:13:19.135 INFO:teuthology.orchestra.run.smithi092.stdout:Rotating logs: 2023-08-26T09:13:19.136 DEBUG:teuthology.orchestra.run.smithi188:> sudo service auditd rotate 2023-08-26T09:13:19.196 INFO:teuthology.orchestra.run.smithi188.stdout:Rotating logs: 2023-08-26T09:13:19.198 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-08-26T09:13:19.198 DEBUG:teuthology.orchestra.run.smithi092:> /usr/sbin/getenforce 2023-08-26T09:13:19.223 INFO:teuthology.orchestra.run.smithi092.stdout:Permissive 2023-08-26T09:13:19.224 DEBUG:teuthology.orchestra.run.smithi188:> /usr/sbin/getenforce 2023-08-26T09:13:19.251 INFO:teuthology.orchestra.run.smithi188.stdout:Permissive 2023-08-26T09:13:19.252 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi092.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi188.front.sepia.ceph.com': 'permissive'} 2023-08-26T09:13:19.252 DEBUG:teuthology.orchestra.run.smithi092:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-26T09:13:19.292 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-26T09:13:19.293 DEBUG:teuthology.orchestra.run.smithi188:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-26T09:13:19.319 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-26T09:13:19.319 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-08-26T09:13:19.320 DEBUG:teuthology.orchestra.run.smithi092:> sudo /usr/sbin/setenforce permissive 2023-08-26T09:13:19.360 DEBUG:teuthology.orchestra.run.smithi188:> sudo /usr/sbin/setenforce permissive 2023-08-26T09:13:19.394 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-08-26T09:13:19.405 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-08-26T09:13:19.406 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-08-26T09:13:19.422 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-08-26T09:13:19.423 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi092.front.sepia.ceph.com,smithi188.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-08-26T09:21:59.184 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi092.front.sepia.ceph.com'), Remote(name='ubuntu@smithi188.front.sepia.ceph.com')] 2023-08-26T09:21:59.186 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-08-26T09:21:59.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T09:21:59.255 DEBUG:teuthology.orchestra.run.smithi092:> true 2023-08-26T09:21:59.321 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-08-26T09:21:59.321 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2023-08-26T09:21:59.322 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T09:21:59.391 DEBUG:teuthology.orchestra.run.smithi188:> true 2023-08-26T09:21:59.458 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi188.front.sepia.ceph.com' 2023-08-26T09:21:59.459 INFO:teuthology.run_tasks:Running task clock... 2023-08-26T09:21:59.471 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-08-26T09:21:59.472 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-26T09:21:59.473 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-26T09:21:59.475 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-26T09:21:59.476 DEBUG:teuthology.orchestra.run.smithi188:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-26T09:21:59.506 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-08-26T09:21:59.519 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-08-26T09:21:59.529 INFO:teuthology.orchestra.run.smithi188.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-08-26T09:21:59.543 INFO:teuthology.orchestra.run.smithi188.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-08-26T09:21:59.591 INFO:teuthology.orchestra.run.smithi092.stderr:sudo: ntpd: command not found 2023-08-26T09:21:59.603 INFO:teuthology.orchestra.run.smithi092.stdout:506 Cannot talk to daemon 2023-08-26T09:21:59.611 INFO:teuthology.orchestra.run.smithi188.stderr:sudo: ntpd: command not found 2023-08-26T09:21:59.617 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-08-26T09:21:59.623 INFO:teuthology.orchestra.run.smithi188.stdout:506 Cannot talk to daemon 2023-08-26T09:21:59.630 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-08-26T09:21:59.638 INFO:teuthology.orchestra.run.smithi188.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-08-26T09:21:59.652 INFO:teuthology.orchestra.run.smithi188.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-08-26T09:21:59.705 INFO:teuthology.orchestra.run.smithi092.stderr:bash: ntpq: command not found 2023-08-26T09:21:59.707 INFO:teuthology.orchestra.run.smithi092.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-26T09:21:59.707 INFO:teuthology.orchestra.run.smithi092.stdout:=============================================================================== 2023-08-26T09:21:59.708 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-26T09:21:59.708 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-26T09:21:59.708 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-26T09:21:59.708 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-26T09:21:59.733 INFO:teuthology.orchestra.run.smithi188.stderr:bash: ntpq: command not found 2023-08-26T09:21:59.737 INFO:teuthology.orchestra.run.smithi188.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-26T09:21:59.737 INFO:teuthology.orchestra.run.smithi188.stdout:=============================================================================== 2023-08-26T09:21:59.737 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-26T09:21:59.737 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-26T09:21:59.737 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-26T09:21:59.738 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-26T09:21:59.739 INFO:teuthology.run_tasks:Running task install... 2023-08-26T09:21:59.748 DEBUG:teuthology.task.install:project ceph 2023-08-26T09:21:59.749 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'e7eb9853fddaf661c68f207346131a7e00d8ed2f'}} 2023-08-26T09:21:59.749 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'e7eb9853fddaf661c68f207346131a7e00d8ed2f'} 2023-08-26T09:21:59.749 INFO:teuthology.task.install:Using flavor: default 2023-08-26T09:21:59.757 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-08-26T09:21:59.757 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-08-26T09:21:59.758 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e7eb9853fddaf661c68f207346131a7e00d8ed2f', 'tag': None, 'wait_for_package': False} 2023-08-26T09:21:59.759 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=e7eb9853fddaf661c68f207346131a7e00d8ed2f 2023-08-26T09:21:59.761 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e7eb9853fddaf661c68f207346131a7e00d8ed2f', 'tag': None, 'wait_for_package': False} 2023-08-26T09:21:59.762 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=e7eb9853fddaf661c68f207346131a7e00d8ed2f 2023-08-26T09:21:59.907 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/main/e7eb9853fddaf661c68f207346131a7e00d8ed2f/centos/8/flavors/default/ 2023-08-26T09:21:59.907 INFO:teuthology.task.install.rpm:Package version is 18.0.0-5706.ge7eb9853 2023-08-26T09:21:59.979 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/main/e7eb9853fddaf661c68f207346131a7e00d8ed2f/centos/8/flavors/default/ 2023-08-26T09:21:59.979 INFO:teuthology.task.install.rpm:Package version is 18.0.0-5706.ge7eb9853 2023-08-26T09:22:00.078 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/main/e7eb9853fddaf661c68f207346131a7e00d8ed2f/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/main/e7eb9853fddaf661c68f207346131a7e00d8ed2f/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/main/e7eb9853fddaf661c68f207346131a7e00d8ed2f/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-08-26T09:22:00.078 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-08-26T09:22:00.078 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-08-26T09:22:00.090 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/main/e7eb9853fddaf661c68f207346131a7e00d8ed2f/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/main/e7eb9853fddaf661c68f207346131a7e00d8ed2f/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/main/e7eb9853fddaf661c68f207346131a7e00d8ed2f/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-08-26T09:22:00.090 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-08-26T09:22:00.091 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-08-26T09:22:00.110 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-08-26T09:22:00.110 DEBUG:teuthology.orchestra.run.smithi092:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e7eb9853fddaf661c68f207346131a7e00d8ed2f/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-08-26T09:22:00.118 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-08-26T09:22:00.118 DEBUG:teuthology.orchestra.run.smithi188:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e7eb9853fddaf661c68f207346131a7e00d8ed2f/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-08-26T09:22:00.178 DEBUG:teuthology.orchestra.run.smithi092:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-08-26T09:22:00.186 DEBUG:teuthology.orchestra.run.smithi188:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-08-26T09:22:00.256 DEBUG:teuthology.orchestra.run.smithi092:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-08-26T09:22:00.263 DEBUG:teuthology.orchestra.run.smithi188:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-08-26T09:22:00.322 INFO:teuthology.orchestra.run.smithi092.stdout:check_obsoletes = 1 2023-08-26T09:22:00.324 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum clean all 2023-08-26T09:22:00.328 INFO:teuthology.orchestra.run.smithi188.stdout:check_obsoletes = 1 2023-08-26T09:22:00.330 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum clean all 2023-08-26T09:22:00.693 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-08-26T09:22:00.702 INFO:teuthology.orchestra.run.smithi188.stdout:Updating Subscription Management repositories. 2023-08-26T09:22:00.949 INFO:teuthology.orchestra.run.smithi092.stdout:44 files removed 2023-08-26T09:22:00.975 INFO:teuthology.orchestra.run.smithi188.stdout:44 files removed 2023-08-26T09:22:00.995 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-08-26T09:22:01.022 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-08-26T09:22:01.324 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-08-26T09:22:01.352 INFO:teuthology.orchestra.run.smithi188.stdout:Updating Subscription Management repositories. 2023-08-26T09:22:01.955 INFO:teuthology.orchestra.run.smithi188.stdout:ceph packages for x86_64 309 kB/s | 81 kB 00:00 2023-08-26T09:22:02.222 INFO:teuthology.orchestra.run.smithi188.stdout:ceph noarch packages 40 kB/s | 9.4 kB 00:00 2023-08-26T09:22:02.250 INFO:teuthology.orchestra.run.smithi092.stdout:ceph packages for x86_64 143 kB/s | 81 kB 00:00 2023-08-26T09:22:02.464 INFO:teuthology.orchestra.run.smithi188.stdout:ceph source packages 6.7 kB/s | 1.5 kB 00:00 2023-08-26T09:22:02.607 INFO:teuthology.orchestra.run.smithi188.stdout:Copr repo for python3-asyncssh owned by ceph 28 kB/s | 3.5 kB 00:00 2023-08-26T09:22:02.684 INFO:teuthology.orchestra.run.smithi092.stdout:ceph noarch packages 23 kB/s | 9.4 kB 00:00 2023-08-26T09:22:03.110 INFO:teuthology.orchestra.run.smithi092.stdout:ceph source packages 3.7 kB/s | 1.5 kB 00:00 2023-08-26T09:22:03.252 INFO:teuthology.orchestra.run.smithi092.stdout:Copr repo for python3-asyncssh owned by ceph 28 kB/s | 3.5 kB 00:00 2023-08-26T09:22:03.977 INFO:teuthology.orchestra.run.smithi092.stdout:Extra Packages for Enterprise Linux 22 MB/s | 16 MB 00:00 2023-08-26T09:22:07.176 INFO:teuthology.orchestra.run.smithi188.stdout:Extra Packages for Enterprise Linux 3.5 MB/s | 16 MB 00:04 2023-08-26T09:22:07.486 INFO:teuthology.orchestra.run.smithi092.stdout:lab-extras 506 kB/s | 24 kB 00:00 2023-08-26T09:22:08.354 INFO:teuthology.orchestra.run.smithi092.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 59 MB/s | 47 MB 00:00 2023-08-26T09:22:10.690 INFO:teuthology.orchestra.run.smithi188.stdout:lab-extras 382 kB/s | 24 kB 00:00 2023-08-26T09:22:11.592 INFO:teuthology.orchestra.run.smithi188.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 57 MB/s | 47 MB 00:00 2023-08-26T09:22:16.346 INFO:teuthology.orchestra.run.smithi092.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 61 MB/s | 53 MB 00:00 2023-08-26T09:22:19.467 INFO:teuthology.orchestra.run.smithi188.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 60 MB/s | 53 MB 00:00 2023-08-26T09:22:27.494 INFO:teuthology.orchestra.run.smithi092.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-26T09:22:27.495 INFO:teuthology.orchestra.run.smithi092.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-26T09:22:27.509 INFO:teuthology.orchestra.run.smithi092.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-08-26T09:22:27.511 INFO:teuthology.orchestra.run.smithi092.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-08-26T09:22:27.512 INFO:teuthology.orchestra.run.smithi092.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-08-26T09:22:27.513 INFO:teuthology.orchestra.run.smithi092.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-08-26T09:22:27.518 INFO:teuthology.orchestra.run.smithi092.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-08-26T09:22:27.519 INFO:teuthology.orchestra.run.smithi092.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-08-26T09:22:27.520 INFO:teuthology.orchestra.run.smithi092.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-08-26T09:22:27.648 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2023-08-26T09:22:27.660 INFO:teuthology.orchestra.run.smithi092.stdout:=========================================================================================================================== 2023-08-26T09:22:27.661 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2023-08-26T09:22:27.661 INFO:teuthology.orchestra.run.smithi092.stdout:=========================================================================================================================== 2023-08-26T09:22:27.661 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2023-08-26T09:22:27.661 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-08-26T09:22:27.662 INFO:teuthology.orchestra.run.smithi092.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-08-26T09:22:27.662 INFO:teuthology.orchestra.run.smithi092.stdout: ceph x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 6.4 k 2023-08-26T09:22:27.662 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-base x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 5.4 M 2023-08-26T09:22:27.662 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-fuse x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 862 k 2023-08-26T09:22:27.662 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 167 k 2023-08-26T09:22:27.662 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 1.6 M 2023-08-26T09:22:27.663 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-cephadm noarch 2:18.0.0-5706.ge7eb9853.el8 ceph-noarch 132 k 2023-08-26T09:22:27.663 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-dashboard noarch 2:18.0.0-5706.ge7eb9853.el8 ceph-noarch 1.7 M 2023-08-26T09:22:27.663 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-5706.ge7eb9853.el8 ceph-noarch 7.4 M 2023-08-26T09:22:27.663 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-rook noarch 2:18.0.0-5706.ge7eb9853.el8 ceph-noarch 47 k 2023-08-26T09:22:27.664 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-radosgw x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 14 M 2023-08-26T09:22:27.664 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-test x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 48 M 2023-08-26T09:22:27.664 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-volume noarch 2:18.0.0-5706.ge7eb9853.el8 ceph-noarch 260 k 2023-08-26T09:22:27.664 INFO:teuthology.orchestra.run.smithi092.stdout: cephadm noarch 2:18.0.0-5706.ge7eb9853.el8 ceph-noarch 171 k 2023-08-26T09:22:27.664 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-mirror x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 260 k 2023-08-26T09:22:27.665 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-top noarch 2:18.0.0-5706.ge7eb9853.el8 ceph-noarch 18 k 2023-08-26T09:22:27.665 INFO:teuthology.orchestra.run.smithi092.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-08-26T09:22:27.665 INFO:teuthology.orchestra.run.smithi092.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-08-26T09:22:27.665 INFO:teuthology.orchestra.run.smithi092.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-08-26T09:22:27.665 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs-devel x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 31 k 2023-08-26T09:22:27.666 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs2 x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 784 k 2023-08-26T09:22:27.666 INFO:teuthology.orchestra.run.smithi092.stdout: librados-devel x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 139 k 2023-08-26T09:22:27.666 INFO:teuthology.orchestra.run.smithi092.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-08-26T09:22:27.666 INFO:teuthology.orchestra.run.smithi092.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-08-26T09:22:27.666 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-08-26T09:22:27.667 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-08-26T09:22:27.667 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-08-26T09:22:27.667 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-08-26T09:22:27.667 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cephfs x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 197 k 2023-08-26T09:22:27.668 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rados x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 371 k 2023-08-26T09:22:27.668 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rbd x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 365 k 2023-08-26T09:22:27.668 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rgw x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 107 k 2023-08-26T09:22:27.668 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-fuse x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 93 k 2023-08-26T09:22:27.668 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-mirror x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 3.5 M 2023-08-26T09:22:27.669 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-nbd x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 179 k 2023-08-26T09:22:27.669 INFO:teuthology.orchestra.run.smithi092.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-08-26T09:22:27.669 INFO:teuthology.orchestra.run.smithi092.stdout:Upgrading: 2023-08-26T09:22:27.669 INFO:teuthology.orchestra.run.smithi092.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-08-26T09:22:27.669 INFO:teuthology.orchestra.run.smithi092.stdout: librados2 x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 3.7 M 2023-08-26T09:22:27.670 INFO:teuthology.orchestra.run.smithi092.stdout: librbd1 x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 3.6 M 2023-08-26T09:22:27.670 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2023-08-26T09:22:27.670 INFO:teuthology.orchestra.run.smithi092.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-08-26T09:22:27.670 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-common x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 22 M 2023-08-26T09:22:27.670 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-grafana-dashboards noarch 2:18.0.0-5706.ge7eb9853.el8 ceph-noarch 23 k 2023-08-26T09:22:27.671 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mds x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 2.3 M 2023-08-26T09:22:27.671 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-modules-core noarch 2:18.0.0-5706.ge7eb9853.el8 ceph-noarch 242 k 2023-08-26T09:22:27.671 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mon x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 4.6 M 2023-08-26T09:22:27.671 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-osd x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 18 M 2023-08-26T09:22:27.671 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-prometheus-alerts noarch 2:18.0.0-5706.ge7eb9853.el8 ceph-noarch 15 k 2023-08-26T09:22:27.672 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-selinux x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 24 k 2023-08-26T09:22:27.672 INFO:teuthology.orchestra.run.smithi092.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-08-26T09:22:27.672 INFO:teuthology.orchestra.run.smithi092.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-08-26T09:22:27.672 INFO:teuthology.orchestra.run.smithi092.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-08-26T09:22:27.672 INFO:teuthology.orchestra.run.smithi092.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-08-26T09:22:27.673 INFO:teuthology.orchestra.run.smithi092.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-08-26T09:22:27.673 INFO:teuthology.orchestra.run.smithi092.stdout: libcephsqlite x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 139 k 2023-08-26T09:22:27.673 INFO:teuthology.orchestra.run.smithi092.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-08-26T09:22:27.673 INFO:teuthology.orchestra.run.smithi092.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-08-26T09:22:27.673 INFO:teuthology.orchestra.run.smithi092.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-08-26T09:22:27.674 INFO:teuthology.orchestra.run.smithi092.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-08-26T09:22:27.674 INFO:teuthology.orchestra.run.smithi092.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-08-26T09:22:27.674 INFO:teuthology.orchestra.run.smithi092.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-08-26T09:22:27.674 INFO:teuthology.orchestra.run.smithi092.stdout: libradosstriper1 x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 472 k 2023-08-26T09:22:27.674 INFO:teuthology.orchestra.run.smithi092.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-08-26T09:22:27.675 INFO:teuthology.orchestra.run.smithi092.stdout: librgw2 x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 6.8 M 2023-08-26T09:22:27.675 INFO:teuthology.orchestra.run.smithi092.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-08-26T09:22:27.675 INFO:teuthology.orchestra.run.smithi092.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-08-26T09:22:27.675 INFO:teuthology.orchestra.run.smithi092.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-08-26T09:22:27.675 INFO:teuthology.orchestra.run.smithi092.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-08-26T09:22:27.676 INFO:teuthology.orchestra.run.smithi092.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-08-26T09:22:27.676 INFO:teuthology.orchestra.run.smithi092.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-08-26T09:22:27.676 INFO:teuthology.orchestra.run.smithi092.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-08-26T09:22:27.676 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-08-26T09:22:27.676 INFO:teuthology.orchestra.run.smithi092.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-08-26T09:22:27.677 INFO:teuthology.orchestra.run.smithi092.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-08-26T09:22:27.677 INFO:teuthology.orchestra.run.smithi092.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-08-26T09:22:27.677 INFO:teuthology.orchestra.run.smithi092.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-08-26T09:22:27.677 INFO:teuthology.orchestra.run.smithi092.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-08-26T09:22:27.677 INFO:teuthology.orchestra.run.smithi092.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-08-26T09:22:27.678 INFO:teuthology.orchestra.run.smithi092.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-08-26T09:22:27.678 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-08-26T09:22:27.678 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-argparse x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 45 k 2023-08-26T09:22:27.678 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-common x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 125 k 2023-08-26T09:22:27.678 INFO:teuthology.orchestra.run.smithi092.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-08-26T09:22:27.679 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-08-26T09:22:27.679 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-08-26T09:22:27.679 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-08-26T09:22:27.679 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-08-26T09:22:27.680 INFO:teuthology.orchestra.run.smithi092.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-08-26T09:22:27.680 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-08-26T09:22:27.680 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-08-26T09:22:27.680 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-08-26T09:22:27.680 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-08-26T09:22:27.680 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-08-26T09:22:27.681 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-26T09:22:27.681 INFO:teuthology.orchestra.run.smithi092.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-08-26T09:22:27.681 INFO:teuthology.orchestra.run.smithi092.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-08-26T09:22:27.681 INFO:teuthology.orchestra.run.smithi092.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-08-26T09:22:27.682 INFO:teuthology.orchestra.run.smithi092.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-08-26T09:22:27.682 INFO:teuthology.orchestra.run.smithi092.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-08-26T09:22:27.682 INFO:teuthology.orchestra.run.smithi092.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-08-26T09:22:27.682 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-08-26T09:22:27.682 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-08-26T09:22:27.683 INFO:teuthology.orchestra.run.smithi092.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-08-26T09:22:27.683 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-08-26T09:22:27.683 INFO:teuthology.orchestra.run.smithi092.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-08-26T09:22:27.683 INFO:teuthology.orchestra.run.smithi092.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-08-26T09:22:27.684 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-08-26T09:22:27.684 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-08-26T09:22:27.684 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-08-26T09:22:27.684 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-08-26T09:22:27.684 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-08-26T09:22:27.684 INFO:teuthology.orchestra.run.smithi092.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-08-26T09:22:27.685 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-26T09:22:27.685 INFO:teuthology.orchestra.run.smithi092.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-08-26T09:22:27.685 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-08-26T09:22:27.685 INFO:teuthology.orchestra.run.smithi092.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-08-26T09:22:27.685 INFO:teuthology.orchestra.run.smithi092.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-08-26T09:22:27.686 INFO:teuthology.orchestra.run.smithi092.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-08-26T09:22:27.686 INFO:teuthology.orchestra.run.smithi092.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-08-26T09:22:27.686 INFO:teuthology.orchestra.run.smithi092.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-08-26T09:22:27.686 INFO:teuthology.orchestra.run.smithi092.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-08-26T09:22:27.686 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-08-26T09:22:27.687 INFO:teuthology.orchestra.run.smithi092.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-08-26T09:22:27.687 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-08-26T09:22:27.687 INFO:teuthology.orchestra.run.smithi092.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-08-26T09:22:27.687 INFO:teuthology.orchestra.run.smithi092.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-08-26T09:22:27.687 INFO:teuthology.orchestra.run.smithi092.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-08-26T09:22:27.688 INFO:teuthology.orchestra.run.smithi092.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-08-26T09:22:27.688 INFO:teuthology.orchestra.run.smithi092.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-08-26T09:22:27.688 INFO:teuthology.orchestra.run.smithi092.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-08-26T09:22:27.688 INFO:teuthology.orchestra.run.smithi092.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-08-26T09:22:27.688 INFO:teuthology.orchestra.run.smithi092.stdout:Enabling module streams: 2023-08-26T09:22:27.689 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql 10 2023-08-26T09:22:27.689 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:22:27.689 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2023-08-26T09:22:27.689 INFO:teuthology.orchestra.run.smithi092.stdout:=========================================================================================================================== 2023-08-26T09:22:27.689 INFO:teuthology.orchestra.run.smithi092.stdout:Install 128 Packages 2023-08-26T09:22:27.690 INFO:teuthology.orchestra.run.smithi092.stdout:Upgrade 3 Packages 2023-08-26T09:22:27.690 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:22:27.690 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 206 M 2023-08-26T09:22:27.691 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2023-08-26T09:22:28.071 INFO:teuthology.orchestra.run.smithi092.stdout:(1/131): ceph-18.0.0-5706.ge7eb9853.el8.x86_64. 57 kB/s | 6.4 kB 00:00 2023-08-26T09:22:28.288 INFO:teuthology.orchestra.run.smithi092.stdout:(2/131): ceph-fuse-18.0.0-5706.ge7eb9853.el8.x8 3.9 MB/s | 862 kB 00:00 2023-08-26T09:22:28.355 INFO:teuthology.orchestra.run.smithi092.stdout:(3/131): ceph-immutable-object-cache-18.0.0-570 2.4 MB/s | 167 kB 00:00 2023-08-26T09:22:28.697 INFO:teuthology.orchestra.run.smithi092.stdout:(4/131): ceph-mds-18.0.0-5706.ge7eb9853.el8.x86 6.7 MB/s | 2.3 MB 00:00 2023-08-26T09:22:28.963 INFO:teuthology.orchestra.run.smithi092.stdout:(5/131): ceph-mgr-18.0.0-5706.ge7eb9853.el8.x86 5.9 MB/s | 1.6 MB 00:00 2023-08-26T09:22:29.347 INFO:teuthology.orchestra.run.smithi092.stdout:(6/131): ceph-common-18.0.0-5706.ge7eb9853.el8. 16 MB/s | 22 MB 00:01 2023-08-26T09:22:29.530 INFO:teuthology.orchestra.run.smithi092.stdout:(7/131): ceph-mon-18.0.0-5706.ge7eb9853.el8.x86 8.1 MB/s | 4.6 MB 00:00 2023-08-26T09:22:30.406 INFO:teuthology.orchestra.run.smithi092.stdout:(8/131): ceph-osd-18.0.0-5706.ge7eb9853.el8.x86 17 MB/s | 18 MB 00:01 2023-08-26T09:22:30.456 INFO:teuthology.orchestra.run.smithi092.stdout:(9/131): ceph-selinux-18.0.0-5706.ge7eb9853.el8 488 kB/s | 24 kB 00:00 2023-08-26T09:22:30.765 INFO:teuthology.orchestra.run.smithi188.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-26T09:22:30.766 INFO:teuthology.orchestra.run.smithi188.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-26T09:22:30.781 INFO:teuthology.orchestra.run.smithi188.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-08-26T09:22:30.782 INFO:teuthology.orchestra.run.smithi188.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-08-26T09:22:30.783 INFO:teuthology.orchestra.run.smithi188.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-08-26T09:22:30.784 INFO:teuthology.orchestra.run.smithi188.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-08-26T09:22:30.787 INFO:teuthology.orchestra.run.smithi188.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-08-26T09:22:30.790 INFO:teuthology.orchestra.run.smithi188.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-08-26T09:22:30.791 INFO:teuthology.orchestra.run.smithi188.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-08-26T09:22:30.925 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2023-08-26T09:22:30.937 INFO:teuthology.orchestra.run.smithi188.stdout:=========================================================================================================================== 2023-08-26T09:22:30.937 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2023-08-26T09:22:30.937 INFO:teuthology.orchestra.run.smithi188.stdout:=========================================================================================================================== 2023-08-26T09:22:30.937 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2023-08-26T09:22:30.937 INFO:teuthology.orchestra.run.smithi188.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-08-26T09:22:30.938 INFO:teuthology.orchestra.run.smithi188.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-08-26T09:22:30.938 INFO:teuthology.orchestra.run.smithi188.stdout: ceph x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 6.4 k 2023-08-26T09:22:30.938 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-base x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 5.4 M 2023-08-26T09:22:30.938 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-fuse x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 862 k 2023-08-26T09:22:30.938 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 167 k 2023-08-26T09:22:30.939 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 1.6 M 2023-08-26T09:22:30.939 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-cephadm noarch 2:18.0.0-5706.ge7eb9853.el8 ceph-noarch 132 k 2023-08-26T09:22:30.939 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-dashboard noarch 2:18.0.0-5706.ge7eb9853.el8 ceph-noarch 1.7 M 2023-08-26T09:22:30.939 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-5706.ge7eb9853.el8 ceph-noarch 7.4 M 2023-08-26T09:22:30.939 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-rook noarch 2:18.0.0-5706.ge7eb9853.el8 ceph-noarch 47 k 2023-08-26T09:22:30.940 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-radosgw x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 14 M 2023-08-26T09:22:30.940 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-test x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 48 M 2023-08-26T09:22:30.940 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-volume noarch 2:18.0.0-5706.ge7eb9853.el8 ceph-noarch 260 k 2023-08-26T09:22:30.940 INFO:teuthology.orchestra.run.smithi188.stdout: cephadm noarch 2:18.0.0-5706.ge7eb9853.el8 ceph-noarch 171 k 2023-08-26T09:22:30.940 INFO:teuthology.orchestra.run.smithi188.stdout: cephfs-mirror x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 260 k 2023-08-26T09:22:30.941 INFO:teuthology.orchestra.run.smithi188.stdout: cephfs-top noarch 2:18.0.0-5706.ge7eb9853.el8 ceph-noarch 18 k 2023-08-26T09:22:30.941 INFO:teuthology.orchestra.run.smithi188.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-08-26T09:22:30.941 INFO:teuthology.orchestra.run.smithi188.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-08-26T09:22:30.941 INFO:teuthology.orchestra.run.smithi188.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-08-26T09:22:30.941 INFO:teuthology.orchestra.run.smithi188.stdout: libcephfs-devel x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 31 k 2023-08-26T09:22:30.942 INFO:teuthology.orchestra.run.smithi188.stdout: libcephfs2 x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 784 k 2023-08-26T09:22:30.942 INFO:teuthology.orchestra.run.smithi188.stdout: librados-devel x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 139 k 2023-08-26T09:22:30.942 INFO:teuthology.orchestra.run.smithi188.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-08-26T09:22:30.942 INFO:teuthology.orchestra.run.smithi188.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-08-26T09:22:30.943 INFO:teuthology.orchestra.run.smithi188.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-08-26T09:22:30.943 INFO:teuthology.orchestra.run.smithi188.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-08-26T09:22:30.943 INFO:teuthology.orchestra.run.smithi188.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-08-26T09:22:30.943 INFO:teuthology.orchestra.run.smithi188.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-08-26T09:22:30.943 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cephfs x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 197 k 2023-08-26T09:22:30.944 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rados x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 371 k 2023-08-26T09:22:30.944 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rbd x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 365 k 2023-08-26T09:22:30.944 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rgw x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 107 k 2023-08-26T09:22:30.944 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-fuse x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 93 k 2023-08-26T09:22:30.944 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-mirror x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 3.5 M 2023-08-26T09:22:30.945 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-nbd x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 179 k 2023-08-26T09:22:30.945 INFO:teuthology.orchestra.run.smithi188.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-08-26T09:22:30.945 INFO:teuthology.orchestra.run.smithi188.stdout:Upgrading: 2023-08-26T09:22:30.945 INFO:teuthology.orchestra.run.smithi188.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-08-26T09:22:30.945 INFO:teuthology.orchestra.run.smithi188.stdout: librados2 x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 3.7 M 2023-08-26T09:22:30.946 INFO:teuthology.orchestra.run.smithi188.stdout: librbd1 x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 3.6 M 2023-08-26T09:22:30.946 INFO:teuthology.orchestra.run.smithi188.stdout:Installing dependencies: 2023-08-26T09:22:30.946 INFO:teuthology.orchestra.run.smithi188.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-08-26T09:22:30.946 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-common x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 22 M 2023-08-26T09:22:30.946 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-grafana-dashboards noarch 2:18.0.0-5706.ge7eb9853.el8 ceph-noarch 23 k 2023-08-26T09:22:30.946 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mds x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 2.3 M 2023-08-26T09:22:30.947 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-modules-core noarch 2:18.0.0-5706.ge7eb9853.el8 ceph-noarch 242 k 2023-08-26T09:22:30.947 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mon x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 4.6 M 2023-08-26T09:22:30.947 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-osd x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 18 M 2023-08-26T09:22:30.947 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-prometheus-alerts noarch 2:18.0.0-5706.ge7eb9853.el8 ceph-noarch 15 k 2023-08-26T09:22:30.948 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-selinux x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 24 k 2023-08-26T09:22:30.948 INFO:teuthology.orchestra.run.smithi188.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-08-26T09:22:30.948 INFO:teuthology.orchestra.run.smithi188.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-08-26T09:22:30.948 INFO:teuthology.orchestra.run.smithi188.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-08-26T09:22:30.948 INFO:teuthology.orchestra.run.smithi188.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-08-26T09:22:30.949 INFO:teuthology.orchestra.run.smithi188.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-08-26T09:22:30.949 INFO:teuthology.orchestra.run.smithi188.stdout: libcephsqlite x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 139 k 2023-08-26T09:22:30.949 INFO:teuthology.orchestra.run.smithi188.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-08-26T09:22:30.949 INFO:teuthology.orchestra.run.smithi188.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-08-26T09:22:30.949 INFO:teuthology.orchestra.run.smithi188.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-08-26T09:22:30.949 INFO:teuthology.orchestra.run.smithi188.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-08-26T09:22:30.950 INFO:teuthology.orchestra.run.smithi188.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-08-26T09:22:30.950 INFO:teuthology.orchestra.run.smithi188.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-08-26T09:22:30.950 INFO:teuthology.orchestra.run.smithi188.stdout: libradosstriper1 x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 472 k 2023-08-26T09:22:30.950 INFO:teuthology.orchestra.run.smithi188.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-08-26T09:22:30.950 INFO:teuthology.orchestra.run.smithi188.stdout: librgw2 x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 6.8 M 2023-08-26T09:22:30.951 INFO:teuthology.orchestra.run.smithi188.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-08-26T09:22:30.951 INFO:teuthology.orchestra.run.smithi188.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-08-26T09:22:30.951 INFO:teuthology.orchestra.run.smithi188.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-08-26T09:22:30.951 INFO:teuthology.orchestra.run.smithi188.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-08-26T09:22:30.951 INFO:teuthology.orchestra.run.smithi188.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-08-26T09:22:30.952 INFO:teuthology.orchestra.run.smithi188.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-08-26T09:22:30.952 INFO:teuthology.orchestra.run.smithi188.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-08-26T09:22:30.952 INFO:teuthology.orchestra.run.smithi188.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-08-26T09:22:30.952 INFO:teuthology.orchestra.run.smithi188.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-08-26T09:22:30.952 INFO:teuthology.orchestra.run.smithi188.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-08-26T09:22:30.953 INFO:teuthology.orchestra.run.smithi188.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-08-26T09:22:30.953 INFO:teuthology.orchestra.run.smithi188.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-08-26T09:22:30.953 INFO:teuthology.orchestra.run.smithi188.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-08-26T09:22:30.953 INFO:teuthology.orchestra.run.smithi188.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-08-26T09:22:30.953 INFO:teuthology.orchestra.run.smithi188.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-08-26T09:22:30.954 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-08-26T09:22:30.954 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-argparse x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 45 k 2023-08-26T09:22:30.954 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-common x86_64 2:18.0.0-5706.ge7eb9853.el8 ceph 125 k 2023-08-26T09:22:30.954 INFO:teuthology.orchestra.run.smithi188.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-08-26T09:22:30.954 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-08-26T09:22:30.955 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-08-26T09:22:30.955 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-08-26T09:22:30.955 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-08-26T09:22:30.955 INFO:teuthology.orchestra.run.smithi188.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-08-26T09:22:30.955 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-08-26T09:22:30.956 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-08-26T09:22:30.956 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-08-26T09:22:30.956 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-08-26T09:22:30.956 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-08-26T09:22:30.956 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-26T09:22:30.957 INFO:teuthology.orchestra.run.smithi188.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-08-26T09:22:30.957 INFO:teuthology.orchestra.run.smithi188.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-08-26T09:22:30.957 INFO:teuthology.orchestra.run.smithi188.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-08-26T09:22:30.957 INFO:teuthology.orchestra.run.smithi188.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-08-26T09:22:30.957 INFO:teuthology.orchestra.run.smithi188.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-08-26T09:22:30.957 INFO:teuthology.orchestra.run.smithi188.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-08-26T09:22:30.958 INFO:teuthology.orchestra.run.smithi188.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-08-26T09:22:30.958 INFO:teuthology.orchestra.run.smithi188.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-08-26T09:22:30.958 INFO:teuthology.orchestra.run.smithi188.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-08-26T09:22:30.958 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-08-26T09:22:30.959 INFO:teuthology.orchestra.run.smithi188.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-08-26T09:22:30.959 INFO:teuthology.orchestra.run.smithi188.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-08-26T09:22:30.959 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-08-26T09:22:30.959 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-08-26T09:22:30.959 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-08-26T09:22:30.960 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-08-26T09:22:30.960 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-08-26T09:22:30.960 INFO:teuthology.orchestra.run.smithi188.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-08-26T09:22:30.960 INFO:teuthology.orchestra.run.smithi188.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-26T09:22:30.960 INFO:teuthology.orchestra.run.smithi188.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-08-26T09:22:30.961 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-08-26T09:22:30.961 INFO:teuthology.orchestra.run.smithi188.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-08-26T09:22:30.961 INFO:teuthology.orchestra.run.smithi188.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-08-26T09:22:30.961 INFO:teuthology.orchestra.run.smithi188.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-08-26T09:22:30.961 INFO:teuthology.orchestra.run.smithi188.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-08-26T09:22:30.962 INFO:teuthology.orchestra.run.smithi188.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-08-26T09:22:30.962 INFO:teuthology.orchestra.run.smithi188.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-08-26T09:22:30.962 INFO:teuthology.orchestra.run.smithi188.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-08-26T09:22:30.962 INFO:teuthology.orchestra.run.smithi188.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-08-26T09:22:30.962 INFO:teuthology.orchestra.run.smithi188.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-08-26T09:22:30.962 INFO:teuthology.orchestra.run.smithi188.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-08-26T09:22:30.963 INFO:teuthology.orchestra.run.smithi188.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-08-26T09:22:30.963 INFO:teuthology.orchestra.run.smithi188.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-08-26T09:22:30.963 INFO:teuthology.orchestra.run.smithi188.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-08-26T09:22:30.963 INFO:teuthology.orchestra.run.smithi188.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-08-26T09:22:30.963 INFO:teuthology.orchestra.run.smithi188.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-08-26T09:22:30.964 INFO:teuthology.orchestra.run.smithi188.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-08-26T09:22:30.964 INFO:teuthology.orchestra.run.smithi188.stdout:Enabling module streams: 2023-08-26T09:22:30.964 INFO:teuthology.orchestra.run.smithi188.stdout: postgresql 10 2023-08-26T09:22:30.964 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-08-26T09:22:30.964 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2023-08-26T09:22:30.965 INFO:teuthology.orchestra.run.smithi188.stdout:=========================================================================================================================== 2023-08-26T09:22:30.965 INFO:teuthology.orchestra.run.smithi188.stdout:Install 128 Packages 2023-08-26T09:22:30.965 INFO:teuthology.orchestra.run.smithi188.stdout:Upgrade 3 Packages 2023-08-26T09:22:30.965 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-08-26T09:22:30.966 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 206 M 2023-08-26T09:22:30.966 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2023-08-26T09:22:31.135 INFO:teuthology.orchestra.run.smithi092.stdout:(10/131): ceph-radosgw-18.0.0-5706.ge7eb9853.el 8.5 MB/s | 14 MB 00:01 2023-08-26T09:22:31.190 INFO:teuthology.orchestra.run.smithi092.stdout:(11/131): cephfs-mirror-18.0.0-5706.ge7eb9853.e 4.6 MB/s | 260 kB 00:00 2023-08-26T09:22:31.265 INFO:teuthology.orchestra.run.smithi092.stdout:(12/131): libcephfs-devel-18.0.0-5706.ge7eb9853 416 kB/s | 31 kB 00:00 2023-08-26T09:22:31.440 INFO:teuthology.orchestra.run.smithi092.stdout:(13/131): libcephfs2-18.0.0-5706.ge7eb9853.el8. 4.4 MB/s | 784 kB 00:00 2023-08-26T09:22:31.541 INFO:teuthology.orchestra.run.smithi092.stdout:(14/131): libcephsqlite-18.0.0-5706.ge7eb9853.e 1.4 MB/s | 139 kB 00:00 2023-08-26T09:22:31.600 INFO:teuthology.orchestra.run.smithi188.stdout:(1/131): ceph-18.0.0-5706.ge7eb9853.el8.x86_64. 24 kB/s | 6.4 kB 00:00 2023-08-26T09:22:31.683 INFO:teuthology.orchestra.run.smithi092.stdout:(15/131): librados-devel-18.0.0-5706.ge7eb9853. 982 kB/s | 139 kB 00:00 2023-08-26T09:22:31.791 INFO:teuthology.orchestra.run.smithi092.stdout:(16/131): libradosstriper1-18.0.0-5706.ge7eb985 4.3 MB/s | 472 kB 00:00 2023-08-26T09:22:32.617 INFO:teuthology.orchestra.run.smithi188.stdout:(2/131): ceph-fuse-18.0.0-5706.ge7eb9853.el8.x8 848 kB/s | 862 kB 00:01 2023-08-26T09:22:32.959 INFO:teuthology.orchestra.run.smithi188.stdout:(3/131): ceph-immutable-object-cache-18.0.0-570 488 kB/s | 167 kB 00:00 2023-08-26T09:22:33.283 INFO:teuthology.orchestra.run.smithi092.stdout:(17/131): ceph-test-18.0.0-5706.ge7eb9853.el8.x 17 MB/s | 48 MB 00:02 2023-08-26T09:22:33.400 INFO:teuthology.orchestra.run.smithi092.stdout:(18/131): librgw2-18.0.0-5706.ge7eb9853.el8.x86 4.2 MB/s | 6.8 MB 00:01 2023-08-26T09:22:33.425 INFO:teuthology.orchestra.run.smithi092.stdout:(19/131): python3-ceph-argparse-18.0.0-5706.ge7 316 kB/s | 45 kB 00:00 2023-08-26T09:22:33.501 INFO:teuthology.orchestra.run.smithi092.stdout:(20/131): python3-cephfs-18.0.0-5706.ge7eb9853. 2.6 MB/s | 197 kB 00:00 2023-08-26T09:22:33.548 INFO:teuthology.orchestra.run.smithi092.stdout:(21/131): python3-ceph-common-18.0.0-5706.ge7eb 1.0 MB/s | 125 kB 00:00 2023-08-26T09:22:33.576 INFO:teuthology.orchestra.run.smithi092.stdout:(22/131): python3-rados-18.0.0-5706.ge7eb9853.e 4.8 MB/s | 371 kB 00:00 2023-08-26T09:22:33.652 INFO:teuthology.orchestra.run.smithi092.stdout:(23/131): python3-rgw-18.0.0-5706.ge7eb9853.el8 1.4 MB/s | 107 kB 00:00 2023-08-26T09:22:33.677 INFO:teuthology.orchestra.run.smithi092.stdout:(24/131): python3-rbd-18.0.0-5706.ge7eb9853.el8 2.4 MB/s | 365 kB 00:00 2023-08-26T09:22:33.742 INFO:teuthology.orchestra.run.smithi092.stdout:(25/131): rbd-fuse-18.0.0-5706.ge7eb9853.el8.x8 1.0 MB/s | 93 kB 00:00 2023-08-26T09:22:33.836 INFO:teuthology.orchestra.run.smithi092.stdout:(26/131): rbd-nbd-18.0.0-5706.ge7eb9853.el8.x86 1.9 MB/s | 179 kB 00:00 2023-08-26T09:22:33.911 INFO:teuthology.orchestra.run.smithi092.stdout:(27/131): ceph-grafana-dashboards-18.0.0-5706.g 308 kB/s | 23 kB 00:00 2023-08-26T09:22:34.012 INFO:teuthology.orchestra.run.smithi092.stdout:(28/131): ceph-mgr-cephadm-18.0.0-5706.ge7eb985 1.3 MB/s | 132 kB 00:00 2023-08-26T09:22:34.476 INFO:teuthology.orchestra.run.smithi188.stdout:(4/131): ceph-base-18.0.0-5706.ge7eb9853.el8.x8 1.7 MB/s | 5.4 MB 00:03 2023-08-26T09:22:34.490 INFO:teuthology.orchestra.run.smithi092.stdout:(29/131): rbd-mirror-18.0.0-5706.ge7eb9853.el8. 4.3 MB/s | 3.5 MB 00:00 2023-08-26T09:22:34.526 INFO:teuthology.orchestra.run.smithi188.stdout:(5/131): ceph-mds-18.0.0-5706.ge7eb9853.el8.x86 1.5 MB/s | 2.3 MB 00:01 2023-08-26T09:22:34.528 INFO:teuthology.orchestra.run.smithi092.stdout:(30/131): ceph-mgr-dashboard-18.0.0-5706.ge7eb9 3.4 MB/s | 1.7 MB 00:00 2023-08-26T09:22:34.629 INFO:teuthology.orchestra.run.smithi092.stdout:(31/131): ceph-mgr-modules-core-18.0.0-5706.ge7 2.4 MB/s | 242 kB 00:00 2023-08-26T09:22:34.721 INFO:teuthology.orchestra.run.smithi092.stdout:(32/131): ceph-mgr-rook-18.0.0-5706.ge7eb9853.e 517 kB/s | 47 kB 00:00 2023-08-26T09:22:34.813 INFO:teuthology.orchestra.run.smithi092.stdout:(33/131): ceph-prometheus-alerts-18.0.0-5706.ge 159 kB/s | 15 kB 00:00 2023-08-26T09:22:34.893 INFO:teuthology.orchestra.run.smithi188.stdout:(6/131): ceph-mgr-18.0.0-5706.ge7eb9853.el8.x86 3.8 MB/s | 1.6 MB 00:00 2023-08-26T09:22:34.904 INFO:teuthology.orchestra.run.smithi092.stdout:(34/131): ceph-volume-18.0.0-5706.ge7eb9853.el8 2.8 MB/s | 260 kB 00:00 2023-08-26T09:22:34.972 INFO:teuthology.orchestra.run.smithi092.stdout:(35/131): ceph-base-18.0.0-5706.ge7eb9853.el8.x 786 kB/s | 5.4 MB 00:07 2023-08-26T09:22:34.997 INFO:teuthology.orchestra.run.smithi092.stdout:(36/131): cephadm-18.0.0-5706.ge7eb9853.el8.noa 1.8 MB/s | 171 kB 00:00 2023-08-26T09:22:35.081 INFO:teuthology.orchestra.run.smithi092.stdout:(37/131): cephfs-top-18.0.0-5706.ge7eb9853.el8. 166 kB/s | 18 kB 00:00 2023-08-26T09:22:35.273 INFO:teuthology.orchestra.run.smithi092.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 307 kB/s | 59 kB 00:00 2023-08-26T09:22:35.298 INFO:teuthology.orchestra.run.smithi092.stdout:(39/131): gperftools-libs-2.7-9.el8.x86_64.rpm 1.0 MB/s | 306 kB 00:00 2023-08-26T09:22:35.373 INFO:teuthology.orchestra.run.smithi092.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 749 kB/s | 75 kB 00:00 2023-08-26T09:22:35.415 INFO:teuthology.orchestra.run.smithi092.stdout:(41/131): python3-asyncssh-2.7.0-2.el8.noarch.r 4.0 MB/s | 476 kB 00:00 2023-08-26T09:22:35.440 INFO:teuthology.orchestra.run.smithi092.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 650 kB/s | 44 kB 00:00 2023-08-26T09:22:35.491 INFO:teuthology.orchestra.run.smithi092.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 2.4 MB/s | 185 kB 00:00 2023-08-26T09:22:35.516 INFO:teuthology.orchestra.run.smithi092.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 438 kB/s | 33 kB 00:00 2023-08-26T09:22:35.558 INFO:teuthology.orchestra.run.smithi092.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 244 kB/s | 16 kB 00:00 2023-08-26T09:22:35.625 INFO:teuthology.orchestra.run.smithi092.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.6 MB/s | 173 kB 00:00 2023-08-26T09:22:35.650 INFO:teuthology.orchestra.run.smithi092.stdout:(47/131): python3-cherrypy-18.4.0-1.el8.noarch. 4.1 MB/s | 384 kB 00:00 2023-08-26T09:22:35.751 INFO:teuthology.orchestra.run.smithi092.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 648 kB/s | 81 kB 00:00 2023-08-26T09:22:35.776 INFO:teuthology.orchestra.run.smithi092.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 88 kB/s | 11 kB 00:00 2023-08-26T09:22:35.818 INFO:teuthology.orchestra.run.smithi092.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 263 kB/s | 18 kB 00:00 2023-08-26T09:22:35.885 INFO:teuthology.orchestra.run.smithi092.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 732 kB/s | 49 kB 00:00 2023-08-26T09:22:35.893 INFO:teuthology.orchestra.run.smithi188.stdout:(7/131): ceph-common-18.0.0-5706.ge7eb9853.el8. 4.9 MB/s | 22 MB 00:04 2023-08-26T09:22:35.967 INFO:teuthology.orchestra.run.smithi092.stdout:(52/131): python3-kubernetes-11.0.0-6.el8.noarc 6.1 MB/s | 1.2 MB 00:00 2023-08-26T09:22:35.994 INFO:teuthology.orchestra.run.smithi092.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 541 kB/s | 59 kB 00:00 2023-08-26T09:22:36.027 INFO:teuthology.orchestra.run.smithi092.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 1.0 MB/s | 60 kB 00:00 2023-08-26T09:22:36.069 INFO:teuthology.orchestra.run.smithi092.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 3.7 MB/s | 283 kB 00:00 2023-08-26T09:22:36.095 INFO:teuthology.orchestra.run.smithi092.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 233 kB/s | 16 kB 00:00 2023-08-26T09:22:36.137 INFO:teuthology.orchestra.run.smithi092.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 502 kB/s | 34 kB 00:00 2023-08-26T09:22:36.162 INFO:teuthology.orchestra.run.smithi092.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 2.9 MB/s | 196 kB 00:00 2023-08-26T09:22:36.246 INFO:teuthology.orchestra.run.smithi092.stdout:(59/131): ceph-mgr-diskprediction-local-18.0.0- 4.2 MB/s | 7.4 MB 00:01 2023-08-26T09:22:36.263 INFO:teuthology.orchestra.run.smithi092.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 187 kB/s | 19 kB 00:00 2023-08-26T09:22:36.288 INFO:teuthology.orchestra.run.smithi092.stdout:(61/131): python3-rsa-4.9-2.el8.noarch.rpm 426 kB/s | 64 kB 00:00 2023-08-26T09:22:36.345 INFO:teuthology.orchestra.run.smithi092.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 355 kB/s | 29 kB 00:00 2023-08-26T09:22:36.363 INFO:teuthology.orchestra.run.smithi092.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 366 kB/s | 27 kB 00:00 2023-08-26T09:22:36.389 INFO:teuthology.orchestra.run.smithi092.stdout:(64/131): python3-singledispatch-3.4.0.3-18.el8 168 kB/s | 24 kB 00:00 2023-08-26T09:22:36.414 INFO:teuthology.orchestra.run.smithi092.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 3.6 MB/s | 255 kB 00:00 2023-08-26T09:22:36.439 INFO:teuthology.orchestra.run.smithi092.stdout:(66/131): python3-webob-1.8.5-1.el8.1.noarch.rp 3.3 MB/s | 251 kB 00:00 2023-08-26T09:22:36.473 INFO:teuthology.orchestra.run.smithi092.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 1.4 MB/s | 85 kB 00:00 2023-08-26T09:22:36.498 INFO:teuthology.orchestra.run.smithi092.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 391 kB/s | 23 kB 00:00 2023-08-26T09:22:36.515 INFO:teuthology.orchestra.run.smithi092.stdout:(69/131): python3-websocket-client-0.56.0-5.el8 486 kB/s | 61 kB 00:00 2023-08-26T09:22:36.549 INFO:teuthology.orchestra.run.smithi092.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.3 MB/s | 70 kB 00:00 2023-08-26T09:22:36.599 INFO:teuthology.orchestra.run.smithi092.stdout:(71/131): thrift-0.13.0-2.el8.x86_64.rpm 14 MB/s | 1.7 MB 00:00 2023-08-26T09:22:36.649 INFO:teuthology.orchestra.run.smithi092.stdout:(72/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.1 MB/s | 110 kB 00:00 2023-08-26T09:22:36.675 INFO:teuthology.orchestra.run.smithi092.stdout:(73/131): python3-pytz-2017.2-9.el8.noarch.rpm 774 kB/s | 54 kB 00:00 2023-08-26T09:22:36.733 INFO:teuthology.orchestra.run.smithi092.stdout:(74/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.0 MB/s | 259 kB 00:00 2023-08-26T09:22:36.767 INFO:teuthology.orchestra.run.smithi092.stdout:(75/131): socat-1.7.4.1-1.el8.x86_64.rpm 3.4 MB/s | 323 kB 00:00 2023-08-26T09:22:36.792 INFO:teuthology.orchestra.run.smithi092.stdout:(76/131): python3-markupsafe-0.23-19.el8.x86_64 664 kB/s | 39 kB 00:00 2023-08-26T09:22:36.825 INFO:teuthology.orchestra.run.smithi092.stdout:(77/131): bison-3.0.4-10.el8.x86_64.rpm 12 MB/s | 688 kB 00:00 2023-08-26T09:22:36.859 INFO:teuthology.orchestra.run.smithi092.stdout:(78/131): python3-jinja2-2.10.1-3.el8.noarch.rp 7.8 MB/s | 538 kB 00:00 2023-08-26T09:22:36.893 INFO:teuthology.orchestra.run.smithi092.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.3 MB/s | 157 kB 00:00 2023-08-26T09:22:36.918 INFO:teuthology.orchestra.run.smithi092.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.1 MB/s | 187 kB 00:00 2023-08-26T09:22:36.952 INFO:teuthology.orchestra.run.smithi092.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 12 MB/s | 713 kB 00:00 2023-08-26T09:22:36.994 INFO:teuthology.orchestra.run.smithi092.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 638 kB/s | 27 kB 00:00 2023-08-26T09:22:37.044 INFO:teuthology.orchestra.run.smithi092.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 6.2 MB/s | 320 kB 00:00 2023-08-26T09:22:37.111 INFO:teuthology.orchestra.run.smithi092.stdout:(84/131): python3-prettytable-0.7.2-14.el8.noar 661 kB/s | 44 kB 00:00 2023-08-26T09:22:37.178 INFO:teuthology.orchestra.run.smithi092.stdout:(85/131): python3-babel-2.5.1-7.el8.noarch.rpm 18 MB/s | 4.8 MB 00:00 2023-08-26T09:22:37.228 INFO:teuthology.orchestra.run.smithi092.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 9.0 MB/s | 457 kB 00:00 2023-08-26T09:22:37.270 INFO:teuthology.orchestra.run.smithi092.stdout:(87/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 5.3 MB/s | 225 kB 00:00 2023-08-26T09:22:37.276 INFO:teuthology.orchestra.run.smithi188.stdout:(8/131): ceph-osd-18.0.0-5706.ge7eb9853.el8.x86 7.5 MB/s | 18 MB 00:02 2023-08-26T09:22:37.345 INFO:teuthology.orchestra.run.smithi092.stdout:(88/131): python3-numpy-1.14.3-10.el8.x86_64.rp 16 MB/s | 3.7 MB 00:00 2023-08-26T09:22:37.362 INFO:teuthology.orchestra.run.smithi188.stdout:(9/131): ceph-selinux-18.0.0-5706.ge7eb9853.el8 284 kB/s | 24 kB 00:00 2023-08-26T09:22:37.379 INFO:teuthology.orchestra.run.smithi092.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 589 kB/s | 64 kB 00:00 2023-08-26T09:22:37.405 INFO:teuthology.orchestra.run.smithi092.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.1 MB/s | 126 kB 00:00 2023-08-26T09:22:37.454 INFO:teuthology.orchestra.run.smithi092.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 269 kB/s | 20 kB 00:00 2023-08-26T09:22:37.479 INFO:teuthology.orchestra.run.smithi092.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.3 MB/s | 103 kB 00:00 2023-08-26T09:22:37.510 INFO:teuthology.orchestra.run.smithi188.stdout:(10/131): ceph-radosgw-18.0.0-5706.ge7eb9853.el 8.4 MB/s | 14 MB 00:01 2023-08-26T09:22:37.594 INFO:teuthology.orchestra.run.smithi188.stdout:(11/131): cephfs-mirror-18.0.0-5706.ge7eb9853.e 3.1 MB/s | 260 kB 00:00 2023-08-26T09:22:37.613 INFO:teuthology.orchestra.run.smithi092.stdout:(93/131): python3-scipy-1.0.0-21.module+el8.5.0 12 MB/s | 14 MB 00:01 2023-08-26T09:22:37.647 INFO:teuthology.orchestra.run.smithi092.stdout:(94/131): libtool-2.4.6-25.el8.x86_64.rpm 3.6 MB/s | 709 kB 00:00 2023-08-26T09:22:37.661 INFO:teuthology.orchestra.run.smithi188.stdout:(12/131): libcephfs-devel-18.0.0-5706.ge7eb9853 466 kB/s | 31 kB 00:00 2023-08-26T09:22:37.672 INFO:teuthology.orchestra.run.smithi092.stdout:(95/131): libpq-13.5-1.el8.x86_64.rpm 3.3 MB/s | 198 kB 00:00 2023-08-26T09:22:37.714 INFO:teuthology.orchestra.run.smithi092.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-08-26T09:22:37.764 INFO:teuthology.orchestra.run.smithi092.stdout:(97/131): librdkafka-0.11.4-3.el8.x86_64.rpm 6.9 MB/s | 354 kB 00:00 2023-08-26T09:22:37.815 INFO:teuthology.orchestra.run.smithi188.stdout:(13/131): libcephfs2-18.0.0-5706.ge7eb9853.el8. 5.0 MB/s | 784 kB 00:00 2023-08-26T09:22:37.881 INFO:teuthology.orchestra.run.smithi092.stdout:(98/131): openblas-threads-0.3.15-3.el8.x86_64. 12 MB/s | 4.9 MB 00:00 2023-08-26T09:22:37.886 INFO:teuthology.orchestra.run.smithi188.stdout:(14/131): libcephsqlite-18.0.0-5706.ge7eb9853.e 1.9 MB/s | 139 kB 00:00 2023-08-26T09:22:37.956 INFO:teuthology.orchestra.run.smithi092.stdout:(99/131): openblas-0.3.15-3.el8.x86_64.rpm 15 MB/s | 4.7 MB 00:00 2023-08-26T09:22:37.970 INFO:teuthology.orchestra.run.smithi188.stdout:(15/131): ceph-mon-18.0.0-5706.ge7eb9853.el8.x8 1.3 MB/s | 4.6 MB 00:03 2023-08-26T09:22:37.995 INFO:teuthology.orchestra.run.smithi188.stdout:(16/131): librados-devel-18.0.0-5706.ge7eb9853. 1.3 MB/s | 139 kB 00:00 2023-08-26T09:22:38.007 INFO:teuthology.orchestra.run.smithi092.stdout:(100/131): postgresql-contrib-10.21-2.module+el 6.3 MB/s | 808 kB 00:00 2023-08-26T09:22:38.041 INFO:teuthology.orchestra.run.smithi092.stdout:(101/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2023-08-26T09:22:38.083 INFO:teuthology.orchestra.run.smithi092.stdout:(102/131): postgresql-10.21-2.module+el8.6.0+15 12 MB/s | 1.5 MB 00:00 2023-08-26T09:22:38.108 INFO:teuthology.orchestra.run.smithi092.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 2.9 MB/s | 200 kB 00:00 2023-08-26T09:22:38.125 INFO:teuthology.orchestra.run.smithi092.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 1.0 MB/s | 43 kB 00:00 2023-08-26T09:22:38.150 INFO:teuthology.orchestra.run.smithi092.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 5.1 MB/s | 220 kB 00:00 2023-08-26T09:22:38.175 INFO:teuthology.orchestra.run.smithi092.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 959 kB/s | 48 kB 00:00 2023-08-26T09:22:38.224 INFO:teuthology.orchestra.run.smithi092.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.1 MB/s | 87 kB 00:00 2023-08-26T09:22:38.251 INFO:teuthology.orchestra.run.smithi092.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 567 kB/s | 43 kB 00:00 2023-08-26T09:22:38.276 INFO:teuthology.orchestra.run.smithi092.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 2.1 MB/s | 109 kB 00:00 2023-08-26T09:22:38.301 INFO:teuthology.orchestra.run.smithi092.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2023-08-26T09:22:38.312 INFO:teuthology.orchestra.run.smithi188.stdout:(17/131): libradosstriper1-18.0.0-5706.ge7eb985 1.4 MB/s | 472 kB 00:00 2023-08-26T09:22:38.335 INFO:teuthology.orchestra.run.smithi092.stdout:(111/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 9.4 MB/s | 560 kB 00:00 2023-08-26T09:22:38.360 INFO:teuthology.orchestra.run.smithi092.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 319 kB/s | 19 kB 00:00 2023-08-26T09:22:38.386 INFO:teuthology.orchestra.run.smithi092.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 3.0 MB/s | 155 kB 00:00 2023-08-26T09:22:38.387 INFO:teuthology.orchestra.run.smithi188.stdout:(18/131): python3-ceph-argparse-18.0.0-5706.ge7 598 kB/s | 45 kB 00:00 2023-08-26T09:22:38.461 INFO:teuthology.orchestra.run.smithi092.stdout:(114/131): postgresql-server-10.21-2.module+el8 7.3 MB/s | 5.1 MB 00:00 2023-08-26T09:22:38.487 INFO:teuthology.orchestra.run.smithi092.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 179 kB/s | 18 kB 00:00 2023-08-26T09:22:38.511 INFO:teuthology.orchestra.run.smithi092.stdout:(116/131): python3-cryptography-3.2.1-5.el8.x86 3.6 MB/s | 559 kB 00:00 2023-08-26T09:22:38.537 INFO:teuthology.orchestra.run.smithi092.stdout:(117/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.7 MB/s | 238 kB 00:00 2023-08-26T09:22:38.537 INFO:teuthology.orchestra.run.smithi188.stdout:(19/131): python3-ceph-common-18.0.0-5706.ge7eb 839 kB/s | 125 kB 00:00 2023-08-26T09:22:38.602 INFO:teuthology.orchestra.run.smithi092.stdout:(118/131): pcre2-devel-10.32-2.el8.x86_64.rpm 4.2 MB/s | 605 kB 00:00 2023-08-26T09:22:38.629 INFO:teuthology.orchestra.run.smithi092.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 786 kB/s | 72 kB 00:00 2023-08-26T09:22:38.654 INFO:teuthology.orchestra.run.smithi092.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-08-26T09:22:38.680 INFO:teuthology.orchestra.run.smithi092.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.2 MB/s | 60 kB 00:00 2023-08-26T09:22:38.696 INFO:teuthology.orchestra.run.smithi188.stdout:(20/131): python3-cephfs-18.0.0-5706.ge7eb9853. 1.2 MB/s | 197 kB 00:00 2023-08-26T09:22:38.705 INFO:teuthology.orchestra.run.smithi092.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.9 MB/s | 98 kB 00:00 2023-08-26T09:22:38.730 INFO:teuthology.orchestra.run.smithi092.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-08-26T09:22:38.747 INFO:teuthology.orchestra.run.smithi092.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 923 kB/s | 39 kB 00:00 2023-08-26T09:22:38.780 INFO:teuthology.orchestra.run.smithi092.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 13 MB/s | 644 kB 00:00 2023-08-26T09:22:38.806 INFO:teuthology.orchestra.run.smithi092.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.9 MB/s | 171 kB 00:00 2023-08-26T09:22:38.831 INFO:teuthology.orchestra.run.smithi092.stdout:(127/131): NetworkManager-initscripts-updown-1. 2.7 MB/s | 138 kB 00:00 2023-08-26T09:22:38.882 INFO:teuthology.orchestra.run.smithi092.stdout:(128/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 6.3 MB/s | 2.3 MB 00:00 2023-08-26T09:22:38.963 INFO:teuthology.orchestra.run.smithi188.stdout:(21/131): python3-rados-18.0.0-5706.ge7eb9853.e 1.4 MB/s | 371 kB 00:00 2023-08-26T09:22:38.972 INFO:teuthology.orchestra.run.smithi092.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 8.6 MB/s | 798 kB 00:00 2023-08-26T09:22:39.288 INFO:teuthology.orchestra.run.smithi188.stdout:(22/131): python3-rbd-18.0.0-5706.ge7eb9853.el8 1.1 MB/s | 365 kB 00:00 2023-08-26T09:22:39.380 INFO:teuthology.orchestra.run.smithi188.stdout:(23/131): python3-rgw-18.0.0-5706.ge7eb9853.el8 1.1 MB/s | 107 kB 00:00 2023-08-26T09:22:39.481 INFO:teuthology.orchestra.run.smithi188.stdout:(24/131): librgw2-18.0.0-5706.ge7eb9853.el8.x86 4.6 MB/s | 6.8 MB 00:01 2023-08-26T09:22:39.506 INFO:teuthology.orchestra.run.smithi188.stdout:(25/131): rbd-fuse-18.0.0-5706.ge7eb9853.el8.x8 744 kB/s | 93 kB 00:00 2023-08-26T09:22:39.640 INFO:teuthology.orchestra.run.smithi188.stdout:(26/131): rbd-nbd-18.0.0-5706.ge7eb9853.el8.x86 1.3 MB/s | 179 kB 00:00 2023-08-26T09:22:39.715 INFO:teuthology.orchestra.run.smithi188.stdout:(27/131): ceph-grafana-dashboards-18.0.0-5706.g 308 kB/s | 23 kB 00:00 2023-08-26T09:22:39.849 INFO:teuthology.orchestra.run.smithi188.stdout:(28/131): ceph-mgr-cephadm-18.0.0-5706.ge7eb985 991 kB/s | 132 kB 00:00 2023-08-26T09:22:40.040 INFO:teuthology.orchestra.run.smithi092.stdout:(130/131): librados2-18.0.0-5706.ge7eb9853.el8. 3.0 MB/s | 3.7 MB 00:01 2023-08-26T09:22:40.141 INFO:teuthology.orchestra.run.smithi188.stdout:(29/131): rbd-mirror-18.0.0-5706.ge7eb9853.el8. 5.4 MB/s | 3.5 MB 00:00 2023-08-26T09:22:40.558 INFO:teuthology.orchestra.run.smithi188.stdout:(30/131): ceph-mgr-dashboard-18.0.0-5706.ge7eb9 2.5 MB/s | 1.7 MB 00:00 2023-08-26T09:22:40.658 INFO:teuthology.orchestra.run.smithi188.stdout:(31/131): ceph-mgr-modules-core-18.0.0-5706.ge7 2.4 MB/s | 242 kB 00:00 2023-08-26T09:22:40.717 INFO:teuthology.orchestra.run.smithi188.stdout:(32/131): ceph-mgr-rook-18.0.0-5706.ge7eb9853.e 814 kB/s | 47 kB 00:00 2023-08-26T09:22:40.775 INFO:teuthology.orchestra.run.smithi188.stdout:(33/131): ceph-prometheus-alerts-18.0.0-5706.ge 250 kB/s | 15 kB 00:00 2023-08-26T09:22:40.934 INFO:teuthology.orchestra.run.smithi188.stdout:(34/131): ceph-volume-18.0.0-5706.ge7eb9853.el8 1.6 MB/s | 260 kB 00:00 2023-08-26T09:22:41.034 INFO:teuthology.orchestra.run.smithi188.stdout:(35/131): cephadm-18.0.0-5706.ge7eb9853.el8.noa 1.7 MB/s | 171 kB 00:00 2023-08-26T09:22:41.126 INFO:teuthology.orchestra.run.smithi188.stdout:(36/131): ceph-mgr-diskprediction-local-18.0.0- 7.5 MB/s | 7.4 MB 00:00 2023-08-26T09:22:41.151 INFO:teuthology.orchestra.run.smithi188.stdout:(37/131): cephfs-top-18.0.0-5706.ge7eb9853.el8. 153 kB/s | 18 kB 00:00 2023-08-26T09:22:41.343 INFO:teuthology.orchestra.run.smithi188.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 307 kB/s | 59 kB 00:00 2023-08-26T09:22:41.794 INFO:teuthology.orchestra.run.smithi188.stdout:(39/131): ceph-test-18.0.0-5706.ge7eb9853.el8.x 11 MB/s | 48 MB 00:04 2023-08-26T09:22:41.807 INFO:teuthology.orchestra.run.smithi092.stdout:(131/131): librbd1-18.0.0-5706.ge7eb9853.el8.x8 1.2 MB/s | 3.6 MB 00:02 2023-08-26T09:22:41.810 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2023-08-26T09:22:41.810 INFO:teuthology.orchestra.run.smithi092.stdout:Total 15 MB/s | 206 MB 00:14 2023-08-26T09:22:41.819 INFO:teuthology.orchestra.run.smithi188.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 158 kB/s | 75 kB 00:00 2023-08-26T09:22:41.853 INFO:teuthology.orchestra.run.smithi188.stdout:(41/131): gperftools-libs-2.7-9.el8.x86_64.rpm 422 kB/s | 306 kB 00:00 2023-08-26T09:22:41.878 INFO:teuthology.orchestra.run.smithi188.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 803 kB/s | 44 kB 00:00 2023-08-26T09:22:41.911 INFO:teuthology.orchestra.run.smithi188.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 3.1 MB/s | 185 kB 00:00 2023-08-26T09:22:41.936 INFO:teuthology.orchestra.run.smithi188.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 566 kB/s | 33 kB 00:00 2023-08-26T09:22:41.962 INFO:teuthology.orchestra.run.smithi188.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 326 kB/s | 16 kB 00:00 2023-08-26T09:22:42.021 INFO:teuthology.orchestra.run.smithi188.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 2.0 MB/s | 173 kB 00:00 2023-08-26T09:22:42.046 INFO:teuthology.orchestra.run.smithi188.stdout:(47/131): python3-asyncssh-2.7.0-2.el8.noarch.r 1.8 MB/s | 476 kB 00:00 2023-08-26T09:22:42.071 INFO:teuthology.orchestra.run.smithi188.stdout:(48/131): python3-cherrypy-18.4.0-1.el8.noarch. 3.4 MB/s | 384 kB 00:00 2023-08-26T09:22:42.096 INFO:teuthology.orchestra.run.smithi188.stdout:(49/131): python3-google-auth-1.1.1-10.el8.noar 1.1 MB/s | 81 kB 00:00 2023-08-26T09:22:42.113 INFO:teuthology.orchestra.run.smithi188.stdout:(50/131): python3-jaraco-6.2-6.el8.noarch.rpm 165 kB/s | 11 kB 00:00 2023-08-26T09:22:42.130 INFO:teuthology.orchestra.run.smithi188.stdout:(51/131): python3-jaraco-functools-2.0-4.el8.no 299 kB/s | 18 kB 00:00 2023-08-26T09:22:42.173 INFO:teuthology.orchestra.run.smithi188.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 826 kB/s | 49 kB 00:00 2023-08-26T09:22:42.223 INFO:teuthology.orchestra.run.smithi188.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 637 kB/s | 59 kB 00:00 2023-08-26T09:22:42.240 INFO:teuthology.orchestra.run.smithi188.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 902 kB/s | 60 kB 00:00 2023-08-26T09:22:42.298 INFO:teuthology.orchestra.run.smithi188.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 3.7 MB/s | 283 kB 00:00 2023-08-26T09:22:42.315 INFO:teuthology.orchestra.run.smithi188.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 207 kB/s | 16 kB 00:00 2023-08-26T09:22:42.374 INFO:teuthology.orchestra.run.smithi188.stdout:(57/131): python3-kubernetes-11.0.0-6.el8.noarc 4.2 MB/s | 1.2 MB 00:00 2023-08-26T09:22:42.391 INFO:teuthology.orchestra.run.smithi188.stdout:(58/131): python3-repoze-lru-0.7-6.el8.noarch.r 365 kB/s | 34 kB 00:00 2023-08-26T09:22:42.416 INFO:teuthology.orchestra.run.smithi188.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 1.9 MB/s | 196 kB 00:00 2023-08-26T09:22:42.441 INFO:teuthology.orchestra.run.smithi188.stdout:(60/131): python3-rsa-4.9-2.el8.noarch.rpm 958 kB/s | 64 kB 00:00 2023-08-26T09:22:42.467 INFO:teuthology.orchestra.run.smithi188.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 247 kB/s | 19 kB 00:00 2023-08-26T09:22:42.492 INFO:teuthology.orchestra.run.smithi188.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 317 kB/s | 24 kB 00:00 2023-08-26T09:22:42.517 INFO:teuthology.orchestra.run.smithi188.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 388 kB/s | 29 kB 00:00 2023-08-26T09:22:42.543 INFO:teuthology.orchestra.run.smithi188.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 365 kB/s | 27 kB 00:00 2023-08-26T09:22:42.593 INFO:teuthology.orchestra.run.smithi188.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 3.3 MB/s | 251 kB 00:00 2023-08-26T09:22:42.621 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2023-08-26T09:22:42.652 INFO:teuthology.orchestra.run.smithi188.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 564 kB/s | 61 kB 00:00 2023-08-26T09:22:42.677 INFO:teuthology.orchestra.run.smithi188.stdout:(67/131): python3-waitress-1.4.3-1.el8.noarch.r 1.6 MB/s | 255 kB 00:00 2023-08-26T09:22:42.694 INFO:teuthology.orchestra.run.smithi188.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 849 kB/s | 85 kB 00:00 2023-08-26T09:22:42.719 INFO:teuthology.orchestra.run.smithi188.stdout:(69/131): python3-zc-lockfile-2.0-2.el8.noarch. 343 kB/s | 23 kB 00:00 2023-08-26T09:22:42.741 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2023-08-26T09:22:42.741 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2023-08-26T09:22:42.744 INFO:teuthology.orchestra.run.smithi188.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 70 kB 00:00 2023-08-26T09:22:42.803 INFO:teuthology.orchestra.run.smithi188.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.0 MB/s | 110 kB 00:00 2023-08-26T09:22:42.845 INFO:teuthology.orchestra.run.smithi188.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2023-08-26T09:22:42.886 INFO:teuthology.orchestra.run.smithi188.stdout:(73/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.1 MB/s | 259 kB 00:00 2023-08-26T09:22:42.929 INFO:teuthology.orchestra.run.smithi188.stdout:(74/131): thrift-0.13.0-2.el8.x86_64.rpm 6.9 MB/s | 1.7 MB 00:00 2023-08-26T09:22:42.962 INFO:teuthology.orchestra.run.smithi188.stdout:(75/131): socat-1.7.4.1-1.el8.x86_64.rpm 4.2 MB/s | 323 kB 00:00 2023-08-26T09:22:43.012 INFO:teuthology.orchestra.run.smithi188.stdout:(76/131): python3-markupsafe-0.23-19.el8.x86_64 465 kB/s | 39 kB 00:00 2023-08-26T09:22:43.071 INFO:teuthology.orchestra.run.smithi188.stdout:(77/131): bison-3.0.4-10.el8.x86_64.rpm 6.5 MB/s | 688 kB 00:00 2023-08-26T09:22:43.113 INFO:teuthology.orchestra.run.smithi188.stdout:(78/131): python3-jinja2-2.10.1-3.el8.noarch.rp 5.2 MB/s | 538 kB 00:00 2023-08-26T09:22:43.138 INFO:teuthology.orchestra.run.smithi188.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.3 MB/s | 157 kB 00:00 2023-08-26T09:22:43.164 INFO:teuthology.orchestra.run.smithi188.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.6 MB/s | 187 kB 00:00 2023-08-26T09:22:43.198 INFO:teuthology.orchestra.run.smithi188.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 12 MB/s | 713 kB 00:00 2023-08-26T09:22:43.240 INFO:teuthology.orchestra.run.smithi188.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 639 kB/s | 27 kB 00:00 2023-08-26T09:22:43.281 INFO:teuthology.orchestra.run.smithi188.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-08-26T09:22:43.323 INFO:teuthology.orchestra.run.smithi188.stdout:(84/131): python3-prettytable-0.7.2-14.el8.noar 1.0 MB/s | 44 kB 00:00 2023-08-26T09:22:43.509 INFO:teuthology.orchestra.run.smithi188.stdout:(85/131): python3-scipy-1.0.0-21.module+el8.5.0 17 MB/s | 14 MB 00:00 2023-08-26T09:22:43.582 INFO:teuthology.orchestra.run.smithi188.stdout:(86/131): python3-babel-2.5.1-7.el8.noarch.rpm 11 MB/s | 4.8 MB 00:00 2023-08-26T09:22:43.616 INFO:teuthology.orchestra.run.smithi188.stdout:(87/131): python3-werkzeug-0.12.2-4.el8.noarch. 4.2 MB/s | 457 kB 00:00 2023-08-26T09:22:43.641 INFO:teuthology.orchestra.run.smithi188.stdout:(88/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 3.8 MB/s | 225 kB 00:00 2023-08-26T09:22:43.666 INFO:teuthology.orchestra.run.smithi188.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2023-08-26T09:22:43.692 INFO:teuthology.orchestra.run.smithi188.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.5 MB/s | 126 kB 00:00 2023-08-26T09:22:43.709 INFO:teuthology.orchestra.run.smithi188.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 479 kB/s | 20 kB 00:00 2023-08-26T09:22:43.734 INFO:teuthology.orchestra.run.smithi188.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.4 MB/s | 103 kB 00:00 2023-08-26T09:22:43.776 INFO:teuthology.orchestra.run.smithi188.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 10 MB/s | 709 kB 00:00 2023-08-26T09:22:43.818 INFO:teuthology.orchestra.run.smithi188.stdout:(94/131): libpq-13.5-1.el8.x86_64.rpm 4.6 MB/s | 198 kB 00:00 2023-08-26T09:22:43.864 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2023-08-26T09:22:43.869 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2023-08-26T09:22:43.893 INFO:teuthology.orchestra.run.smithi188.stdout:(95/131): python3-numpy-1.14.3-10.el8.x86_64.rp 6.6 MB/s | 3.7 MB 00:00 2023-08-26T09:22:43.952 INFO:teuthology.orchestra.run.smithi188.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 3.4 MB/s | 202 kB 00:00 2023-08-26T09:22:43.994 INFO:teuthology.orchestra.run.smithi188.stdout:(97/131): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-08-26T09:22:44.244 INFO:teuthology.orchestra.run.smithi188.stdout:(98/131): openblas-threads-0.3.15-3.el8.x86_64. 9.5 MB/s | 4.9 MB 00:00 2023-08-26T09:22:44.365 INFO:teuthology.orchestra.run.smithi188.stdout:(99/131): openblas-0.3.15-3.el8.x86_64.rpm 8.6 MB/s | 4.7 MB 00:00 2023-08-26T09:22:44.403 INFO:teuthology.orchestra.run.smithi188.stdout:(100/131): postgresql-contrib-10.21-2.module+el 5.0 MB/s | 808 kB 00:00 2023-08-26T09:22:44.445 INFO:teuthology.orchestra.run.smithi188.stdout:(101/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2023-08-26T09:22:44.487 INFO:teuthology.orchestra.run.smithi188.stdout:(102/131): postgresql-10.21-2.module+el8.6.0+15 12 MB/s | 1.5 MB 00:00 2023-08-26T09:22:44.512 INFO:teuthology.orchestra.run.smithi188.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 2.9 MB/s | 200 kB 00:00 2023-08-26T09:22:44.538 INFO:teuthology.orchestra.run.smithi188.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 850 kB/s | 43 kB 00:00 2023-08-26T09:22:44.554 INFO:teuthology.orchestra.run.smithi188.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 5.2 MB/s | 220 kB 00:00 2023-08-26T09:22:44.580 INFO:teuthology.orchestra.run.smithi188.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 1.1 MB/s | 48 kB 00:00 2023-08-26T09:22:44.605 INFO:teuthology.orchestra.run.smithi188.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-08-26T09:22:44.631 INFO:teuthology.orchestra.run.smithi188.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 846 kB/s | 43 kB 00:00 2023-08-26T09:22:44.656 INFO:teuthology.orchestra.run.smithi188.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 2.1 MB/s | 109 kB 00:00 2023-08-26T09:22:44.681 INFO:teuthology.orchestra.run.smithi188.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.4 MB/s | 229 kB 00:00 2023-08-26T09:22:44.715 INFO:teuthology.orchestra.run.smithi188.stdout:(111/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 9.4 MB/s | 560 kB 00:00 2023-08-26T09:22:44.740 INFO:teuthology.orchestra.run.smithi188.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 319 kB/s | 19 kB 00:00 2023-08-26T09:22:44.765 INFO:teuthology.orchestra.run.smithi188.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 3.0 MB/s | 155 kB 00:00 2023-08-26T09:22:44.849 INFO:teuthology.orchestra.run.smithi188.stdout:(114/131): postgresql-server-10.21-2.module+el8 5.9 MB/s | 5.1 MB 00:00 2023-08-26T09:22:44.875 INFO:teuthology.orchestra.run.smithi188.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 164 kB/s | 18 kB 00:00 2023-08-26T09:22:44.908 INFO:teuthology.orchestra.run.smithi188.stdout:(116/131): python3-cryptography-3.2.1-5.el8.x86 3.3 MB/s | 559 kB 00:00 2023-08-26T09:22:44.942 INFO:teuthology.orchestra.run.smithi188.stdout:(117/131): pcre2-devel-10.32-2.el8.x86_64.rpm 6.4 MB/s | 605 kB 00:00 2023-08-26T09:22:44.967 INFO:teuthology.orchestra.run.smithi188.stdout:(118/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.5 MB/s | 238 kB 00:00 2023-08-26T09:22:44.992 INFO:teuthology.orchestra.run.smithi188.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.4 MB/s | 72 kB 00:00 2023-08-26T09:22:45.018 INFO:teuthology.orchestra.run.smithi188.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-08-26T09:22:45.043 INFO:teuthology.orchestra.run.smithi188.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.2 MB/s | 60 kB 00:00 2023-08-26T09:22:45.068 INFO:teuthology.orchestra.run.smithi188.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.9 MB/s | 98 kB 00:00 2023-08-26T09:22:45.093 INFO:teuthology.orchestra.run.smithi188.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-08-26T09:22:45.119 INFO:teuthology.orchestra.run.smithi188.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 765 kB/s | 39 kB 00:00 2023-08-26T09:22:45.161 INFO:teuthology.orchestra.run.smithi188.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 9.4 MB/s | 644 kB 00:00 2023-08-26T09:22:45.177 INFO:teuthology.orchestra.run.smithi188.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.9 MB/s | 171 kB 00:00 2023-08-26T09:22:45.194 INFO:teuthology.orchestra.run.smithi188.stdout:(127/131): NetworkManager-initscripts-updown-1. 4.0 MB/s | 138 kB 00:00 2023-08-26T09:22:45.262 INFO:teuthology.orchestra.run.smithi188.stdout:(128/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 6.6 MB/s | 2.3 MB 00:00 2023-08-26T09:22:45.312 INFO:teuthology.orchestra.run.smithi188.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2023-08-26T09:22:45.945 INFO:teuthology.orchestra.run.smithi188.stdout:(130/131): librbd1-18.0.0-5706.ge7eb9853.el8.x8 4.8 MB/s | 3.6 MB 00:00 2023-08-26T09:22:46.704 INFO:teuthology.orchestra.run.smithi188.stdout:(131/131): librados2-18.0.0-5706.ge7eb9853.el8. 2.4 MB/s | 3.7 MB 00:01 2023-08-26T09:22:46.708 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2023-08-26T09:22:46.709 INFO:teuthology.orchestra.run.smithi188.stdout:Total 13 MB/s | 206 MB 00:15 2023-08-26T09:22:47.534 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2023-08-26T09:22:47.654 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2023-08-26T09:22:47.654 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2023-08-26T09:22:48.780 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2023-08-26T09:22:48.783 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2023-08-26T09:22:49.204 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2023-08-26T09:22:49.379 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-08-26T09:22:49.573 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-08-26T09:22:49.770 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-08-26T09:22:49.964 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-08-26T09:22:50.086 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-08-26T09:22:50.314 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-08-26T09:22:50.701 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-08-26T09:22:50.930 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : librados2-2:18.0.0-5706.ge7eb9853.el8.x86_64 6/134 2023-08-26T09:22:51.359 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librados2-2:18.0.0-5706.ge7eb9853.el8.x86_64 6/134 2023-08-26T09:22:51.573 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : librbd1-2:18.0.0-5706.ge7eb9853.el8.x86_64 7/134 2023-08-26T09:22:51.699 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librbd1-2:18.0.0-5706.ge7eb9853.el8.x86_64 7/134 2023-08-26T09:22:51.905 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephfs2-2:18.0.0-5706.ge7eb9853.el8.x86_64 8/134 2023-08-26T09:22:51.986 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libcephfs2-2:18.0.0-5706.ge7eb9853.el8.x86_64 8/134 2023-08-26T09:22:52.273 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rados-2:18.0.0-5706.ge7eb9853.el8.x86_64 9/134 2023-08-26T09:22:52.528 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-08-26T09:22:52.750 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-08-26T09:22:53.181 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-08-26T09:22:53.450 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-08-26T09:22:53.647 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephsqlite-2:18.0.0-5706.ge7eb9853.el8.x86_64 14/134 2023-08-26T09:22:53.768 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libcephsqlite-2:18.0.0-5706.ge7eb9853.el8.x86_64 14/134 2023-08-26T09:22:53.921 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libradosstriper1-2:18.0.0-5706.ge7eb9853.el8.x86 15/134 2023-08-26T09:22:54.027 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libradosstriper1-2:18.0.0-5706.ge7eb9853.el8.x86 15/134 2023-08-26T09:22:54.081 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2023-08-26T09:22:54.163 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-08-26T09:22:54.267 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-08-26T09:22:54.304 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-08-26T09:22:54.463 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-08-26T09:22:54.467 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-08-26T09:22:54.684 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-08-26T09:22:54.869 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-08-26T09:22:54.984 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-08-26T09:22:55.063 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-08-26T09:22:55.219 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-08-26T09:22:55.246 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-08-26T09:22:55.714 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-08-26T09:22:55.830 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-08-26T09:22:55.927 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : librados2-2:18.0.0-5706.ge7eb9853.el8.x86_64 6/134 2023-08-26T09:22:56.012 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-08-26T09:22:56.324 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librados2-2:18.0.0-5706.ge7eb9853.el8.x86_64 6/134 2023-08-26T09:22:56.552 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : librbd1-2:18.0.0-5706.ge7eb9853.el8.x86_64 7/134 2023-08-26T09:22:56.679 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librbd1-2:18.0.0-5706.ge7eb9853.el8.x86_64 7/134 2023-08-26T09:22:56.704 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-08-26T09:22:56.860 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libcephfs2-2:18.0.0-5706.ge7eb9853.el8.x86_64 8/134 2023-08-26T09:22:56.945 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: libcephfs2-2:18.0.0-5706.ge7eb9853.el8.x86_64 8/134 2023-08-26T09:22:57.020 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-08-26T09:22:57.146 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-rados-2:18.0.0-5706.ge7eb9853.el8.x86_64 9/134 2023-08-26T09:22:57.236 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-08-26T09:22:57.417 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-08-26T09:22:57.604 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-08-26T09:22:57.860 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-08-26T09:22:57.985 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-08-26T09:22:58.020 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-08-26T09:22:58.247 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-08-26T09:22:58.272 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-08-26T09:22:58.434 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libcephsqlite-2:18.0.0-5706.ge7eb9853.el8.x86_64 14/134 2023-08-26T09:22:58.483 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-08-26T09:22:58.524 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: libcephsqlite-2:18.0.0-5706.ge7eb9853.el8.x86_64 14/134 2023-08-26T09:22:58.677 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ceph-common-2:18.0.0-5706.ge7eb9853.el8. 26/134 2023-08-26T09:22:58.743 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libradosstriper1-2:18.0.0-5706.ge7eb9853.el8.x86 15/134 2023-08-26T09:22:58.822 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: libradosstriper1-2:18.0.0-5706.ge7eb9853.el8.x86 15/134 2023-08-26T09:22:58.825 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ceph-argparse-2:18.0.0-5706.ge7eb9853.el 27/134 2023-08-26T09:22:58.976 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-08-26T09:22:59.106 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-08-26T09:22:59.259 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-08-26T09:22:59.765 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cephfs-2:18.0.0-5706.ge7eb9853.el8.x86_6 28/134 2023-08-26T09:22:59.876 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-08-26T09:23:00.051 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-08-26T09:23:00.059 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-08-26T09:23:00.305 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-08-26T09:23:00.597 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-08-26T09:23:00.646 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-08-26T09:23:00.817 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-08-26T09:23:00.836 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-08-26T09:23:01.735 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-08-26T09:23:02.024 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-08-26T09:23:02.276 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-08-26T09:23:02.487 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-08-26T09:23:02.615 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-08-26T09:23:02.689 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-08-26T09:23:02.881 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-08-26T09:23:02.946 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-08-26T09:23:03.127 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-08-26T09:23:03.172 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-08-26T09:23:03.298 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-ceph-common-2:18.0.0-5706.ge7eb9853.el8. 26/134 2023-08-26T09:23:03.355 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-08-26T09:23:03.436 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-ceph-argparse-2:18.0.0-5706.ge7eb9853.el 27/134 2023-08-26T09:23:03.566 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rbd-2:18.0.0-5706.ge7eb9853.el8.x86_64 36/134 2023-08-26T09:23:03.715 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librados-devel-2:18.0.0-5706.ge7eb9853.el8.x86_6 37/134 2023-08-26T09:23:03.920 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-08-26T09:23:04.135 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-08-26T09:23:04.321 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-08-26T09:23:04.370 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cephfs-2:18.0.0-5706.ge7eb9853.el8.x86_6 28/134 2023-08-26T09:23:04.456 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-08-26T09:23:04.681 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-08-26T09:23:04.689 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-08-26T09:23:04.871 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-08-26T09:23:04.961 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-08-26T09:23:05.199 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-08-26T09:23:05.234 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-08-26T09:23:05.433 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-08-26T09:23:05.522 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-08-26T09:23:05.746 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-08-26T09:23:05.957 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-08-26T09:23:06.215 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-08-26T09:23:06.553 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-08-26T09:23:06.826 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-08-26T09:23:07.019 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-08-26T09:23:07.207 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-08-26T09:23:07.274 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-08-26T09:23:07.435 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-08-26T09:23:07.575 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-08-26T09:23:07.629 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-08-26T09:23:07.761 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-08-26T09:23:07.924 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-08-26T09:23:07.967 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-08-26T09:23:08.171 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-rbd-2:18.0.0-5706.ge7eb9853.el8.x86_64 36/134 2023-08-26T09:23:08.173 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-08-26T09:23:08.363 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : librados-devel-2:18.0.0-5706.ge7eb9853.el8.x86_6 37/134 2023-08-26T09:23:08.423 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-08-26T09:23:08.525 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-08-26T09:23:08.641 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-08-26T09:23:08.689 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-08-26T09:23:08.850 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-08-26T09:23:08.909 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-08-26T09:23:09.052 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-08-26T09:23:09.065 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-08-26T09:23:09.260 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-08-26T09:23:09.272 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-08-26T09:23:09.332 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-08-26T09:23:09.470 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-08-26T09:23:09.560 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-08-26T09:23:09.763 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-08-26T09:23:09.866 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-08-26T09:23:09.952 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-08-26T09:23:10.016 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-08-26T09:23:10.176 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-08-26T09:23:10.290 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-08-26T09:23:10.360 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-08-26T09:23:10.452 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-08-26T09:23:10.610 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-08-26T09:23:10.668 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-08-26T09:23:10.828 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-08-26T09:23:10.840 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-08-26T09:23:11.131 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-08-26T09:23:11.154 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-08-26T09:23:11.366 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-08-26T09:23:11.400 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-08-26T09:23:11.522 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-08-26T09:23:11.582 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-08-26T09:23:11.704 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-08-26T09:23:11.803 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-08-26T09:23:11.878 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-08-26T09:23:12.004 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-08-26T09:23:12.080 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-08-26T09:23:12.167 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-08-26T09:23:12.237 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-08-26T09:23:12.412 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-08-26T09:23:12.483 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-08-26T09:23:12.548 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-08-26T09:23:12.710 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-08-26T09:23:12.747 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-08-26T09:23:12.938 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-08-26T09:23:12.971 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-08-26T09:23:13.196 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-08-26T09:23:13.256 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-08-26T09:23:13.355 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-08-26T09:23:13.503 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-08-26T09:23:13.512 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-08-26T09:23:13.731 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-08-26T09:23:13.741 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-08-26T09:23:13.790 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-08-26T09:23:13.974 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-08-26T09:23:14.010 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-08-26T09:23:14.192 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-08-26T09:23:14.208 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-08-26T09:23:14.372 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-08-26T09:23:14.485 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-08-26T09:23:14.701 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-08-26T09:23:14.923 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-08-26T09:23:15.080 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-08-26T09:23:15.257 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-08-26T09:23:15.287 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-08-26T09:23:15.545 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-08-26T09:23:15.547 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-08-26T09:23:15.787 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-08-26T09:23:15.799 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-08-26T09:23:15.934 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-08-26T09:23:16.068 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-08-26T09:23:16.068 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-08-26T09:23:16.282 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-08-26T09:23:16.373 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-08-26T09:23:16.475 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-08-26T09:23:16.600 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-08-26T09:23:16.717 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-08-26T09:23:16.900 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-08-26T09:23:17.067 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-08-26T09:23:17.268 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-08-26T09:23:17.388 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-08-26T09:23:17.502 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-08-26T09:23:17.575 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librgw2-2:18.0.0-5706.ge7eb9853.el8.x86_64 92/134 2023-08-26T09:23:17.666 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librgw2-2:18.0.0-5706.ge7eb9853.el8.x86_64 92/134 2023-08-26T09:23:17.686 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-08-26T09:23:17.841 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rgw-2:18.0.0-5706.ge7eb9853.el8.x86_64 93/134 2023-08-26T09:23:17.927 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-08-26T09:23:18.154 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-08-26T09:23:18.312 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-08-26T09:23:18.545 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-08-26T09:23:19.619 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-08-26T09:23:19.900 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-08-26T09:23:20.166 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-08-26T09:23:20.453 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-08-26T09:23:20.734 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-08-26T09:23:20.928 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-08-26T09:23:21.508 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-common-2:18.0.0-5706.ge7eb9853.el8.x86_64 94/134 2023-08-26T09:23:21.757 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-common-2:18.0.0-5706.ge7eb9853.el8.x86_64 94/134 2023-08-26T09:23:21.768 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-08-26T09:23:21.996 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : librgw2-2:18.0.0-5706.ge7eb9853.el8.x86_64 92/134 2023-08-26T09:23:22.070 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librgw2-2:18.0.0-5706.ge7eb9853.el8.x86_64 92/134 2023-08-26T09:23:22.237 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-rgw-2:18.0.0-5706.ge7eb9853.el8.x86_64 93/134 2023-08-26T09:23:22.341 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-common-2:18.0.0-5706.ge7eb9853.el8.x86_64 94/134 2023-08-26T09:23:22.639 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-base-2:18.0.0-5706.ge7eb9853.el8.x86_64 95/134 2023-08-26T09:23:22.717 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-base-2:18.0.0-5706.ge7eb9853.el8.x86_64 95/134 2023-08-26T09:23:22.898 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-selinux-2:18.0.0-5706.ge7eb9853.el8.x86_64 96/134 2023-08-26T09:23:25.949 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-common-2:18.0.0-5706.ge7eb9853.el8.x86_64 94/134 2023-08-26T09:23:26.178 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-common-2:18.0.0-5706.ge7eb9853.el8.x86_64 94/134 2023-08-26T09:23:26.756 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-common-2:18.0.0-5706.ge7eb9853.el8.x86_64 94/134 2023-08-26T09:23:27.274 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-base-2:18.0.0-5706.ge7eb9853.el8.x86_64 95/134 2023-08-26T09:23:27.612 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-base-2:18.0.0-5706.ge7eb9853.el8.x86_64 95/134 2023-08-26T09:23:28.319 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-selinux-2:18.0.0-5706.ge7eb9853.el8.x86_64 96/134 2023-08-26T09:23:41.418 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-selinux-2:18.0.0-5706.ge7eb9853.el8.x86_64 96/134 2023-08-26T09:23:41.418 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /sys 2023-08-26T09:23:41.418 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /proc 2023-08-26T09:23:41.419 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /dev 2023-08-26T09:23:41.419 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /run 2023-08-26T09:23:41.419 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /mnt 2023-08-26T09:23:41.419 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /var/tmp 2023-08-26T09:23:41.419 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /home 2023-08-26T09:23:41.420 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /tmp 2023-08-26T09:23:41.420 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /dev 2023-08-26T09:23:41.420 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:23:41.819 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-volume-2:18.0.0-5706.ge7eb9853.el8.noarch 97/134 2023-08-26T09:23:43.406 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-volume-2:18.0.0-5706.ge7eb9853.el8.noarch 97/134 2023-08-26T09:23:43.592 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-osd-2:18.0.0-5706.ge7eb9853.el8.x86_64 98/134 2023-08-26T09:23:43.810 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-osd-2:18.0.0-5706.ge7eb9853.el8.x86_64 98/134 2023-08-26T09:23:43.993 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mds-2:18.0.0-5706.ge7eb9853.el8.x86_64 99/134 2023-08-26T09:23:44.448 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mds-2:18.0.0-5706.ge7eb9853.el8.x86_64 99/134 2023-08-26T09:23:44.652 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mon-2:18.0.0-5706.ge7eb9853.el8.x86_64 100/134 2023-08-26T09:23:44.668 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mon-2:18.0.0-5706.ge7eb9853.el8.x86_64 100/134 2023-08-26T09:23:46.391 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: cephadm-2:18.0.0-5706.ge7eb9853.el8.noarch 101/134 2023-08-26T09:23:46.619 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephadm-2:18.0.0-5706.ge7eb9853.el8.noarch 101/134 2023-08-26T09:23:46.732 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-5706.ge7eb9853.e 102/134 2023-08-26T09:23:46.925 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-5706.ge7eb9853. 103/134 2023-08-26T09:23:47.117 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-5706.ge7eb9853.el8.noa 104/134 2023-08-26T09:23:47.310 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-selinux-2:18.0.0-5706.ge7eb9853.el8.x86_64 96/134 2023-08-26T09:23:47.310 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /sys 2023-08-26T09:23:47.310 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /proc 2023-08-26T09:23:47.311 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /dev 2023-08-26T09:23:47.311 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /run 2023-08-26T09:23:47.311 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /mnt 2023-08-26T09:23:47.311 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /var/tmp 2023-08-26T09:23:47.311 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /home 2023-08-26T09:23:47.312 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /tmp 2023-08-26T09:23:47.312 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /dev 2023-08-26T09:23:47.312 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-08-26T09:23:47.336 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-5706.ge7eb9853.el8.noa 104/134 2023-08-26T09:23:47.673 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-volume-2:18.0.0-5706.ge7eb9853.el8.noarch 97/134 2023-08-26T09:23:47.691 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-5706.ge7eb9853.el8.n 105/134 2023-08-26T09:23:48.647 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-5706.ge7eb9853.el8.n 105/134 2023-08-26T09:23:48.825 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-5706.ge7e 106/134 2023-08-26T09:23:48.915 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-5706.ge7e 106/134 2023-08-26T09:23:49.261 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-volume-2:18.0.0-5706.ge7eb9853.el8.noarch 97/134 2023-08-26T09:23:49.320 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-5706.ge7eb9853.el 107/134 2023-08-26T09:23:49.452 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-osd-2:18.0.0-5706.ge7eb9853.el8.x86_64 98/134 2023-08-26T09:23:49.524 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-2:18.0.0-5706.ge7eb9853.el8.x86_64 108/134 2023-08-26T09:23:49.558 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-2:18.0.0-5706.ge7eb9853.el8.x86_64 108/134 2023-08-26T09:23:49.672 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-osd-2:18.0.0-5706.ge7eb9853.el8.x86_64 98/134 2023-08-26T09:23:49.733 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-rook-2:18.0.0-5706.ge7eb9853.el8.noarch 109/134 2023-08-26T09:23:49.744 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-5706.ge7eb9853.el8.noarch 109/134 2023-08-26T09:23:49.856 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mds-2:18.0.0-5706.ge7eb9853.el8.x86_64 99/134 2023-08-26T09:23:50.311 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mds-2:18.0.0-5706.ge7eb9853.el8.x86_64 99/134 2023-08-26T09:23:50.472 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mon-2:18.0.0-5706.ge7eb9853.el8.x86_64 100/134 2023-08-26T09:23:50.490 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mon-2:18.0.0-5706.ge7eb9853.el8.x86_64 100/134 2023-08-26T09:23:51.091 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-2:18.0.0-5706.ge7eb9853.el8.x86_64 110/134 2023-08-26T09:23:51.354 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-radosgw-2:18.0.0-5706.ge7eb9853.el8.x86_64 111/134 2023-08-26T09:23:51.388 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-5706.ge7eb9853.el8.x86_64 111/134 2023-08-26T09:23:51.533 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-5706.ge7eb9 112/134 2023-08-26T09:23:51.575 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-5706.ge7eb9 112/134 2023-08-26T09:23:51.758 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephfs-mirror-2:18.0.0-5706.ge7eb9853.el8.x86_64 113/134 2023-08-26T09:23:52.121 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-5706.ge7eb9853.el8.x86_64 113/134 2023-08-26T09:23:52.254 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: cephadm-2:18.0.0-5706.ge7eb9853.el8.noarch 101/134 2023-08-26T09:23:52.267 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-mirror-2:18.0.0-5706.ge7eb9853.el8.x86_64 114/134 2023-08-26T09:23:52.462 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : cephadm-2:18.0.0-5706.ge7eb9853.el8.noarch 101/134 2023-08-26T09:23:52.577 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-5706.ge7eb9853.e 102/134 2023-08-26T09:23:52.770 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-5706.ge7eb9853. 103/134 2023-08-26T09:23:52.971 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-5706.ge7eb9853.el8.noa 104/134 2023-08-26T09:23:53.192 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-5706.ge7eb9853.el8.noa 104/134 2023-08-26T09:23:53.492 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-5706.ge7eb9853.el8.n 105/134 2023-08-26T09:23:54.454 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-5706.ge7eb9853.el8.n 105/134 2023-08-26T09:23:54.637 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-5706.ge7e 106/134 2023-08-26T09:23:54.727 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-5706.ge7e 106/134 2023-08-26T09:23:55.101 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-5706.ge7eb9853.el 107/134 2023-08-26T09:23:55.267 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-2:18.0.0-5706.ge7eb9853.el8.x86_64 108/134 2023-08-26T09:23:55.302 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-2:18.0.0-5706.ge7eb9853.el8.x86_64 108/134 2023-08-26T09:23:55.513 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-rook-2:18.0.0-5706.ge7eb9853.el8.noarch 109/134 2023-08-26T09:23:55.526 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-5706.ge7eb9853.el8.noarch 109/134 2023-08-26T09:23:56.810 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: rbd-mirror-2:18.0.0-5706.ge7eb9853.el8.x86_64 114/134 2023-08-26T09:23:56.834 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-2:18.0.0-5706.ge7eb9853.el8.x86_64 110/134 2023-08-26T09:23:57.042 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-radosgw-2:18.0.0-5706.ge7eb9853.el8.x86_64 111/134 2023-08-26T09:23:57.076 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-5706.ge7eb9853.el8.x86_64 111/134 2023-08-26T09:23:57.135 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-test-2:18.0.0-5706.ge7eb9853.el8.x86_64 115/134 2023-08-26T09:23:57.254 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-5706.ge7eb9 112/134 2023-08-26T09:23:57.296 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-5706.ge7eb9 112/134 2023-08-26T09:23:57.315 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-08-26T09:23:57.445 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : cephfs-mirror-2:18.0.0-5706.ge7eb9853.el8.x86_64 113/134 2023-08-26T09:23:57.502 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-08-26T09:23:57.798 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-5706.ge7eb9853.el8.x86_64 113/134 2023-08-26T09:23:57.954 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : rbd-mirror-2:18.0.0-5706.ge7eb9853.el8.x86_64 114/134 2023-08-26T09:23:58.425 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-08-26T09:23:58.739 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-08-26T09:23:58.906 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-fuse-2:18.0.0-5706.ge7eb9853.el8.x86_64 119/134 2023-08-26T09:23:59.110 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-08-26T09:23:59.277 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephfs-devel-2:18.0.0-5706.ge7eb9853.el8.x86_ 121/134 2023-08-26T09:23:59.416 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-08-26T09:24:01.667 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-26T09:24:01.948 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-26T09:24:01.965 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-26T09:24:02.164 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephfs-top-2:18.0.0-5706.ge7eb9853.el8.noarch 124/134 2023-08-26T09:24:02.422 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-fuse-2:18.0.0-5706.ge7eb9853.el8.x86_64 125/134 2023-08-26T09:24:02.512 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: rbd-mirror-2:18.0.0-5706.ge7eb9853.el8.x86_64 114/134 2023-08-26T09:24:02.725 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-nbd-2:18.0.0-5706.ge7eb9853.el8.x86_64 126/134 2023-08-26T09:24:02.782 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-test-2:18.0.0-5706.ge7eb9853.el8.x86_64 115/134 2023-08-26T09:24:02.969 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-08-26T09:24:03.016 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-08-26T09:24:03.159 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-08-26T09:24:03.205 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-08-26T09:24:03.213 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-08-26T09:24:03.403 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-08-26T09:24:03.613 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-08-26T09:24:03.697 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-08-26T09:24:03.947 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-08-26T09:24:03.959 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-08-26T09:24:03.960 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-26T09:24:04.063 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-08-26T09:24:04.175 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-26T09:24:04.175 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-26T09:24:04.402 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-08-26T09:24:04.427 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-26T09:24:04.620 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-26T09:24:04.621 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-fuse-2:18.0.0-5706.ge7eb9853.el8.x86_64 119/134 2023-08-26T09:24:04.831 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-08-26T09:24:05.039 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libcephfs-devel-2:18.0.0-5706.ge7eb9853.el8.x86_ 121/134 2023-08-26T09:24:05.126 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-08-26T09:24:05.127 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-2:18.0.0-5706.ge7eb9853.el8.x86_64 1/134 2023-08-26T09:24:05.127 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-base-2:18.0.0-5706.ge7eb9853.el8.x86_64 2/134 2023-08-26T09:24:05.127 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-common-2:18.0.0-5706.ge7eb9853.el8.x86_64 3/134 2023-08-26T09:24:05.127 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-fuse-2:18.0.0-5706.ge7eb9853.el8.x86_64 4/134 2023-08-26T09:24:05.127 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-5706.ge7eb9 5/134 2023-08-26T09:24:05.128 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mds-2:18.0.0-5706.ge7eb9853.el8.x86_64 6/134 2023-08-26T09:24:05.128 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-2:18.0.0-5706.ge7eb9853.el8.x86_64 7/134 2023-08-26T09:24:05.128 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mon-2:18.0.0-5706.ge7eb9853.el8.x86_64 8/134 2023-08-26T09:24:05.128 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-osd-2:18.0.0-5706.ge7eb9853.el8.x86_64 9/134 2023-08-26T09:24:05.128 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-radosgw-2:18.0.0-5706.ge7eb9853.el8.x86_64 10/134 2023-08-26T09:24:05.129 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-selinux-2:18.0.0-5706.ge7eb9853.el8.x86_64 11/134 2023-08-26T09:24:05.129 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-test-2:18.0.0-5706.ge7eb9853.el8.x86_64 12/134 2023-08-26T09:24:05.129 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephfs-mirror-2:18.0.0-5706.ge7eb9853.el8.x86_64 13/134 2023-08-26T09:24:05.129 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephfs-devel-2:18.0.0-5706.ge7eb9853.el8.x86_ 14/134 2023-08-26T09:24:05.129 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephfs2-2:18.0.0-5706.ge7eb9853.el8.x86_64 15/134 2023-08-26T09:24:05.130 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephsqlite-2:18.0.0-5706.ge7eb9853.el8.x86_64 16/134 2023-08-26T09:24:05.130 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados-devel-2:18.0.0-5706.ge7eb9853.el8.x86_6 17/134 2023-08-26T09:24:05.130 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libradosstriper1-2:18.0.0-5706.ge7eb9853.el8.x86 18/134 2023-08-26T09:24:05.130 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librgw2-2:18.0.0-5706.ge7eb9853.el8.x86_64 19/134 2023-08-26T09:24:05.130 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ceph-argparse-2:18.0.0-5706.ge7eb9853.el 20/134 2023-08-26T09:24:05.130 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ceph-common-2:18.0.0-5706.ge7eb9853.el8. 21/134 2023-08-26T09:24:05.131 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cephfs-2:18.0.0-5706.ge7eb9853.el8.x86_6 22/134 2023-08-26T09:24:05.131 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rados-2:18.0.0-5706.ge7eb9853.el8.x86_64 23/134 2023-08-26T09:24:05.131 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rbd-2:18.0.0-5706.ge7eb9853.el8.x86_64 24/134 2023-08-26T09:24:05.132 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rgw-2:18.0.0-5706.ge7eb9853.el8.x86_64 25/134 2023-08-26T09:24:05.132 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-fuse-2:18.0.0-5706.ge7eb9853.el8.x86_64 26/134 2023-08-26T09:24:05.132 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-mirror-2:18.0.0-5706.ge7eb9853.el8.x86_64 27/134 2023-08-26T09:24:05.132 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-nbd-2:18.0.0-5706.ge7eb9853.el8.x86_64 28/134 2023-08-26T09:24:05.132 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-5706.ge7eb9853. 29/134 2023-08-26T09:24:05.133 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-5706.ge7eb9853.el8.noa 30/134 2023-08-26T09:24:05.136 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-5706.ge7eb9853.el8.n 31/134 2023-08-26T09:24:05.137 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-5706.ge7e 32/134 2023-08-26T09:24:05.137 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-5706.ge7eb9853.el 33/134 2023-08-26T09:24:05.137 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-rook-2:18.0.0-5706.ge7eb9853.el8.noarch 34/134 2023-08-26T09:24:05.137 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-5706.ge7eb9853.e 35/134 2023-08-26T09:24:05.137 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-volume-2:18.0.0-5706.ge7eb9853.el8.noarch 36/134 2023-08-26T09:24:05.138 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephadm-2:18.0.0-5706.ge7eb9853.el8.noarch 37/134 2023-08-26T09:24:05.138 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephfs-top-2:18.0.0-5706.ge7eb9853.el8.noarch 38/134 2023-08-26T09:24:05.138 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-08-26T09:24:05.138 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-08-26T09:24:05.138 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-08-26T09:24:05.138 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-08-26T09:24:05.139 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-08-26T09:24:05.139 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-08-26T09:24:05.139 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-08-26T09:24:05.139 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-08-26T09:24:05.140 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-08-26T09:24:05.140 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-08-26T09:24:05.140 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-08-26T09:24:05.140 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-08-26T09:24:05.140 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-08-26T09:24:05.141 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-08-26T09:24:05.141 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-08-26T09:24:05.141 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-08-26T09:24:05.141 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-08-26T09:24:05.141 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-08-26T09:24:05.141 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-08-26T09:24:05.142 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-08-26T09:24:05.142 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-08-26T09:24:05.142 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-08-26T09:24:05.142 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-08-26T09:24:05.142 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-08-26T09:24:05.143 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-08-26T09:24:05.143 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-08-26T09:24:05.143 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-08-26T09:24:05.143 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-08-26T09:24:05.143 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-08-26T09:24:05.144 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-08-26T09:24:05.144 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-08-26T09:24:05.149 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-08-26T09:24:05.150 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-08-26T09:24:05.150 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-08-26T09:24:05.150 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-08-26T09:24:05.150 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-08-26T09:24:05.150 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-08-26T09:24:05.151 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-08-26T09:24:05.151 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-08-26T09:24:05.151 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-08-26T09:24:05.151 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-08-26T09:24:05.151 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-08-26T09:24:05.152 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-08-26T09:24:05.152 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-08-26T09:24:05.152 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-08-26T09:24:05.152 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-08-26T09:24:05.152 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-08-26T09:24:05.153 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-08-26T09:24:05.153 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-08-26T09:24:05.153 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-08-26T09:24:05.153 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-08-26T09:24:05.153 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-08-26T09:24:05.153 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-08-26T09:24:05.154 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-08-26T09:24:05.154 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-08-26T09:24:05.154 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-08-26T09:24:05.154 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-08-26T09:24:05.154 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-08-26T09:24:05.155 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-08-26T09:24:05.155 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-08-26T09:24:05.155 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-08-26T09:24:05.155 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-08-26T09:24:05.155 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-08-26T09:24:05.156 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-08-26T09:24:05.156 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-08-26T09:24:05.156 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-08-26T09:24:05.156 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-08-26T09:24:05.156 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-08-26T09:24:05.157 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-08-26T09:24:05.157 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-08-26T09:24:05.157 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-08-26T09:24:05.157 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-08-26T09:24:05.157 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-08-26T09:24:05.157 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-08-26T09:24:05.158 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-08-26T09:24:05.158 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-08-26T09:24:05.158 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-08-26T09:24:05.158 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-08-26T09:24:05.158 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-08-26T09:24:05.159 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-08-26T09:24:05.159 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-08-26T09:24:05.159 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-08-26T09:24:05.159 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-08-26T09:24:05.159 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-08-26T09:24:05.160 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-08-26T09:24:05.160 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-08-26T09:24:05.160 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-08-26T09:24:05.160 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-08-26T09:24:05.160 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-08-26T09:24:05.160 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-08-26T09:24:05.161 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados2-2:18.0.0-5706.ge7eb9853.el8.x86_64 129/134 2023-08-26T09:24:05.161 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-08-26T09:24:05.161 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librbd1-2:18.0.0-5706.ge7eb9853.el8.x86_64 131/134 2023-08-26T09:24:05.161 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-26T09:24:05.161 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-08-26T09:24:05.178 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-08-26T09:24:07.389 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-26T09:24:07.676 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-26T09:24:07.696 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-26T09:24:07.852 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : cephfs-top-2:18.0.0-5706.ge7eb9853.el8.noarch 124/134 2023-08-26T09:24:07.896 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-26T09:24:07.896 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:51 ago on Sat 26 Aug 2023 09:22:16 AM UTC. 2023-08-26T09:24:08.159 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : rbd-fuse-2:18.0.0-5706.ge7eb9853.el8.x86_64 125/134 2023-08-26T09:24:08.434 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : rbd-nbd-2:18.0.0-5706.ge7eb9853.el8.x86_64 126/134 2023-08-26T09:24:08.711 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-08-26T09:24:08.834 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-08-26T09:24:08.843 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-08-26T09:24:09.040 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-08-26T09:24:09.226 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-08-26T09:24:09.322 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-08-26T09:24:09.559 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-08-26T09:24:09.571 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-08-26T09:24:09.572 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-26T09:24:09.762 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-26T09:24:09.762 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-26T09:24:10.014 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-26T09:24:10.199 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-26T09:24:10.728 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-08-26T09:24:10.728 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-2:18.0.0-5706.ge7eb9853.el8.x86_64 1/134 2023-08-26T09:24:10.729 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-base-2:18.0.0-5706.ge7eb9853.el8.x86_64 2/134 2023-08-26T09:24:10.729 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-common-2:18.0.0-5706.ge7eb9853.el8.x86_64 3/134 2023-08-26T09:24:10.729 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-fuse-2:18.0.0-5706.ge7eb9853.el8.x86_64 4/134 2023-08-26T09:24:10.729 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-5706.ge7eb9 5/134 2023-08-26T09:24:10.729 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mds-2:18.0.0-5706.ge7eb9853.el8.x86_64 6/134 2023-08-26T09:24:10.730 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-2:18.0.0-5706.ge7eb9853.el8.x86_64 7/134 2023-08-26T09:24:10.730 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mon-2:18.0.0-5706.ge7eb9853.el8.x86_64 8/134 2023-08-26T09:24:10.730 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-osd-2:18.0.0-5706.ge7eb9853.el8.x86_64 9/134 2023-08-26T09:24:10.730 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-radosgw-2:18.0.0-5706.ge7eb9853.el8.x86_64 10/134 2023-08-26T09:24:10.731 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-selinux-2:18.0.0-5706.ge7eb9853.el8.x86_64 11/134 2023-08-26T09:24:10.731 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-test-2:18.0.0-5706.ge7eb9853.el8.x86_64 12/134 2023-08-26T09:24:10.732 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : cephfs-mirror-2:18.0.0-5706.ge7eb9853.el8.x86_64 13/134 2023-08-26T09:24:10.732 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libcephfs-devel-2:18.0.0-5706.ge7eb9853.el8.x86_ 14/134 2023-08-26T09:24:10.732 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libcephfs2-2:18.0.0-5706.ge7eb9853.el8.x86_64 15/134 2023-08-26T09:24:10.732 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libcephsqlite-2:18.0.0-5706.ge7eb9853.el8.x86_64 16/134 2023-08-26T09:24:10.732 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librados-devel-2:18.0.0-5706.ge7eb9853.el8.x86_6 17/134 2023-08-26T09:24:10.733 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libradosstriper1-2:18.0.0-5706.ge7eb9853.el8.x86 18/134 2023-08-26T09:24:10.733 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librgw2-2:18.0.0-5706.ge7eb9853.el8.x86_64 19/134 2023-08-26T09:24:10.733 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-ceph-argparse-2:18.0.0-5706.ge7eb9853.el 20/134 2023-08-26T09:24:10.733 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-ceph-common-2:18.0.0-5706.ge7eb9853.el8. 21/134 2023-08-26T09:24:10.733 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cephfs-2:18.0.0-5706.ge7eb9853.el8.x86_6 22/134 2023-08-26T09:24:10.734 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-rados-2:18.0.0-5706.ge7eb9853.el8.x86_64 23/134 2023-08-26T09:24:10.734 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-rbd-2:18.0.0-5706.ge7eb9853.el8.x86_64 24/134 2023-08-26T09:24:10.734 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-rgw-2:18.0.0-5706.ge7eb9853.el8.x86_64 25/134 2023-08-26T09:24:10.734 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : rbd-fuse-2:18.0.0-5706.ge7eb9853.el8.x86_64 26/134 2023-08-26T09:24:10.734 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : rbd-mirror-2:18.0.0-5706.ge7eb9853.el8.x86_64 27/134 2023-08-26T09:24:10.735 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : rbd-nbd-2:18.0.0-5706.ge7eb9853.el8.x86_64 28/134 2023-08-26T09:24:10.735 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-5706.ge7eb9853. 29/134 2023-08-26T09:24:10.735 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-5706.ge7eb9853.el8.noa 30/134 2023-08-26T09:24:10.744 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-5706.ge7eb9853.el8.n 31/134 2023-08-26T09:24:10.744 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-5706.ge7e 32/134 2023-08-26T09:24:10.745 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-5706.ge7eb9853.el 33/134 2023-08-26T09:24:10.745 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-rook-2:18.0.0-5706.ge7eb9853.el8.noarch 34/134 2023-08-26T09:24:10.745 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-5706.ge7eb9853.e 35/134 2023-08-26T09:24:10.745 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-volume-2:18.0.0-5706.ge7eb9853.el8.noarch 36/134 2023-08-26T09:24:10.745 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : cephadm-2:18.0.0-5706.ge7eb9853.el8.noarch 37/134 2023-08-26T09:24:10.746 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : cephfs-top-2:18.0.0-5706.ge7eb9853.el8.noarch 38/134 2023-08-26T09:24:10.746 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-08-26T09:24:10.746 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-08-26T09:24:10.746 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-08-26T09:24:10.746 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-08-26T09:24:10.747 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-08-26T09:24:10.747 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-08-26T09:24:10.747 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-08-26T09:24:10.747 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-08-26T09:24:10.747 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-08-26T09:24:10.748 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-08-26T09:24:10.748 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-08-26T09:24:10.748 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-08-26T09:24:10.748 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-08-26T09:24:10.748 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-08-26T09:24:10.748 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-08-26T09:24:10.749 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-08-26T09:24:10.749 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-08-26T09:24:10.749 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-08-26T09:24:10.749 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-08-26T09:24:10.749 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-08-26T09:24:10.750 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-08-26T09:24:10.750 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-08-26T09:24:10.750 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-08-26T09:24:10.750 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-08-26T09:24:10.750 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-08-26T09:24:10.751 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-08-26T09:24:10.751 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-08-26T09:24:10.751 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-08-26T09:24:10.751 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-08-26T09:24:10.751 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-08-26T09:24:10.752 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-08-26T09:24:10.752 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-08-26T09:24:10.752 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-08-26T09:24:10.752 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-08-26T09:24:10.752 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-08-26T09:24:10.752 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-08-26T09:24:10.753 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-08-26T09:24:10.753 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-08-26T09:24:10.753 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-08-26T09:24:10.753 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-08-26T09:24:10.753 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-08-26T09:24:10.754 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-08-26T09:24:10.754 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-08-26T09:24:10.754 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-08-26T09:24:10.754 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-08-26T09:24:10.754 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-08-26T09:24:10.755 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-08-26T09:24:10.755 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-08-26T09:24:10.755 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-08-26T09:24:10.755 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-08-26T09:24:10.755 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-08-26T09:24:10.756 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-08-26T09:24:10.756 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-08-26T09:24:10.756 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-08-26T09:24:10.756 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-08-26T09:24:10.756 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-08-26T09:24:10.756 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-08-26T09:24:10.757 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-08-26T09:24:10.757 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-08-26T09:24:10.757 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-08-26T09:24:10.757 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-08-26T09:24:10.757 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-08-26T09:24:10.758 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-08-26T09:24:10.758 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-08-26T09:24:10.758 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-08-26T09:24:10.758 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-08-26T09:24:10.758 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-08-26T09:24:10.759 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-08-26T09:24:10.759 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-08-26T09:24:10.759 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-08-26T09:24:10.759 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-08-26T09:24:10.759 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-08-26T09:24:10.760 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-08-26T09:24:10.760 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-08-26T09:24:10.760 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-08-26T09:24:10.760 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-08-26T09:24:10.760 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-08-26T09:24:10.760 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-08-26T09:24:10.761 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-08-26T09:24:10.761 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-08-26T09:24:10.761 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-08-26T09:24:10.761 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-08-26T09:24:10.761 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-08-26T09:24:10.762 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-08-26T09:24:10.762 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-08-26T09:24:10.762 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-08-26T09:24:10.762 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-08-26T09:24:10.762 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-08-26T09:24:10.762 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-08-26T09:24:10.763 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-08-26T09:24:10.763 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librados2-2:18.0.0-5706.ge7eb9853.el8.x86_64 129/134 2023-08-26T09:24:10.764 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-08-26T09:24:10.764 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librbd1-2:18.0.0-5706.ge7eb9853.el8.x86_64 131/134 2023-08-26T09:24:10.764 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-26T09:24:10.765 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-08-26T09:24:11.057 INFO:teuthology.orchestra.run.smithi092.stdout:Installed products updated. 2023-08-26T09:24:11.285 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:24:11.285 INFO:teuthology.orchestra.run.smithi092.stdout:Upgraded: 2023-08-26T09:24:11.285 INFO:teuthology.orchestra.run.smithi092.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-08-26T09:24:11.285 INFO:teuthology.orchestra.run.smithi092.stdout: librados2-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:11.286 INFO:teuthology.orchestra.run.smithi092.stdout: librbd1-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:11.286 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2023-08-26T09:24:11.286 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-08-26T09:24:11.287 INFO:teuthology.orchestra.run.smithi092.stdout: automake-1.16.1-7.el8.noarch 2023-08-26T09:24:11.287 INFO:teuthology.orchestra.run.smithi092.stdout: bison-3.0.4-10.el8.x86_64 2023-08-26T09:24:11.287 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:11.287 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-base-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:11.288 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-common-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:11.288 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-fuse-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:11.288 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-grafana-dashboards-2:18.0.0-5706.ge7eb9853.el8.noarch 2023-08-26T09:24:11.288 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-immutable-object-cache-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:11.289 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mds-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:11.289 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:11.289 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-cephadm-2:18.0.0-5706.ge7eb9853.el8.noarch 2023-08-26T09:24:11.289 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-dashboard-2:18.0.0-5706.ge7eb9853.el8.noarch 2023-08-26T09:24:11.289 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-diskprediction-local-2:18.0.0-5706.ge7eb9853.el8.noarch 2023-08-26T09:24:11.290 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-modules-core-2:18.0.0-5706.ge7eb9853.el8.noarch 2023-08-26T09:24:11.290 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-rook-2:18.0.0-5706.ge7eb9853.el8.noarch 2023-08-26T09:24:11.290 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mon-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:11.290 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-osd-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:11.290 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-prometheus-alerts-2:18.0.0-5706.ge7eb9853.el8.noarch 2023-08-26T09:24:11.291 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-radosgw-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:11.291 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-selinux-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:11.291 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-test-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:11.291 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-volume-2:18.0.0-5706.ge7eb9853.el8.noarch 2023-08-26T09:24:11.291 INFO:teuthology.orchestra.run.smithi092.stdout: cephadm-2:18.0.0-5706.ge7eb9853.el8.noarch 2023-08-26T09:24:11.292 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-mirror-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:11.292 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-top-2:18.0.0-5706.ge7eb9853.el8.noarch 2023-08-26T09:24:11.292 INFO:teuthology.orchestra.run.smithi092.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-08-26T09:24:11.292 INFO:teuthology.orchestra.run.smithi092.stdout: flex-2.6.1-9.el8.x86_64 2023-08-26T09:24:11.292 INFO:teuthology.orchestra.run.smithi092.stdout: fuse-2.9.7-15.el8.x86_64 2023-08-26T09:24:11.292 INFO:teuthology.orchestra.run.smithi092.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-08-26T09:24:11.293 INFO:teuthology.orchestra.run.smithi092.stdout: jq-1.6-3.el8.x86_64 2023-08-26T09:24:11.293 INFO:teuthology.orchestra.run.smithi092.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-08-26T09:24:11.293 INFO:teuthology.orchestra.run.smithi092.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-08-26T09:24:11.293 INFO:teuthology.orchestra.run.smithi092.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-08-26T09:24:11.293 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs-devel-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:11.294 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs2-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:11.294 INFO:teuthology.orchestra.run.smithi092.stdout: libcephsqlite-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:11.294 INFO:teuthology.orchestra.run.smithi092.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-08-26T09:24:11.294 INFO:teuthology.orchestra.run.smithi092.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-08-26T09:24:11.294 INFO:teuthology.orchestra.run.smithi092.stdout: liboath-2.6.2-3.el8.x86_64 2023-08-26T09:24:11.295 INFO:teuthology.orchestra.run.smithi092.stdout: libpq-13.5-1.el8.x86_64 2023-08-26T09:24:11.295 INFO:teuthology.orchestra.run.smithi092.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-08-26T09:24:11.295 INFO:teuthology.orchestra.run.smithi092.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-08-26T09:24:11.295 INFO:teuthology.orchestra.run.smithi092.stdout: librados-devel-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:11.295 INFO:teuthology.orchestra.run.smithi092.stdout: libradosstriper1-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:11.296 INFO:teuthology.orchestra.run.smithi092.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-08-26T09:24:11.296 INFO:teuthology.orchestra.run.smithi092.stdout: librgw2-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:11.296 INFO:teuthology.orchestra.run.smithi092.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-08-26T09:24:11.298 INFO:teuthology.orchestra.run.smithi092.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-08-26T09:24:11.298 INFO:teuthology.orchestra.run.smithi092.stdout: libtool-2.4.6-25.el8.x86_64 2023-08-26T09:24:11.298 INFO:teuthology.orchestra.run.smithi092.stdout: libunwind-1.3.1-3.el8.x86_64 2023-08-26T09:24:11.298 INFO:teuthology.orchestra.run.smithi092.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-08-26T09:24:11.298 INFO:teuthology.orchestra.run.smithi092.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-08-26T09:24:11.299 INFO:teuthology.orchestra.run.smithi092.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-08-26T09:24:11.299 INFO:teuthology.orchestra.run.smithi092.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-08-26T09:24:11.299 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-0.3.15-3.el8.x86_64 2023-08-26T09:24:11.299 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-08-26T09:24:11.300 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-08-26T09:24:11.300 INFO:teuthology.orchestra.run.smithi092.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-08-26T09:24:11.300 INFO:teuthology.orchestra.run.smithi092.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-08-26T09:24:11.300 INFO:teuthology.orchestra.run.smithi092.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-08-26T09:24:11.300 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-26T09:24:11.301 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-26T09:24:11.301 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-26T09:24:11.301 INFO:teuthology.orchestra.run.smithi092.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-08-26T09:24:11.301 INFO:teuthology.orchestra.run.smithi092.stdout: python3-babel-2.5.1-7.el8.noarch 2023-08-26T09:24:11.301 INFO:teuthology.orchestra.run.smithi092.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-08-26T09:24:11.302 INFO:teuthology.orchestra.run.smithi092.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-08-26T09:24:11.302 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-08-26T09:24:11.302 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-argparse-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:11.302 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-common-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:11.302 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cephfs-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:11.303 INFO:teuthology.orchestra.run.smithi092.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-08-26T09:24:11.303 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-08-26T09:24:11.303 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-08-26T09:24:11.303 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-08-26T09:24:11.303 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-08-26T09:24:11.304 INFO:teuthology.orchestra.run.smithi092.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-08-26T09:24:11.304 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-6.2-6.el8.noarch 2023-08-26T09:24:11.304 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-08-26T09:24:11.304 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-08-26T09:24:11.305 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-08-26T09:24:11.305 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-08-26T09:24:11.305 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-08-26T09:24:11.305 INFO:teuthology.orchestra.run.smithi092.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-08-26T09:24:11.305 INFO:teuthology.orchestra.run.smithi092.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-08-26T09:24:11.306 INFO:teuthology.orchestra.run.smithi092.stdout: python3-mako-1.0.6-13.el8.noarch 2023-08-26T09:24:11.306 INFO:teuthology.orchestra.run.smithi092.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-08-26T09:24:11.306 INFO:teuthology.orchestra.run.smithi092.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-08-26T09:24:11.306 INFO:teuthology.orchestra.run.smithi092.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-08-26T09:24:11.306 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-08-26T09:24:11.307 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-08-26T09:24:11.307 INFO:teuthology.orchestra.run.smithi092.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-08-26T09:24:11.307 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-08-26T09:24:11.308 INFO:teuthology.orchestra.run.smithi092.stdout: python3-portend-2.6-1.el8.noarch 2023-08-26T09:24:11.308 INFO:teuthology.orchestra.run.smithi092.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-08-26T09:24:11.308 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-08-26T09:24:11.308 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-08-26T09:24:11.308 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-08-26T09:24:11.309 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pycparser-2.14-14.el8.noarch 2023-08-26T09:24:11.309 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pytz-2017.2-9.el8.noarch 2023-08-26T09:24:11.309 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rados-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:11.309 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rbd-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:11.309 INFO:teuthology.orchestra.run.smithi092.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-08-26T09:24:11.309 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-08-26T09:24:11.310 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rgw-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:11.310 INFO:teuthology.orchestra.run.smithi092.stdout: python3-routes-2.4.1-12.el8.noarch 2023-08-26T09:24:11.310 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rsa-4.9-2.el8.noarch 2023-08-26T09:24:11.311 INFO:teuthology.orchestra.run.smithi092.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-08-26T09:24:11.311 INFO:teuthology.orchestra.run.smithi092.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-08-26T09:24:11.311 INFO:teuthology.orchestra.run.smithi092.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-08-26T09:24:11.311 INFO:teuthology.orchestra.run.smithi092.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-08-26T09:24:11.311 INFO:teuthology.orchestra.run.smithi092.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-08-26T09:24:11.312 INFO:teuthology.orchestra.run.smithi092.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-08-26T09:24:11.312 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-08-26T09:24:11.312 INFO:teuthology.orchestra.run.smithi092.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-08-26T09:24:11.312 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-08-26T09:24:11.312 INFO:teuthology.orchestra.run.smithi092.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-08-26T09:24:11.313 INFO:teuthology.orchestra.run.smithi092.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-08-26T09:24:11.313 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-fuse-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:11.313 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-mirror-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:11.313 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-nbd-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:11.313 INFO:teuthology.orchestra.run.smithi092.stdout: socat-1.7.4.1-1.el8.x86_64 2023-08-26T09:24:11.313 INFO:teuthology.orchestra.run.smithi092.stdout: thrift-0.13.0-2.el8.x86_64 2023-08-26T09:24:11.314 INFO:teuthology.orchestra.run.smithi092.stdout: uuid-1.6.2-43.el8.x86_64 2023-08-26T09:24:11.314 INFO:teuthology.orchestra.run.smithi092.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-08-26T09:24:11.314 INFO:teuthology.orchestra.run.smithi092.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-08-26T09:24:11.314 INFO:teuthology.orchestra.run.smithi092.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-08-26T09:24:11.314 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:24:11.315 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2023-08-26T09:24:11.501 DEBUG:teuthology.parallel:result is None 2023-08-26T09:24:13.488 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-26T09:24:13.488 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:54 ago on Sat 26 Aug 2023 09:22:19 AM UTC. 2023-08-26T09:24:16.472 INFO:teuthology.orchestra.run.smithi188.stdout:Installed products updated. 2023-08-26T09:24:16.688 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-08-26T09:24:16.688 INFO:teuthology.orchestra.run.smithi188.stdout:Upgraded: 2023-08-26T09:24:16.688 INFO:teuthology.orchestra.run.smithi188.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-08-26T09:24:16.688 INFO:teuthology.orchestra.run.smithi188.stdout: librados2-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:16.689 INFO:teuthology.orchestra.run.smithi188.stdout: librbd1-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:16.689 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2023-08-26T09:24:16.689 INFO:teuthology.orchestra.run.smithi188.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-08-26T09:24:16.690 INFO:teuthology.orchestra.run.smithi188.stdout: automake-1.16.1-7.el8.noarch 2023-08-26T09:24:16.690 INFO:teuthology.orchestra.run.smithi188.stdout: bison-3.0.4-10.el8.x86_64 2023-08-26T09:24:16.690 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:16.690 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-base-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:16.691 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-common-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:16.691 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-fuse-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:16.691 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-grafana-dashboards-2:18.0.0-5706.ge7eb9853.el8.noarch 2023-08-26T09:24:16.691 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-immutable-object-cache-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:16.692 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mds-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:16.692 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:16.692 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-cephadm-2:18.0.0-5706.ge7eb9853.el8.noarch 2023-08-26T09:24:16.692 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-dashboard-2:18.0.0-5706.ge7eb9853.el8.noarch 2023-08-26T09:24:16.692 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-diskprediction-local-2:18.0.0-5706.ge7eb9853.el8.noarch 2023-08-26T09:24:16.693 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-modules-core-2:18.0.0-5706.ge7eb9853.el8.noarch 2023-08-26T09:24:16.693 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-rook-2:18.0.0-5706.ge7eb9853.el8.noarch 2023-08-26T09:24:16.693 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mon-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:16.693 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-osd-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:16.693 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-prometheus-alerts-2:18.0.0-5706.ge7eb9853.el8.noarch 2023-08-26T09:24:16.694 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-radosgw-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:16.694 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-selinux-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:16.694 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-test-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:16.694 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-volume-2:18.0.0-5706.ge7eb9853.el8.noarch 2023-08-26T09:24:16.694 INFO:teuthology.orchestra.run.smithi188.stdout: cephadm-2:18.0.0-5706.ge7eb9853.el8.noarch 2023-08-26T09:24:16.695 INFO:teuthology.orchestra.run.smithi188.stdout: cephfs-mirror-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:16.695 INFO:teuthology.orchestra.run.smithi188.stdout: cephfs-top-2:18.0.0-5706.ge7eb9853.el8.noarch 2023-08-26T09:24:16.695 INFO:teuthology.orchestra.run.smithi188.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-08-26T09:24:16.695 INFO:teuthology.orchestra.run.smithi188.stdout: flex-2.6.1-9.el8.x86_64 2023-08-26T09:24:16.695 INFO:teuthology.orchestra.run.smithi188.stdout: fuse-2.9.7-15.el8.x86_64 2023-08-26T09:24:16.696 INFO:teuthology.orchestra.run.smithi188.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-08-26T09:24:16.696 INFO:teuthology.orchestra.run.smithi188.stdout: jq-1.6-3.el8.x86_64 2023-08-26T09:24:16.696 INFO:teuthology.orchestra.run.smithi188.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-08-26T09:24:16.696 INFO:teuthology.orchestra.run.smithi188.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-08-26T09:24:16.696 INFO:teuthology.orchestra.run.smithi188.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-08-26T09:24:16.697 INFO:teuthology.orchestra.run.smithi188.stdout: libcephfs-devel-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:16.697 INFO:teuthology.orchestra.run.smithi188.stdout: libcephfs2-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:16.697 INFO:teuthology.orchestra.run.smithi188.stdout: libcephsqlite-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:16.697 INFO:teuthology.orchestra.run.smithi188.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-08-26T09:24:16.697 INFO:teuthology.orchestra.run.smithi188.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-08-26T09:24:16.698 INFO:teuthology.orchestra.run.smithi188.stdout: liboath-2.6.2-3.el8.x86_64 2023-08-26T09:24:16.698 INFO:teuthology.orchestra.run.smithi188.stdout: libpq-13.5-1.el8.x86_64 2023-08-26T09:24:16.698 INFO:teuthology.orchestra.run.smithi188.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-08-26T09:24:16.698 INFO:teuthology.orchestra.run.smithi188.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-08-26T09:24:16.698 INFO:teuthology.orchestra.run.smithi188.stdout: librados-devel-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:16.698 INFO:teuthology.orchestra.run.smithi188.stdout: libradosstriper1-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:16.699 INFO:teuthology.orchestra.run.smithi188.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-08-26T09:24:16.699 INFO:teuthology.orchestra.run.smithi188.stdout: librgw2-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:16.699 INFO:teuthology.orchestra.run.smithi188.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-08-26T09:24:16.699 INFO:teuthology.orchestra.run.smithi188.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-08-26T09:24:16.699 INFO:teuthology.orchestra.run.smithi188.stdout: libtool-2.4.6-25.el8.x86_64 2023-08-26T09:24:16.700 INFO:teuthology.orchestra.run.smithi188.stdout: libunwind-1.3.1-3.el8.x86_64 2023-08-26T09:24:16.700 INFO:teuthology.orchestra.run.smithi188.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-08-26T09:24:16.700 INFO:teuthology.orchestra.run.smithi188.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-08-26T09:24:16.701 INFO:teuthology.orchestra.run.smithi188.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-08-26T09:24:16.701 INFO:teuthology.orchestra.run.smithi188.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-08-26T09:24:16.701 INFO:teuthology.orchestra.run.smithi188.stdout: openblas-0.3.15-3.el8.x86_64 2023-08-26T09:24:16.701 INFO:teuthology.orchestra.run.smithi188.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-08-26T09:24:16.701 INFO:teuthology.orchestra.run.smithi188.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-08-26T09:24:16.702 INFO:teuthology.orchestra.run.smithi188.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-08-26T09:24:16.702 INFO:teuthology.orchestra.run.smithi188.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-08-26T09:24:16.702 INFO:teuthology.orchestra.run.smithi188.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-08-26T09:24:16.702 INFO:teuthology.orchestra.run.smithi188.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-26T09:24:16.703 INFO:teuthology.orchestra.run.smithi188.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-26T09:24:16.703 INFO:teuthology.orchestra.run.smithi188.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-26T09:24:16.703 INFO:teuthology.orchestra.run.smithi188.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-08-26T09:24:16.703 INFO:teuthology.orchestra.run.smithi188.stdout: python3-babel-2.5.1-7.el8.noarch 2023-08-26T09:24:16.703 INFO:teuthology.orchestra.run.smithi188.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-08-26T09:24:16.704 INFO:teuthology.orchestra.run.smithi188.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-08-26T09:24:16.704 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-08-26T09:24:16.704 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-argparse-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:16.704 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-common-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:16.705 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cephfs-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:16.705 INFO:teuthology.orchestra.run.smithi188.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-08-26T09:24:16.705 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-08-26T09:24:16.705 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-08-26T09:24:16.705 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-08-26T09:24:16.706 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-08-26T09:24:16.706 INFO:teuthology.orchestra.run.smithi188.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-08-26T09:24:16.706 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-6.2-6.el8.noarch 2023-08-26T09:24:16.706 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-08-26T09:24:16.707 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-08-26T09:24:16.707 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-08-26T09:24:16.707 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-08-26T09:24:16.707 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-08-26T09:24:16.707 INFO:teuthology.orchestra.run.smithi188.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-08-26T09:24:16.708 INFO:teuthology.orchestra.run.smithi188.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-08-26T09:24:16.708 INFO:teuthology.orchestra.run.smithi188.stdout: python3-mako-1.0.6-13.el8.noarch 2023-08-26T09:24:16.708 INFO:teuthology.orchestra.run.smithi188.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-08-26T09:24:16.708 INFO:teuthology.orchestra.run.smithi188.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-08-26T09:24:16.709 INFO:teuthology.orchestra.run.smithi188.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-08-26T09:24:16.709 INFO:teuthology.orchestra.run.smithi188.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-08-26T09:24:16.709 INFO:teuthology.orchestra.run.smithi188.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-08-26T09:24:16.709 INFO:teuthology.orchestra.run.smithi188.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-08-26T09:24:16.709 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-08-26T09:24:16.710 INFO:teuthology.orchestra.run.smithi188.stdout: python3-portend-2.6-1.el8.noarch 2023-08-26T09:24:16.710 INFO:teuthology.orchestra.run.smithi188.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-08-26T09:24:16.710 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-08-26T09:24:16.710 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-08-26T09:24:16.711 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-08-26T09:24:16.711 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pycparser-2.14-14.el8.noarch 2023-08-26T09:24:16.711 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pytz-2017.2-9.el8.noarch 2023-08-26T09:24:16.712 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rados-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:16.712 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rbd-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:16.712 INFO:teuthology.orchestra.run.smithi188.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-08-26T09:24:16.712 INFO:teuthology.orchestra.run.smithi188.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-08-26T09:24:16.713 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rgw-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:16.713 INFO:teuthology.orchestra.run.smithi188.stdout: python3-routes-2.4.1-12.el8.noarch 2023-08-26T09:24:16.713 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rsa-4.9-2.el8.noarch 2023-08-26T09:24:16.714 INFO:teuthology.orchestra.run.smithi188.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-08-26T09:24:16.714 INFO:teuthology.orchestra.run.smithi188.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-08-26T09:24:16.714 INFO:teuthology.orchestra.run.smithi188.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-08-26T09:24:16.715 INFO:teuthology.orchestra.run.smithi188.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-08-26T09:24:16.716 INFO:teuthology.orchestra.run.smithi188.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-08-26T09:24:16.716 INFO:teuthology.orchestra.run.smithi188.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-08-26T09:24:16.716 INFO:teuthology.orchestra.run.smithi188.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-08-26T09:24:16.717 INFO:teuthology.orchestra.run.smithi188.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-08-26T09:24:16.717 INFO:teuthology.orchestra.run.smithi188.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-08-26T09:24:16.717 INFO:teuthology.orchestra.run.smithi188.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-08-26T09:24:16.717 INFO:teuthology.orchestra.run.smithi188.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-08-26T09:24:16.718 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-fuse-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:16.718 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-mirror-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:16.718 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-nbd-2:18.0.0-5706.ge7eb9853.el8.x86_64 2023-08-26T09:24:16.718 INFO:teuthology.orchestra.run.smithi188.stdout: socat-1.7.4.1-1.el8.x86_64 2023-08-26T09:24:16.719 INFO:teuthology.orchestra.run.smithi188.stdout: thrift-0.13.0-2.el8.x86_64 2023-08-26T09:24:16.719 INFO:teuthology.orchestra.run.smithi188.stdout: uuid-1.6.2-43.el8.x86_64 2023-08-26T09:24:16.719 INFO:teuthology.orchestra.run.smithi188.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-08-26T09:24:16.719 INFO:teuthology.orchestra.run.smithi188.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-08-26T09:24:16.720 INFO:teuthology.orchestra.run.smithi188.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-08-26T09:24:16.720 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-08-26T09:24:16.720 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2023-08-26T09:24:16.896 DEBUG:teuthology.parallel:result is None 2023-08-26T09:24:16.897 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=e7eb9853fddaf661c68f207346131a7e00d8ed2f 2023-08-26T09:24:17.124 DEBUG:teuthology.orchestra.run.smithi092:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-08-26T09:24:17.151 INFO:teuthology.orchestra.run.smithi092.stdout:18.0.0-5706.ge7eb9853.el8 2023-08-26T09:24:17.152 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5706.ge7eb9853.el8 2023-08-26T09:24:17.153 INFO:teuthology.task.install:The correct ceph version 18.0.0-5706.ge7eb9853 is installed. 2023-08-26T09:24:17.154 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=e7eb9853fddaf661c68f207346131a7e00d8ed2f 2023-08-26T09:24:17.301 DEBUG:teuthology.orchestra.run.smithi188:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-08-26T09:24:17.328 INFO:teuthology.orchestra.run.smithi188.stdout:18.0.0-5706.ge7eb9853.el8 2023-08-26T09:24:17.328 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5706.ge7eb9853.el8 2023-08-26T09:24:17.329 INFO:teuthology.task.install:The correct ceph version 18.0.0-5706.ge7eb9853 is installed. 2023-08-26T09:24:17.329 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-08-26T09:24:17.330 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-08-26T09:24:17.330 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-26T09:24:17.376 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-08-26T09:24:17.377 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-26T09:24:17.418 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-08-26T09:24:17.418 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-08-26T09:24:17.418 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/daemon-helper 2023-08-26T09:24:17.448 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-26T09:24:17.517 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-08-26T09:24:17.517 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/usr/bin/daemon-helper 2023-08-26T09:24:17.545 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-26T09:24:17.612 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-08-26T09:24:17.612 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-08-26T09:24:17.613 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-26T09:24:17.640 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-26T09:24:17.708 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-08-26T09:24:17.708 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-26T09:24:17.734 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-26T09:24:17.801 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-08-26T09:24:17.802 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-08-26T09:24:17.802 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/stdin-killer 2023-08-26T09:24:17.829 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-26T09:24:17.896 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-08-26T09:24:17.897 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/usr/bin/stdin-killer 2023-08-26T09:24:17.923 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-26T09:24:17.989 INFO:teuthology.run_tasks:Running task ceph... 2023-08-26T09:24:18.062 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-08-26T09:24:18.063 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 777 /var/log/ceph 2023-08-26T09:24:18.066 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 777 /var/log/ceph 2023-08-26T09:24:18.092 INFO:tasks.ceph:Disabling ceph logrotate... 2023-08-26T09:24:18.093 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f -- /etc/logrotate.d/ceph 2023-08-26T09:24:18.132 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -f -- /etc/logrotate.d/ceph 2023-08-26T09:24:18.158 INFO:tasks.ceph:Creating extra log directories... 2023-08-26T09:24:18.159 DEBUG:teuthology.orchestra.run.smithi092:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-08-26T09:24:18.199 DEBUG:teuthology.orchestra.run.smithi188:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-08-26T09:24:18.235 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-08-26T09:24:18.236 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-08-26T09:24:18.236 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-08-26T09:24:18.236 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-08-26T09:24:18.237 DEBUG:teuthology.orchestra.run.smithi092:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-08-26T09:24:18.280 DEBUG:teuthology.orchestra.run.smithi092:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-08-26T09:24:18.424 DEBUG:teuthology.orchestra.run.smithi092:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-08-26T09:24:18.451 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-08-26T09:24:18.452 DEBUG:teuthology.orchestra.run.smithi188:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-08-26T09:24:18.468 DEBUG:teuthology.orchestra.run.smithi188:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-08-26T09:24:18.614 DEBUG:teuthology.orchestra.run.smithi188:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-08-26T09:24:18.646 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-08-26T09:24:18.647 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-08-26T09:24:18.647 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-08-25_17:36:25-fs-main-distro-default-smithi/7380057', 'branch': 'main', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7380057', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-08-25_17:36:25-fs-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'e7eb9853fddaf661c68f207346131a7e00d8ed2f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'e7eb9853fddaf661c68f207346131a7e00d8ed2f'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': 'e7eb9853fddaf661c68f207346131a7e00d8ed2f'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 2135, 'sha1': 'e7eb9853fddaf661c68f207346131a7e00d8ed2f', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_e7eb9853fddaf661c68f207346131a7e00d8ed2f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'e7eb9853fddaf661c68f207346131a7e00d8ed2f', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi092.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac=', 'smithi188.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'e7eb9853fddaf661c68f207346131a7e00d8ed2f'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '449a1bc2027504e7b3c3d7b30fa4178906581da7', 'timestamp': '2023-08-25_17:36:25', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2002'} 2023-08-26T09:24:18.648 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-08-26T09:24:18.651 DEBUG:teuthology.orchestra.run.smithi188:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-08-26T09:24:18.698 DEBUG:teuthology.orchestra.run.smithi092:> sudo install -d -m0777 -- /var/run/ceph 2023-08-26T09:24:18.708 DEBUG:teuthology.orchestra.run.smithi188:> sudo install -d -m0777 -- /var/run/ceph 2023-08-26T09:24:18.764 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-08-26T09:24:18.765 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/scratch_devs of=/dev/stdout 2023-08-26T09:24:18.789 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-08-26T09:24:18.789 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_1 2023-08-26T09:24:18.846 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-08-26T09:24:18.846 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-26T09:24:18.847 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 6h/6d Inode: 391461 Links: 1 2023-08-26T09:24:18.847 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-26T09:24:18.847 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2023-08-26T09:24:18.847 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2023-08-26 09:24:04.830632395 +0000 2023-08-26T09:24:18.847 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2023-08-26 09:21:30.816394378 +0000 2023-08-26T09:24:18.848 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2023-08-26 09:21:30.816394378 +0000 2023-08-26T09:24:18.848 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: - 2023-08-26T09:24:18.848 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-08-26T09:24:18.911 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2023-08-26T09:24:18.911 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2023-08-26T09:24:18.911 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000283707 s, 1.8 MB/s 2023-08-26T09:24:18.913 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-08-26T09:24:18.971 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_2 2023-08-26T09:24:19.028 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-08-26T09:24:19.029 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-26T09:24:19.029 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 6h/6d Inode: 390718 Links: 1 2023-08-26T09:24:19.029 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-26T09:24:19.029 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2023-08-26T09:24:19.030 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2023-08-26 09:24:04.830632395 +0000 2023-08-26T09:24:19.030 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2023-08-26 09:21:31.360378995 +0000 2023-08-26T09:24:19.030 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2023-08-26 09:21:31.360378995 +0000 2023-08-26T09:24:19.030 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: - 2023-08-26T09:24:19.031 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-08-26T09:24:19.093 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2023-08-26T09:24:19.093 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2023-08-26T09:24:19.093 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.00028338 s, 1.8 MB/s 2023-08-26T09:24:19.094 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-08-26T09:24:19.152 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_3 2023-08-26T09:24:19.209 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-08-26T09:24:19.210 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-26T09:24:19.210 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 6h/6d Inode: 392473 Links: 1 2023-08-26T09:24:19.210 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-26T09:24:19.210 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2023-08-26T09:24:19.210 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2023-08-26 09:24:04.830632395 +0000 2023-08-26T09:24:19.211 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2023-08-26 09:21:31.869364604 +0000 2023-08-26T09:24:19.211 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2023-08-26 09:21:31.869364604 +0000 2023-08-26T09:24:19.211 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: - 2023-08-26T09:24:19.212 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-08-26T09:24:19.274 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2023-08-26T09:24:19.274 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2023-08-26T09:24:19.274 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000223843 s, 2.3 MB/s 2023-08-26T09:24:19.276 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-08-26T09:24:19.333 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_4 2023-08-26T09:24:19.390 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-08-26T09:24:19.391 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-26T09:24:19.391 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 6h/6d Inode: 390756 Links: 1 2023-08-26T09:24:19.391 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-26T09:24:19.391 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2023-08-26T09:24:19.392 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2023-08-26 09:24:04.831632368 +0000 2023-08-26T09:24:19.392 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2023-08-26 09:21:32.354350890 +0000 2023-08-26T09:24:19.392 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2023-08-26 09:21:32.354350890 +0000 2023-08-26T09:24:19.392 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: - 2023-08-26T09:24:19.392 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-08-26T09:24:19.455 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2023-08-26T09:24:19.455 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2023-08-26T09:24:19.456 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000215722 s, 2.4 MB/s 2023-08-26T09:24:19.457 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-08-26T09:24:19.514 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-26T09:24:19.515 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-08-26T09:24:19.515 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/scratch_devs of=/dev/stdout 2023-08-26T09:24:19.534 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-08-26T09:24:19.535 DEBUG:teuthology.orchestra.run.smithi188:> stat /dev/vg_nvme/lv_1 2023-08-26T09:24:19.592 INFO:teuthology.orchestra.run.smithi188.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-08-26T09:24:19.593 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-26T09:24:19.593 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 6h/6d Inode: 392008 Links: 1 2023-08-26T09:24:19.594 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-26T09:24:19.594 INFO:teuthology.orchestra.run.smithi188.stdout:Context: system_u:object_r:device_t:s0 2023-08-26T09:24:19.594 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 2023-08-26 09:24:10.427696358 +0000 2023-08-26T09:24:19.595 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2023-08-26 09:21:29.451709503 +0000 2023-08-26T09:24:19.595 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2023-08-26 09:21:29.451709503 +0000 2023-08-26T09:24:19.595 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: - 2023-08-26T09:24:19.595 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-08-26T09:24:19.660 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records in 2023-08-26T09:24:19.661 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records out 2023-08-26T09:24:19.661 INFO:teuthology.orchestra.run.smithi188.stderr:512 bytes copied, 0.000267924 s, 1.9 MB/s 2023-08-26T09:24:19.662 DEBUG:teuthology.orchestra.run.smithi188:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-08-26T09:24:19.724 DEBUG:teuthology.orchestra.run.smithi188:> stat /dev/vg_nvme/lv_2 2023-08-26T09:24:19.783 INFO:teuthology.orchestra.run.smithi188.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-08-26T09:24:19.783 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-26T09:24:19.784 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 6h/6d Inode: 392283 Links: 1 2023-08-26T09:24:19.784 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-26T09:24:19.784 INFO:teuthology.orchestra.run.smithi188.stdout:Context: system_u:object_r:device_t:s0 2023-08-26T09:24:19.784 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 2023-08-26 09:24:10.427696358 +0000 2023-08-26T09:24:19.785 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2023-08-26 09:21:29.996699807 +0000 2023-08-26T09:24:19.785 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2023-08-26 09:21:29.996699807 +0000 2023-08-26T09:24:19.785 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: - 2023-08-26T09:24:19.785 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-08-26T09:24:19.851 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records in 2023-08-26T09:24:19.851 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records out 2023-08-26T09:24:19.852 INFO:teuthology.orchestra.run.smithi188.stderr:512 bytes copied, 0.000233507 s, 2.2 MB/s 2023-08-26T09:24:19.853 DEBUG:teuthology.orchestra.run.smithi188:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-08-26T09:24:19.911 DEBUG:teuthology.orchestra.run.smithi188:> stat /dev/vg_nvme/lv_3 2023-08-26T09:24:19.968 INFO:teuthology.orchestra.run.smithi188.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-08-26T09:24:19.968 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-26T09:24:19.969 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 6h/6d Inode: 384366 Links: 1 2023-08-26T09:24:19.969 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-26T09:24:19.969 INFO:teuthology.orchestra.run.smithi188.stdout:Context: system_u:object_r:device_t:s0 2023-08-26T09:24:19.969 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 2023-08-26 09:24:10.427696358 +0000 2023-08-26T09:24:19.969 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2023-08-26 09:21:30.501690822 +0000 2023-08-26T09:24:19.970 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2023-08-26 09:21:30.501690822 +0000 2023-08-26T09:24:19.970 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: - 2023-08-26T09:24:19.970 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-08-26T09:24:20.032 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records in 2023-08-26T09:24:20.033 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records out 2023-08-26T09:24:20.033 INFO:teuthology.orchestra.run.smithi188.stderr:512 bytes copied, 0.000226123 s, 2.3 MB/s 2023-08-26T09:24:20.034 DEBUG:teuthology.orchestra.run.smithi188:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-08-26T09:24:20.092 DEBUG:teuthology.orchestra.run.smithi188:> stat /dev/vg_nvme/lv_4 2023-08-26T09:24:20.149 INFO:teuthology.orchestra.run.smithi188.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-08-26T09:24:20.150 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-26T09:24:20.150 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 6h/6d Inode: 389068 Links: 1 2023-08-26T09:24:20.150 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-26T09:24:20.150 INFO:teuthology.orchestra.run.smithi188.stdout:Context: system_u:object_r:device_t:s0 2023-08-26T09:24:20.150 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 2023-08-26 09:24:10.427696358 +0000 2023-08-26T09:24:20.151 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2023-08-26 09:21:30.998681980 +0000 2023-08-26T09:24:20.151 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2023-08-26 09:21:30.998681980 +0000 2023-08-26T09:24:20.151 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: - 2023-08-26T09:24:20.151 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-08-26T09:24:20.213 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records in 2023-08-26T09:24:20.214 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records out 2023-08-26T09:24:20.214 INFO:teuthology.orchestra.run.smithi188.stderr:512 bytes copied, 0.000187754 s, 2.7 MB/s 2023-08-26T09:24:20.216 DEBUG:teuthology.orchestra.run.smithi188:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-08-26T09:24:20.274 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-26T09:24:20.274 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi092.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi188.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-08-26T09:24:20.274 INFO:tasks.ceph:Generating config... 2023-08-26T09:24:20.276 INFO:tasks.ceph:[client] client mount timeout = 600 2023-08-26T09:24:20.276 INFO:tasks.ceph:[client] debug client = 20 2023-08-26T09:24:20.276 INFO:tasks.ceph:[client] debug ms = 1 2023-08-26T09:24:20.276 INFO:tasks.ceph:[client] pid file = 2023-08-26T09:24:20.277 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-08-26T09:24:20.277 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-08-26T09:24:20.277 INFO:tasks.ceph:[mds] debug mds = 20 2023-08-26T09:24:20.277 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-08-26T09:24:20.278 INFO:tasks.ceph:[mds] debug ms = 1 2023-08-26T09:24:20.278 INFO:tasks.ceph:[mds] mds debug frag = True 2023-08-26T09:24:20.278 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-08-26T09:24:20.278 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-08-26T09:24:20.279 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-08-26T09:24:20.279 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-08-26T09:24:20.279 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-08-26T09:24:20.279 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-08-26T09:24:20.280 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-08-26T09:24:20.280 INFO:tasks.ceph:[mgr] debug ms = 1 2023-08-26T09:24:20.280 INFO:tasks.ceph:[mon] debug mon = 20 2023-08-26T09:24:20.280 INFO:tasks.ceph:[mon] debug ms = 1 2023-08-26T09:24:20.281 INFO:tasks.ceph:[mon] debug paxos = 20 2023-08-26T09:24:20.281 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-08-26T09:24:20.281 INFO:tasks.ceph:[osd] bdev async discard = True 2023-08-26T09:24:20.281 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-08-26T09:24:20.282 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-08-26T09:24:20.282 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-08-26T09:24:20.282 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-08-26T09:24:20.282 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-08-26T09:24:20.283 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-08-26T09:24:20.283 INFO:tasks.ceph:[osd] debug ms = 1 2023-08-26T09:24:20.283 INFO:tasks.ceph:[osd] debug osd = 20 2023-08-26T09:24:20.283 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-08-26T09:24:20.284 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-08-26T09:24:20.284 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-08-26T09:24:20.284 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-08-26T09:24:20.284 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-08-26T09:24:20.285 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-08-26T09:24:20.285 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-08-26T09:24:20.285 INFO:tasks.ceph:Setting up mon.a... 2023-08-26T09:24:20.286 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-08-26T09:24:20.341 INFO:teuthology.orchestra.run.smithi092.stdout:creating /etc/ceph/ceph.keyring 2023-08-26T09:24:20.344 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-08-26T09:24:20.392 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-26T09:24:20.418 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.92'), ('mon.b', '172.21.15.188'), ('mon.c', '[v2:172.21.15.188:3301,v1:172.21.15.188:6790]')] 2023-08-26T09:24:20.419 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.92,172.21.15.188,[v2:172.21.15.188:3301,v1:172.21.15.188:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-08-26T09:24:20.420 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-08-26T09:24:20.420 DEBUG:teuthology.orchestra.run.smithi092:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-08-26T09:24:20.475 DEBUG:teuthology.orchestra.run.smithi092:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.92 --add b 172.21.15.188 --addv c '[v2:172.21.15.188:3301,v1:172.21.15.188:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-08-26T09:24:20.563 INFO:teuthology.orchestra.run.smithi092.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-08-26T09:24:20.564 INFO:teuthology.orchestra.run.smithi092.stdout:monmaptool: generated fsid 254a2d31-bd41-4507-8326-1b205ac24377 2023-08-26T09:24:20.564 INFO:teuthology.orchestra.run.smithi092.stdout:setting min_mon_release = pacific 2023-08-26T09:24:20.564 INFO:teuthology.orchestra.run.smithi092.stdout:epoch 0 2023-08-26T09:24:20.565 INFO:teuthology.orchestra.run.smithi092.stdout:fsid 254a2d31-bd41-4507-8326-1b205ac24377 2023-08-26T09:24:20.565 INFO:teuthology.orchestra.run.smithi092.stdout:last_changed 2023-08-26T09:24:20.559113+0000 2023-08-26T09:24:20.565 INFO:teuthology.orchestra.run.smithi092.stdout:created 2023-08-26T09:24:20.559113+0000 2023-08-26T09:24:20.566 INFO:teuthology.orchestra.run.smithi092.stdout:min_mon_release 16 (pacific) 2023-08-26T09:24:20.566 INFO:teuthology.orchestra.run.smithi092.stdout:election_strategy: 1 2023-08-26T09:24:20.566 INFO:teuthology.orchestra.run.smithi092.stdout:0: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.a 2023-08-26T09:24:20.567 INFO:teuthology.orchestra.run.smithi092.stdout:1: [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] mon.b 2023-08-26T09:24:20.567 INFO:teuthology.orchestra.run.smithi092.stdout:2: [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] mon.c 2023-08-26T09:24:20.567 INFO:teuthology.orchestra.run.smithi092.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-08-26T09:24:20.569 DEBUG:teuthology.orchestra.run.smithi092:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-08-26T09:24:20.586 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 254a2d31-bd41-4507-8326-1b205ac24377... 2023-08-26T09:24:20.587 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-26T09:24:20.629 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-26T09:24:20.671 INFO:teuthology.orchestra.run.smithi092.stdout:[global] 2023-08-26T09:24:20.672 INFO:teuthology.orchestra.run.smithi092.stdout: chdir = "" 2023-08-26T09:24:20.672 INFO:teuthology.orchestra.run.smithi092.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-26T09:24:20.672 INFO:teuthology.orchestra.run.smithi092.stdout: auth supported = cephx 2023-08-26T09:24:20.673 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:24:20.673 INFO:teuthology.orchestra.run.smithi092.stdout: filestore xattr use omap = true 2023-08-26T09:24:20.673 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:24:20.674 INFO:teuthology.orchestra.run.smithi092.stdout: mon clock drift allowed = 1.000 2023-08-26T09:24:20.674 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:24:20.674 INFO:teuthology.orchestra.run.smithi092.stdout: osd crush chooseleaf type = 0 2023-08-26T09:24:20.675 INFO:teuthology.orchestra.run.smithi092.stdout: auth debug = true 2023-08-26T09:24:20.675 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:24:20.675 INFO:teuthology.orchestra.run.smithi092.stdout: ms die on old message = true 2023-08-26T09:24:20.676 INFO:teuthology.orchestra.run.smithi092.stdout: ms die on bug = true 2023-08-26T09:24:20.676 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:24:20.677 INFO:teuthology.orchestra.run.smithi092.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-26T09:24:20.677 INFO:teuthology.orchestra.run.smithi092.stdout: mon pg warn max object skew = 0 2023-08-26T09:24:20.677 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:24:20.678 INFO:teuthology.orchestra.run.smithi092.stdout: # disable pg_autoscaler by default for new pools 2023-08-26T09:24:20.678 INFO:teuthology.orchestra.run.smithi092.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-26T09:24:20.678 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:24:20.679 INFO:teuthology.orchestra.run.smithi092.stdout: osd pool default size = 2 2023-08-26T09:24:20.679 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:24:20.679 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd allow primary affinity = true 2023-08-26T09:24:20.680 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd allow pg remap = true 2023-08-26T09:24:20.680 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on legacy crush tunables = false 2023-08-26T09:24:20.680 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on crush straw calc version zero = false 2023-08-26T09:24:20.681 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on no sortbitwise = false 2023-08-26T09:24:20.682 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on osd down out interval zero = false 2023-08-26T09:24:20.682 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on too few osds = false 2023-08-26T09:24:20.682 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-26T09:24:20.683 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-26T09:24:20.683 INFO:teuthology.orchestra.run.smithi092.stdout: mon_allow_pool_size_one = true 2023-08-26T09:24:20.684 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:24:20.684 INFO:teuthology.orchestra.run.smithi092.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-08-26T09:24:20.684 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:24:20.685 INFO:teuthology.orchestra.run.smithi092.stdout: osd default data pool replay window = 5 2023-08-26T09:24:20.685 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:24:20.685 INFO:teuthology.orchestra.run.smithi092.stdout: mon allow pool delete = true 2023-08-26T09:24:20.686 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:24:20.686 INFO:teuthology.orchestra.run.smithi092.stdout: mon cluster log file level = debug 2023-08-26T09:24:20.687 INFO:teuthology.orchestra.run.smithi092.stdout: debug asserts on shutdown = true 2023-08-26T09:24:20.687 INFO:teuthology.orchestra.run.smithi092.stdout: mon health detail to clog = false 2023-08-26T09:24:20.687 INFO:teuthology.orchestra.run.smithi092.stdout: mon host = "172.21.15.92,172.21.15.188,[v2:172.21.15.188:3301,v1:172.21.15.188:6790]" 2023-08-26T09:24:20.688 INFO:teuthology.orchestra.run.smithi092.stdout: fsid = 254a2d31-bd41-4507-8326-1b205ac24377 2023-08-26T09:24:20.688 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:24:20.689 INFO:teuthology.orchestra.run.smithi092.stdout:[osd] 2023-08-26T09:24:20.689 INFO:teuthology.orchestra.run.smithi092.stdout: osd journal size = 100 2023-08-26T09:24:20.690 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:24:20.690 INFO:teuthology.orchestra.run.smithi092.stdout: osd scrub load threshold = 5.0 2023-08-26T09:24:20.690 INFO:teuthology.orchestra.run.smithi092.stdout: osd scrub max interval = 600 2023-08-26T09:24:20.691 INFO:teuthology.orchestra.run.smithi092.stdout: osd mclock profile = high_recovery_ops 2023-08-26T09:24:20.691 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:24:20.691 INFO:teuthology.orchestra.run.smithi092.stdout: osd recover clone overlap = true 2023-08-26T09:24:20.692 INFO:teuthology.orchestra.run.smithi092.stdout: osd recovery max chunk = 1048576 2023-08-26T09:24:20.692 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:24:20.692 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug shutdown = true 2023-08-26T09:24:20.693 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug op order = true 2023-08-26T09:24:20.693 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug verify stray on activate = true 2023-08-26T09:24:20.693 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:24:20.694 INFO:teuthology.orchestra.run.smithi092.stdout: osd open classes on start = true 2023-08-26T09:24:20.694 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug pg log writeout = true 2023-08-26T09:24:20.695 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:24:20.695 INFO:teuthology.orchestra.run.smithi092.stdout: osd deep scrub update digest min age = 30 2023-08-26T09:24:20.695 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:24:20.696 INFO:teuthology.orchestra.run.smithi092.stdout: osd map max advance = 10 2023-08-26T09:24:20.697 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:24:20.697 INFO:teuthology.orchestra.run.smithi092.stdout: journal zero on create = true 2023-08-26T09:24:20.697 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:24:20.698 INFO:teuthology.orchestra.run.smithi092.stdout: filestore ondisk finisher threads = 3 2023-08-26T09:24:20.698 INFO:teuthology.orchestra.run.smithi092.stdout: filestore apply finisher threads = 3 2023-08-26T09:24:20.698 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:24:20.699 INFO:teuthology.orchestra.run.smithi092.stdout: bdev debug aio = true 2023-08-26T09:24:20.700 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug misdirected ops = true 2023-08-26T09:24:20.700 INFO:teuthology.orchestra.run.smithi092.stdout: bdev async discard = True 2023-08-26T09:24:20.700 INFO:teuthology.orchestra.run.smithi092.stdout: bdev enable discard = True 2023-08-26T09:24:20.701 INFO:teuthology.orchestra.run.smithi092.stdout: bluestore allocator = bitmap 2023-08-26T09:24:20.701 INFO:teuthology.orchestra.run.smithi092.stdout: bluestore block size = 96636764160 2023-08-26T09:24:20.702 INFO:teuthology.orchestra.run.smithi092.stdout: bluestore fsck on mount = True 2023-08-26T09:24:20.702 INFO:teuthology.orchestra.run.smithi092.stdout: debug bluefs = 1/20 2023-08-26T09:24:20.702 INFO:teuthology.orchestra.run.smithi092.stdout: debug bluestore = 1/20 2023-08-26T09:24:20.703 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2023-08-26T09:24:20.703 INFO:teuthology.orchestra.run.smithi092.stdout: debug osd = 20 2023-08-26T09:24:20.703 INFO:teuthology.orchestra.run.smithi092.stdout: debug rocksdb = 4/10 2023-08-26T09:24:20.704 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd backfillfull_ratio = 0.85 2023-08-26T09:24:20.704 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd full ratio = 0.9 2023-08-26T09:24:20.704 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd nearfull ratio = 0.8 2023-08-26T09:24:20.705 INFO:teuthology.orchestra.run.smithi092.stdout: osd failsafe full ratio = 0.95 2023-08-26T09:24:20.705 INFO:teuthology.orchestra.run.smithi092.stdout: osd objectstore = bluestore 2023-08-26T09:24:20.705 INFO:teuthology.orchestra.run.smithi092.stdout: osd op complaint time = 180 2023-08-26T09:24:20.706 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:24:20.706 INFO:teuthology.orchestra.run.smithi092.stdout:[mgr] 2023-08-26T09:24:20.706 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2023-08-26T09:24:20.707 INFO:teuthology.orchestra.run.smithi092.stdout: debug mgr = 20 2023-08-26T09:24:20.707 INFO:teuthology.orchestra.run.smithi092.stdout: debug mon = 20 2023-08-26T09:24:20.708 INFO:teuthology.orchestra.run.smithi092.stdout: debug auth = 20 2023-08-26T09:24:20.708 INFO:teuthology.orchestra.run.smithi092.stdout: mon reweight min pgs per osd = 4 2023-08-26T09:24:20.708 INFO:teuthology.orchestra.run.smithi092.stdout: mon reweight min bytes per osd = 10 2023-08-26T09:24:20.709 INFO:teuthology.orchestra.run.smithi092.stdout: mgr/telemetry/nag = false 2023-08-26T09:24:20.709 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:24:20.710 INFO:teuthology.orchestra.run.smithi092.stdout:[mon] 2023-08-26T09:24:20.710 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2023-08-26T09:24:20.710 INFO:teuthology.orchestra.run.smithi092.stdout: debug mon = 20 2023-08-26T09:24:20.711 INFO:teuthology.orchestra.run.smithi092.stdout: debug paxos = 20 2023-08-26T09:24:20.711 INFO:teuthology.orchestra.run.smithi092.stdout: debug auth = 20 2023-08-26T09:24:20.712 INFO:teuthology.orchestra.run.smithi092.stdout: mon data avail warn = 5 2023-08-26T09:24:20.712 INFO:teuthology.orchestra.run.smithi092.stdout: mon mgr mkfs grace = 240 2023-08-26T09:24:20.712 INFO:teuthology.orchestra.run.smithi092.stdout: mon reweight min pgs per osd = 4 2023-08-26T09:24:20.713 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd reporter subtree level = osd 2023-08-26T09:24:20.713 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd prime pg temp = true 2023-08-26T09:24:20.713 INFO:teuthology.orchestra.run.smithi092.stdout: mon reweight min bytes per osd = 10 2023-08-26T09:24:20.714 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:24:20.714 INFO:teuthology.orchestra.run.smithi092.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-26T09:24:20.714 INFO:teuthology.orchestra.run.smithi092.stdout: auth mon ticket ttl = 660 # 11m 2023-08-26T09:24:20.715 INFO:teuthology.orchestra.run.smithi092.stdout: auth service ticket ttl = 240 # 4m 2023-08-26T09:24:20.715 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:24:20.716 INFO:teuthology.orchestra.run.smithi092.stdout: # don't complain about insecure global_id in the test suite 2023-08-26T09:24:20.716 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-26T09:24:20.716 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-26T09:24:20.717 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:24:20.717 INFO:teuthology.orchestra.run.smithi092.stdout: # 1m isn't quite enough 2023-08-26T09:24:20.717 INFO:teuthology.orchestra.run.smithi092.stdout: mon_down_mkfs_grace = 2m 2023-08-26T09:24:20.718 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:24:20.718 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_filestore_osds = false 2023-08-26T09:24:20.718 INFO:teuthology.orchestra.run.smithi092.stdout: mon op complaint time = 120 2023-08-26T09:24:20.719 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:24:20.719 INFO:teuthology.orchestra.run.smithi092.stdout:[client] 2023-08-26T09:24:20.719 INFO:teuthology.orchestra.run.smithi092.stdout: rgw cache enabled = true 2023-08-26T09:24:20.720 INFO:teuthology.orchestra.run.smithi092.stdout: rgw enable ops log = true 2023-08-26T09:24:20.720 INFO:teuthology.orchestra.run.smithi092.stdout: rgw enable usage log = true 2023-08-26T09:24:20.721 INFO:teuthology.orchestra.run.smithi092.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-26T09:24:20.721 INFO:teuthology.orchestra.run.smithi092.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-26T09:24:20.721 INFO:teuthology.orchestra.run.smithi092.stdout: client mount timeout = 600 2023-08-26T09:24:20.722 INFO:teuthology.orchestra.run.smithi092.stdout: debug client = 20 2023-08-26T09:24:20.722 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2023-08-26T09:24:20.723 INFO:teuthology.orchestra.run.smithi092.stdout: pid file = "" 2023-08-26T09:24:20.723 INFO:teuthology.orchestra.run.smithi092.stdout: rados mon op timeout = 900 2023-08-26T09:24:20.723 INFO:teuthology.orchestra.run.smithi092.stdout: rados osd op timeout = 900 2023-08-26T09:24:20.724 INFO:teuthology.orchestra.run.smithi092.stdout:[mon.a] 2023-08-26T09:24:20.724 INFO:teuthology.orchestra.run.smithi092.stdout:[mon.b] 2023-08-26T09:24:20.724 INFO:teuthology.orchestra.run.smithi092.stdout:[mon.c] 2023-08-26T09:24:20.725 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.a] 2023-08-26T09:24:20.725 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.c] 2023-08-26T09:24:20.725 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.b] 2023-08-26T09:24:20.726 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.d] 2023-08-26T09:24:20.726 INFO:teuthology.orchestra.run.smithi092.stdout:[mds] 2023-08-26T09:24:20.726 INFO:teuthology.orchestra.run.smithi092.stdout: debug mds = 20 2023-08-26T09:24:20.727 INFO:teuthology.orchestra.run.smithi092.stdout: debug mds balancer = 20 2023-08-26T09:24:20.727 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2023-08-26T09:24:20.727 INFO:teuthology.orchestra.run.smithi092.stdout: mds debug frag = True 2023-08-26T09:24:20.728 INFO:teuthology.orchestra.run.smithi092.stdout: mds debug scatterstat = True 2023-08-26T09:24:20.728 INFO:teuthology.orchestra.run.smithi092.stdout: mds op complaint time = 180 2023-08-26T09:24:20.728 INFO:teuthology.orchestra.run.smithi092.stdout: mds verify scatter = True 2023-08-26T09:24:20.729 INFO:teuthology.orchestra.run.smithi092.stdout: osd op complaint time = 180 2023-08-26T09:24:20.729 INFO:teuthology.orchestra.run.smithi092.stdout: rados mon op timeout = 900 2023-08-26T09:24:20.729 INFO:teuthology.orchestra.run.smithi092.stdout: rados osd op timeout = 900 2023-08-26T09:24:20.732 INFO:teuthology.orchestra.run.smithi188.stdout:[global] 2023-08-26T09:24:20.733 INFO:teuthology.orchestra.run.smithi188.stdout: chdir = "" 2023-08-26T09:24:20.733 INFO:teuthology.orchestra.run.smithi188.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-26T09:24:20.733 INFO:teuthology.orchestra.run.smithi188.stdout: auth supported = cephx 2023-08-26T09:24:20.734 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-08-26T09:24:20.734 INFO:teuthology.orchestra.run.smithi188.stdout: filestore xattr use omap = true 2023-08-26T09:24:20.734 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-08-26T09:24:20.734 INFO:teuthology.orchestra.run.smithi188.stdout: mon clock drift allowed = 1.000 2023-08-26T09:24:20.735 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-08-26T09:24:20.735 INFO:teuthology.orchestra.run.smithi188.stdout: osd crush chooseleaf type = 0 2023-08-26T09:24:20.735 INFO:teuthology.orchestra.run.smithi188.stdout: auth debug = true 2023-08-26T09:24:20.735 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-08-26T09:24:20.736 INFO:teuthology.orchestra.run.smithi188.stdout: ms die on old message = true 2023-08-26T09:24:20.736 INFO:teuthology.orchestra.run.smithi188.stdout: ms die on bug = true 2023-08-26T09:24:20.736 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-08-26T09:24:20.736 INFO:teuthology.orchestra.run.smithi188.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-26T09:24:20.737 INFO:teuthology.orchestra.run.smithi188.stdout: mon pg warn max object skew = 0 2023-08-26T09:24:20.737 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-08-26T09:24:20.737 INFO:teuthology.orchestra.run.smithi188.stdout: # disable pg_autoscaler by default for new pools 2023-08-26T09:24:20.737 INFO:teuthology.orchestra.run.smithi188.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-26T09:24:20.738 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-08-26T09:24:20.738 INFO:teuthology.orchestra.run.smithi188.stdout: osd pool default size = 2 2023-08-26T09:24:20.738 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-08-26T09:24:20.739 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd allow primary affinity = true 2023-08-26T09:24:20.739 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd allow pg remap = true 2023-08-26T09:24:20.740 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on legacy crush tunables = false 2023-08-26T09:24:20.740 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on crush straw calc version zero = false 2023-08-26T09:24:20.740 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on no sortbitwise = false 2023-08-26T09:24:20.741 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on osd down out interval zero = false 2023-08-26T09:24:20.741 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on too few osds = false 2023-08-26T09:24:20.741 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-26T09:24:20.741 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-26T09:24:20.741 INFO:teuthology.orchestra.run.smithi188.stdout: mon_allow_pool_size_one = true 2023-08-26T09:24:20.742 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-08-26T09:24:20.742 INFO:teuthology.orchestra.run.smithi188.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-08-26T09:24:20.742 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-08-26T09:24:20.742 INFO:teuthology.orchestra.run.smithi188.stdout: osd default data pool replay window = 5 2023-08-26T09:24:20.743 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-08-26T09:24:20.743 INFO:teuthology.orchestra.run.smithi188.stdout: mon allow pool delete = true 2023-08-26T09:24:20.743 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-08-26T09:24:20.743 INFO:teuthology.orchestra.run.smithi188.stdout: mon cluster log file level = debug 2023-08-26T09:24:20.743 INFO:teuthology.orchestra.run.smithi188.stdout: debug asserts on shutdown = true 2023-08-26T09:24:20.744 INFO:teuthology.orchestra.run.smithi188.stdout: mon health detail to clog = false 2023-08-26T09:24:20.744 INFO:teuthology.orchestra.run.smithi188.stdout: mon host = "172.21.15.92,172.21.15.188,[v2:172.21.15.188:3301,v1:172.21.15.188:6790]" 2023-08-26T09:24:20.745 INFO:teuthology.orchestra.run.smithi188.stdout: fsid = 254a2d31-bd41-4507-8326-1b205ac24377 2023-08-26T09:24:20.745 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-08-26T09:24:20.745 INFO:teuthology.orchestra.run.smithi188.stdout:[osd] 2023-08-26T09:24:20.745 INFO:teuthology.orchestra.run.smithi188.stdout: osd journal size = 100 2023-08-26T09:24:20.746 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-08-26T09:24:20.746 INFO:teuthology.orchestra.run.smithi188.stdout: osd scrub load threshold = 5.0 2023-08-26T09:24:20.746 INFO:teuthology.orchestra.run.smithi188.stdout: osd scrub max interval = 600 2023-08-26T09:24:20.746 INFO:teuthology.orchestra.run.smithi188.stdout: osd mclock profile = high_recovery_ops 2023-08-26T09:24:20.747 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-08-26T09:24:20.747 INFO:teuthology.orchestra.run.smithi188.stdout: osd recover clone overlap = true 2023-08-26T09:24:20.747 INFO:teuthology.orchestra.run.smithi188.stdout: osd recovery max chunk = 1048576 2023-08-26T09:24:20.747 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-08-26T09:24:20.748 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug shutdown = true 2023-08-26T09:24:20.748 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug op order = true 2023-08-26T09:24:20.748 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug verify stray on activate = true 2023-08-26T09:24:20.749 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-08-26T09:24:20.749 INFO:teuthology.orchestra.run.smithi188.stdout: osd open classes on start = true 2023-08-26T09:24:20.749 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug pg log writeout = true 2023-08-26T09:24:20.749 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-08-26T09:24:20.750 INFO:teuthology.orchestra.run.smithi188.stdout: osd deep scrub update digest min age = 30 2023-08-26T09:24:20.750 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-08-26T09:24:20.750 INFO:teuthology.orchestra.run.smithi188.stdout: osd map max advance = 10 2023-08-26T09:24:20.750 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-08-26T09:24:20.751 INFO:teuthology.orchestra.run.smithi188.stdout: journal zero on create = true 2023-08-26T09:24:20.751 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-08-26T09:24:20.752 INFO:teuthology.orchestra.run.smithi188.stdout: filestore ondisk finisher threads = 3 2023-08-26T09:24:20.752 INFO:teuthology.orchestra.run.smithi188.stdout: filestore apply finisher threads = 3 2023-08-26T09:24:20.752 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-08-26T09:24:20.753 INFO:teuthology.orchestra.run.smithi188.stdout: bdev debug aio = true 2023-08-26T09:24:20.753 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug misdirected ops = true 2023-08-26T09:24:20.753 INFO:teuthology.orchestra.run.smithi188.stdout: bdev async discard = True 2023-08-26T09:24:20.754 INFO:teuthology.orchestra.run.smithi188.stdout: bdev enable discard = True 2023-08-26T09:24:20.754 INFO:teuthology.orchestra.run.smithi188.stdout: bluestore allocator = bitmap 2023-08-26T09:24:20.754 INFO:teuthology.orchestra.run.smithi188.stdout: bluestore block size = 96636764160 2023-08-26T09:24:20.754 INFO:teuthology.orchestra.run.smithi188.stdout: bluestore fsck on mount = True 2023-08-26T09:24:20.755 INFO:teuthology.orchestra.run.smithi188.stdout: debug bluefs = 1/20 2023-08-26T09:24:20.755 INFO:teuthology.orchestra.run.smithi188.stdout: debug bluestore = 1/20 2023-08-26T09:24:20.755 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2023-08-26T09:24:20.755 INFO:teuthology.orchestra.run.smithi188.stdout: debug osd = 20 2023-08-26T09:24:20.755 INFO:teuthology.orchestra.run.smithi188.stdout: debug rocksdb = 4/10 2023-08-26T09:24:20.756 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd backfillfull_ratio = 0.85 2023-08-26T09:24:20.756 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd full ratio = 0.9 2023-08-26T09:24:20.756 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd nearfull ratio = 0.8 2023-08-26T09:24:20.756 INFO:teuthology.orchestra.run.smithi188.stdout: osd failsafe full ratio = 0.95 2023-08-26T09:24:20.756 INFO:teuthology.orchestra.run.smithi188.stdout: osd objectstore = bluestore 2023-08-26T09:24:20.757 INFO:teuthology.orchestra.run.smithi188.stdout: osd op complaint time = 180 2023-08-26T09:24:20.757 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-08-26T09:24:20.757 INFO:teuthology.orchestra.run.smithi188.stdout:[mgr] 2023-08-26T09:24:20.757 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2023-08-26T09:24:20.757 INFO:teuthology.orchestra.run.smithi188.stdout: debug mgr = 20 2023-08-26T09:24:20.758 INFO:teuthology.orchestra.run.smithi188.stdout: debug mon = 20 2023-08-26T09:24:20.758 INFO:teuthology.orchestra.run.smithi188.stdout: debug auth = 20 2023-08-26T09:24:20.758 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min pgs per osd = 4 2023-08-26T09:24:20.758 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min bytes per osd = 10 2023-08-26T09:24:20.758 INFO:teuthology.orchestra.run.smithi188.stdout: mgr/telemetry/nag = false 2023-08-26T09:24:20.758 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-08-26T09:24:20.759 INFO:teuthology.orchestra.run.smithi188.stdout:[mon] 2023-08-26T09:24:20.759 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2023-08-26T09:24:20.759 INFO:teuthology.orchestra.run.smithi188.stdout: debug mon = 20 2023-08-26T09:24:20.759 INFO:teuthology.orchestra.run.smithi188.stdout: debug paxos = 20 2023-08-26T09:24:20.759 INFO:teuthology.orchestra.run.smithi188.stdout: debug auth = 20 2023-08-26T09:24:20.760 INFO:teuthology.orchestra.run.smithi188.stdout: mon data avail warn = 5 2023-08-26T09:24:20.760 INFO:teuthology.orchestra.run.smithi188.stdout: mon mgr mkfs grace = 240 2023-08-26T09:24:20.760 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min pgs per osd = 4 2023-08-26T09:24:20.761 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd reporter subtree level = osd 2023-08-26T09:24:20.761 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd prime pg temp = true 2023-08-26T09:24:20.761 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min bytes per osd = 10 2023-08-26T09:24:20.761 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-08-26T09:24:20.762 INFO:teuthology.orchestra.run.smithi188.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-26T09:24:20.762 INFO:teuthology.orchestra.run.smithi188.stdout: auth mon ticket ttl = 660 # 11m 2023-08-26T09:24:20.762 INFO:teuthology.orchestra.run.smithi188.stdout: auth service ticket ttl = 240 # 4m 2023-08-26T09:24:20.762 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-08-26T09:24:20.762 INFO:teuthology.orchestra.run.smithi188.stdout: # don't complain about insecure global_id in the test suite 2023-08-26T09:24:20.763 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-26T09:24:20.763 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-26T09:24:20.763 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-08-26T09:24:20.763 INFO:teuthology.orchestra.run.smithi188.stdout: # 1m isn't quite enough 2023-08-26T09:24:20.763 INFO:teuthology.orchestra.run.smithi188.stdout: mon_down_mkfs_grace = 2m 2023-08-26T09:24:20.764 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-08-26T09:24:20.764 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_filestore_osds = false 2023-08-26T09:24:20.764 INFO:teuthology.orchestra.run.smithi188.stdout: mon op complaint time = 120 2023-08-26T09:24:20.765 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-08-26T09:24:20.765 INFO:teuthology.orchestra.run.smithi188.stdout:[client] 2023-08-26T09:24:20.765 INFO:teuthology.orchestra.run.smithi188.stdout: rgw cache enabled = true 2023-08-26T09:24:20.765 INFO:teuthology.orchestra.run.smithi188.stdout: rgw enable ops log = true 2023-08-26T09:24:20.766 INFO:teuthology.orchestra.run.smithi188.stdout: rgw enable usage log = true 2023-08-26T09:24:20.766 INFO:teuthology.orchestra.run.smithi188.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-26T09:24:20.766 INFO:teuthology.orchestra.run.smithi188.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-26T09:24:20.767 INFO:teuthology.orchestra.run.smithi188.stdout: client mount timeout = 600 2023-08-26T09:24:20.767 INFO:teuthology.orchestra.run.smithi188.stdout: debug client = 20 2023-08-26T09:24:20.767 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2023-08-26T09:24:20.768 INFO:teuthology.orchestra.run.smithi188.stdout: pid file = "" 2023-08-26T09:24:20.768 INFO:teuthology.orchestra.run.smithi188.stdout: rados mon op timeout = 900 2023-08-26T09:24:20.768 INFO:teuthology.orchestra.run.smithi188.stdout: rados osd op timeout = 900 2023-08-26T09:24:20.769 INFO:teuthology.orchestra.run.smithi188.stdout:[mon.a] 2023-08-26T09:24:20.769 INFO:teuthology.orchestra.run.smithi188.stdout:[mon.b] 2023-08-26T09:24:20.769 INFO:teuthology.orchestra.run.smithi188.stdout:[mon.c] 2023-08-26T09:24:20.770 INFO:teuthology.orchestra.run.smithi188.stdout:[mds.a] 2023-08-26T09:24:20.770 INFO:teuthology.orchestra.run.smithi188.stdout:[mds.c] 2023-08-26T09:24:20.770 INFO:teuthology.orchestra.run.smithi188.stdout:[mds.b] 2023-08-26T09:24:20.771 INFO:teuthology.orchestra.run.smithi188.stdout:[mds.d] 2023-08-26T09:24:20.771 INFO:teuthology.orchestra.run.smithi188.stdout:[mds] 2023-08-26T09:24:20.771 INFO:teuthology.orchestra.run.smithi188.stdout: debug mds = 20 2023-08-26T09:24:20.772 INFO:teuthology.orchestra.run.smithi188.stdout: debug mds balancer = 20 2023-08-26T09:24:20.772 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2023-08-26T09:24:20.772 INFO:teuthology.orchestra.run.smithi188.stdout: mds debug frag = True 2023-08-26T09:24:20.772 INFO:teuthology.orchestra.run.smithi188.stdout: mds debug scatterstat = True 2023-08-26T09:24:20.772 INFO:teuthology.orchestra.run.smithi188.stdout: mds op complaint time = 180 2023-08-26T09:24:20.773 INFO:teuthology.orchestra.run.smithi188.stdout: mds verify scatter = True 2023-08-26T09:24:20.773 INFO:teuthology.orchestra.run.smithi188.stdout: osd op complaint time = 180 2023-08-26T09:24:20.773 INFO:teuthology.orchestra.run.smithi188.stdout: rados mon op timeout = 900 2023-08-26T09:24:20.773 INFO:teuthology.orchestra.run.smithi188.stdout: rados osd op timeout = 900 2023-08-26T09:24:20.774 INFO:tasks.ceph:Creating admin key on mon.a... 2023-08-26T09:24:20.774 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-08-26T09:24:20.831 INFO:tasks.ceph:Copying monmap to all nodes... 2023-08-26T09:24:20.831 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-08-26T09:24:20.832 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-08-26T09:24:20.849 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-08-26T09:24:20.849 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-08-26T09:24:20.905 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi092.front.sepia.ceph.com 2023-08-26T09:24:20.906 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-08-26T09:24:20.906 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/ceph/ceph.keyring 2023-08-26T09:24:20.906 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-26T09:24:20.981 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-08-26T09:24:20.982 DEBUG:teuthology.orchestra.run.smithi092:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-08-26T09:24:21.038 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi188.front.sepia.ceph.com 2023-08-26T09:24:21.039 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-08-26T09:24:21.039 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/ceph/ceph.keyring 2023-08-26T09:24:21.039 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-26T09:24:21.081 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-08-26T09:24:21.081 DEBUG:teuthology.orchestra.run.smithi188:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-08-26T09:24:21.136 INFO:tasks.ceph:Setting up mon nodes... 2023-08-26T09:24:21.137 INFO:tasks.ceph:Setting up mgr nodes... 2023-08-26T09:24:21.137 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-08-26T09:24:21.190 INFO:teuthology.orchestra.run.smithi092.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-08-26T09:24:21.192 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-08-26T09:24:21.266 INFO:teuthology.orchestra.run.smithi188.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-08-26T09:24:21.268 INFO:tasks.ceph:Setting up mds nodes... 2023-08-26T09:24:21.269 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-08-26T09:24:21.325 INFO:teuthology.orchestra.run.smithi092.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-08-26T09:24:21.326 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-08-26T09:24:21.356 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-08-26T09:24:21.453 INFO:teuthology.orchestra.run.smithi092.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-08-26T09:24:21.455 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-08-26T09:24:21.481 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-08-26T09:24:21.539 INFO:teuthology.orchestra.run.smithi188.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-08-26T09:24:21.540 DEBUG:teuthology.orchestra.run.smithi188:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-08-26T09:24:21.570 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-08-26T09:24:21.667 INFO:teuthology.orchestra.run.smithi188.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-08-26T09:24:21.669 DEBUG:teuthology.orchestra.run.smithi188:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-08-26T09:24:21.697 INFO:tasks.ceph_client:Setting up client nodes... 2023-08-26T09:24:21.698 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-08-26T09:24:21.743 INFO:teuthology.orchestra.run.smithi092.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-08-26T09:24:21.755 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-08-26T09:24:21.838 INFO:teuthology.orchestra.run.smithi092.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-08-26T09:24:21.851 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-08-26T09:24:21.894 INFO:teuthology.orchestra.run.smithi188.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-08-26T09:24:21.907 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-08-26T09:24:21.989 INFO:teuthology.orchestra.run.smithi188.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-08-26T09:24:22.002 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-08-26T09:24:22.002 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi092.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi188.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-08-26T09:24:22.003 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-08-26T09:24:22.031 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-26T09:24:22.031 INFO:tasks.ceph:role: osd.0 2023-08-26T09:24:22.031 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi092.front.sepia.ceph.com 2023-08-26T09:24:22.032 DEBUG:teuthology.orchestra.run.smithi092:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-08-26T09:24:22.105 INFO:teuthology.orchestra.run.smithi092.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-08-26T09:24:22.105 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-26T09:24:22.105 INFO:teuthology.orchestra.run.smithi092.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-26T09:24:22.105 INFO:teuthology.orchestra.run.smithi092.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-26T09:24:22.106 INFO:teuthology.orchestra.run.smithi092.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-26T09:24:22.106 INFO:teuthology.orchestra.run.smithi092.stdout: = sunit=0 swidth=0 blks 2023-08-26T09:24:22.106 INFO:teuthology.orchestra.run.smithi092.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-26T09:24:22.106 INFO:teuthology.orchestra.run.smithi092.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-26T09:24:22.106 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-26T09:24:22.107 INFO:teuthology.orchestra.run.smithi092.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-26T09:24:22.540 INFO:teuthology.orchestra.run.smithi092.stdout:Discarding blocks...Done. 2023-08-26T09:24:22.542 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi092.front.sepia.ceph.com -o noatime 2023-08-26T09:24:22.542 DEBUG:teuthology.orchestra.run.smithi092:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-08-26T09:24:22.741 DEBUG:teuthology.orchestra.run.smithi092:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-08-26T09:24:22.779 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-08-26T09:24:22.849 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-26T09:24:22.849 INFO:tasks.ceph:role: osd.1 2023-08-26T09:24:22.850 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi092.front.sepia.ceph.com 2023-08-26T09:24:22.850 DEBUG:teuthology.orchestra.run.smithi092:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-08-26T09:24:22.924 INFO:teuthology.orchestra.run.smithi092.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-08-26T09:24:22.925 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-26T09:24:22.925 INFO:teuthology.orchestra.run.smithi092.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-26T09:24:22.925 INFO:teuthology.orchestra.run.smithi092.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-26T09:24:22.925 INFO:teuthology.orchestra.run.smithi092.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-26T09:24:22.925 INFO:teuthology.orchestra.run.smithi092.stdout: = sunit=0 swidth=0 blks 2023-08-26T09:24:22.926 INFO:teuthology.orchestra.run.smithi092.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-26T09:24:22.926 INFO:teuthology.orchestra.run.smithi092.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-26T09:24:22.926 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-26T09:24:22.926 INFO:teuthology.orchestra.run.smithi092.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-26T09:24:23.346 INFO:teuthology.orchestra.run.smithi092.stdout:Discarding blocks...Done. 2023-08-26T09:24:23.348 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi092.front.sepia.ceph.com -o noatime 2023-08-26T09:24:23.348 DEBUG:teuthology.orchestra.run.smithi092:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-08-26T09:24:23.465 DEBUG:teuthology.orchestra.run.smithi092:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-08-26T09:24:23.501 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-08-26T09:24:23.574 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-26T09:24:23.575 INFO:tasks.ceph:role: osd.2 2023-08-26T09:24:23.575 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi092.front.sepia.ceph.com 2023-08-26T09:24:23.576 DEBUG:teuthology.orchestra.run.smithi092:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-08-26T09:24:23.655 INFO:teuthology.orchestra.run.smithi092.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-08-26T09:24:23.655 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-26T09:24:23.655 INFO:teuthology.orchestra.run.smithi092.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-26T09:24:23.656 INFO:teuthology.orchestra.run.smithi092.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-26T09:24:23.656 INFO:teuthology.orchestra.run.smithi092.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-26T09:24:23.656 INFO:teuthology.orchestra.run.smithi092.stdout: = sunit=0 swidth=0 blks 2023-08-26T09:24:23.656 INFO:teuthology.orchestra.run.smithi092.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-26T09:24:23.656 INFO:teuthology.orchestra.run.smithi092.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-26T09:24:23.657 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-26T09:24:23.657 INFO:teuthology.orchestra.run.smithi092.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-26T09:24:24.105 INFO:teuthology.orchestra.run.smithi092.stdout:Discarding blocks...Done. 2023-08-26T09:24:24.107 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi092.front.sepia.ceph.com -o noatime 2023-08-26T09:24:24.107 DEBUG:teuthology.orchestra.run.smithi092:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-08-26T09:24:24.285 DEBUG:teuthology.orchestra.run.smithi092:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-08-26T09:24:24.324 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-08-26T09:24:24.396 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-26T09:24:24.397 INFO:tasks.ceph:role: osd.3 2023-08-26T09:24:24.397 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi092.front.sepia.ceph.com 2023-08-26T09:24:24.397 DEBUG:teuthology.orchestra.run.smithi092:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-08-26T09:24:24.475 INFO:teuthology.orchestra.run.smithi092.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-08-26T09:24:24.476 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-26T09:24:24.476 INFO:teuthology.orchestra.run.smithi092.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-26T09:24:24.476 INFO:teuthology.orchestra.run.smithi092.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-26T09:24:24.476 INFO:teuthology.orchestra.run.smithi092.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-26T09:24:24.476 INFO:teuthology.orchestra.run.smithi092.stdout: = sunit=0 swidth=0 blks 2023-08-26T09:24:24.477 INFO:teuthology.orchestra.run.smithi092.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-26T09:24:24.477 INFO:teuthology.orchestra.run.smithi092.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-26T09:24:24.477 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-26T09:24:24.477 INFO:teuthology.orchestra.run.smithi092.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-26T09:24:24.899 INFO:teuthology.orchestra.run.smithi092.stdout:Discarding blocks...Done. 2023-08-26T09:24:24.901 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi092.front.sepia.ceph.com -o noatime 2023-08-26T09:24:24.901 DEBUG:teuthology.orchestra.run.smithi092:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-08-26T09:24:25.076 DEBUG:teuthology.orchestra.run.smithi092:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-08-26T09:24:25.114 DEBUG:teuthology.orchestra.run.smithi092:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-26T09:24:25.226 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:25.221+0000 7f65669bb640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-08-26T09:24:25.227 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:25.222+0000 7f65669bb640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-08-26T09:24:25.227 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:25.222+0000 7f65669bb640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-26T09:24:25.227 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:25.222+0000 7f65669bb640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-26T09:24:25.227 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:25.222+0000 7f65669bb640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-26T09:24:25.228 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:25.222+0000 7f65669bb640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-08-26T09:24:28.095 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-08-26T09:24:28.128 DEBUG:teuthology.orchestra.run.smithi092:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-26T09:24:28.224 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:28.218+0000 7facc4763640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-08-26T09:24:28.224 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:28.218+0000 7facc4763640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-08-26T09:24:28.224 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:28.218+0000 7facc4763640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-26T09:24:28.224 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:28.218+0000 7facc4763640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-26T09:24:28.225 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:28.218+0000 7facc4763640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-26T09:24:28.225 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:28.219+0000 7facc4763640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-08-26T09:24:31.102 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-08-26T09:24:31.137 DEBUG:teuthology.orchestra.run.smithi092:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-26T09:24:31.234 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:31.226+0000 7f49c8c55640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-08-26T09:24:31.234 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:31.227+0000 7f49c8c55640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-08-26T09:24:31.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:31.227+0000 7f49c8c55640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-26T09:24:31.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:31.227+0000 7f49c8c55640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-26T09:24:31.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:31.227+0000 7f49c8c55640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-26T09:24:31.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:31.227+0000 7f49c8c55640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-08-26T09:24:34.105 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-08-26T09:24:34.138 DEBUG:teuthology.orchestra.run.smithi092:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-26T09:24:34.234 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:34.228+0000 7fb44f332640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-08-26T09:24:34.234 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:34.228+0000 7fb44f332640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-08-26T09:24:34.234 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:34.228+0000 7fb44f332640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-08-26T09:24:34.234 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:34.228+0000 7fb44f332640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-08-26T09:24:34.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:34.228+0000 7fb44f332640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-08-26T09:24:34.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:34.229+0000 7fb44f332640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-08-26T09:24:37.095 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-08-26T09:24:37.135 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-08-26T09:24:37.170 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-26T09:24:37.170 INFO:tasks.ceph:role: osd.4 2023-08-26T09:24:37.171 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi188.front.sepia.ceph.com 2023-08-26T09:24:37.171 DEBUG:teuthology.orchestra.run.smithi188:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-08-26T09:24:37.250 INFO:teuthology.orchestra.run.smithi188.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-08-26T09:24:37.251 INFO:teuthology.orchestra.run.smithi188.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-26T09:24:37.251 INFO:teuthology.orchestra.run.smithi188.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-26T09:24:37.251 INFO:teuthology.orchestra.run.smithi188.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-26T09:24:37.251 INFO:teuthology.orchestra.run.smithi188.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-26T09:24:37.252 INFO:teuthology.orchestra.run.smithi188.stdout: = sunit=0 swidth=0 blks 2023-08-26T09:24:37.252 INFO:teuthology.orchestra.run.smithi188.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-26T09:24:37.252 INFO:teuthology.orchestra.run.smithi188.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-26T09:24:37.252 INFO:teuthology.orchestra.run.smithi188.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-26T09:24:37.252 INFO:teuthology.orchestra.run.smithi188.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-26T09:24:37.681 INFO:teuthology.orchestra.run.smithi188.stdout:Discarding blocks...Done. 2023-08-26T09:24:37.683 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi188.front.sepia.ceph.com -o noatime 2023-08-26T09:24:37.683 DEBUG:teuthology.orchestra.run.smithi188:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-08-26T09:24:37.871 DEBUG:teuthology.orchestra.run.smithi188:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-08-26T09:24:37.952 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-08-26T09:24:38.026 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-26T09:24:38.027 INFO:tasks.ceph:role: osd.5 2023-08-26T09:24:38.027 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi188.front.sepia.ceph.com 2023-08-26T09:24:38.027 DEBUG:teuthology.orchestra.run.smithi188:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-08-26T09:24:38.106 INFO:teuthology.orchestra.run.smithi188.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-08-26T09:24:38.107 INFO:teuthology.orchestra.run.smithi188.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-26T09:24:38.107 INFO:teuthology.orchestra.run.smithi188.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-26T09:24:38.107 INFO:teuthology.orchestra.run.smithi188.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-26T09:24:38.107 INFO:teuthology.orchestra.run.smithi188.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-26T09:24:38.108 INFO:teuthology.orchestra.run.smithi188.stdout: = sunit=0 swidth=0 blks 2023-08-26T09:24:38.108 INFO:teuthology.orchestra.run.smithi188.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-26T09:24:38.108 INFO:teuthology.orchestra.run.smithi188.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-26T09:24:38.108 INFO:teuthology.orchestra.run.smithi188.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-26T09:24:38.108 INFO:teuthology.orchestra.run.smithi188.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-26T09:24:38.528 INFO:teuthology.orchestra.run.smithi188.stdout:Discarding blocks...Done. 2023-08-26T09:24:38.530 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi188.front.sepia.ceph.com -o noatime 2023-08-26T09:24:38.531 DEBUG:teuthology.orchestra.run.smithi188:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-08-26T09:24:38.652 DEBUG:teuthology.orchestra.run.smithi188:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-08-26T09:24:38.688 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-08-26T09:24:38.758 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-26T09:24:38.758 INFO:tasks.ceph:role: osd.6 2023-08-26T09:24:38.759 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi188.front.sepia.ceph.com 2023-08-26T09:24:38.759 DEBUG:teuthology.orchestra.run.smithi188:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-08-26T09:24:38.833 INFO:teuthology.orchestra.run.smithi188.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-08-26T09:24:38.833 INFO:teuthology.orchestra.run.smithi188.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-26T09:24:38.833 INFO:teuthology.orchestra.run.smithi188.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-26T09:24:38.834 INFO:teuthology.orchestra.run.smithi188.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-26T09:24:38.834 INFO:teuthology.orchestra.run.smithi188.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-26T09:24:38.834 INFO:teuthology.orchestra.run.smithi188.stdout: = sunit=0 swidth=0 blks 2023-08-26T09:24:38.834 INFO:teuthology.orchestra.run.smithi188.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-26T09:24:38.834 INFO:teuthology.orchestra.run.smithi188.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-26T09:24:38.835 INFO:teuthology.orchestra.run.smithi188.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-26T09:24:38.835 INFO:teuthology.orchestra.run.smithi188.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-26T09:24:39.272 INFO:teuthology.orchestra.run.smithi188.stdout:Discarding blocks...Done. 2023-08-26T09:24:39.273 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi188.front.sepia.ceph.com -o noatime 2023-08-26T09:24:39.274 DEBUG:teuthology.orchestra.run.smithi188:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-08-26T09:24:39.423 DEBUG:teuthology.orchestra.run.smithi188:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-08-26T09:24:39.459 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-08-26T09:24:39.528 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-26T09:24:39.528 INFO:tasks.ceph:role: osd.7 2023-08-26T09:24:39.529 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi188.front.sepia.ceph.com 2023-08-26T09:24:39.530 DEBUG:teuthology.orchestra.run.smithi188:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-08-26T09:24:39.603 INFO:teuthology.orchestra.run.smithi188.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-08-26T09:24:39.603 INFO:teuthology.orchestra.run.smithi188.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-26T09:24:39.603 INFO:teuthology.orchestra.run.smithi188.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-26T09:24:39.603 INFO:teuthology.orchestra.run.smithi188.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-26T09:24:39.604 INFO:teuthology.orchestra.run.smithi188.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-26T09:24:39.604 INFO:teuthology.orchestra.run.smithi188.stdout: = sunit=0 swidth=0 blks 2023-08-26T09:24:39.604 INFO:teuthology.orchestra.run.smithi188.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-26T09:24:39.604 INFO:teuthology.orchestra.run.smithi188.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-26T09:24:39.604 INFO:teuthology.orchestra.run.smithi188.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-26T09:24:39.605 INFO:teuthology.orchestra.run.smithi188.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-26T09:24:40.032 INFO:teuthology.orchestra.run.smithi188.stdout:Discarding blocks...Done. 2023-08-26T09:24:40.034 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi188.front.sepia.ceph.com -o noatime 2023-08-26T09:24:40.035 DEBUG:teuthology.orchestra.run.smithi188:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-08-26T09:24:40.212 DEBUG:teuthology.orchestra.run.smithi188:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-08-26T09:24:40.252 DEBUG:teuthology.orchestra.run.smithi188:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-26T09:24:40.376 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:40.370+0000 7fcbda569640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-08-26T09:24:40.376 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:40.371+0000 7fcbda569640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-08-26T09:24:40.377 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:40.371+0000 7fcbda569640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-08-26T09:24:40.377 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:40.371+0000 7fcbda569640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-08-26T09:24:40.377 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:40.371+0000 7fcbda569640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-08-26T09:24:40.377 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:40.371+0000 7fcbda569640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-08-26T09:24:43.251 DEBUG:teuthology.orchestra.run.smithi188:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-08-26T09:24:43.282 DEBUG:teuthology.orchestra.run.smithi188:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-26T09:24:43.374 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:43.369+0000 7f766bf91640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-08-26T09:24:43.375 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:43.369+0000 7f766bf91640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-08-26T09:24:43.375 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:43.369+0000 7f766bf91640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-08-26T09:24:43.375 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:43.369+0000 7f766bf91640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-08-26T09:24:43.376 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:43.369+0000 7f766bf91640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-08-26T09:24:43.376 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:43.370+0000 7f766bf91640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-08-26T09:24:46.240 DEBUG:teuthology.orchestra.run.smithi188:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-08-26T09:24:46.272 DEBUG:teuthology.orchestra.run.smithi188:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-26T09:24:46.364 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:46.358+0000 7fc029db8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-08-26T09:24:46.364 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:46.359+0000 7fc029db8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-08-26T09:24:46.365 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:46.359+0000 7fc029db8640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-08-26T09:24:46.365 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:46.359+0000 7fc029db8640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-08-26T09:24:46.365 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:46.359+0000 7fc029db8640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-08-26T09:24:46.365 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:46.359+0000 7fc029db8640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-08-26T09:24:48.650 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:24:48.653 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:24:49.244 DEBUG:teuthology.orchestra.run.smithi188:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-08-26T09:24:49.276 DEBUG:teuthology.orchestra.run.smithi188:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-26T09:24:49.367 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:49.363+0000 7fd103f57640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-08-26T09:24:49.368 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:49.363+0000 7fd103f57640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-08-26T09:24:49.368 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:49.363+0000 7fd103f57640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-08-26T09:24:49.368 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:49.363+0000 7fd103f57640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-08-26T09:24:49.368 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:49.363+0000 7fd103f57640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-08-26T09:24:49.369 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:49.364+0000 7fd103f57640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-08-26T09:24:52.229 DEBUG:teuthology.orchestra.run.smithi188:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-08-26T09:24:52.260 INFO:tasks.ceph:Reading keys from all nodes... 2023-08-26T09:24:52.261 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-08-26T09:24:52.261 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-08-26T09:24:52.292 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-08-26T09:24:52.292 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-08-26T09:24:52.360 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-08-26T09:24:52.361 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-08-26T09:24:52.429 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-08-26T09:24:52.430 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-08-26T09:24:52.497 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-08-26T09:24:52.497 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-08-26T09:24:52.571 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-08-26T09:24:52.572 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-08-26T09:24:52.646 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-08-26T09:24:52.647 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-08-26T09:24:52.718 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-08-26T09:24:52.718 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-08-26T09:24:52.750 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-08-26T09:24:52.750 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-08-26T09:24:52.825 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-08-26T09:24:52.826 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-08-26T09:24:52.894 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-08-26T09:24:52.894 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-08-26T09:24:52.962 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-08-26T09:24:52.963 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-08-26T09:24:53.031 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-08-26T09:24:53.032 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-08-26T09:24:53.099 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-08-26T09:24:53.099 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-08-26T09:24:53.167 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-08-26T09:24:53.167 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-08-26T09:24:53.185 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-08-26T09:24:53.185 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-08-26T09:24:53.242 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-08-26T09:24:53.242 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-08-26T09:24:53.260 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-08-26T09:24:53.260 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-08-26T09:24:53.316 INFO:tasks.ceph:Adding keys to all mons... 2023-08-26T09:24:53.317 DEBUG:teuthology.orchestra.run.smithi092:> sudo tee -a /etc/ceph/ceph.keyring 2023-08-26T09:24:53.319 DEBUG:teuthology.orchestra.run.smithi188:> sudo tee -a /etc/ceph/ceph.keyring 2023-08-26T09:24:53.359 INFO:teuthology.orchestra.run.smithi092.stdout:[mgr.y] 2023-08-26T09:24:53.360 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQDFxOlkxAAXCxAArEYT91+qQ/8wr0dS3MIr/g== 2023-08-26T09:24:53.360 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.a] 2023-08-26T09:24:53.360 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQDFxOlkk235EhAAe1bNsrK/sxnN0v9i68Bkig== 2023-08-26T09:24:53.360 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.c] 2023-08-26T09:24:53.361 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQDFxOlkb3e9GhAAJJ2EQwJMUjYx+s2CdR6UkQ== 2023-08-26T09:24:53.361 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.0] 2023-08-26T09:24:53.361 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQDJxOlkeK9ADRAACwlDTi42455SHrVCXIz/aQ== 2023-08-26T09:24:53.361 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.1] 2023-08-26T09:24:53.361 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQDMxOlkW4MVDRAADrZXg1hpegqIRjl8iAdcfg== 2023-08-26T09:24:53.362 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.2] 2023-08-26T09:24:53.362 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQDPxOlk4GyaDRAA6iIWUhxJt/z+ZaO4kNu07Q== 2023-08-26T09:24:53.362 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.3] 2023-08-26T09:24:53.362 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQDSxOlkvxyuDRAAA8dq+1Sszcn6NLWSIX/mVA== 2023-08-26T09:24:53.362 INFO:teuthology.orchestra.run.smithi092.stdout:[mgr.x] 2023-08-26T09:24:53.363 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQDFxOlkvYaZDxAATYBkNVAiFxi5AYwHi3YpdA== 2023-08-26T09:24:53.363 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.b] 2023-08-26T09:24:53.363 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQDFxOlkv0TZHxAA01DhL0Wi2cw9T+kq/8ThKg== 2023-08-26T09:24:53.363 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.d] 2023-08-26T09:24:53.363 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQDFxOlkiQmDJxAAzcEI8EcI4yzj3M+emnCq0A== 2023-08-26T09:24:53.364 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.4] 2023-08-26T09:24:53.364 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQDYxOlk+UMtFhAAqyFsW/HEORMMyeuWONnRYg== 2023-08-26T09:24:53.364 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.5] 2023-08-26T09:24:53.364 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQDbxOlkMcIUFhAAPD2/0LQyWcChiPvQyG1svQ== 2023-08-26T09:24:53.365 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.6] 2023-08-26T09:24:53.365 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQDexOlki+11FRAAc4uqUkw9hWvTdJinsBD+IQ== 2023-08-26T09:24:53.365 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.7] 2023-08-26T09:24:53.365 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQDhxOlkQmynFRAAytgvtLQ+RGGftMuzxpuhHA== 2023-08-26T09:24:53.365 INFO:teuthology.orchestra.run.smithi092.stdout:[client.0] 2023-08-26T09:24:53.366 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQDFxOlkZDgMLBAA162qALEz2DZ0yz7kRLRfqQ== 2023-08-26T09:24:53.366 INFO:teuthology.orchestra.run.smithi092.stdout:[client.2] 2023-08-26T09:24:53.366 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQDFxOlkLvy8MRAAy1vhw9ohhnRtkbVH9O/28w== 2023-08-26T09:24:53.366 INFO:teuthology.orchestra.run.smithi092.stdout:[client.1] 2023-08-26T09:24:53.366 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQDFxOlkt8gQNRAABU95s0YzWQj0wd3U3wkIAQ== 2023-08-26T09:24:53.366 INFO:teuthology.orchestra.run.smithi092.stdout:[client.3] 2023-08-26T09:24:53.367 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQDFxOlkO+7COhAAVtrhQc0esLhCiYOmoXaeKw== 2023-08-26T09:24:53.382 INFO:teuthology.orchestra.run.smithi188.stdout:[mgr.y] 2023-08-26T09:24:53.382 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQDFxOlkxAAXCxAArEYT91+qQ/8wr0dS3MIr/g== 2023-08-26T09:24:53.382 INFO:teuthology.orchestra.run.smithi188.stdout:[mds.a] 2023-08-26T09:24:53.383 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQDFxOlkk235EhAAe1bNsrK/sxnN0v9i68Bkig== 2023-08-26T09:24:53.383 INFO:teuthology.orchestra.run.smithi188.stdout:[mds.c] 2023-08-26T09:24:53.383 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQDFxOlkb3e9GhAAJJ2EQwJMUjYx+s2CdR6UkQ== 2023-08-26T09:24:53.383 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.0] 2023-08-26T09:24:53.383 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQDJxOlkeK9ADRAACwlDTi42455SHrVCXIz/aQ== 2023-08-26T09:24:53.384 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.1] 2023-08-26T09:24:53.384 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQDMxOlkW4MVDRAADrZXg1hpegqIRjl8iAdcfg== 2023-08-26T09:24:53.384 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.2] 2023-08-26T09:24:53.384 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQDPxOlk4GyaDRAA6iIWUhxJt/z+ZaO4kNu07Q== 2023-08-26T09:24:53.384 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.3] 2023-08-26T09:24:53.384 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQDSxOlkvxyuDRAAA8dq+1Sszcn6NLWSIX/mVA== 2023-08-26T09:24:53.385 INFO:teuthology.orchestra.run.smithi188.stdout:[mgr.x] 2023-08-26T09:24:53.385 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQDFxOlkvYaZDxAATYBkNVAiFxi5AYwHi3YpdA== 2023-08-26T09:24:53.385 INFO:teuthology.orchestra.run.smithi188.stdout:[mds.b] 2023-08-26T09:24:53.385 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQDFxOlkv0TZHxAA01DhL0Wi2cw9T+kq/8ThKg== 2023-08-26T09:24:53.385 INFO:teuthology.orchestra.run.smithi188.stdout:[mds.d] 2023-08-26T09:24:53.386 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQDFxOlkiQmDJxAAzcEI8EcI4yzj3M+emnCq0A== 2023-08-26T09:24:53.386 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.4] 2023-08-26T09:24:53.386 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQDYxOlk+UMtFhAAqyFsW/HEORMMyeuWONnRYg== 2023-08-26T09:24:53.386 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.5] 2023-08-26T09:24:53.386 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQDbxOlkMcIUFhAAPD2/0LQyWcChiPvQyG1svQ== 2023-08-26T09:24:53.387 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.6] 2023-08-26T09:24:53.387 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQDexOlki+11FRAAc4uqUkw9hWvTdJinsBD+IQ== 2023-08-26T09:24:53.387 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.7] 2023-08-26T09:24:53.387 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQDhxOlkQmynFRAAytgvtLQ+RGGftMuzxpuhHA== 2023-08-26T09:24:53.387 INFO:teuthology.orchestra.run.smithi188.stdout:[client.0] 2023-08-26T09:24:53.388 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQDFxOlkZDgMLBAA162qALEz2DZ0yz7kRLRfqQ== 2023-08-26T09:24:53.388 INFO:teuthology.orchestra.run.smithi188.stdout:[client.2] 2023-08-26T09:24:53.388 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQDFxOlkLvy8MRAAy1vhw9ohhnRtkbVH9O/28w== 2023-08-26T09:24:53.388 INFO:teuthology.orchestra.run.smithi188.stdout:[client.1] 2023-08-26T09:24:53.388 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQDFxOlkt8gQNRAABU95s0YzWQj0wd3U3wkIAQ== 2023-08-26T09:24:53.389 INFO:teuthology.orchestra.run.smithi188.stdout:[client.3] 2023-08-26T09:24:53.389 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQDFxOlkO+7COhAAVtrhQc0esLhCiYOmoXaeKw== 2023-08-26T09:24:53.390 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-26T09:24:53.411 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-26T09:24:53.487 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-26T09:24:53.489 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-26T09:24:53.545 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-26T09:24:53.547 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-26T09:24:53.603 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-26T09:24:53.606 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-26T09:24:53.659 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-26T09:24:53.661 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-26T09:24:53.714 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-26T09:24:53.718 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-26T09:24:53.771 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-26T09:24:53.773 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-26T09:24:53.826 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-26T09:24:53.829 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-26T09:24:53.882 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-26T09:24:53.884 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-26T09:24:53.940 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-26T09:24:53.943 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-26T09:24:54.000 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-26T09:24:54.002 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-26T09:24:54.055 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-26T09:24:54.057 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-26T09:24:54.111 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-26T09:24:54.113 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-26T09:24:54.167 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-26T09:24:54.170 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-26T09:24:54.223 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-26T09:24:54.226 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-26T09:24:54.282 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-26T09:24:54.284 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-26T09:24:54.341 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-26T09:24:54.343 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-26T09:24:54.400 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-26T09:24:54.404 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-26T09:24:54.460 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-08-26T09:24:54.460 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-08-26T09:24:54.486 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-26T09:24:54.583 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-08-26T09:24:54.609 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-08-26T09:24:54.636 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-26T09:24:54.735 DEBUG:teuthology.orchestra.run.smithi188:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-08-26T09:24:54.762 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-08-26T09:24:54.828 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-26T09:24:54.926 DEBUG:teuthology.orchestra.run.smithi188:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-08-26T09:24:54.954 DEBUG:teuthology.orchestra.run.smithi092:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-08-26T09:24:54.957 DEBUG:teuthology.orchestra.run.smithi188:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-08-26T09:24:55.011 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-08-26T09:24:55.012 INFO:tasks.ceph.mon.a:Restarting daemon 2023-08-26T09:24:55.012 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-08-26T09:24:55.015 INFO:tasks.ceph.mon.a:Started 2023-08-26T09:24:55.015 INFO:tasks.ceph.mon.b:Restarting daemon 2023-08-26T09:24:55.015 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-08-26T09:24:55.054 INFO:tasks.ceph.mon.b:Started 2023-08-26T09:24:55.054 INFO:tasks.ceph.mon.c:Restarting daemon 2023-08-26T09:24:55.055 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-08-26T09:24:55.056 INFO:tasks.ceph.mon.c:Started 2023-08-26T09:24:55.057 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-08-26T09:24:55.057 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-08-26T09:24:55.058 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-08-26T09:24:55.060 INFO:tasks.ceph.mgr.y:Started 2023-08-26T09:24:55.060 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-08-26T09:24:55.061 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-08-26T09:24:55.063 INFO:tasks.ceph.mgr.x:Started 2023-08-26T09:24:55.063 INFO:tasks.ceph:Setting crush tunables to default 2023-08-26T09:24:55.063 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd crush tunables default 2023-08-26T09:24:55.186 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.180+0000 7fa379fb3700 1 Processor -- start 2023-08-26T09:24:55.187 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.180+0000 7fa379fb3700 1 -- start start 2023-08-26T09:24:55.188 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.181+0000 7fa379fb3700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa37415d490 0x7fa37406b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:55.188 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.181+0000 7fa379fb3700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa3740b1eb0 0x7fa3740ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:55.189 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.181+0000 7fa379fb3700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3740d25d0 con 0x7fa3740ce5f0 2023-08-26T09:24:55.189 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.181+0000 7fa379fb3700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3740cdc70 con 0x7fa37415d490 2023-08-26T09:24:55.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.181+0000 7fa379fb3700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa37415d870 con 0x7fa3740b1eb0 2023-08-26T09:24:55.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.181+0000 7fa373fff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fa3740ce5f0 0x7fa3740b6250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:55702/0 (socket says 172.21.15.92:55702) 2023-08-26T09:24:55.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.181+0000 7fa373fff700 1 -- 172.21.15.92:0/2202276406 learned_addr learned my addr 172.21.15.92:0/2202276406 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:24:55.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.181+0000 7fa372ffd700 1 --2- 172.21.15.92:0/2202276406 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa3740b1eb0 0x7fa3740ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:55.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.181+0000 7fa3737fe700 1 --2- 172.21.15.92:0/2202276406 >> v2:172.21.15.188:3300/0 conn(0x7fa37415d490 0x7fa37406b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:55.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.182+0000 7fa372ffd700 1 -- 172.21.15.92:0/2202276406 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa3740b1eb0 msgr2=0x7fa3740ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-08-26T09:24:55.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.182+0000 7fa372ffd700 1 -- 172.21.15.92:0/2202276406 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa3740b1eb0 msgr2=0x7fa3740ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-26T09:24:55.192 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.182+0000 7fa372ffd700 1 --2- 172.21.15.92:0/2202276406 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa3740b1eb0 0x7fa3740ce0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-26T09:24:55.192 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.182+0000 7fa372ffd700 1 --2- 172.21.15.92:0/2202276406 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa3740b1eb0 0x7fa3740ce0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-26T09:24:55.192 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.182+0000 7fa3737fe700 1 -- 172.21.15.92:0/2202276406 >> v2:172.21.15.188:3300/0 conn(0x7fa37415d490 msgr2=0x7fa37406b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-08-26T09:24:55.192 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.182+0000 7fa3737fe700 1 -- 172.21.15.92:0/2202276406 >> v2:172.21.15.188:3300/0 conn(0x7fa37415d490 msgr2=0x7fa37406b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-26T09:24:55.193 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.182+0000 7fa3737fe700 1 --2- 172.21.15.92:0/2202276406 >> v2:172.21.15.188:3300/0 conn(0x7fa37415d490 0x7fa37406b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-26T09:24:55.193 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.182+0000 7fa3737fe700 1 --2- 172.21.15.92:0/2202276406 >> v2:172.21.15.188:3300/0 conn(0x7fa37415d490 0x7fa37406b5e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-26T09:24:55.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.377+0000 7fa3727fc700 1 -- 172.21.15.92:0/2202276406 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 638579970 0 0) 0x7fa3740d25d0 con 0x7fa3740ce5f0 2023-08-26T09:24:55.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.377+0000 7fa3727fc700 1 -- 172.21.15.92:0/2202276406 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa35c0035b0 con 0x7fa3740ce5f0 2023-08-26T09:24:55.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.378+0000 7fa3727fc700 1 -- 172.21.15.92:0/2202276406 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 414256926 0 0) 0x7fa35c0035b0 con 0x7fa3740ce5f0 2023-08-26T09:24:55.385 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.378+0000 7fa3727fc700 1 -- 172.21.15.92:0/2202276406 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa3740b1eb0 msgr2=0x7fa3740ce0b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-26T09:24:55.385 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.378+0000 7fa3727fc700 1 --2- 172.21.15.92:0/2202276406 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa3740b1eb0 0x7fa3740ce0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:55.385 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.378+0000 7fa3727fc700 1 -- 172.21.15.92:0/2202276406 >> v2:172.21.15.188:3300/0 conn(0x7fa37415d490 msgr2=0x7fa37406b5e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-26T09:24:55.385 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.378+0000 7fa3727fc700 1 --2- 172.21.15.92:0/2202276406 >> v2:172.21.15.188:3300/0 conn(0x7fa37415d490 0x7fa37406b5e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:55.385 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.378+0000 7fa3727fc700 1 -- 172.21.15.92:0/2202276406 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3740b57e0 con 0x7fa3740ce5f0 2023-08-26T09:24:55.386 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.378+0000 7fa3727fc700 1 -- 172.21.15.92:0/2202276406 <== mon.0 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1019361464 0 0) 0x7fa36c0019f0 con 0x7fa3740ce5f0 2023-08-26T09:24:55.386 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.378+0000 7fa3727fc700 1 -- 172.21.15.92:0/2202276406 >> v1:172.21.15.92:6789/0 conn(0x7fa3740ce5f0 legacy=0x7fa3740b6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:55.386 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.378+0000 7fa3727fc700 1 --2- 172.21.15.92:0/2202276406 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa35c003a00 0x7fa35c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:55.386 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.378+0000 7fa3727fc700 1 --2- 172.21.15.92:0/2202276406 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa3740b1eb0 0x7fa35c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:55.386 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.378+0000 7fa3727fc700 1 --2- 172.21.15.92:0/2202276406 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa35c004d90 0x7fa35c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:55.387 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.378+0000 7fa3727fc700 1 -- 172.21.15.92:0/2202276406 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3740cdc70 con 0x7fa35c004d90 2023-08-26T09:24:55.387 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.378+0000 7fa3727fc700 1 -- 172.21.15.92:0/2202276406 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa35c00baf0 con 0x7fa35c003a00 2023-08-26T09:24:55.387 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.378+0000 7fa3727fc700 1 -- 172.21.15.92:0/2202276406 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa35c00bcb0 con 0x7fa3740b1eb0 2023-08-26T09:24:55.387 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.378+0000 7fa3737fe700 1 --2- 172.21.15.92:0/2202276406 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa35c003a00 0x7fa35c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:55.387 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.378+0000 7fa373fff700 1 --2- 172.21.15.92:0/2202276406 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa35c004d90 0x7fa35c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:55.388 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.378+0000 7fa372ffd700 1 --2- 172.21.15.92:0/2202276406 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa3740b1eb0 0x7fa35c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:55.388 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.379+0000 7fa3737fe700 1 -- 172.21.15.92:0/2202276406 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa3740b1eb0 msgr2=0x7fa35c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:24:55.388 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.379+0000 7fa3737fe700 1 --2- 172.21.15.92:0/2202276406 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa3740b1eb0 0x7fa35c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:55.388 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.379+0000 7fa3737fe700 1 -- 172.21.15.92:0/2202276406 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa35c004d90 msgr2=0x7fa35c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:24:55.388 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.379+0000 7fa3737fe700 1 --2- 172.21.15.92:0/2202276406 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa35c004d90 0x7fa35c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:55.388 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.379+0000 7fa3737fe700 1 -- 172.21.15.92:0/2202276406 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa35c0035b0 con 0x7fa35c003a00 2023-08-26T09:24:55.389 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.379+0000 7fa373fff700 1 --2- 172.21.15.92:0/2202276406 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa35c004d90 0x7fa35c005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-26T09:24:55.389 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.379+0000 7fa3737fe700 1 --2- 172.21.15.92:0/2202276406 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa35c003a00 0x7fa35c003e20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa368009890 tx=0x7fa35c005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f439c461a8347555 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:24:55.389 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.380+0000 7fa3727fc700 1 -- 172.21.15.92:0/2202276406 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36800c070 con 0x7fa35c003a00 2023-08-26T09:24:55.389 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.380+0000 7fa3727fc700 1 -- 172.21.15.92:0/2202276406 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa368004020 con 0x7fa35c003a00 2023-08-26T09:24:55.389 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.380+0000 7fa3727fc700 1 -- 172.21.15.92:0/2202276406 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3680043b0 con 0x7fa35c003a00 2023-08-26T09:24:55.393 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.381+0000 7fa379fb3700 1 -- 172.21.15.92:0/2202276406 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa35c003a00 msgr2=0x7fa35c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:55.393 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.381+0000 7fa379fb3700 1 --2- 172.21.15.92:0/2202276406 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa35c003a00 0x7fa35c003e20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa368009890 tx=0x7fa35c005880 comp rx=0 tx=0).stop 2023-08-26T09:24:55.393 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.381+0000 7fa373fff700 1 -- 172.21.15.92:0/2202276406 reap_dead start 2023-08-26T09:24:55.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.381+0000 7fa379fb3700 1 -- 172.21.15.92:0/2202276406 shutdown_connections 2023-08-26T09:24:55.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.381+0000 7fa379fb3700 1 -- 172.21.15.92:0/2202276406 >> 172.21.15.92:0/2202276406 conn(0x7fa37406aac0 msgr2=0x7fa37406aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:24:55.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.381+0000 7fa379fb3700 1 -- 172.21.15.92:0/2202276406 shutdown_connections 2023-08-26T09:24:55.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.381+0000 7fa379fb3700 1 -- 172.21.15.92:0/2202276406 wait complete. 2023-08-26T09:24:55.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.383+0000 7fa379fb3700 1 Processor -- start 2023-08-26T09:24:55.395 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.383+0000 7fa379fb3700 1 -- start start 2023-08-26T09:24:55.395 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.384+0000 7fa379fb3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa35c003a00 0x7fa37415e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:55.395 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.384+0000 7fa379fb3700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa3740c8d80 0x7fa3741e9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:55.395 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.384+0000 7fa379fb3700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa37415c150 0x7fa37415c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:55.395 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.384+0000 7fa379fb3700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37415cb10 con 0x7fa35c003a00 2023-08-26T09:24:55.396 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.384+0000 7fa379fb3700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37415ead0 con 0x7fa3740c8d80 2023-08-26T09:24:55.396 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.384+0000 7fa379fb3700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa37415edb0 con 0x7fa37415c150 2023-08-26T09:24:55.396 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.384+0000 7fa3737fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa35c003a00 0x7fa37415e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:55.396 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.384+0000 7fa3737fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa35c003a00 0x7fa37415e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43716/0 (socket says 172.21.15.92:43716) 2023-08-26T09:24:55.396 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.384+0000 7fa3737fe700 1 -- 172.21.15.92:0/3880372305 learned_addr learned my addr 172.21.15.92:0/3880372305 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:24:55.397 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.384+0000 7fa372ffd700 1 --2- 172.21.15.92:0/3880372305 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa3740c8d80 0x7fa3741e9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:55.397 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.384+0000 7fa373fff700 1 --2- 172.21.15.92:0/3880372305 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa37415c150 0x7fa37415c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:55.397 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.384+0000 7fa3737fe700 1 -- 172.21.15.92:0/3880372305 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa37415c150 msgr2=0x7fa37415c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:55.397 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.384+0000 7fa3737fe700 1 --2- 172.21.15.92:0/3880372305 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa37415c150 0x7fa37415c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:55.398 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.384+0000 7fa3737fe700 1 -- 172.21.15.92:0/3880372305 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa3740c8d80 msgr2=0x7fa3741e9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:55.398 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.384+0000 7fa3737fe700 1 --2- 172.21.15.92:0/3880372305 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa3740c8d80 0x7fa3741e9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:55.398 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.384+0000 7fa3737fe700 1 -- 172.21.15.92:0/3880372305 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa37415f090 con 0x7fa35c003a00 2023-08-26T09:24:55.398 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.384+0000 7fa373fff700 1 --2- 172.21.15.92:0/3880372305 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa37415c150 0x7fa37415c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:24:55.398 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.384+0000 7fa3737fe700 1 --2- 172.21.15.92:0/3880372305 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa35c003a00 0x7fa37415e280 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa368009fd0 tx=0x7fa3680047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:24:55.399 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.385+0000 7fa35bfff700 1 -- 172.21.15.92:0/3880372305 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3680038b0 con 0x7fa35c003a00 2023-08-26T09:24:55.399 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.385+0000 7fa35bfff700 1 -- 172.21.15.92:0/3880372305 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa368003a10 con 0x7fa35c003a00 2023-08-26T09:24:55.399 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.385+0000 7fa35bfff700 1 -- 172.21.15.92:0/3880372305 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa368003dc0 con 0x7fa35c003a00 2023-08-26T09:24:55.399 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.385+0000 7fa379fb3700 1 -- 172.21.15.92:0/3880372305 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa37415f370 con 0x7fa35c003a00 2023-08-26T09:24:55.400 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.385+0000 7fa379fb3700 1 -- 172.21.15.92:0/3880372305 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa37415e7c0 con 0x7fa35c003a00 2023-08-26T09:24:55.400 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.385+0000 7fa35bfff700 1 -- 172.21.15.92:0/3880372305 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa36801c760 con 0x7fa35c003a00 2023-08-26T09:24:55.400 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.385+0000 7fa35bfff700 1 -- 172.21.15.92:0/3880372305 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa3680308c0 con 0x7fa35c003a00 2023-08-26T09:24:55.400 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.386+0000 7fa379fb3700 1 -- 172.21.15.92:0/3880372305 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa37415f9c0 con 0x7fa35c003a00 2023-08-26T09:24:55.401 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.390+0000 7fa35bfff700 1 -- 172.21.15.92:0/3880372305 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fa368017030 con 0x7fa35c003a00 2023-08-26T09:24:55.472 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.468+0000 7fa379fb3700 1 -- 172.21.15.92:0/3880372305 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fa37404eeb0 con 0x7fa35c003a00 2023-08-26T09:24:55.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.470+0000 7fa35bfff700 1 -- 172.21.15.92:0/3880372305 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fa36800f040 con 0x7fa35c003a00 2023-08-26T09:24:55.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.471+0000 7fa379fb3700 1 -- 172.21.15.92:0/3880372305 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa35c003a00 msgr2=0x7fa37415e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:55.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.471+0000 7fa379fb3700 1 --2- 172.21.15.92:0/3880372305 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa35c003a00 0x7fa37415e280 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa368009fd0 tx=0x7fa3680047c0 comp rx=0 tx=0).stop 2023-08-26T09:24:55.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.471+0000 7fa379fb3700 1 -- 172.21.15.92:0/3880372305 shutdown_connections 2023-08-26T09:24:55.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.471+0000 7fa379fb3700 1 --2- 172.21.15.92:0/3880372305 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa37415c150 0x7fa37415c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:55.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.471+0000 7fa379fb3700 1 --2- 172.21.15.92:0/3880372305 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa35c003a00 0x7fa37415e280 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:55.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.471+0000 7fa379fb3700 1 --2- 172.21.15.92:0/3880372305 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa3740c8d80 0x7fa3741e9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:55.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.471+0000 7fa379fb3700 1 -- 172.21.15.92:0/3880372305 >> 172.21.15.92:0/3880372305 conn(0x7fa37406aac0 msgr2=0x7fa3740d1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:24:55.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.471+0000 7fa379fb3700 1 -- 172.21.15.92:0/3880372305 shutdown_connections 2023-08-26T09:24:55.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:55.471+0000 7fa379fb3700 1 -- 172.21.15.92:0/3880372305 wait complete. 2023-08-26T09:24:55.478 INFO:teuthology.orchestra.run.smithi092.stderr:adjusted tunables profile to default 2023-08-26T09:24:55.488 INFO:tasks.ceph:check_enable_crimson: False 2023-08-26T09:24:55.488 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-08-26T09:24:55.489 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-08-26T09:24:55.489 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-08-26T09:24:55.500 INFO:tasks.ceph.mgr.x.smithi188.stderr:2023-08-26T09:24:55.495+0000 7fcf66a31200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-26T09:24:55.503 INFO:tasks.ceph.mgr.y.smithi092.stderr:2023-08-26T09:24:55.499+0000 7f278e1b6200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-26T09:24:55.517 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-08-26T09:24:55.517 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-08-26T09:24:55.565 INFO:tasks.ceph.mgr.x.smithi188.stderr:2023-08-26T09:24:55.560+0000 7fcf66a31200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-26T09:24:55.573 INFO:tasks.ceph.mgr.y.smithi092.stderr:2023-08-26T09:24:55.569+0000 7f278e1b6200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-26T09:24:55.583 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-08-26T09:24:55.583 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-08-26T09:24:55.640 INFO:tasks.ceph.mgr.x.smithi188.stderr:2023-08-26T09:24:55.635+0000 7fcf66a31200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-26T09:24:55.651 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-08-26T09:24:55.651 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-08-26T09:24:55.656 INFO:tasks.ceph.mgr.y.smithi092.stderr:2023-08-26T09:24:55.652+0000 7f278e1b6200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-26T09:24:55.683 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-08-26T09:24:55.683 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-08-26T09:24:55.709 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-08-26T09:24:55.709 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-08-26T09:24:55.720 INFO:tasks.ceph.mgr.x.smithi188.stderr:2023-08-26T09:24:55.715+0000 7fcf66a31200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-26T09:24:55.741 INFO:tasks.ceph.mgr.y.smithi092.stderr:2023-08-26T09:24:55.737+0000 7f278e1b6200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-26T09:24:55.746 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-08-26T09:24:55.746 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-08-26T09:24:55.812 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-08-26T09:24:55.813 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-08-26T09:24:55.872 INFO:tasks.ceph.mgr.x.smithi188.stderr:2023-08-26T09:24:55.867+0000 7fcf66a31200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-26T09:24:55.880 DEBUG:teuthology.orchestra.run.smithi188:> sudo ceph --cluster ceph osd new 9e9e7638-4459-4d8d-8e40-130bcf48df66 0 2023-08-26T09:24:55.883 INFO:tasks.ceph.mgr.y.smithi092.stderr:2023-08-26T09:24:55.879+0000 7f278e1b6200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-26T09:24:56.046 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.037+0000 7fdbc223a700 1 Processor -- start 2023-08-26T09:24:56.047 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.037+0000 7fdbc223a700 1 -- start start 2023-08-26T09:24:56.047 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.038+0000 7fdbc223a700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fdbbc06e740 0x7fdbbc06ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:56.047 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.038+0000 7fdbc223a700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbbc0cdd10 con 0x7fdbbc15a3f0 2023-08-26T09:24:56.047 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.038+0000 7fdbc223a700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbbc15b2b0 con 0x7fdbbc150d20 2023-08-26T09:24:56.048 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.038+0000 7fdbc223a700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbbc06f110 con 0x7fdbbc06e740 2023-08-26T09:24:56.048 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.038+0000 7fdbbb7fe700 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7fdbbc150d20 0x7fdbbc06d960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:33242/0 (socket says 172.21.15.188:33242) 2023-08-26T09:24:56.048 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.038+0000 7fdbbb7fe700 1 -- 172.21.15.188:0/2887939056 learned_addr learned my addr 172.21.15.188:0/2887939056 (peer_addr_for_me v1:172.21.15.188:0/0) 2023-08-26T09:24:56.048 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.038+0000 7fdbbaffd700 1 --2- 172.21.15.188:0/2887939056 >> v2:172.21.15.92:3300/0 conn(0x7fdbbc06e740 0x7fdbbc06ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:56.048 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.038+0000 7fdbba7fc700 1 -- 172.21.15.188:0/2887939056 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2596668214 0 0) 0x7fdbbc15b2b0 con 0x7fdbbc150d20 2023-08-26T09:24:56.049 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.038+0000 7fdbba7fc700 1 -- 172.21.15.188:0/2887939056 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdba40035b0 con 0x7fdbbc150d20 2023-08-26T09:24:56.049 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.038+0000 7fdbba7fc700 1 -- 172.21.15.188:0/2887939056 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3261317574 0 0) 0x7fdbbc0cdd10 con 0x7fdbbc15a3f0 2023-08-26T09:24:56.049 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.038+0000 7fdbba7fc700 1 -- 172.21.15.188:0/2887939056 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbbc15b2b0 con 0x7fdbbc15a3f0 2023-08-26T09:24:56.049 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.038+0000 7fdbba7fc700 1 -- 172.21.15.188:0/2887939056 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2098043638 0 0) 0x7fdba40035b0 con 0x7fdbbc150d20 2023-08-26T09:24:56.049 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.038+0000 7fdbba7fc700 1 -- 172.21.15.188:0/2887939056 >> v2:172.21.15.92:3300/0 conn(0x7fdbbc06e740 msgr2=0x7fdbbc06ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:24:56.050 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.038+0000 7fdbba7fc700 1 --2- 172.21.15.188:0/2887939056 >> v2:172.21.15.92:3300/0 conn(0x7fdbbc06e740 0x7fdbbc06ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:56.050 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.038+0000 7fdbba7fc700 1 -- 172.21.15.188:0/2887939056 >> v1:172.21.15.92:6789/0 conn(0x7fdbbc15a3f0 legacy=0x7fdbbc15a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:56.050 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.038+0000 7fdbba7fc700 1 -- 172.21.15.188:0/2887939056 --> v1:172.21.15.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbbc15afd0 con 0x7fdbbc150d20 2023-08-26T09:24:56.050 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.038+0000 7fdbba7fc700 1 -- 172.21.15.188:0/2887939056 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1019361464 0 0) 0x7fdbac001670 con 0x7fdbbc150d20 2023-08-26T09:24:56.050 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.039+0000 7fdbba7fc700 1 -- 172.21.15.188:0/2887939056 >> v1:172.21.15.188:6789/0 conn(0x7fdbbc150d20 legacy=0x7fdbbc06d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:56.051 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.039+0000 7fdbba7fc700 1 --2- 172.21.15.188:0/2887939056 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdba4003b90 0x7fdba4003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:56.051 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.039+0000 7fdbba7fc700 1 --2- 172.21.15.188:0/2887939056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdba4004850 0x7fdba4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:56.051 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.039+0000 7fdbba7fc700 1 --2- 172.21.15.188:0/2887939056 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdba4005210 0x7fdba400dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:56.051 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.039+0000 7fdbba7fc700 1 -- 172.21.15.188:0/2887939056 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbbc06f110 con 0x7fdba4004850 2023-08-26T09:24:56.051 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.039+0000 7fdbba7fc700 1 -- 172.21.15.188:0/2887939056 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba400e2a0 con 0x7fdba4005210 2023-08-26T09:24:56.052 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.039+0000 7fdbba7fc700 1 -- 172.21.15.188:0/2887939056 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba400e460 con 0x7fdba4003b90 2023-08-26T09:24:56.052 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.039+0000 7fdbbaffd700 1 --2- 172.21.15.188:0/2887939056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdba4004850 0x7fdba4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:56.052 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.039+0000 7fdbbbfff700 1 --2- 172.21.15.188:0/2887939056 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdba4005210 0x7fdba400dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:56.052 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.039+0000 7fdbbb7fe700 1 --2- 172.21.15.188:0/2887939056 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdba4003b90 0x7fdba4003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:56.052 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.039+0000 7fdbbbfff700 1 -- 172.21.15.188:0/2887939056 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdba4003b90 msgr2=0x7fdba4003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:24:56.053 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.039+0000 7fdbbbfff700 1 --2- 172.21.15.188:0/2887939056 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdba4003b90 0x7fdba4003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:56.053 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.039+0000 7fdbbbfff700 1 -- 172.21.15.188:0/2887939056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdba4004850 msgr2=0x7fdba4004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:24:56.053 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.039+0000 7fdbbbfff700 1 --2- 172.21.15.188:0/2887939056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdba4004850 0x7fdba4004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:56.053 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.039+0000 7fdbbbfff700 1 -- 172.21.15.188:0/2887939056 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba40035b0 con 0x7fdba4005210 2023-08-26T09:24:56.053 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.039+0000 7fdbbaffd700 1 --2- 172.21.15.188:0/2887939056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdba4004850 0x7fdba4004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-26T09:24:56.054 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.039+0000 7fdbbbfff700 1 -- 172.21.15.188:0/2887939056 reap_dead start 2023-08-26T09:24:56.054 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.039+0000 7fdbbbfff700 1 --2- 172.21.15.188:0/2887939056 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdba4005210 0x7fdba400dc20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdbb400e7d0 tx=0x7fdba4005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=334fe578b7890bc server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:24:56.054 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.039+0000 7fdbba7fc700 1 -- 172.21.15.188:0/2887939056 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb4013070 con 0x7fdba4005210 2023-08-26T09:24:56.054 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.039+0000 7fdbba7fc700 1 -- 172.21.15.188:0/2887939056 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb400e0d0 con 0x7fdba4005210 2023-08-26T09:24:56.054 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.039+0000 7fdbba7fc700 1 -- 172.21.15.188:0/2887939056 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb4001fc0 con 0x7fdba4005210 2023-08-26T09:24:56.055 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.040+0000 7fdbc223a700 1 -- 172.21.15.188:0/2887939056 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdba4005210 msgr2=0x7fdba400dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:56.055 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.040+0000 7fdbc223a700 1 --2- 172.21.15.188:0/2887939056 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdba4005210 0x7fdba400dc20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdbb400e7d0 tx=0x7fdba4005880 comp rx=0 tx=0).stop 2023-08-26T09:24:56.055 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.040+0000 7fdbc223a700 1 -- 172.21.15.188:0/2887939056 shutdown_connections 2023-08-26T09:24:56.055 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.040+0000 7fdbc223a700 1 --2- 172.21.15.188:0/2887939056 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdba4005210 0x7fdba400dc20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:56.055 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.040+0000 7fdbc223a700 1 -- 172.21.15.188:0/2887939056 >> 172.21.15.188:0/2887939056 conn(0x7fdbbc0cfc50 msgr2=0x7fdbbc0d0030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:24:56.056 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.040+0000 7fdbc223a700 1 -- 172.21.15.188:0/2887939056 shutdown_connections 2023-08-26T09:24:56.056 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.040+0000 7fdbc223a700 1 -- 172.21.15.188:0/2887939056 wait complete. 2023-08-26T09:24:56.056 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.041+0000 7fdbc223a700 1 Processor -- start 2023-08-26T09:24:56.056 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.041+0000 7fdbc223a700 1 -- start start 2023-08-26T09:24:56.058 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.042+0000 7fdbc223a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdba4005210 0x7fdbbc0c2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:56.059 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.042+0000 7fdbc223a700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdbbc1f2390 0x7fdbbc0b4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:56.059 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.042+0000 7fdbc223a700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdbbc0b4f80 0x7fdbbc0c3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:56.059 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.042+0000 7fdbc223a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbbc0b5400 con 0x7fdba4005210 2023-08-26T09:24:56.059 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.042+0000 7fdbc223a700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbbc0c2a40 con 0x7fdbbc1f2390 2023-08-26T09:24:56.059 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.042+0000 7fdbc223a700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbbc0c6d20 con 0x7fdbbc0b4f80 2023-08-26T09:24:56.060 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.042+0000 7fdbbaffd700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdbbc1f2390 0x7fdbbc0b4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:56.060 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.042+0000 7fdbbbfff700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdbbc0b4f80 0x7fdbbc0c3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:56.060 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.042+0000 7fdbbaffd700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdbbc1f2390 0x7fdbbc0b4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:39478/0 (socket says 172.21.15.188:39478) 2023-08-26T09:24:56.060 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.042+0000 7fdbbaffd700 1 -- 172.21.15.188:0/1319185005 learned_addr learned my addr 172.21.15.188:0/1319185005 (peer_addr_for_me v2:172.21.15.188:0/0) 2023-08-26T09:24:56.060 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.042+0000 7fdbbb7fe700 1 --2- 172.21.15.188:0/1319185005 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdba4005210 0x7fdbbc0c2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:56.061 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.043+0000 7fdbbbfff700 1 -- 172.21.15.188:0/1319185005 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdbbc1f2390 msgr2=0x7fdbbc0b4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:56.061 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.043+0000 7fdbbbfff700 1 --2- 172.21.15.188:0/1319185005 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdbbc1f2390 0x7fdbbc0b4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:56.061 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.043+0000 7fdbbbfff700 1 -- 172.21.15.188:0/1319185005 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdba4005210 msgr2=0x7fdbbc0c2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:56.061 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.043+0000 7fdbbbfff700 1 --2- 172.21.15.188:0/1319185005 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdba4005210 0x7fdbbc0c2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:56.061 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.043+0000 7fdbbbfff700 1 -- 172.21.15.188:0/1319185005 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbbc0c6fc0 con 0x7fdbbc0b4f80 2023-08-26T09:24:56.061 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.043+0000 7fdbbb7fe700 1 --2- 172.21.15.188:0/1319185005 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdba4005210 0x7fdbbc0c2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-26T09:24:56.062 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.043+0000 7fdbbbfff700 1 --2- 172.21.15.188:0/1319185005 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdbbc0b4f80 0x7fdbbc0c3780 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc15a7d0 tx=0x7fdbb4001650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:24:56.062 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.043+0000 7fdba3fff700 1 -- 172.21.15.188:0/1319185005 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb4003a00 con 0x7fdbbc0b4f80 2023-08-26T09:24:56.062 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.043+0000 7fdba3fff700 1 -- 172.21.15.188:0/1319185005 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb4003b60 con 0x7fdbbc0b4f80 2023-08-26T09:24:56.062 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.043+0000 7fdbc223a700 1 -- 172.21.15.188:0/1319185005 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbbc0c72a0 con 0x7fdbbc0b4f80 2023-08-26T09:24:56.063 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.043+0000 7fdba3fff700 1 -- 172.21.15.188:0/1319185005 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb4005070 con 0x7fdbbc0b4f80 2023-08-26T09:24:56.063 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.043+0000 7fdbc223a700 1 -- 172.21.15.188:0/1319185005 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbbc0c7860 con 0x7fdbbc0b4f80 2023-08-26T09:24:56.063 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.043+0000 7fdba3fff700 1 -- 172.21.15.188:0/1319185005 <== mon.2 v2:172.21.15.188:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fdbb40054d0 con 0x7fdbbc0b4f80 2023-08-26T09:24:56.063 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.043+0000 7fdba3fff700 1 -- 172.21.15.188:0/1319185005 <== mon.2 v2:172.21.15.188:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fdbb4029840 con 0x7fdbbc0b4f80 2023-08-26T09:24:56.063 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.044+0000 7fdbc223a700 1 -- 172.21.15.188:0/1319185005 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbbc04eeb0 con 0x7fdbbc0b4f80 2023-08-26T09:24:56.064 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.046+0000 7fdba3fff700 1 -- 172.21.15.188:0/1319185005 <== mon.2 v2:172.21.15.188:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fdbb401c070 con 0x7fdbbc0b4f80 2023-08-26T09:24:56.133 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.128+0000 7fdbc223a700 1 -- 172.21.15.188:0/1319185005 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9e9e7638-4459-4d8d-8e40-130bcf48df66", "id": 0} v 0) v1 -- 0x7fdbbc15d750 con 0x7fdbbc0b4f80 2023-08-26T09:24:56.136 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.131+0000 7fdba3fff700 1 -- 172.21.15.188:0/1319185005 <== mon.2 v2:172.21.15.188:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9e9e7638-4459-4d8d-8e40-130bcf48df66", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdbb0009730 con 0x7fdbbc0b4f80 2023-08-26T09:24:56.136 INFO:teuthology.orchestra.run.smithi188.stdout:0 2023-08-26T09:24:56.137 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.132+0000 7fdbc223a700 1 -- 172.21.15.188:0/1319185005 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdbbc0b4f80 msgr2=0x7fdbbc0c3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:56.137 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.132+0000 7fdbc223a700 1 --2- 172.21.15.188:0/1319185005 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdbbc0b4f80 0x7fdbbc0c3780 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc15a7d0 tx=0x7fdbb4001650 comp rx=0 tx=0).stop 2023-08-26T09:24:56.138 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.132+0000 7fdbc223a700 1 -- 172.21.15.188:0/1319185005 shutdown_connections 2023-08-26T09:24:56.138 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.132+0000 7fdbc223a700 1 --2- 172.21.15.188:0/1319185005 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdbbc0b4f80 0x7fdbbc0c3780 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:56.138 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.132+0000 7fdbc223a700 1 --2- 172.21.15.188:0/1319185005 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdba4005210 0x7fdbbc0c2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:56.138 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.132+0000 7fdbc223a700 1 --2- 172.21.15.188:0/1319185005 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdbbc1f2390 0x7fdbbc0b4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:56.138 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.132+0000 7fdbc223a700 1 -- 172.21.15.188:0/1319185005 >> 172.21.15.188:0/1319185005 conn(0x7fdbbc0cfc50 msgr2=0x7fdbbc06d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:24:56.139 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.132+0000 7fdbc223a700 1 -- 172.21.15.188:0/1319185005 shutdown_connections 2023-08-26T09:24:56.139 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.132+0000 7fdbc223a700 1 -- 172.21.15.188:0/1319185005 wait complete. 2023-08-26T09:24:56.149 DEBUG:teuthology.orchestra.run.smithi188:> sudo ceph --cluster ceph osd new 164e68c9-aedd-4df5-9b70-f4b1ec3bda13 1 2023-08-26T09:24:56.265 INFO:tasks.ceph.mgr.y.smithi092.stderr:2023-08-26T09:24:56.261+0000 7f278e1b6200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-26T09:24:56.268 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.263+0000 7f6d6759e700 1 Processor -- start 2023-08-26T09:24:56.268 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.263+0000 7f6d6759e700 1 -- start start 2023-08-26T09:24:56.271 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.264+0000 7f6d6759e700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f6d680ce700 0x7f6d680cabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:56.271 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.264+0000 7f6d6759e700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f6d6815e000 0x7f6d68071c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:56.271 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.264+0000 7f6d6759e700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d680ceae0 con 0x7f6d6815e520 2023-08-26T09:24:56.271 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.264+0000 7f6d6759e700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d680c9910 con 0x7f6d6815e000 2023-08-26T09:24:56.272 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.264+0000 7f6d6759e700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d680c9b20 con 0x7f6d680ce700 2023-08-26T09:24:56.272 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.264+0000 7f6d6659c700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f6d680ce700 0x7f6d680cabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:56.272 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.264+0000 7f6d65d9b700 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f6d6815e520 0x7f6d6815d8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:33262/0 (socket says 172.21.15.188:33262) 2023-08-26T09:24:56.272 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.264+0000 7f6d6659c700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f6d680ce700 0x7f6d680cabc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:39482/0 (socket says 172.21.15.188:39482) 2023-08-26T09:24:56.272 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.264+0000 7f6d65d9b700 1 -- 172.21.15.188:0/2959427178 learned_addr learned my addr 172.21.15.188:0/2959427178 (peer_addr_for_me v1:172.21.15.188:0/0) 2023-08-26T09:24:56.273 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.264+0000 7f6d66d9d700 1 --2- 172.21.15.188:0/2959427178 >> v2:172.21.15.92:3300/0 conn(0x7f6d6815e000 0x7f6d68071c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:56.273 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.264+0000 7f6d6659c700 1 -- 172.21.15.188:0/2959427178 >> v2:172.21.15.92:3300/0 conn(0x7f6d6815e000 msgr2=0x7f6d68071c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:24:56.273 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.264+0000 7f6d6659c700 1 --2- 172.21.15.188:0/2959427178 >> v2:172.21.15.92:3300/0 conn(0x7f6d6815e000 0x7f6d68071c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:56.273 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.264+0000 7f6d6659c700 1 -- 172.21.15.188:0/2959427178 >> v1:172.21.15.188:6789/0 conn(0x7f6d6815e520 legacy=0x7f6d6815d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:56.273 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.265+0000 7f6d6659c700 1 -- 172.21.15.188:0/2959427178 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d680c9e00 con 0x7f6d680ce700 2023-08-26T09:24:56.274 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.265+0000 7f6d6659c700 1 --2- 172.21.15.188:0/2959427178 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6d680ce700 0x7f6d680cabc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6d68068520 tx=0x7f6d58009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d7d2b3f9352ad97 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:24:56.274 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.265+0000 7f6d6559a700 1 -- 172.21.15.188:0/2959427178 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d58011830 con 0x7f6d680ce700 2023-08-26T09:24:56.274 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.265+0000 7f6d6559a700 1 -- 172.21.15.188:0/2959427178 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d58011990 con 0x7f6d680ce700 2023-08-26T09:24:56.274 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.265+0000 7f6d6559a700 1 -- 172.21.15.188:0/2959427178 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d58011d20 con 0x7f6d680ce700 2023-08-26T09:24:56.274 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.265+0000 7f6d6759e700 1 -- 172.21.15.188:0/2959427178 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6d680ce700 msgr2=0x7f6d680cabc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:56.275 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.265+0000 7f6d6759e700 1 --2- 172.21.15.188:0/2959427178 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6d680ce700 0x7f6d680cabc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6d68068520 tx=0x7f6d58009b20 comp rx=0 tx=0).stop 2023-08-26T09:24:56.275 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.265+0000 7f6d6759e700 1 -- 172.21.15.188:0/2959427178 shutdown_connections 2023-08-26T09:24:56.275 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.265+0000 7f6d6759e700 1 --2- 172.21.15.188:0/2959427178 >> v2:172.21.15.92:3300/0 conn(0x7f6d6815e000 0x7f6d68071c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:56.275 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.265+0000 7f6d6759e700 1 --2- 172.21.15.188:0/2959427178 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6d680ce700 0x7f6d680cabc0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:56.275 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.265+0000 7f6d6759e700 1 -- 172.21.15.188:0/2959427178 >> 172.21.15.188:0/2959427178 conn(0x7f6d6806c4b0 msgr2=0x7f6d6806c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:24:56.275 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.265+0000 7f6d6759e700 1 -- 172.21.15.188:0/2959427178 shutdown_connections 2023-08-26T09:24:56.276 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.266+0000 7f6d6759e700 1 -- 172.21.15.188:0/2959427178 wait complete. 2023-08-26T09:24:56.278 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.267+0000 7f6d6759e700 1 Processor -- start 2023-08-26T09:24:56.278 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.267+0000 7f6d6759e700 1 -- start start 2023-08-26T09:24:56.278 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.267+0000 7f6d6759e700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6d680ce700 0x7f6d6815ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:56.279 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.267+0000 7f6d6759e700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6d6815e000 0x7f6d6815af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:56.279 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.268+0000 7f6d6759e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d6815e520 0x7f6d681575e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:56.279 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.268+0000 7f6d6759e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d680c6390 con 0x7f6d6815e520 2023-08-26T09:24:56.279 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.268+0000 7f6d6759e700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d681f6e50 con 0x7f6d6815e000 2023-08-26T09:24:56.280 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.268+0000 7f6d6759e700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d680c6570 con 0x7f6d680ce700 2023-08-26T09:24:56.280 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.268+0000 7f6d65d9b700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6d6815e000 0x7f6d6815af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:56.280 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.268+0000 7f6d6659c700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6d680ce700 0x7f6d6815ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:56.280 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.268+0000 7f6d65d9b700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6d6815e000 0x7f6d6815af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:39490/0 (socket says 172.21.15.188:39490) 2023-08-26T09:24:56.280 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.268+0000 7f6d65d9b700 1 -- 172.21.15.188:0/2220002903 learned_addr learned my addr 172.21.15.188:0/2220002903 (peer_addr_for_me v2:172.21.15.188:0/0) 2023-08-26T09:24:56.281 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.268+0000 7f6d66d9d700 1 --2- 172.21.15.188:0/2220002903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d6815e520 0x7f6d681575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:56.281 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.268+0000 7f6d65d9b700 1 -- 172.21.15.188:0/2220002903 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6d680ce700 msgr2=0x7f6d6815ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:56.281 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.268+0000 7f6d65d9b700 1 --2- 172.21.15.188:0/2220002903 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6d680ce700 0x7f6d6815ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:56.281 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.268+0000 7f6d65d9b700 1 -- 172.21.15.188:0/2220002903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d6815e520 msgr2=0x7f6d681575e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:56.281 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.268+0000 7f6d65d9b700 1 --2- 172.21.15.188:0/2220002903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d6815e520 0x7f6d681575e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:56.282 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.268+0000 7f6d65d9b700 1 -- 172.21.15.188:0/2220002903 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d580094a0 con 0x7f6d6815e000 2023-08-26T09:24:56.282 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.268+0000 7f6d6659c700 1 --2- 172.21.15.188:0/2220002903 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6d680ce700 0x7f6d6815ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-26T09:24:56.282 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.268+0000 7f6d65d9b700 1 --2- 172.21.15.188:0/2220002903 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6d6815e000 0x7f6d6815af30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c00c520 tx=0x7f6d5c00c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:24:56.282 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.268+0000 7f6d56ffd700 1 -- 172.21.15.188:0/2220002903 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c005d70 con 0x7f6d6815e000 2023-08-26T09:24:56.282 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.268+0000 7f6d56ffd700 1 -- 172.21.15.188:0/2220002903 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d5c0070d0 con 0x7f6d6815e000 2023-08-26T09:24:56.282 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.268+0000 7f6d6759e700 1 -- 172.21.15.188:0/2220002903 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d680c6850 con 0x7f6d6815e000 2023-08-26T09:24:56.283 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.268+0000 7f6d56ffd700 1 -- 172.21.15.188:0/2220002903 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c007440 con 0x7f6d6815e000 2023-08-26T09:24:56.283 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.268+0000 7f6d6759e700 1 -- 172.21.15.188:0/2220002903 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d680c6be0 con 0x7f6d6815e000 2023-08-26T09:24:56.283 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.269+0000 7f6d56ffd700 1 -- 172.21.15.188:0/2220002903 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6d5c01c440 con 0x7f6d6815e000 2023-08-26T09:24:56.283 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.269+0000 7f6d56ffd700 1 -- 172.21.15.188:0/2220002903 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f6d5c0127b0 con 0x7f6d6815e000 2023-08-26T09:24:56.283 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.270+0000 7f6d6759e700 1 -- 172.21.15.188:0/2220002903 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d680c69e0 con 0x7f6d6815e000 2023-08-26T09:24:56.284 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.272+0000 7f6d56ffd700 1 -- 172.21.15.188:0/2220002903 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f6d5c021060 con 0x7f6d6815e000 2023-08-26T09:24:56.284 INFO:tasks.ceph.mgr.x.smithi188.stderr:2023-08-26T09:24:56.278+0000 7fcf66a31200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-26T09:24:56.360 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.355+0000 7f6d6759e700 1 -- 172.21.15.188:0/2220002903 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd new", "uuid": "164e68c9-aedd-4df5-9b70-f4b1ec3bda13", "id": 1} v 0) v1 -- 0x7f6d68067a10 con 0x7f6d6815e000 2023-08-26T09:24:56.365 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.360+0000 7f6d56ffd700 1 -- 172.21.15.188:0/2220002903 <== mon.1 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "164e68c9-aedd-4df5-9b70-f4b1ec3bda13", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6d5c017070 con 0x7f6d6815e000 2023-08-26T09:24:56.366 INFO:teuthology.orchestra.run.smithi188.stdout:1 2023-08-26T09:24:56.367 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.361+0000 7f6d6759e700 1 -- 172.21.15.188:0/2220002903 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6d6815e000 msgr2=0x7f6d6815af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:56.367 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.361+0000 7f6d6759e700 1 --2- 172.21.15.188:0/2220002903 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6d6815e000 0x7f6d6815af30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c00c520 tx=0x7f6d5c00c830 comp rx=0 tx=0).stop 2023-08-26T09:24:56.367 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.362+0000 7f6d6759e700 1 -- 172.21.15.188:0/2220002903 shutdown_connections 2023-08-26T09:24:56.367 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.362+0000 7f6d6759e700 1 --2- 172.21.15.188:0/2220002903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d6815e520 0x7f6d681575e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:56.368 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.362+0000 7f6d6759e700 1 --2- 172.21.15.188:0/2220002903 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6d680ce700 0x7f6d6815ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:56.368 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.362+0000 7f6d6759e700 1 --2- 172.21.15.188:0/2220002903 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6d6815e000 0x7f6d6815af30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:56.368 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.362+0000 7f6d6759e700 1 -- 172.21.15.188:0/2220002903 >> 172.21.15.188:0/2220002903 conn(0x7f6d6806c4b0 msgr2=0x7f6d68159840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:24:56.368 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.362+0000 7f6d6759e700 1 -- 172.21.15.188:0/2220002903 shutdown_connections 2023-08-26T09:24:56.368 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.362+0000 7f6d6759e700 1 -- 172.21.15.188:0/2220002903 wait complete. 2023-08-26T09:24:56.380 DEBUG:teuthology.orchestra.run.smithi188:> sudo ceph --cluster ceph osd new 8701dfee-629a-4d30-82e4-b8fac340303f 2 2023-08-26T09:24:56.382 INFO:tasks.ceph.mgr.y.smithi092.stderr:2023-08-26T09:24:56.378+0000 7f278e1b6200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-26T09:24:56.407 INFO:tasks.ceph.mgr.x.smithi188.stderr:2023-08-26T09:24:56.402+0000 7fcf66a31200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-26T09:24:56.468 INFO:tasks.ceph.mgr.y.smithi092.stderr:2023-08-26T09:24:56.464+0000 7f278e1b6200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-26T09:24:56.499 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.494+0000 7f0c83ef9700 1 Processor -- start 2023-08-26T09:24:56.500 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.495+0000 7f0c83ef9700 1 -- start start 2023-08-26T09:24:56.503 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.495+0000 7f0c83ef9700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0c7c144ae0 0x7f0c7c0c6500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:56.503 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.495+0000 7f0c83ef9700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c7c0c4c10 0x7f0c7c06a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:56.503 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.495+0000 7f0c83ef9700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c7c06b1a0 con 0x7f0c7c06a860 2023-08-26T09:24:56.504 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.495+0000 7f0c83ef9700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c7c06acf0 con 0x7f0c7c144ae0 2023-08-26T09:24:56.504 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.495+0000 7f0c83ef9700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7c144ec0 con 0x7f0c7c0c4c10 2023-08-26T09:24:56.504 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.496+0000 7f0c81494700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c7c0c4c10 0x7f0c7c06a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:56.504 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.496+0000 7f0c81494700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c7c0c4c10 0x7f0c7c06a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.188:49558/0 (socket says 172.21.15.188:49558) 2023-08-26T09:24:56.504 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.496+0000 7f0c81494700 1 -- 172.21.15.188:0/410042871 learned_addr learned my addr 172.21.15.188:0/410042871 (peer_addr_for_me v2:172.21.15.188:0/0) 2023-08-26T09:24:56.504 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.496+0000 7f0c81c95700 1 --2- 172.21.15.188:0/410042871 >> v2:172.21.15.92:3300/0 conn(0x7f0c7c144ae0 0x7f0c7c0c6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:56.505 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.496+0000 7f0c80c93700 1 -- 172.21.15.188:0/410042871 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3760400537 0 0) 0x7f0c7c06b1a0 con 0x7f0c7c06a860 2023-08-26T09:24:56.505 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.496+0000 7f0c81494700 1 -- 172.21.15.188:0/410042871 >> v2:172.21.15.92:3300/0 conn(0x7f0c7c144ae0 msgr2=0x7f0c7c0c6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:24:56.505 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.496+0000 7f0c81494700 1 --2- 172.21.15.188:0/410042871 >> v2:172.21.15.92:3300/0 conn(0x7f0c7c144ae0 0x7f0c7c0c6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:56.505 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.496+0000 7f0c81494700 1 -- 172.21.15.188:0/410042871 >> v1:172.21.15.188:6789/0 conn(0x7f0c7c06a860 legacy=0x7f0c7c070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:56.505 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.496+0000 7f0c81494700 1 -- 172.21.15.188:0/410042871 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c7c06ea00 con 0x7f0c7c0c4c10 2023-08-26T09:24:56.506 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.496+0000 7f0c81494700 1 --2- 172.21.15.188:0/410042871 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c7c0c4c10 0x7f0c7c06a320 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c0098f0 tx=0x7f0c6c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e40d4678b6f0f29 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:24:56.506 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.496+0000 7f0c80c93700 1 -- 172.21.15.188:0/410042871 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c011830 con 0x7f0c7c0c4c10 2023-08-26T09:24:56.506 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.496+0000 7f0c80c93700 1 -- 172.21.15.188:0/410042871 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6c011990 con 0x7f0c7c0c4c10 2023-08-26T09:24:56.506 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.496+0000 7f0c80c93700 1 -- 172.21.15.188:0/410042871 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c011d20 con 0x7f0c7c0c4c10 2023-08-26T09:24:56.506 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.497+0000 7f0c83ef9700 1 -- 172.21.15.188:0/410042871 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c7c0c4c10 msgr2=0x7f0c7c06a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:56.507 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.497+0000 7f0c83ef9700 1 --2- 172.21.15.188:0/410042871 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c7c0c4c10 0x7f0c7c06a320 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c0098f0 tx=0x7f0c6c009c00 comp rx=0 tx=0).stop 2023-08-26T09:24:56.507 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.497+0000 7f0c83ef9700 1 -- 172.21.15.188:0/410042871 shutdown_connections 2023-08-26T09:24:56.507 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.497+0000 7f0c83ef9700 1 --2- 172.21.15.188:0/410042871 >> v2:172.21.15.92:3300/0 conn(0x7f0c7c144ae0 0x7f0c7c0c6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:56.507 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.497+0000 7f0c83ef9700 1 --2- 172.21.15.188:0/410042871 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c7c0c4c10 0x7f0c7c06a320 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:56.507 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.497+0000 7f0c83ef9700 1 -- 172.21.15.188:0/410042871 >> 172.21.15.188:0/410042871 conn(0x7f0c7c06b430 msgr2=0x7f0c7c06b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:24:56.508 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.497+0000 7f0c83ef9700 1 -- 172.21.15.188:0/410042871 shutdown_connections 2023-08-26T09:24:56.508 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.497+0000 7f0c83ef9700 1 -- 172.21.15.188:0/410042871 wait complete. 2023-08-26T09:24:56.508 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.498+0000 7f0c83ef9700 1 Processor -- start 2023-08-26T09:24:56.508 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.498+0000 7f0c83ef9700 1 -- start start 2023-08-26T09:24:56.510 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.499+0000 7f0c83ef9700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c7c06a860 0x7f0c7c13e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:56.510 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.499+0000 7f0c83ef9700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c7c0c4c10 0x7f0c7c0cf130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:56.511 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.499+0000 7f0c83ef9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c7c144ae0 0x7f0c7c15ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:56.511 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.499+0000 7f0c83ef9700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7c15dd80 con 0x7f0c7c144ae0 2023-08-26T09:24:56.511 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.499+0000 7f0c83ef9700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7c0cee20 con 0x7f0c7c06a860 2023-08-26T09:24:56.511 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.499+0000 7f0c83ef9700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7c0ce580 con 0x7f0c7c0c4c10 2023-08-26T09:24:56.511 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.499+0000 7f0c81c95700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c7c06a860 0x7f0c7c13e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:56.512 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.499+0000 7f0c81494700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c7c0c4c10 0x7f0c7c0cf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:56.512 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.499+0000 7f0c81494700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c7c0c4c10 0x7f0c7c0cf130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.188:49564/0 (socket says 172.21.15.188:49564) 2023-08-26T09:24:56.512 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.499+0000 7f0c81494700 1 -- 172.21.15.188:0/1788558093 learned_addr learned my addr 172.21.15.188:0/1788558093 (peer_addr_for_me v2:172.21.15.188:0/0) 2023-08-26T09:24:56.512 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.499+0000 7f0c82496700 1 --2- 172.21.15.188:0/1788558093 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c7c144ae0 0x7f0c7c15ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:56.512 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.499+0000 7f0c81494700 1 -- 172.21.15.188:0/1788558093 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c7c06a860 msgr2=0x7f0c7c13e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:56.513 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.499+0000 7f0c81494700 1 --2- 172.21.15.188:0/1788558093 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c7c06a860 0x7f0c7c13e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:56.513 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.499+0000 7f0c81494700 1 -- 172.21.15.188:0/1788558093 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c7c144ae0 msgr2=0x7f0c7c15ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:56.513 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.499+0000 7f0c81494700 1 --2- 172.21.15.188:0/1788558093 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c7c144ae0 0x7f0c7c15ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:56.513 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.499+0000 7f0c81494700 1 -- 172.21.15.188:0/1788558093 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c6c009550 con 0x7f0c7c0c4c10 2023-08-26T09:24:56.513 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.499+0000 7f0c81c95700 1 --2- 172.21.15.188:0/1788558093 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c7c06a860 0x7f0c7c13e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-26T09:24:56.514 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.499+0000 7f0c81494700 1 --2- 172.21.15.188:0/1788558093 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c7c0c4c10 0x7f0c7c0cf130 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c009f50 tx=0x7f0c6c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:24:56.514 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.500+0000 7f0c727fc700 1 -- 172.21.15.188:0/1788558093 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c004400 con 0x7f0c7c0c4c10 2023-08-26T09:24:56.514 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.500+0000 7f0c727fc700 1 -- 172.21.15.188:0/1788558093 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6c01f070 con 0x7f0c7c0c4c10 2023-08-26T09:24:56.514 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.500+0000 7f0c727fc700 1 -- 172.21.15.188:0/1788558093 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c0038e0 con 0x7f0c7c0c4c10 2023-08-26T09:24:56.514 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.500+0000 7f0c83ef9700 1 -- 172.21.15.188:0/1788558093 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c7c0ce860 con 0x7f0c7c0c4c10 2023-08-26T09:24:56.514 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.500+0000 7f0c83ef9700 1 -- 172.21.15.188:0/1788558093 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c7c0b3e80 con 0x7f0c7c0c4c10 2023-08-26T09:24:56.515 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.500+0000 7f0c727fc700 1 -- 172.21.15.188:0/1788558093 <== mon.2 v2:172.21.15.188:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0c6c021030 con 0x7f0c7c0c4c10 2023-08-26T09:24:56.515 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.500+0000 7f0c727fc700 1 -- 172.21.15.188:0/1788558093 <== mon.2 v2:172.21.15.188:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f0c6c01ae10 con 0x7f0c7c0c4c10 2023-08-26T09:24:56.515 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.501+0000 7f0c83ef9700 1 -- 172.21.15.188:0/1788558093 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c7c04eeb0 con 0x7f0c7c0c4c10 2023-08-26T09:24:56.515 INFO:tasks.ceph.mgr.x.smithi188.stderr:2023-08-26T09:24:56.501+0000 7fcf66a31200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-26T09:24:56.516 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.503+0000 7f0c727fc700 1 -- 172.21.15.188:0/1788558093 <== mon.2 v2:172.21.15.188:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f0c6c015020 con 0x7f0c7c0c4c10 2023-08-26T09:24:56.550 INFO:tasks.ceph.mgr.y.smithi092.stderr:2023-08-26T09:24:56.546+0000 7f278e1b6200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-26T09:24:56.591 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.586+0000 7f0c83ef9700 1 -- 172.21.15.188:0/1788558093 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8701dfee-629a-4d30-82e4-b8fac340303f", "id": 2} v 0) v1 -- 0x7f0c7c0cb270 con 0x7f0c7c0c4c10 2023-08-26T09:24:56.598 INFO:tasks.ceph.mgr.x.smithi188.stderr:2023-08-26T09:24:56.593+0000 7fcf66a31200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-26T09:24:56.599 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.594+0000 7f0c727fc700 1 -- 172.21.15.188:0/1788558093 <== mon.2 v2:172.21.15.188:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8701dfee-629a-4d30-82e4-b8fac340303f", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0c6c003d40 con 0x7f0c7c0c4c10 2023-08-26T09:24:56.599 INFO:teuthology.orchestra.run.smithi188.stdout:2 2023-08-26T09:24:56.600 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.595+0000 7f0c83ef9700 1 -- 172.21.15.188:0/1788558093 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c7c0c4c10 msgr2=0x7f0c7c0cf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:56.601 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.595+0000 7f0c83ef9700 1 --2- 172.21.15.188:0/1788558093 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c7c0c4c10 0x7f0c7c0cf130 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c009f50 tx=0x7f0c6c004750 comp rx=0 tx=0).stop 2023-08-26T09:24:56.601 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.595+0000 7f0c83ef9700 1 -- 172.21.15.188:0/1788558093 shutdown_connections 2023-08-26T09:24:56.601 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.595+0000 7f0c83ef9700 1 --2- 172.21.15.188:0/1788558093 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c7c06a860 0x7f0c7c13e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:56.601 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.595+0000 7f0c83ef9700 1 --2- 172.21.15.188:0/1788558093 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c7c144ae0 0x7f0c7c15ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:56.601 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.595+0000 7f0c83ef9700 1 --2- 172.21.15.188:0/1788558093 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c7c0c4c10 0x7f0c7c0cf130 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:56.602 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.595+0000 7f0c83ef9700 1 -- 172.21.15.188:0/1788558093 >> 172.21.15.188:0/1788558093 conn(0x7f0c7c06b430 msgr2=0x7f0c7c06b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:24:56.602 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.595+0000 7f0c83ef9700 1 -- 172.21.15.188:0/1788558093 shutdown_connections 2023-08-26T09:24:56.602 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.595+0000 7f0c83ef9700 1 -- 172.21.15.188:0/1788558093 wait complete. 2023-08-26T09:24:56.611 DEBUG:teuthology.orchestra.run.smithi188:> sudo ceph --cluster ceph osd new 93bdc94d-dc07-495f-995a-a6ad072f0247 3 2023-08-26T09:24:56.775 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.770+0000 7f478325a700 1 Processor -- start 2023-08-26T09:24:56.775 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.770+0000 7f478325a700 1 -- start start 2023-08-26T09:24:56.777 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.771+0000 7f478325a700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f477c0b1eb0 0x7f477c06b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:56.778 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.771+0000 7f478325a700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f477c0d25d0 con 0x7f477c15d490 2023-08-26T09:24:56.778 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.771+0000 7f478325a700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f477c0b57e0 con 0x7f477c0b6250 2023-08-26T09:24:56.778 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.771+0000 7f478325a700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f477c0cdc70 con 0x7f477c0b1eb0 2023-08-26T09:24:56.778 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.771+0000 7f477bfff700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f477c0b1eb0 0x7f477c06b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:56.779 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.771+0000 7f47817f7700 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f477c0b6250 0x7f477c0b66e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:33288/0 (socket says 172.21.15.188:33288) 2023-08-26T09:24:56.779 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.771+0000 7f47817f7700 1 -- 172.21.15.188:0/2547685029 learned_addr learned my addr 172.21.15.188:0/2547685029 (peer_addr_for_me v1:172.21.15.188:0/0) 2023-08-26T09:24:56.779 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.771+0000 7f477bfff700 1 -- 172.21.15.188:0/2547685029 >> v1:172.21.15.188:6789/0 conn(0x7f477c0b6250 legacy=0x7f477c0b66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:56.779 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.771+0000 7f477bfff700 1 -- 172.21.15.188:0/2547685029 >> v1:172.21.15.92:6789/0 conn(0x7f477c15d490 legacy=0x7f477c0ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:56.780 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.771+0000 7f477b7fe700 1 -- 172.21.15.188:0/2547685029 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1829087503 0 0) 0x7f477c0b57e0 con 0x7f477c0b6250 2023-08-26T09:24:56.780 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.771+0000 7f477bfff700 1 -- 172.21.15.188:0/2547685029 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f477c0d2820 con 0x7f477c0b1eb0 2023-08-26T09:24:56.780 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.771+0000 7f477bfff700 1 --2- 172.21.15.188:0/2547685029 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f477c0b1eb0 0x7f477c06b5e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4768009870 tx=0x7f4768009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd3ce79ade22131b server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:24:56.780 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.772+0000 7f477b7fe700 1 -- 172.21.15.188:0/2547685029 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4768011830 con 0x7f477c0b1eb0 2023-08-26T09:24:56.781 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.772+0000 7f477b7fe700 1 -- 172.21.15.188:0/2547685029 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4768011990 con 0x7f477c0b1eb0 2023-08-26T09:24:56.781 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.772+0000 7f477b7fe700 1 -- 172.21.15.188:0/2547685029 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4768011d20 con 0x7f477c0b1eb0 2023-08-26T09:24:56.781 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.772+0000 7f478325a700 1 -- 172.21.15.188:0/2547685029 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f477c0b1eb0 msgr2=0x7f477c06b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:56.781 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.772+0000 7f478325a700 1 --2- 172.21.15.188:0/2547685029 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f477c0b1eb0 0x7f477c06b5e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4768009870 tx=0x7f4768009b80 comp rx=0 tx=0).stop 2023-08-26T09:24:56.782 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.772+0000 7f478325a700 1 -- 172.21.15.188:0/2547685029 shutdown_connections 2023-08-26T09:24:56.782 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.772+0000 7f478325a700 1 --2- 172.21.15.188:0/2547685029 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f477c0b1eb0 0x7f477c06b5e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:56.782 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.772+0000 7f478325a700 1 -- 172.21.15.188:0/2547685029 >> 172.21.15.188:0/2547685029 conn(0x7f477c06aac0 msgr2=0x7f477c06aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:24:56.782 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.772+0000 7f478325a700 1 -- 172.21.15.188:0/2547685029 shutdown_connections 2023-08-26T09:24:56.782 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.772+0000 7f478325a700 1 -- 172.21.15.188:0/2547685029 wait complete. 2023-08-26T09:24:56.785 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.774+0000 7f478325a700 1 Processor -- start 2023-08-26T09:24:56.785 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.774+0000 7f478325a700 1 -- start start 2023-08-26T09:24:56.785 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.775+0000 7f478325a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f477c0b1eb0 0x7f477c14c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:56.785 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.775+0000 7f478325a700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f477c0b6250 0x7f477c0d1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:56.785 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.775+0000 7f478325a700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f477c15d490 0x7f477c15d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:56.786 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.775+0000 7f478325a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477c160850 con 0x7f477c0b1eb0 2023-08-26T09:24:56.786 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.775+0000 7f478325a700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477c15fcd0 con 0x7f477c0b6250 2023-08-26T09:24:56.786 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.775+0000 7f478325a700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f477c15ffb0 con 0x7f477c15d490 2023-08-26T09:24:56.786 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.775+0000 7f47817f7700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f477c15d490 0x7f477c15d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:56.786 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.775+0000 7f477bfff700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f477c0b6250 0x7f477c0d1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:56.787 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.775+0000 7f47817f7700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f477c15d490 0x7f477c15d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.188:49578/0 (socket says 172.21.15.188:49578) 2023-08-26T09:24:56.787 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.775+0000 7f47817f7700 1 -- 172.21.15.188:0/4079725690 learned_addr learned my addr 172.21.15.188:0/4079725690 (peer_addr_for_me v2:172.21.15.188:0/0) 2023-08-26T09:24:56.787 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.775+0000 7f4780ff6700 1 --2- 172.21.15.188:0/4079725690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f477c0b1eb0 0x7f477c14c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:56.787 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.776+0000 7f47817f7700 1 -- 172.21.15.188:0/4079725690 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f477c0b6250 msgr2=0x7f477c0d1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:56.787 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.776+0000 7f47817f7700 1 --2- 172.21.15.188:0/4079725690 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f477c0b6250 0x7f477c0d1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:56.788 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.776+0000 7f47817f7700 1 -- 172.21.15.188:0/4079725690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f477c0b1eb0 msgr2=0x7f477c14c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:56.788 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.776+0000 7f47817f7700 1 --2- 172.21.15.188:0/4079725690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f477c0b1eb0 0x7f477c14c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:56.788 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.776+0000 7f47817f7700 1 -- 172.21.15.188:0/4079725690 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47680094a0 con 0x7f477c15d490 2023-08-26T09:24:56.788 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.776+0000 7f477bfff700 1 --2- 172.21.15.188:0/4079725690 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f477c0b6250 0x7f477c0d1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-26T09:24:56.788 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.776+0000 7f47817f7700 1 --2- 172.21.15.188:0/4079725690 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f477c15d490 0x7f477c15d870 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f477400cc50 tx=0x7f477400cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:24:56.789 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.776+0000 7f47797fa700 1 -- 172.21.15.188:0/4079725690 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477400aa70 con 0x7f477c15d490 2023-08-26T09:24:56.789 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.776+0000 7f47797fa700 1 -- 172.21.15.188:0/4079725690 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477400abf0 con 0x7f477c15d490 2023-08-26T09:24:56.789 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.776+0000 7f47797fa700 1 -- 172.21.15.188:0/4079725690 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47740070d0 con 0x7f477c15d490 2023-08-26T09:24:56.789 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.776+0000 7f478325a700 1 -- 172.21.15.188:0/4079725690 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f477c160290 con 0x7f477c15d490 2023-08-26T09:24:56.789 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.776+0000 7f478325a700 1 -- 172.21.15.188:0/4079725690 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f477c15f980 con 0x7f477c15d490 2023-08-26T09:24:56.789 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.776+0000 7f47797fa700 1 -- 172.21.15.188:0/4079725690 <== mon.2 v2:172.21.15.188:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4774007530 con 0x7f477c15d490 2023-08-26T09:24:56.790 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.776+0000 7f47797fa700 1 -- 172.21.15.188:0/4079725690 <== mon.2 v2:172.21.15.188:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f4774012de0 con 0x7f477c15d490 2023-08-26T09:24:56.790 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.777+0000 7f478325a700 1 -- 172.21.15.188:0/4079725690 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f477c066ad0 con 0x7f477c15d490 2023-08-26T09:24:56.790 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.779+0000 7f47797fa700 1 -- 172.21.15.188:0/4079725690 <== mon.2 v2:172.21.15.188:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f4774018070 con 0x7f477c15d490 2023-08-26T09:24:56.869 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.864+0000 7f478325a700 1 -- 172.21.15.188:0/4079725690 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "osd new", "uuid": "93bdc94d-dc07-495f-995a-a6ad072f0247", "id": 3} v 0) v1 -- 0x7f477c04eeb0 con 0x7f477c15d490 2023-08-26T09:24:56.876 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.871+0000 7f47797fa700 1 -- 172.21.15.188:0/4079725690 <== mon.2 v2:172.21.15.188:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "93bdc94d-dc07-495f-995a-a6ad072f0247", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4774012400 con 0x7f477c15d490 2023-08-26T09:24:56.877 INFO:teuthology.orchestra.run.smithi188.stdout:3 2023-08-26T09:24:56.878 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.872+0000 7f478325a700 1 -- 172.21.15.188:0/4079725690 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f477c15d490 msgr2=0x7f477c15d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:56.878 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.872+0000 7f478325a700 1 --2- 172.21.15.188:0/4079725690 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f477c15d490 0x7f477c15d870 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f477400cc50 tx=0x7f477400cf60 comp rx=0 tx=0).stop 2023-08-26T09:24:56.878 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.873+0000 7f478325a700 1 -- 172.21.15.188:0/4079725690 shutdown_connections 2023-08-26T09:24:56.878 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.873+0000 7f478325a700 1 --2- 172.21.15.188:0/4079725690 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f477c15d490 0x7f477c15d870 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:56.879 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.873+0000 7f478325a700 1 --2- 172.21.15.188:0/4079725690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f477c0b1eb0 0x7f477c14c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:56.879 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.873+0000 7f478325a700 1 --2- 172.21.15.188:0/4079725690 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f477c0b6250 0x7f477c0d1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:56.879 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.873+0000 7f478325a700 1 -- 172.21.15.188:0/4079725690 >> 172.21.15.188:0/4079725690 conn(0x7f477c06aac0 msgr2=0x7f477c0b66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:24:56.879 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.873+0000 7f478325a700 1 -- 172.21.15.188:0/4079725690 shutdown_connections 2023-08-26T09:24:56.879 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:56.873+0000 7f478325a700 1 -- 172.21.15.188:0/4079725690 wait complete. 2023-08-26T09:24:56.889 DEBUG:teuthology.orchestra.run.smithi188:> sudo ceph --cluster ceph osd new d9d0ea80-8481-46a7-9677-c338d32cf1d2 4 2023-08-26T09:24:56.979 INFO:tasks.ceph.mgr.y.smithi092.stderr:2023-08-26T09:24:56.974+0000 7f278e1b6200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-26T09:24:57.010 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.005+0000 7f0d0d2c9700 1 Processor -- start 2023-08-26T09:24:57.011 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.005+0000 7f0d0d2c9700 1 -- start start 2023-08-26T09:24:57.014 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.006+0000 7f0d0d2c9700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0d0806aa30 0x7f0d08165cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:57.015 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.006+0000 7f0d0d2c9700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d0806b1a0 con 0x7f0d080c4c10 2023-08-26T09:24:57.015 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.006+0000 7f0d0d2c9700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d0806ea00 con 0x7f0d08144ae0 2023-08-26T09:24:57.015 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.006+0000 7f0d0d2c9700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d08144ec0 con 0x7f0d0806aa30 2023-08-26T09:24:57.015 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.006+0000 7f0d06ffd700 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f0d08144ae0 0x7f0d080c6500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:33296/0 (socket says 172.21.15.188:33296) 2023-08-26T09:24:57.015 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.006+0000 7f0d06ffd700 1 -- 172.21.15.188:0/1280662120 learned_addr learned my addr 172.21.15.188:0/1280662120 (peer_addr_for_me v1:172.21.15.188:0/0) 2023-08-26T09:24:57.016 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.007+0000 7f0d077fe700 1 --2- 172.21.15.188:0/1280662120 >> v2:172.21.15.92:3300/0 conn(0x7f0d0806aa30 0x7f0d08165cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:57.016 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.007+0000 7f0d05ffb700 1 -- 172.21.15.188:0/1280662120 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1214722912 0 0) 0x7f0d0806ea00 con 0x7f0d08144ae0 2023-08-26T09:24:57.016 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.007+0000 7f0d05ffb700 1 -- 172.21.15.188:0/1280662120 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cf00035b0 con 0x7f0d08144ae0 2023-08-26T09:24:57.016 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.007+0000 7f0d05ffb700 1 -- 172.21.15.188:0/1280662120 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2586807323 0 0) 0x7f0cf00035b0 con 0x7f0d08144ae0 2023-08-26T09:24:57.016 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.007+0000 7f0d05ffb700 1 -- 172.21.15.188:0/1280662120 >> v2:172.21.15.92:3300/0 conn(0x7f0d0806aa30 msgr2=0x7f0d08165cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:24:57.017 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.007+0000 7f0d05ffb700 1 --2- 172.21.15.188:0/1280662120 >> v2:172.21.15.92:3300/0 conn(0x7f0d0806aa30 0x7f0d08165cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:57.017 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.007+0000 7f0d05ffb700 1 -- 172.21.15.188:0/1280662120 >> v1:172.21.15.92:6789/0 conn(0x7f0d080c4c10 legacy=0x7f0d0806a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:57.017 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.007+0000 7f0d05ffb700 1 -- 172.21.15.188:0/1280662120 --> v1:172.21.15.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d0806dbe0 con 0x7f0d08144ae0 2023-08-26T09:24:57.017 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.007+0000 7f0d05ffb700 1 -- 172.21.15.188:0/1280662120 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1019361464 0 0) 0x7f0cf8001670 con 0x7f0d08144ae0 2023-08-26T09:24:57.017 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.007+0000 7f0d077fe700 1 --2- 172.21.15.188:0/1280662120 >> v2:172.21.15.92:3300/0 conn(0x7f0d0806aa30 0x7f0d08165cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-26T09:24:57.018 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.007+0000 7f0d05ffb700 1 -- 172.21.15.188:0/1280662120 >> v1:172.21.15.188:6789/0 conn(0x7f0d08144ae0 legacy=0x7f0d080c6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:57.018 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.007+0000 7f0d05ffb700 1 --2- 172.21.15.188:0/1280662120 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0cf0003a00 0x7f0cf0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:57.018 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.007+0000 7f0d05ffb700 1 --2- 172.21.15.188:0/1280662120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0cf0004850 0x7f0cf0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:57.018 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.007+0000 7f0d05ffb700 1 --2- 172.21.15.188:0/1280662120 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0cf0005210 0x7f0cf000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:57.018 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.007+0000 7f0d05ffb700 1 -- 172.21.15.188:0/1280662120 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d08144ec0 con 0x7f0cf0004850 2023-08-26T09:24:57.018 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.007+0000 7f0d05ffb700 1 -- 172.21.15.188:0/1280662120 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf000c0b0 con 0x7f0cf0005210 2023-08-26T09:24:57.019 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.007+0000 7f0d05ffb700 1 -- 172.21.15.188:0/1280662120 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf000c270 con 0x7f0cf0003a00 2023-08-26T09:24:57.019 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.007+0000 7f0d06ffd700 1 --2- 172.21.15.188:0/1280662120 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0cf0003a00 0x7f0cf0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:57.019 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.007+0000 7f0d067fc700 1 --2- 172.21.15.188:0/1280662120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0cf0004850 0x7f0cf0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:57.019 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.007+0000 7f0d077fe700 1 --2- 172.21.15.188:0/1280662120 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0cf0005210 0x7f0cf000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:57.019 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.007+0000 7f0d06ffd700 1 -- 172.21.15.188:0/1280662120 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0cf0005210 msgr2=0x7f0cf000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:24:57.020 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.007+0000 7f0d06ffd700 1 --2- 172.21.15.188:0/1280662120 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0cf0005210 0x7f0cf000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:57.020 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.007+0000 7f0d06ffd700 1 -- 172.21.15.188:0/1280662120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0cf0004850 msgr2=0x7f0cf0004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:24:57.020 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.007+0000 7f0d06ffd700 1 --2- 172.21.15.188:0/1280662120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0cf0004850 0x7f0cf0004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:57.020 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.007+0000 7f0d06ffd700 1 -- 172.21.15.188:0/1280662120 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf00035b0 con 0x7f0cf0003a00 2023-08-26T09:24:57.020 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.007+0000 7f0d077fe700 1 -- 172.21.15.188:0/1280662120 reap_dead start 2023-08-26T09:24:57.021 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.008+0000 7f0d06ffd700 1 --2- 172.21.15.188:0/1280662120 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0cf0003a00 0x7f0cf0003e20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0cf800c2a0 tx=0x7f0cf0005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1837417e467d048f server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:24:57.021 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.008+0000 7f0d05ffb700 1 -- 172.21.15.188:0/1280662120 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf8007c10 con 0x7f0cf0003a00 2023-08-26T09:24:57.021 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.008+0000 7f0d05ffb700 1 -- 172.21.15.188:0/1280662120 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf800cd60 con 0x7f0cf0003a00 2023-08-26T09:24:57.021 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.008+0000 7f0d05ffb700 1 -- 172.21.15.188:0/1280662120 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf8005ba0 con 0x7f0cf0003a00 2023-08-26T09:24:57.021 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.008+0000 7f0d0d2c9700 1 -- 172.21.15.188:0/1280662120 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0cf0003a00 msgr2=0x7f0cf0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:57.021 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.008+0000 7f0d0d2c9700 1 --2- 172.21.15.188:0/1280662120 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0cf0003a00 0x7f0cf0003e20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0cf800c2a0 tx=0x7f0cf0005880 comp rx=0 tx=0).stop 2023-08-26T09:24:57.022 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.008+0000 7f0d0d2c9700 1 -- 172.21.15.188:0/1280662120 shutdown_connections 2023-08-26T09:24:57.022 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.008+0000 7f0d0d2c9700 1 --2- 172.21.15.188:0/1280662120 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0cf0003a00 0x7f0cf0003e20 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:57.022 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.008+0000 7f0d0d2c9700 1 -- 172.21.15.188:0/1280662120 >> 172.21.15.188:0/1280662120 conn(0x7f0d0806b430 msgr2=0x7f0d0806b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:24:57.022 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.008+0000 7f0d0d2c9700 1 -- 172.21.15.188:0/1280662120 shutdown_connections 2023-08-26T09:24:57.022 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.008+0000 7f0d0d2c9700 1 -- 172.21.15.188:0/1280662120 wait complete. 2023-08-26T09:24:57.023 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.010+0000 7f0d0d2c9700 1 Processor -- start 2023-08-26T09:24:57.023 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.010+0000 7f0d0d2c9700 1 -- start start 2023-08-26T09:24:57.025 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.010+0000 7f0d0d2c9700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0cf0003a00 0x7f0d081f45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:57.025 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.010+0000 7f0d0d2c9700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0d0815ab90 0x7f0d08143520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:57.026 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.010+0000 7f0d0d2c9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d08143a60 0x7f0d081f0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:57.026 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.011+0000 7f0d0d2c9700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d08143ee0 con 0x7f0d08143a60 2023-08-26T09:24:57.026 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.011+0000 7f0d0d2c9700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0813fbf0 con 0x7f0cf0003a00 2023-08-26T09:24:57.026 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.011+0000 7f0d0d2c9700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d081f4110 con 0x7f0d0815ab90 2023-08-26T09:24:57.026 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.011+0000 7f0d06ffd700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0cf0003a00 0x7f0d081f45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:57.027 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.011+0000 7f0d06ffd700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0cf0003a00 0x7f0d081f45a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:39528/0 (socket says 172.21.15.188:39528) 2023-08-26T09:24:57.027 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.011+0000 7f0d06ffd700 1 -- 172.21.15.188:0/2683326105 learned_addr learned my addr 172.21.15.188:0/2683326105 (peer_addr_for_me v2:172.21.15.188:0/0) 2023-08-26T09:24:57.027 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.011+0000 7f0d067fc700 1 --2- 172.21.15.188:0/2683326105 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0d0815ab90 0x7f0d08143520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:57.027 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.011+0000 7f0d077fe700 1 --2- 172.21.15.188:0/2683326105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d08143a60 0x7f0d081f0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:57.027 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.011+0000 7f0d067fc700 1 -- 172.21.15.188:0/2683326105 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0cf0003a00 msgr2=0x7f0d081f45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:57.028 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.011+0000 7f0d067fc700 1 --2- 172.21.15.188:0/2683326105 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0cf0003a00 0x7f0d081f45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:57.028 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.011+0000 7f0d067fc700 1 -- 172.21.15.188:0/2683326105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d08143a60 msgr2=0x7f0d081f0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:57.028 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.011+0000 7f0d067fc700 1 --2- 172.21.15.188:0/2683326105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d08143a60 0x7f0d081f0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:57.028 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.011+0000 7f0d067fc700 1 -- 172.21.15.188:0/2683326105 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d081f13a0 con 0x7f0d0815ab90 2023-08-26T09:24:57.028 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.011+0000 7f0d06ffd700 1 --2- 172.21.15.188:0/2683326105 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0cf0003a00 0x7f0d081f45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-26T09:24:57.028 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.011+0000 7f0d067fc700 1 --2- 172.21.15.188:0/2683326105 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0d0815ab90 0x7f0d08143520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0d08069cd0 tx=0x7f0cfc00fa50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:24:57.029 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.011+0000 7f0cef7fe700 1 -- 172.21.15.188:0/2683326105 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc005320 con 0x7f0d0815ab90 2023-08-26T09:24:57.029 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.011+0000 7f0cef7fe700 1 -- 172.21.15.188:0/2683326105 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cfc005480 con 0x7f0d0815ab90 2023-08-26T09:24:57.029 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.011+0000 7f0d0d2c9700 1 -- 172.21.15.188:0/2683326105 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d081f10c0 con 0x7f0d0815ab90 2023-08-26T09:24:57.029 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.011+0000 7f0cef7fe700 1 -- 172.21.15.188:0/2683326105 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc006a80 con 0x7f0d0815ab90 2023-08-26T09:24:57.029 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.011+0000 7f0d0d2c9700 1 -- 172.21.15.188:0/2683326105 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d081f3da0 con 0x7f0d0815ab90 2023-08-26T09:24:57.030 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.011+0000 7f0cef7fe700 1 -- 172.21.15.188:0/2683326105 <== mon.2 v2:172.21.15.188:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0cfc007030 con 0x7f0d0815ab90 2023-08-26T09:24:57.030 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.012+0000 7f0cef7fe700 1 -- 172.21.15.188:0/2683326105 <== mon.2 v2:172.21.15.188:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f0cfc003810 con 0x7f0d0815ab90 2023-08-26T09:24:57.030 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.012+0000 7f0d0d2c9700 1 -- 172.21.15.188:0/2683326105 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d0804eeb0 con 0x7f0d0815ab90 2023-08-26T09:24:57.030 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.014+0000 7f0cef7fe700 1 -- 172.21.15.188:0/2683326105 <== mon.2 v2:172.21.15.188:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f0cfc01a070 con 0x7f0d0815ab90 2023-08-26T09:24:57.055 INFO:tasks.ceph.mgr.x.smithi188.stderr:2023-08-26T09:24:57.050+0000 7fcf66a31200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-26T09:24:57.103 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.098+0000 7f0d0d2c9700 1 -- 172.21.15.188:0/2683326105 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d9d0ea80-8481-46a7-9677-c338d32cf1d2", "id": 4} v 0) v1 -- 0x7f0d08142190 con 0x7f0d0815ab90 2023-08-26T09:24:57.111 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.106+0000 7f0cef7fe700 1 -- 172.21.15.188:0/2683326105 <== mon.2 v2:172.21.15.188:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d9d0ea80-8481-46a7-9677-c338d32cf1d2", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0cfc003a20 con 0x7f0d0815ab90 2023-08-26T09:24:57.111 INFO:teuthology.orchestra.run.smithi188.stdout:4 2023-08-26T09:24:57.112 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.107+0000 7f0d0d2c9700 1 -- 172.21.15.188:0/2683326105 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0d0815ab90 msgr2=0x7f0d08143520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:57.113 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.107+0000 7f0d0d2c9700 1 --2- 172.21.15.188:0/2683326105 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0d0815ab90 0x7f0d08143520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0d08069cd0 tx=0x7f0cfc00fa50 comp rx=0 tx=0).stop 2023-08-26T09:24:57.113 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.107+0000 7f0d0d2c9700 1 -- 172.21.15.188:0/2683326105 shutdown_connections 2023-08-26T09:24:57.113 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.107+0000 7f0d0d2c9700 1 --2- 172.21.15.188:0/2683326105 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0cf0003a00 0x7f0d081f45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:57.113 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.107+0000 7f0d0d2c9700 1 --2- 172.21.15.188:0/2683326105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d08143a60 0x7f0d081f0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:57.113 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.107+0000 7f0d0d2c9700 1 --2- 172.21.15.188:0/2683326105 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0d0815ab90 0x7f0d08143520 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:57.114 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.107+0000 7f0d0d2c9700 1 -- 172.21.15.188:0/2683326105 >> 172.21.15.188:0/2683326105 conn(0x7f0d0806b430 msgr2=0x7f0d0815d950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:24:57.114 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.107+0000 7f0d0d2c9700 1 -- 172.21.15.188:0/2683326105 shutdown_connections 2023-08-26T09:24:57.114 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.107+0000 7f0d0d2c9700 1 -- 172.21.15.188:0/2683326105 wait complete. 2023-08-26T09:24:57.125 DEBUG:teuthology.orchestra.run.smithi188:> sudo ceph --cluster ceph osd new 38d03253-467a-456f-bd5e-5a46532a0b18 5 2023-08-26T09:24:57.246 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.241+0000 7fee63868700 1 Processor -- start 2023-08-26T09:24:57.246 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.241+0000 7fee63868700 1 -- start start 2023-08-26T09:24:57.249 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.242+0000 7fee63868700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fee5c15def0 0x7fee5c0ceb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:57.249 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.242+0000 7fee63868700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fee5c0ce150 0x7fee5c15e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:57.249 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.242+0000 7fee63868700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee5c0cd3b0 con 0x7fee5c15e810 2023-08-26T09:24:57.250 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.242+0000 7fee63868700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee5c0cd690 con 0x7fee5c0ce150 2023-08-26T09:24:57.250 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.242+0000 7fee63868700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c0cd970 con 0x7fee5c15def0 2023-08-26T09:24:57.250 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.242+0000 7fee61e05700 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7fee5c15e810 0x7fee5c0c9aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:33316/0 (socket says 172.21.15.188:33316) 2023-08-26T09:24:57.250 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.242+0000 7fee61e05700 1 -- 172.21.15.188:0/3804632504 learned_addr learned my addr 172.21.15.188:0/3804632504 (peer_addr_for_me v1:172.21.15.188:0/0) 2023-08-26T09:24:57.250 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.242+0000 7fee61604700 1 --2- 172.21.15.188:0/3804632504 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fee5c15def0 0x7fee5c0ceb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:57.251 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.242+0000 7fee60e03700 1 --2- 172.21.15.188:0/3804632504 >> v2:172.21.15.92:3300/0 conn(0x7fee5c0ce150 0x7fee5c15e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:57.251 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.242+0000 7fee53fff700 1 -- 172.21.15.188:0/3804632504 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2255942239 0 0) 0x7fee5c0cd3b0 con 0x7fee5c15e810 2023-08-26T09:24:57.251 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.242+0000 7fee53fff700 1 -- 172.21.15.188:0/3804632504 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee480035b0 con 0x7fee5c15e810 2023-08-26T09:24:57.251 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.242+0000 7fee61604700 1 -- 172.21.15.188:0/3804632504 >> v2:172.21.15.92:3300/0 conn(0x7fee5c0ce150 msgr2=0x7fee5c15e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:24:57.251 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.242+0000 7fee61604700 1 --2- 172.21.15.188:0/3804632504 >> v2:172.21.15.92:3300/0 conn(0x7fee5c0ce150 0x7fee5c15e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:57.252 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.242+0000 7fee61604700 1 -- 172.21.15.188:0/3804632504 >> v1:172.21.15.188:6789/0 conn(0x7fee5c15e810 legacy=0x7fee5c0c9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:57.252 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.242+0000 7fee61604700 1 -- 172.21.15.188:0/3804632504 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee5c0cdc50 con 0x7fee5c15def0 2023-08-26T09:24:57.252 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.243+0000 7fee61604700 1 --2- 172.21.15.188:0/3804632504 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fee5c15def0 0x7fee5c0ceb80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fee58009840 tx=0x7fee58009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=177675aee676eb4e server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:24:57.252 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.243+0000 7fee53fff700 1 -- 172.21.15.188:0/3804632504 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee58011830 con 0x7fee5c15def0 2023-08-26T09:24:57.252 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.243+0000 7fee53fff700 1 -- 172.21.15.188:0/3804632504 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee58011990 con 0x7fee5c15def0 2023-08-26T09:24:57.253 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.243+0000 7fee53fff700 1 -- 172.21.15.188:0/3804632504 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee58011d20 con 0x7fee5c15def0 2023-08-26T09:24:57.253 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.244+0000 7fee63868700 1 -- 172.21.15.188:0/3804632504 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fee5c15def0 msgr2=0x7fee5c0ceb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:57.253 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.244+0000 7fee63868700 1 --2- 172.21.15.188:0/3804632504 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fee5c15def0 0x7fee5c0ceb80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fee58009840 tx=0x7fee58009b50 comp rx=0 tx=0).stop 2023-08-26T09:24:57.253 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.244+0000 7fee63868700 1 -- 172.21.15.188:0/3804632504 shutdown_connections 2023-08-26T09:24:57.254 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.244+0000 7fee63868700 1 --2- 172.21.15.188:0/3804632504 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fee5c15def0 0x7fee5c0ceb80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:57.254 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.244+0000 7fee63868700 1 --2- 172.21.15.188:0/3804632504 >> v2:172.21.15.92:3300/0 conn(0x7fee5c0ce150 0x7fee5c15e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:57.254 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.244+0000 7fee63868700 1 -- 172.21.15.188:0/3804632504 >> 172.21.15.188:0/3804632504 conn(0x7fee5c0cf450 msgr2=0x7fee5c0cf860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:24:57.254 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.244+0000 7fee63868700 1 -- 172.21.15.188:0/3804632504 shutdown_connections 2023-08-26T09:24:57.254 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.244+0000 7fee63868700 1 -- 172.21.15.188:0/3804632504 wait complete. 2023-08-26T09:24:57.257 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.245+0000 7fee63868700 1 Processor -- start 2023-08-26T09:24:57.257 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.245+0000 7fee63868700 1 -- start start 2023-08-26T09:24:57.257 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.246+0000 7fee63868700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fee5c15def0 0x7fee5c156c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:57.258 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.246+0000 7fee63868700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee5c15e810 0x7fee5c0aee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:57.258 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.246+0000 7fee63868700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fee5c0af3d0 0x7fee5c0b4080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:57.258 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.246+0000 7fee63868700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c0af880 con 0x7fee5c15e810 2023-08-26T09:24:57.258 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.246+0000 7fee63868700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c1571c0 con 0x7fee5c15def0 2023-08-26T09:24:57.258 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.246+0000 7fee63868700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c15a020 con 0x7fee5c0af3d0 2023-08-26T09:24:57.259 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.246+0000 7fee61604700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fee5c15def0 0x7fee5c156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:57.259 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.246+0000 7fee61e05700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fee5c0af3d0 0x7fee5c0b4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:57.259 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.246+0000 7fee61604700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fee5c15def0 0x7fee5c156c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:39540/0 (socket says 172.21.15.188:39540) 2023-08-26T09:24:57.259 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.246+0000 7fee61604700 1 -- 172.21.15.188:0/2711167974 learned_addr learned my addr 172.21.15.188:0/2711167974 (peer_addr_for_me v2:172.21.15.188:0/0) 2023-08-26T09:24:57.260 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.246+0000 7fee60e03700 1 --2- 172.21.15.188:0/2711167974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee5c15e810 0x7fee5c0aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:57.260 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.246+0000 7fee61e05700 1 -- 172.21.15.188:0/2711167974 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fee5c15def0 msgr2=0x7fee5c156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:57.260 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.246+0000 7fee61e05700 1 --2- 172.21.15.188:0/2711167974 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fee5c15def0 0x7fee5c156c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:57.260 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.246+0000 7fee61e05700 1 -- 172.21.15.188:0/2711167974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee5c15e810 msgr2=0x7fee5c0aee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:57.260 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.246+0000 7fee61e05700 1 --2- 172.21.15.188:0/2711167974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee5c15e810 0x7fee5c0aee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:57.261 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.246+0000 7fee61e05700 1 -- 172.21.15.188:0/2711167974 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee580094a0 con 0x7fee5c0af3d0 2023-08-26T09:24:57.261 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.246+0000 7fee61e05700 1 --2- 172.21.15.188:0/2711167974 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fee5c0af3d0 0x7fee5c0b4080 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fee5400caa0 tx=0x7fee5400cdb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:24:57.261 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.246+0000 7fee51ffb700 1 -- 172.21.15.188:0/2711167974 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5400a9e0 con 0x7fee5c0af3d0 2023-08-26T09:24:57.261 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.246+0000 7fee51ffb700 1 -- 172.21.15.188:0/2711167974 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee5400ab40 con 0x7fee5c0af3d0 2023-08-26T09:24:57.262 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.246+0000 7fee63868700 1 -- 172.21.15.188:0/2711167974 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee5c159450 con 0x7fee5c0af3d0 2023-08-26T09:24:57.262 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.246+0000 7fee51ffb700 1 -- 172.21.15.188:0/2711167974 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee54012400 con 0x7fee5c0af3d0 2023-08-26T09:24:57.262 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.247+0000 7fee51ffb700 1 -- 172.21.15.188:0/2711167974 <== mon.2 v2:172.21.15.188:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fee54012560 con 0x7fee5c0af3d0 2023-08-26T09:24:57.262 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.247+0000 7fee63868700 1 -- 172.21.15.188:0/2711167974 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee5c1599d0 con 0x7fee5c0af3d0 2023-08-26T09:24:57.262 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.247+0000 7fee51ffb700 1 -- 172.21.15.188:0/2711167974 <== mon.2 v2:172.21.15.188:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fee5401ba20 con 0x7fee5c0af3d0 2023-08-26T09:24:57.263 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.248+0000 7fee63868700 1 -- 172.21.15.188:0/2711167974 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee5c15a190 con 0x7fee5c0af3d0 2023-08-26T09:24:57.263 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.250+0000 7fee51ffb700 1 -- 172.21.15.188:0/2711167974 <== mon.2 v2:172.21.15.188:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fee54017070 con 0x7fee5c0af3d0 2023-08-26T09:24:57.337 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.332+0000 7fee63868700 1 -- 172.21.15.188:0/2711167974 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "osd new", "uuid": "38d03253-467a-456f-bd5e-5a46532a0b18", "id": 5} v 0) v1 -- 0x7fee5c04eeb0 con 0x7fee5c0af3d0 2023-08-26T09:24:57.345 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.340+0000 7fee51ffb700 1 -- 172.21.15.188:0/2711167974 <== mon.2 v2:172.21.15.188:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "38d03253-467a-456f-bd5e-5a46532a0b18", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fee5401bbe0 con 0x7fee5c0af3d0 2023-08-26T09:24:57.353 INFO:teuthology.orchestra.run.smithi188.stdout:5 2023-08-26T09:24:57.354 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.341+0000 7fee63868700 1 -- 172.21.15.188:0/2711167974 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fee5c0af3d0 msgr2=0x7fee5c0b4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:57.354 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.341+0000 7fee63868700 1 --2- 172.21.15.188:0/2711167974 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fee5c0af3d0 0x7fee5c0b4080 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fee5400caa0 tx=0x7fee5400cdb0 comp rx=0 tx=0).stop 2023-08-26T09:24:57.355 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.341+0000 7fee63868700 1 -- 172.21.15.188:0/2711167974 shutdown_connections 2023-08-26T09:24:57.355 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.341+0000 7fee63868700 1 --2- 172.21.15.188:0/2711167974 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fee5c15def0 0x7fee5c156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:57.355 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.341+0000 7fee63868700 1 --2- 172.21.15.188:0/2711167974 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fee5c0af3d0 0x7fee5c0b4080 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:57.355 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.341+0000 7fee63868700 1 --2- 172.21.15.188:0/2711167974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee5c15e810 0x7fee5c0aee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:57.355 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.341+0000 7fee63868700 1 -- 172.21.15.188:0/2711167974 >> 172.21.15.188:0/2711167974 conn(0x7fee5c0cf450 msgr2=0x7fee5c0afc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:24:57.356 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.341+0000 7fee63868700 1 -- 172.21.15.188:0/2711167974 shutdown_connections 2023-08-26T09:24:57.356 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.341+0000 7fee63868700 1 -- 172.21.15.188:0/2711167974 wait complete. 2023-08-26T09:24:57.358 DEBUG:teuthology.orchestra.run.smithi188:> sudo ceph --cluster ceph osd new d61564b5-136f-42e5-a843-626c2017cc35 6 2023-08-26T09:24:57.500 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.495+0000 7f1f6ec58700 1 Processor -- start 2023-08-26T09:24:57.500 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.495+0000 7f1f6ec58700 1 -- start start 2023-08-26T09:24:57.501 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.497+0000 7f1f6ec58700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f680b1eb0 0x7f1f6806b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:57.501 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.497+0000 7f1f6ec58700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f1f680b6250 0x7f1f680b66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:57.502 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.497+0000 7f1f6ec58700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f680d25d0 con 0x7f1f6815d490 2023-08-26T09:24:57.502 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.497+0000 7f1f6ec58700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f680cdc70 con 0x7f1f680b6250 2023-08-26T09:24:57.502 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.497+0000 7f1f6ec58700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6815d870 con 0x7f1f680b1eb0 2023-08-26T09:24:57.504 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.497+0000 7f1f6c9f4700 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f1f6815d490 0x7f1f680ce0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:33324/0 (socket says 172.21.15.188:33324) 2023-08-26T09:24:57.504 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.497+0000 7f1f6c9f4700 1 -- 172.21.15.188:0/3141607563 learned_addr learned my addr 172.21.15.188:0/3141607563 (peer_addr_for_me v1:172.21.15.188:0/0) 2023-08-26T09:24:57.504 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.497+0000 7f1f67fff700 1 --2- 172.21.15.188:0/3141607563 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f680b1eb0 0x7f1f6806b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:57.505 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.497+0000 7f1f6d1f5700 1 --2- 172.21.15.188:0/3141607563 >> v2:172.21.15.92:3300/0 conn(0x7f1f680b6250 0x7f1f680b66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:57.505 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.497+0000 7f1f677fe700 1 -- 172.21.15.188:0/3141607563 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3934015778 0 0) 0x7f1f680d25d0 con 0x7f1f6815d490 2023-08-26T09:24:57.506 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.497+0000 7f1f677fe700 1 -- 172.21.15.188:0/3141607563 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f580035b0 con 0x7f1f6815d490 2023-08-26T09:24:57.507 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.497+0000 7f1f67fff700 1 -- 172.21.15.188:0/3141607563 >> v2:172.21.15.92:3300/0 conn(0x7f1f680b6250 msgr2=0x7f1f680b66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:24:57.507 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.497+0000 7f1f67fff700 1 --2- 172.21.15.188:0/3141607563 >> v2:172.21.15.92:3300/0 conn(0x7f1f680b6250 0x7f1f680b66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:57.507 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.497+0000 7f1f677fe700 1 -- 172.21.15.188:0/3141607563 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2193255219 0 0) 0x7f1f580035b0 con 0x7f1f6815d490 2023-08-26T09:24:57.507 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.497+0000 7f1f67fff700 1 -- 172.21.15.188:0/3141607563 >> v1:172.21.15.188:6789/0 conn(0x7f1f6815d490 legacy=0x7f1f680ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:57.508 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.497+0000 7f1f67fff700 1 -- 172.21.15.188:0/3141607563 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f680b57e0 con 0x7f1f680b1eb0 2023-08-26T09:24:57.508 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.497+0000 7f1f6d1f5700 1 --2- 172.21.15.188:0/3141607563 >> v2:172.21.15.92:3300/0 conn(0x7f1f680b6250 0x7f1f680b66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-26T09:24:57.508 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.498+0000 7f1f67fff700 1 --2- 172.21.15.188:0/3141607563 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f680b1eb0 0x7f1f6806b5e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1f54009840 tx=0x7f1f54009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb604ec8122a7eea server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:24:57.509 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.498+0000 7f1f677fe700 1 -- 172.21.15.188:0/3141607563 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c001670 con 0x7f1f680b1eb0 2023-08-26T09:24:57.509 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.498+0000 7f1f677fe700 1 -- 172.21.15.188:0/3141607563 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f54004030 con 0x7f1f680b1eb0 2023-08-26T09:24:57.509 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.498+0000 7f1f677fe700 1 -- 172.21.15.188:0/3141607563 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f540043c0 con 0x7f1f680b1eb0 2023-08-26T09:24:57.509 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.499+0000 7f1f6ec58700 1 -- 172.21.15.188:0/3141607563 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f680b1eb0 msgr2=0x7f1f6806b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:57.510 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.499+0000 7f1f6ec58700 1 --2- 172.21.15.188:0/3141607563 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f680b1eb0 0x7f1f6806b5e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1f54009840 tx=0x7f1f54009b50 comp rx=0 tx=0).stop 2023-08-26T09:24:57.510 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.499+0000 7f1f6ec58700 1 -- 172.21.15.188:0/3141607563 shutdown_connections 2023-08-26T09:24:57.510 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.499+0000 7f1f6ec58700 1 --2- 172.21.15.188:0/3141607563 >> v2:172.21.15.92:3300/0 conn(0x7f1f680b6250 0x7f1f680b66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:57.510 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.499+0000 7f1f6ec58700 1 --2- 172.21.15.188:0/3141607563 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f680b1eb0 0x7f1f6806b5e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:57.512 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.499+0000 7f1f6ec58700 1 -- 172.21.15.188:0/3141607563 >> 172.21.15.188:0/3141607563 conn(0x7f1f6806aac0 msgr2=0x7f1f6806aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:24:57.512 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.499+0000 7f1f6ec58700 1 -- 172.21.15.188:0/3141607563 shutdown_connections 2023-08-26T09:24:57.512 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.499+0000 7f1f6ec58700 1 -- 172.21.15.188:0/3141607563 wait complete. 2023-08-26T09:24:57.514 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.500+0000 7f1f6ec58700 1 Processor -- start 2023-08-26T09:24:57.515 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.501+0000 7f1f6ec58700 1 -- start start 2023-08-26T09:24:57.515 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.502+0000 7f1f6ec58700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f680b1eb0 0x7f1f6815c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:57.515 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.502+0000 7f1f6ec58700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f680b6250 0x7f1f680c9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:57.515 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.502+0000 7f1f6ec58700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f6815d490 0x7f1f680cb130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:57.516 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.502+0000 7f1f6ec58700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6815cce0 con 0x7f1f680b1eb0 2023-08-26T09:24:57.516 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.502+0000 7f1f6ec58700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f680c7c00 con 0x7f1f6815d490 2023-08-26T09:24:57.516 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.502+0000 7f1f6ec58700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f680c7ee0 con 0x7f1f680b6250 2023-08-26T09:24:57.516 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.502+0000 7f1f6d1f5700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f6815d490 0x7f1f680cb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:57.517 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.502+0000 7f1f6d1f5700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f6815d490 0x7f1f680cb130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:39554/0 (socket says 172.21.15.188:39554) 2023-08-26T09:24:57.517 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.502+0000 7f1f6d1f5700 1 -- 172.21.15.188:0/1254457266 learned_addr learned my addr 172.21.15.188:0/1254457266 (peer_addr_for_me v2:172.21.15.188:0/0) 2023-08-26T09:24:57.517 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.502+0000 7f1f6c9f4700 1 --2- 172.21.15.188:0/1254457266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f680b1eb0 0x7f1f6815c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:57.517 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.502+0000 7f1f67fff700 1 --2- 172.21.15.188:0/1254457266 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f680b6250 0x7f1f680c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:57.517 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.502+0000 7f1f6d1f5700 1 -- 172.21.15.188:0/1254457266 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f680b6250 msgr2=0x7f1f680c9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:57.518 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.502+0000 7f1f6d1f5700 1 --2- 172.21.15.188:0/1254457266 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f680b6250 0x7f1f680c9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:57.518 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.502+0000 7f1f6d1f5700 1 -- 172.21.15.188:0/1254457266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f680b1eb0 msgr2=0x7f1f6815c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:57.518 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.502+0000 7f1f6d1f5700 1 --2- 172.21.15.188:0/1254457266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f680b1eb0 0x7f1f6815c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:57.518 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.502+0000 7f1f6d1f5700 1 -- 172.21.15.188:0/1254457266 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f60009a70 con 0x7f1f6815d490 2023-08-26T09:24:57.518 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.502+0000 7f1f6d1f5700 1 --2- 172.21.15.188:0/1254457266 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f6815d490 0x7f1f680cb130 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1f6000efc0 tx=0x7f1f6000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:24:57.519 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.503+0000 7f1f657fa700 1 -- 172.21.15.188:0/1254457266 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6000cb40 con 0x7f1f6815d490 2023-08-26T09:24:57.519 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.503+0000 7f1f6ec58700 1 -- 172.21.15.188:0/1254457266 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f540094a0 con 0x7f1f6815d490 2023-08-26T09:24:57.519 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.503+0000 7f1f6ec58700 1 -- 172.21.15.188:0/1254457266 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f680c84a0 con 0x7f1f6815d490 2023-08-26T09:24:57.519 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.503+0000 7f1f657fa700 1 -- 172.21.15.188:0/1254457266 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f6000f040 con 0x7f1f6815d490 2023-08-26T09:24:57.519 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.503+0000 7f1f657fa700 1 -- 172.21.15.188:0/1254457266 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f60003a20 con 0x7f1f6815d490 2023-08-26T09:24:57.520 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.504+0000 7f1f657fa700 1 -- 172.21.15.188:0/1254457266 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1f60004020 con 0x7f1f6815d490 2023-08-26T09:24:57.520 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.504+0000 7f1f657fa700 1 -- 172.21.15.188:0/1254457266 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f1f60014db0 con 0x7f1f6815d490 2023-08-26T09:24:57.520 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.504+0000 7f1f6ec58700 1 -- 172.21.15.188:0/1254457266 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f480052f0 con 0x7f1f6815d490 2023-08-26T09:24:57.520 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.508+0000 7f1f657fa700 1 -- 172.21.15.188:0/1254457266 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f1f60018030 con 0x7f1f6815d490 2023-08-26T09:24:57.597 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.592+0000 7f1f6ec58700 1 -- 172.21.15.188:0/1254457266 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d61564b5-136f-42e5-a843-626c2017cc35", "id": 6} v 0) v1 -- 0x7f1f48005640 con 0x7f1f6815d490 2023-08-26T09:24:57.604 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.599+0000 7f1f657fa700 1 -- 172.21.15.188:0/1254457266 <== mon.1 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d61564b5-136f-42e5-a843-626c2017cc35", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1f600147c0 con 0x7f1f6815d490 2023-08-26T09:24:57.605 INFO:teuthology.orchestra.run.smithi188.stdout:6 2023-08-26T09:24:57.605 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.600+0000 7f1f6ec58700 1 -- 172.21.15.188:0/1254457266 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f6815d490 msgr2=0x7f1f680cb130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:57.606 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.600+0000 7f1f6ec58700 1 --2- 172.21.15.188:0/1254457266 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f6815d490 0x7f1f680cb130 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1f6000efc0 tx=0x7f1f6000c3a0 comp rx=0 tx=0).stop 2023-08-26T09:24:57.606 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.600+0000 7f1f6ec58700 1 -- 172.21.15.188:0/1254457266 shutdown_connections 2023-08-26T09:24:57.606 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.600+0000 7f1f6ec58700 1 --2- 172.21.15.188:0/1254457266 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f6815d490 0x7f1f680cb130 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:57.606 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.600+0000 7f1f6ec58700 1 --2- 172.21.15.188:0/1254457266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f680b1eb0 0x7f1f6815c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:57.606 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.600+0000 7f1f6ec58700 1 --2- 172.21.15.188:0/1254457266 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f680b6250 0x7f1f680c9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:57.607 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.600+0000 7f1f6ec58700 1 -- 172.21.15.188:0/1254457266 >> 172.21.15.188:0/1254457266 conn(0x7f1f6806aac0 msgr2=0x7f1f680b7960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:24:57.607 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.601+0000 7f1f6ec58700 1 -- 172.21.15.188:0/1254457266 shutdown_connections 2023-08-26T09:24:57.607 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.601+0000 7f1f6ec58700 1 -- 172.21.15.188:0/1254457266 wait complete. 2023-08-26T09:24:57.614 INFO:tasks.ceph.mgr.y.smithi092.stderr:2023-08-26T09:24:57.610+0000 7f278e1b6200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-26T09:24:57.618 DEBUG:teuthology.orchestra.run.smithi188:> sudo ceph --cluster ceph osd new fae2949e-0d62-42cd-ba72-08f516084b20 7 2023-08-26T09:24:57.682 INFO:tasks.ceph.mgr.y.smithi092.stderr:2023-08-26T09:24:57.678+0000 7f278e1b6200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-26T09:24:57.716 INFO:tasks.ceph.mgr.x.smithi188.stderr:2023-08-26T09:24:57.711+0000 7fcf66a31200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-26T09:24:57.753 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.737+0000 7fa416012700 1 Processor -- start 2023-08-26T09:24:57.753 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.738+0000 7fa416012700 1 -- start start 2023-08-26T09:24:57.754 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.738+0000 7fa416012700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa4100b28d0 0x7fa4100b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:57.754 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.738+0000 7fa416012700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4100ce450 0x7fa410161930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:57.754 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.738+0000 7fa416012700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa41015da10 0x7fa41015ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:57.754 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.738+0000 7fa416012700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa41015e9b0 con 0x7fa41015da10 2023-08-26T09:24:57.754 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.738+0000 7fa416012700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4101614a0 con 0x7fa4100b28d0 2023-08-26T09:24:57.755 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.738+0000 7fa416012700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4100b31f0 con 0x7fa4100ce450 2023-08-26T09:24:57.755 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.738+0000 7fa40f7fe700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa4100b28d0 0x7fa4100b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:57.756 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.738+0000 7fa40effd700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4100ce450 0x7fa410161930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:57.763 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.738+0000 7fa40f7fe700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa4100b28d0 0x7fa4100b2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:39558/0 (socket says 172.21.15.188:39558) 2023-08-26T09:24:57.764 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.738+0000 7fa40f7fe700 1 -- 172.21.15.188:0/887711446 learned_addr learned my addr 172.21.15.188:0/887711446 (peer_addr_for_me v2:172.21.15.188:0/0) 2023-08-26T09:24:57.765 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.738+0000 7fa40effd700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4100ce450 0x7fa410161930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.188:49622/0 (socket says 172.21.15.188:49622) 2023-08-26T09:24:57.766 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.739+0000 7fa40ffff700 1 --2- 172.21.15.188:0/887711446 >> v2:172.21.15.92:3300/0 conn(0x7fa41015da10 0x7fa41015ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:57.767 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.739+0000 7fa40effd700 1 -- 172.21.15.188:0/887711446 >> v2:172.21.15.188:3300/0 conn(0x7fa4100b28d0 msgr2=0x7fa4100b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:24:57.768 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.739+0000 7fa40effd700 1 --2- 172.21.15.188:0/887711446 >> v2:172.21.15.188:3300/0 conn(0x7fa4100b28d0 0x7fa4100b2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:57.769 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.739+0000 7fa40effd700 1 -- 172.21.15.188:0/887711446 >> v2:172.21.15.92:3300/0 conn(0x7fa41015da10 msgr2=0x7fa41015ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:24:57.770 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.739+0000 7fa40effd700 1 --2- 172.21.15.188:0/887711446 >> v2:172.21.15.92:3300/0 conn(0x7fa41015da10 0x7fa41015ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:57.772 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.739+0000 7fa40effd700 1 -- 172.21.15.188:0/887711446 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa41015e3f0 con 0x7fa4100ce450 2023-08-26T09:24:57.772 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.739+0000 7fa40f7fe700 1 --2- 172.21.15.188:0/887711446 >> v2:172.21.15.188:3300/0 conn(0x7fa4100b28d0 0x7fa4100b2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-26T09:24:57.774 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.739+0000 7fa40ffff700 1 --2- 172.21.15.188:0/887711446 >> v2:172.21.15.92:3300/0 conn(0x7fa41015da10 0x7fa41015ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:24:57.774 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.739+0000 7fa40effd700 1 --2- 172.21.15.188:0/887711446 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4100ce450 0x7fa410161930 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa4100d0db0 tx=0x7fa404009b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=442b3ab7538bea6b server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:24:57.774 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.739+0000 7fa40e7fc700 1 -- 172.21.15.188:0/887711446 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa404011830 con 0x7fa4100ce450 2023-08-26T09:24:57.775 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.739+0000 7fa40e7fc700 1 -- 172.21.15.188:0/887711446 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa404011990 con 0x7fa4100ce450 2023-08-26T09:24:57.775 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.739+0000 7fa40e7fc700 1 -- 172.21.15.188:0/887711446 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa404011d20 con 0x7fa4100ce450 2023-08-26T09:24:57.775 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.740+0000 7fa416012700 1 -- 172.21.15.188:0/887711446 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4100ce450 msgr2=0x7fa410161930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:57.775 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.740+0000 7fa416012700 1 --2- 172.21.15.188:0/887711446 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4100ce450 0x7fa410161930 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa4100d0db0 tx=0x7fa404009b20 comp rx=0 tx=0).stop 2023-08-26T09:24:57.775 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.740+0000 7fa416012700 1 -- 172.21.15.188:0/887711446 shutdown_connections 2023-08-26T09:24:57.776 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.740+0000 7fa416012700 1 --2- 172.21.15.188:0/887711446 >> v2:172.21.15.188:3300/0 conn(0x7fa4100b28d0 0x7fa4100b2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:57.776 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.740+0000 7fa416012700 1 --2- 172.21.15.188:0/887711446 >> v2:172.21.15.92:3300/0 conn(0x7fa41015da10 0x7fa41015ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:57.776 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.740+0000 7fa416012700 1 --2- 172.21.15.188:0/887711446 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4100ce450 0x7fa410161930 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:57.776 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.740+0000 7fa416012700 1 -- 172.21.15.188:0/887711446 >> 172.21.15.188:0/887711446 conn(0x7fa4100cd8d0 msgr2=0x7fa4100cdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:24:57.776 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.740+0000 7fa416012700 1 -- 172.21.15.188:0/887711446 shutdown_connections 2023-08-26T09:24:57.777 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.740+0000 7fa416012700 1 -- 172.21.15.188:0/887711446 wait complete. 2023-08-26T09:24:57.777 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.741+0000 7fa416012700 1 Processor -- start 2023-08-26T09:24:57.777 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.741+0000 7fa416012700 1 -- start start 2023-08-26T09:24:57.777 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.742+0000 7fa416012700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4100b28d0 0x7fa4100ad610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:57.777 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.742+0000 7fa416012700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4100ce450 0x7fa4100b3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:57.777 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.742+0000 7fa416012700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa41015da10 0x7fa4100aefd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:57.778 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.742+0000 7fa416012700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4100c98a0 con 0x7fa41015da10 2023-08-26T09:24:57.778 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.742+0000 7fa416012700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4100b3f50 con 0x7fa4100b28d0 2023-08-26T09:24:57.778 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.742+0000 7fa416012700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4100af510 con 0x7fa4100ce450 2023-08-26T09:24:57.778 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.742+0000 7fa40effd700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4100ce450 0x7fa4100b3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:57.778 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.742+0000 7fa40f7fe700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4100b28d0 0x7fa4100ad610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:57.779 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.742+0000 7fa40effd700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4100ce450 0x7fa4100b3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.188:49628/0 (socket says 172.21.15.188:49628) 2023-08-26T09:24:57.779 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.742+0000 7fa40effd700 1 -- 172.21.15.188:0/2895193761 learned_addr learned my addr 172.21.15.188:0/2895193761 (peer_addr_for_me v2:172.21.15.188:0/0) 2023-08-26T09:24:57.779 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.742+0000 7fa40ffff700 1 --2- 172.21.15.188:0/2895193761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa41015da10 0x7fa4100aefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:57.779 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.742+0000 7fa40effd700 1 -- 172.21.15.188:0/2895193761 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4100b28d0 msgr2=0x7fa4100ad610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:57.779 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.742+0000 7fa40effd700 1 --2- 172.21.15.188:0/2895193761 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4100b28d0 0x7fa4100ad610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:57.780 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.742+0000 7fa40effd700 1 -- 172.21.15.188:0/2895193761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa41015da10 msgr2=0x7fa4100aefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:57.780 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.742+0000 7fa40effd700 1 --2- 172.21.15.188:0/2895193761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa41015da10 0x7fa4100aefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:57.780 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.742+0000 7fa40effd700 1 -- 172.21.15.188:0/2895193761 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa400009550 con 0x7fa4100ce450 2023-08-26T09:24:57.780 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.742+0000 7fa40f7fe700 1 --2- 172.21.15.188:0/2895193761 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4100b28d0 0x7fa4100ad610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-26T09:24:57.780 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.742+0000 7fa40effd700 1 --2- 172.21.15.188:0/2895193761 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4100ce450 0x7fa4100b3a10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa404009b60 tx=0x7fa404004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:24:57.781 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.742+0000 7fa3f7fff700 1 -- 172.21.15.188:0/2895193761 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa404004450 con 0x7fa4100ce450 2023-08-26T09:24:57.781 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.742+0000 7fa3f7fff700 1 -- 172.21.15.188:0/2895193761 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa40401e070 con 0x7fa4100ce450 2023-08-26T09:24:57.781 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.742+0000 7fa416012700 1 -- 172.21.15.188:0/2895193761 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4040094a0 con 0x7fa4100ce450 2023-08-26T09:24:57.781 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.742+0000 7fa3f7fff700 1 -- 172.21.15.188:0/2895193761 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4040038e0 con 0x7fa4100ce450 2023-08-26T09:24:57.781 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.743+0000 7fa416012700 1 -- 172.21.15.188:0/2895193761 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4100c8f70 con 0x7fa4100ce450 2023-08-26T09:24:57.782 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.743+0000 7fa3f7fff700 1 -- 172.21.15.188:0/2895193761 <== mon.2 v2:172.21.15.188:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa404003d40 con 0x7fa4100ce450 2023-08-26T09:24:57.782 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.743+0000 7fa3f7fff700 1 -- 172.21.15.188:0/2895193761 <== mon.2 v2:172.21.15.188:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fa40401aa80 con 0x7fa4100ce450 2023-08-26T09:24:57.782 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.744+0000 7fa416012700 1 -- 172.21.15.188:0/2895193761 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa41004eeb0 con 0x7fa4100ce450 2023-08-26T09:24:57.782 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.746+0000 7fa3f7fff700 1 -- 172.21.15.188:0/2895193761 <== mon.2 v2:172.21.15.188:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fa404020070 con 0x7fa4100ce450 2023-08-26T09:24:57.796 INFO:tasks.ceph.mgr.x.smithi188.stderr:2023-08-26T09:24:57.791+0000 7fcf66a31200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-26T09:24:57.844 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.838+0000 7fa416012700 1 -- 172.21.15.188:0/2895193761 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "osd new", "uuid": "fae2949e-0d62-42cd-ba72-08f516084b20", "id": 7} v 0) v1 -- 0x7fa4100b09e0 con 0x7fa4100ce450 2023-08-26T09:24:57.854 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.849+0000 7fa3f7fff700 1 -- 172.21.15.188:0/2895193761 <== mon.2 v2:172.21.15.188:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fae2949e-0d62-42cd-ba72-08f516084b20", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa404015020 con 0x7fa4100ce450 2023-08-26T09:24:57.854 INFO:teuthology.orchestra.run.smithi188.stdout:7 2023-08-26T09:24:57.856 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.850+0000 7fa416012700 1 -- 172.21.15.188:0/2895193761 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4100ce450 msgr2=0x7fa4100b3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:57.856 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.850+0000 7fa416012700 1 --2- 172.21.15.188:0/2895193761 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4100ce450 0x7fa4100b3a10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa404009b60 tx=0x7fa404004750 comp rx=0 tx=0).stop 2023-08-26T09:24:57.856 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.850+0000 7fa416012700 1 -- 172.21.15.188:0/2895193761 shutdown_connections 2023-08-26T09:24:57.856 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.850+0000 7fa416012700 1 --2- 172.21.15.188:0/2895193761 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4100b28d0 0x7fa4100ad610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:57.857 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.850+0000 7fa416012700 1 --2- 172.21.15.188:0/2895193761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa41015da10 0x7fa4100aefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:57.857 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.850+0000 7fa416012700 1 --2- 172.21.15.188:0/2895193761 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4100ce450 0x7fa4100b3a10 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:57.857 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.850+0000 7fa416012700 1 -- 172.21.15.188:0/2895193761 >> 172.21.15.188:0/2895193761 conn(0x7fa4100cd8d0 msgr2=0x7fa41006b430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:24:57.857 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.850+0000 7fa416012700 1 -- 172.21.15.188:0/2895193761 shutdown_connections 2023-08-26T09:24:57.857 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:24:57.850+0000 7fa416012700 1 -- 172.21.15.188:0/2895193761 wait complete. 2023-08-26T09:24:57.867 INFO:tasks.ceph.osd.0:Restarting daemon 2023-08-26T09:24:57.867 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-08-26T09:24:57.870 INFO:tasks.ceph.osd.0:Started 2023-08-26T09:24:57.870 INFO:tasks.ceph.osd.1:Restarting daemon 2023-08-26T09:24:57.871 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-08-26T09:24:57.872 INFO:tasks.ceph.osd.1:Started 2023-08-26T09:24:57.873 INFO:tasks.ceph.osd.2:Restarting daemon 2023-08-26T09:24:57.873 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-08-26T09:24:57.875 INFO:tasks.ceph.osd.2:Started 2023-08-26T09:24:57.876 INFO:tasks.ceph.osd.3:Restarting daemon 2023-08-26T09:24:57.876 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-08-26T09:24:57.878 INFO:tasks.ceph.osd.3:Started 2023-08-26T09:24:57.878 INFO:tasks.ceph.osd.4:Restarting daemon 2023-08-26T09:24:57.878 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-08-26T09:24:57.880 INFO:tasks.ceph.osd.4:Started 2023-08-26T09:24:57.881 INFO:tasks.ceph.osd.5:Restarting daemon 2023-08-26T09:24:57.881 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-08-26T09:24:57.883 INFO:tasks.ceph.osd.5:Started 2023-08-26T09:24:57.883 INFO:tasks.ceph.osd.6:Restarting daemon 2023-08-26T09:24:57.884 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-08-26T09:24:57.886 INFO:tasks.ceph.osd.6:Started 2023-08-26T09:24:57.886 INFO:tasks.ceph.osd.7:Restarting daemon 2023-08-26T09:24:57.886 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-08-26T09:24:57.889 INFO:tasks.ceph.osd.7:Started 2023-08-26T09:24:57.889 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-26T09:24:58.056 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.052+0000 7f1b2787a700 1 Processor -- start 2023-08-26T09:24:58.056 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.052+0000 7f1b2787a700 1 -- start start 2023-08-26T09:24:58.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.053+0000 7f1b2787a700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b200cd8e0 0x7f1b200c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:58.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.053+0000 7f1b2787a700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f1b2015eae0 0x7f1b200cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:58.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.053+0000 7f1b2787a700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b200cbb50 con 0x7f1b200d1a60 2023-08-26T09:24:58.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.053+0000 7f1b2787a700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b200cffb0 con 0x7f1b2015eae0 2023-08-26T09:24:58.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.053+0000 7f1b2787a700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b200cbe10 con 0x7f1b200cd8e0 2023-08-26T09:24:58.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.053+0000 7f1b25e17700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f1b2015eae0 0x7f1b200cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:58.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.053+0000 7f1b24e15700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f1b200d1a60 0x7f1b2015e3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:55760/0 (socket says 172.21.15.92:55760) 2023-08-26T09:24:58.061 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.053+0000 7f1b24e15700 1 -- 172.21.15.92:0/1755777361 learned_addr learned my addr 172.21.15.92:0/1755777361 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:24:58.061 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.054+0000 7f1b25616700 1 --2- 172.21.15.92:0/1755777361 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b200cd8e0 0x7f1b200c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:58.061 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.054+0000 7f1b25e17700 1 -- 172.21.15.92:0/1755777361 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b200cd8e0 msgr2=0x7f1b200c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:24:58.061 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.054+0000 7f1b25e17700 1 --2- 172.21.15.92:0/1755777361 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b200cd8e0 0x7f1b200c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:58.062 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.054+0000 7f1b25e17700 1 -- 172.21.15.92:0/1755777361 >> v1:172.21.15.92:6789/0 conn(0x7f1b200d1a60 legacy=0x7f1b2015e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:58.062 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.054+0000 7f1b25e17700 1 -- 172.21.15.92:0/1755777361 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b200cf730 con 0x7f1b2015eae0 2023-08-26T09:24:58.062 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.054+0000 7f1b25616700 1 --2- 172.21.15.92:0/1755777361 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b200cd8e0 0x7f1b200c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:24:58.062 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.054+0000 7f1b25e17700 1 --2- 172.21.15.92:0/1755777361 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b2015eae0 0x7f1b200cc2a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1b18009d90 tx=0x7f1b1800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=accf1aed6ea80f9a server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:24:58.063 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.054+0000 7f1b17fff700 1 -- 172.21.15.92:0/1755777361 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1800e070 con 0x7f1b2015eae0 2023-08-26T09:24:58.063 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.054+0000 7f1b17fff700 1 -- 172.21.15.92:0/1755777361 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b1800bbd0 con 0x7f1b2015eae0 2023-08-26T09:24:58.063 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.054+0000 7f1b17fff700 1 -- 172.21.15.92:0/1755777361 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b18012430 con 0x7f1b2015eae0 2023-08-26T09:24:58.063 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.054+0000 7f1b2787a700 1 -- 172.21.15.92:0/1755777361 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b2015eae0 msgr2=0x7f1b200cc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:58.063 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.054+0000 7f1b2787a700 1 --2- 172.21.15.92:0/1755777361 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b2015eae0 0x7f1b200cc2a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1b18009d90 tx=0x7f1b1800b330 comp rx=0 tx=0).stop 2023-08-26T09:24:58.064 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.055+0000 7f1b2787a700 1 -- 172.21.15.92:0/1755777361 shutdown_connections 2023-08-26T09:24:58.064 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.055+0000 7f1b2787a700 1 --2- 172.21.15.92:0/1755777361 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b2015eae0 0x7f1b200cc2a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:58.064 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.055+0000 7f1b2787a700 1 --2- 172.21.15.92:0/1755777361 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b200cd8e0 0x7f1b200c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:58.064 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.055+0000 7f1b2787a700 1 -- 172.21.15.92:0/1755777361 >> 172.21.15.92:0/1755777361 conn(0x7f1b200d0f40 msgr2=0x7f1b200d1350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:24:58.065 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.055+0000 7f1b2787a700 1 -- 172.21.15.92:0/1755777361 shutdown_connections 2023-08-26T09:24:58.065 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.055+0000 7f1b2787a700 1 -- 172.21.15.92:0/1755777361 wait complete. 2023-08-26T09:24:58.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.056+0000 7f1b2787a700 1 Processor -- start 2023-08-26T09:24:58.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.057+0000 7f1b2787a700 1 -- start start 2023-08-26T09:24:58.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.058+0000 7f1b2787a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b200cd8e0 0x7f1b20151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:58.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.058+0000 7f1b2787a700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b200d1a60 0x7f1b200c9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:58.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.058+0000 7f1b2787a700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b2015eae0 0x7f1b201556d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:58.070 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.058+0000 7f1b2787a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b201524e0 con 0x7f1b200cd8e0 2023-08-26T09:24:58.070 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.058+0000 7f1b2787a700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2006b430 con 0x7f1b2015eae0 2023-08-26T09:24:58.070 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.058+0000 7f1b2787a700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2006bcd0 con 0x7f1b200d1a60 2023-08-26T09:24:58.070 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.058+0000 7f1b25616700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b200cd8e0 0x7f1b20151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:58.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.058+0000 7f1b25616700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b200cd8e0 0x7f1b20151fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43752/0 (socket says 172.21.15.92:43752) 2023-08-26T09:24:58.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.058+0000 7f1b25616700 1 -- 172.21.15.92:0/2254727962 learned_addr learned my addr 172.21.15.92:0/2254727962 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:24:58.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.058+0000 7f1b24e15700 1 --2- 172.21.15.92:0/2254727962 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b200d1a60 0x7f1b200c9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:58.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.058+0000 7f1b25e17700 1 --2- 172.21.15.92:0/2254727962 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b2015eae0 0x7f1b201556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:58.072 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.058+0000 7f1b25616700 1 -- 172.21.15.92:0/2254727962 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b200d1a60 msgr2=0x7f1b200c9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:58.072 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.058+0000 7f1b25616700 1 --2- 172.21.15.92:0/2254727962 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b200d1a60 0x7f1b200c9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:58.072 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.058+0000 7f1b25616700 1 -- 172.21.15.92:0/2254727962 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b2015eae0 msgr2=0x7f1b201556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:58.072 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.058+0000 7f1b25616700 1 --2- 172.21.15.92:0/2254727962 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b2015eae0 0x7f1b201556d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:58.073 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.058+0000 7f1b25616700 1 -- 172.21.15.92:0/2254727962 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b18009a70 con 0x7f1b200cd8e0 2023-08-26T09:24:58.073 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.058+0000 7f1b25616700 1 --2- 172.21.15.92:0/2254727962 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b200cd8e0 0x7f1b20151fa0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c00e840 tx=0x7f1b1c00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:24:58.073 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.058+0000 7f1b15ffb700 1 -- 172.21.15.92:0/2254727962 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c005c20 con 0x7f1b200cd8e0 2023-08-26T09:24:58.073 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.058+0000 7f1b15ffb700 1 -- 172.21.15.92:0/2254727962 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b1c005d80 con 0x7f1b200cd8e0 2023-08-26T09:24:58.073 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.058+0000 7f1b2787a700 1 -- 172.21.15.92:0/2254727962 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b200c9a10 con 0x7f1b200cd8e0 2023-08-26T09:24:58.074 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.058+0000 7f1b15ffb700 1 -- 172.21.15.92:0/2254727962 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c004260 con 0x7f1b200cd8e0 2023-08-26T09:24:58.074 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.059+0000 7f1b15ffb700 1 -- 172.21.15.92:0/2254727962 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1b1c0036a0 con 0x7f1b200cd8e0 2023-08-26T09:24:58.074 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.059+0000 7f1b2787a700 1 -- 172.21.15.92:0/2254727962 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b2006b960 con 0x7f1b200cd8e0 2023-08-26T09:24:58.074 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.059+0000 7f1b15ffb700 1 -- 172.21.15.92:0/2254727962 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f1b1c003b80 con 0x7f1b200cd8e0 2023-08-26T09:24:58.074 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.059+0000 7f1b2787a700 1 -- 172.21.15.92:0/2254727962 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b2004e660 con 0x7f1b200cd8e0 2023-08-26T09:24:58.075 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.062+0000 7f1b15ffb700 1 -- 172.21.15.92:0/2254727962 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f1b1c03ab00 con 0x7f1b200cd8e0 2023-08-26T09:24:58.135 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.130+0000 7f1b2787a700 1 -- 172.21.15.92:0/2254727962 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b2006b0e0 con 0x7f1b200cd8e0 2023-08-26T09:24:58.136 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.131+0000 7f1b15ffb700 1 -- 172.21.15.92:0/2254727962 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f1b1c029070 con 0x7f1b200cd8e0 2023-08-26T09:24:58.136 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:24:58.136 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":10,"fsid":"254a2d31-bd41-4507-8326-1b205ac24377","created":"2023-08-26T09:24:55.352131+0000","modified":"2023-08-26T09:24:57.840725+0000","last_up_change":"0.000000","last_in_change":"2023-08-26T09:24:57.840725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9e9e7638-4459-4d8d-8e40-130bcf48df66","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"164e68c9-aedd-4df5-9b70-f4b1ec3bda13","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8701dfee-629a-4d30-82e4-b8fac340303f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"93bdc94d-dc07-495f-995a-a6ad072f0247","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d9d0ea80-8481-46a7-9677-c338d32cf1d2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"38d03253-467a-456f-bd5e-5a46532a0b18","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d61564b5-136f-42e5-a843-626c2017cc35","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fae2949e-0d62-42cd-ba72-08f516084b20","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-26T09:24:58.137 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.132+0000 7f1b2787a700 1 -- 172.21.15.92:0/2254727962 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b200cd8e0 msgr2=0x7f1b20151fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:58.138 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.132+0000 7f1b2787a700 1 --2- 172.21.15.92:0/2254727962 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b200cd8e0 0x7f1b20151fa0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c00e840 tx=0x7f1b1c00eb50 comp rx=0 tx=0).stop 2023-08-26T09:24:58.138 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.132+0000 7f1b2787a700 1 -- 172.21.15.92:0/2254727962 shutdown_connections 2023-08-26T09:24:58.138 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.132+0000 7f1b2787a700 1 --2- 172.21.15.92:0/2254727962 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b2015eae0 0x7f1b201556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:58.139 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.132+0000 7f1b2787a700 1 --2- 172.21.15.92:0/2254727962 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b200cd8e0 0x7f1b20151fa0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:58.139 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.132+0000 7f1b2787a700 1 --2- 172.21.15.92:0/2254727962 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b200d1a60 0x7f1b200c9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:58.139 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.132+0000 7f1b2787a700 1 -- 172.21.15.92:0/2254727962 >> 172.21.15.92:0/2254727962 conn(0x7f1b200d0f40 msgr2=0x7f1b200ccbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:24:58.139 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.132+0000 7f1b2787a700 1 -- 172.21.15.92:0/2254727962 shutdown_connections 2023-08-26T09:24:58.140 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:24:58.132+0000 7f1b2787a700 1 -- 172.21.15.92:0/2254727962 wait complete. 2023-08-26T09:24:58.149 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-08-26T09:24:58.149 INFO:tasks.ceph:Waiting for OSDs to come up 2023-08-26T09:24:58.246 INFO:tasks.ceph.osd.5.smithi188.stderr:2023-08-26T09:24:58.241+0000 7f5b34089640 -1 Falling back to public interface 2023-08-26T09:24:58.433 INFO:tasks.ceph.mgr.y.smithi092.stderr:2023-08-26T09:24:58.429+0000 7f278e1b6200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-26T09:24:58.490 INFO:tasks.ceph.osd.4.smithi188.stderr:2023-08-26T09:24:58.485+0000 7f1e197bd640 -1 Falling back to public interface 2023-08-26T09:24:58.491 INFO:tasks.ceph.osd.6.smithi188.stderr:2023-08-26T09:24:58.485+0000 7f13c734c640 -1 Falling back to public interface 2023-08-26T09:24:58.491 INFO:tasks.ceph.osd.4.smithi188.stderr:2023-08-26T09:24:58.486+0000 7f1e10b7b700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6808/0: (98) Address already in use 2023-08-26T09:24:58.494 INFO:tasks.ceph.osd.3.smithi092.stderr:2023-08-26T09:24:58.490+0000 7f1d6a4d7640 -1 Falling back to public interface 2023-08-26T09:24:58.496 INFO:tasks.ceph.osd.1.smithi092.stderr:2023-08-26T09:24:58.492+0000 7f668e515640 -1 Falling back to public interface 2023-08-26T09:24:58.504 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-08-26T09:24:58.500+0000 7f09b34d5640 -1 Falling back to public interface 2023-08-26T09:24:58.505 INFO:tasks.ceph.osd.2.smithi092.stderr:2023-08-26T09:24:58.500+0000 7f8976ce5640 -1 Falling back to public interface 2023-08-26T09:24:58.513 INFO:tasks.ceph.mgr.y.smithi092.stderr:2023-08-26T09:24:58.509+0000 7f278e1b6200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-26T09:24:58.524 INFO:tasks.ceph.osd.7.smithi188.stderr:2023-08-26T09:24:58.519+0000 7f9e836c0640 -1 Falling back to public interface 2023-08-26T09:24:58.537 INFO:tasks.ceph.mgr.x.smithi188.stderr:2023-08-26T09:24:58.532+0000 7fcf66a31200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-26T09:24:58.615 INFO:tasks.ceph.mgr.x.smithi188.stderr:2023-08-26T09:24:58.610+0000 7fcf66a31200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-26T09:24:58.655 INFO:tasks.ceph.mgr.y.smithi092.stderr:2023-08-26T09:24:58.650+0000 7f278e1b6200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-26T09:24:58.756 INFO:tasks.ceph.mgr.x.smithi188.stderr:2023-08-26T09:24:58.751+0000 7fcf66a31200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-26T09:24:58.889 INFO:tasks.ceph.mgr.y.smithi092.stderr:2023-08-26T09:24:58.885+0000 7f278e1b6200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-26T09:24:58.956 DEBUG:teuthology.orchestra.run.smithi092:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-08-26T09:24:58.992 INFO:tasks.ceph.mgr.x.smithi188.stderr:2023-08-26T09:24:58.987+0000 7fcf66a31200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-26T09:24:59.071 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.067+0000 7fac50e11700 1 Processor -- start 2023-08-26T09:24:59.071 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.067+0000 7fac50e11700 1 -- start start 2023-08-26T09:24:59.073 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.068+0000 7fac50e11700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac4c0cd6c0 0x7fac4c06b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:59.074 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.068+0000 7fac50e11700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac4c0d05a0 con 0x7fac4c0afe00 2023-08-26T09:24:59.074 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.068+0000 7fac50e11700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac4c0d1ce0 con 0x7fac4c0d0110 2023-08-26T09:24:59.074 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.068+0000 7fac50e11700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac4c0cf350 con 0x7fac4c0cd6c0 2023-08-26T09:24:59.074 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.068+0000 7fac49d9b700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fac4c0afe00 0x7fac4c0cdaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:55772/0 (socket says 172.21.15.92:55772) 2023-08-26T09:24:59.074 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.068+0000 7fac49d9b700 1 -- 172.21.15.92:0/504078366 learned_addr learned my addr 172.21.15.92:0/504078366 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:24:59.075 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.068+0000 7fac4a59c700 1 --2- 172.21.15.92:0/504078366 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac4c0cd6c0 0x7fac4c06b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:59.075 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.068+0000 7fac4959a700 1 -- 172.21.15.92:0/504078366 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3889762202 0 0) 0x7fac4c0d05a0 con 0x7fac4c0afe00 2023-08-26T09:24:59.075 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.068+0000 7fac4959a700 1 -- 172.21.15.92:0/504078366 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac340035b0 con 0x7fac4c0afe00 2023-08-26T09:24:59.075 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.068+0000 7fac4959a700 1 -- 172.21.15.92:0/504078366 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4257012590 0 0) 0x7fac4c0d1ce0 con 0x7fac4c0d0110 2023-08-26T09:24:59.076 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.068+0000 7fac4a59c700 1 -- 172.21.15.92:0/504078366 >> v1:172.21.15.188:6789/0 conn(0x7fac4c0d0110 legacy=0x7fac4c0cb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:59.076 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.068+0000 7fac4a59c700 1 -- 172.21.15.92:0/504078366 >> v1:172.21.15.92:6789/0 conn(0x7fac4c0afe00 legacy=0x7fac4c0cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:59.076 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.068+0000 7fac4a59c700 1 -- 172.21.15.92:0/504078366 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac4c0cf630 con 0x7fac4c0cd6c0 2023-08-26T09:24:59.076 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.068+0000 7fac4a59c700 1 --2- 172.21.15.92:0/504078366 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac4c0cd6c0 0x7fac4c06b640 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fac3c009850 tx=0x7fac3c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8936a6dca16dee9 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:24:59.076 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.069+0000 7fac4959a700 1 -- 172.21.15.92:0/504078366 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3c005e30 con 0x7fac4c0cd6c0 2023-08-26T09:24:59.076 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.069+0000 7fac4959a700 1 -- 172.21.15.92:0/504078366 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac3c006030 con 0x7fac4c0cd6c0 2023-08-26T09:24:59.077 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.069+0000 7fac4959a700 1 -- 172.21.15.92:0/504078366 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3c0063e0 con 0x7fac4c0cd6c0 2023-08-26T09:24:59.077 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.069+0000 7fac50e11700 1 -- 172.21.15.92:0/504078366 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac4c0cd6c0 msgr2=0x7fac4c06b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:59.077 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.069+0000 7fac50e11700 1 --2- 172.21.15.92:0/504078366 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac4c0cd6c0 0x7fac4c06b640 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fac3c009850 tx=0x7fac3c009b60 comp rx=0 tx=0).stop 2023-08-26T09:24:59.077 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.069+0000 7fac50e11700 1 -- 172.21.15.92:0/504078366 shutdown_connections 2023-08-26T09:24:59.077 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.069+0000 7fac50e11700 1 --2- 172.21.15.92:0/504078366 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac4c0cd6c0 0x7fac4c06b640 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:59.078 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.069+0000 7fac50e11700 1 -- 172.21.15.92:0/504078366 >> 172.21.15.92:0/504078366 conn(0x7fac4c09a150 msgr2=0x7fac4c0d0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:24:59.078 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.069+0000 7fac50e11700 1 -- 172.21.15.92:0/504078366 shutdown_connections 2023-08-26T09:24:59.078 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.069+0000 7fac50e11700 1 -- 172.21.15.92:0/504078366 wait complete. 2023-08-26T09:24:59.082 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.071+0000 7fac50e11700 1 Processor -- start 2023-08-26T09:24:59.082 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.071+0000 7fac50e11700 1 -- start start 2023-08-26T09:24:59.082 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.071+0000 7fac50e11700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac4c0afe00 0x7fac4c0c7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:59.082 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.071+0000 7fac50e11700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac4c0cd6c0 0x7fac4c0b5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:59.082 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.071+0000 7fac50e11700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac4c0d0110 0x7fac4c0b64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:24:59.083 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.071+0000 7fac50e11700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac4c1f2670 con 0x7fac4c0d0110 2023-08-26T09:24:59.083 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.071+0000 7fac50e11700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac4c1f2930 con 0x7fac4c0afe00 2023-08-26T09:24:59.083 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.071+0000 7fac50e11700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac4c1f2c10 con 0x7fac4c0cd6c0 2023-08-26T09:24:59.083 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.072+0000 7fac4a59c700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac4c0afe00 0x7fac4c0c7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:59.084 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.072+0000 7fac4ad9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac4c0d0110 0x7fac4c0b64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:59.084 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.072+0000 7fac4a59c700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac4c0afe00 0x7fac4c0c7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.92:60802/0 (socket says 172.21.15.92:60802) 2023-08-26T09:24:59.085 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.072+0000 7fac4a59c700 1 -- 172.21.15.92:0/2062213722 learned_addr learned my addr 172.21.15.92:0/2062213722 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:24:59.085 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.072+0000 7fac49d9b700 1 --2- 172.21.15.92:0/2062213722 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac4c0cd6c0 0x7fac4c0b5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:24:59.085 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.072+0000 7fac4ad9d700 1 -- 172.21.15.92:0/2062213722 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac4c0cd6c0 msgr2=0x7fac4c0b5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:59.085 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.072+0000 7fac4ad9d700 1 --2- 172.21.15.92:0/2062213722 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac4c0cd6c0 0x7fac4c0b5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:59.085 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.072+0000 7fac4ad9d700 1 -- 172.21.15.92:0/2062213722 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac4c0afe00 msgr2=0x7fac4c0c7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:59.085 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.072+0000 7fac4ad9d700 1 --2- 172.21.15.92:0/2062213722 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac4c0afe00 0x7fac4c0c7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:59.086 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.072+0000 7fac4ad9d700 1 -- 172.21.15.92:0/2062213722 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac3c009430 con 0x7fac4c0d0110 2023-08-26T09:24:59.086 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.072+0000 7fac49d9b700 1 --2- 172.21.15.92:0/2062213722 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac4c0cd6c0 0x7fac4c0b5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-26T09:24:59.086 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.072+0000 7fac4a59c700 1 --2- 172.21.15.92:0/2062213722 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac4c0afe00 0x7fac4c0c7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-26T09:24:59.086 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.072+0000 7fac4ad9d700 1 --2- 172.21.15.92:0/2062213722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac4c0d0110 0x7fac4c0b64a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fac4400c7c0 tx=0x7fac4400cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:24:59.086 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.072+0000 7fac3affd700 1 -- 172.21.15.92:0/2062213722 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac44003e30 con 0x7fac4c0d0110 2023-08-26T09:24:59.087 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.072+0000 7fac3affd700 1 -- 172.21.15.92:0/2062213722 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac44005070 con 0x7fac4c0d0110 2023-08-26T09:24:59.087 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.072+0000 7fac50e11700 1 -- 172.21.15.92:0/2062213722 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac4c1f2ef0 con 0x7fac4c0d0110 2023-08-26T09:24:59.087 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.072+0000 7fac3affd700 1 -- 172.21.15.92:0/2062213722 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac44005420 con 0x7fac4c0d0110 2023-08-26T09:24:59.087 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.072+0000 7fac50e11700 1 -- 172.21.15.92:0/2062213722 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac4c0c76d0 con 0x7fac4c0d0110 2023-08-26T09:24:59.087 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.072+0000 7fac3affd700 1 -- 172.21.15.92:0/2062213722 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fac4401c440 con 0x7fac4c0d0110 2023-08-26T09:24:59.088 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.073+0000 7fac3affd700 1 -- 172.21.15.92:0/2062213722 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fac44012ad0 con 0x7fac4c0d0110 2023-08-26T09:24:59.088 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.073+0000 7fac50e11700 1 -- 172.21.15.92:0/2062213722 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac4c04e660 con 0x7fac4c0d0110 2023-08-26T09:24:59.088 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.075+0000 7fac3affd700 1 -- 172.21.15.92:0/2062213722 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fac44017070 con 0x7fac4c0d0110 2023-08-26T09:24:59.104 INFO:tasks.ceph.mgr.y.smithi092.stderr:2023-08-26T09:24:59.100+0000 7f278e1b6200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-26T09:24:59.149 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.145+0000 7fac50e11700 1 -- 172.21.15.92:0/2062213722 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fac4c06cb90 con 0x7fac4c0d0110 2023-08-26T09:24:59.150 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.146+0000 7fac3affd700 1 -- 172.21.15.92:0/2062213722 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fac44012510 con 0x7fac4c0d0110 2023-08-26T09:24:59.150 INFO:teuthology.misc.health.smithi092.stdout: 2023-08-26T09:24:59.151 INFO:teuthology.misc.health.smithi092.stdout:{"epoch":10,"fsid":"254a2d31-bd41-4507-8326-1b205ac24377","created":"2023-08-26T09:24:55.352131+0000","modified":"2023-08-26T09:24:57.840725+0000","last_up_change":"0.000000","last_in_change":"2023-08-26T09:24:57.840725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9e9e7638-4459-4d8d-8e40-130bcf48df66","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"164e68c9-aedd-4df5-9b70-f4b1ec3bda13","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8701dfee-629a-4d30-82e4-b8fac340303f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"93bdc94d-dc07-495f-995a-a6ad072f0247","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d9d0ea80-8481-46a7-9677-c338d32cf1d2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"38d03253-467a-456f-bd5e-5a46532a0b18","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d61564b5-136f-42e5-a843-626c2017cc35","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fae2949e-0d62-42cd-ba72-08f516084b20","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-26T09:24:59.152 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.146+0000 7fac50e11700 1 -- 172.21.15.92:0/2062213722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac4c0d0110 msgr2=0x7fac4c0b64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:24:59.152 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.146+0000 7fac50e11700 1 --2- 172.21.15.92:0/2062213722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac4c0d0110 0x7fac4c0b64a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fac4400c7c0 tx=0x7fac4400cad0 comp rx=0 tx=0).stop 2023-08-26T09:24:59.152 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.146+0000 7fac50e11700 1 -- 172.21.15.92:0/2062213722 shutdown_connections 2023-08-26T09:24:59.152 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.146+0000 7fac50e11700 1 --2- 172.21.15.92:0/2062213722 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac4c0afe00 0x7fac4c0c7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:59.152 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.146+0000 7fac50e11700 1 --2- 172.21.15.92:0/2062213722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac4c0d0110 0x7fac4c0b64a0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:59.153 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.146+0000 7fac50e11700 1 --2- 172.21.15.92:0/2062213722 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac4c0cd6c0 0x7fac4c0b5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:24:59.154 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.147+0000 7fac50e11700 1 -- 172.21.15.92:0/2062213722 >> 172.21.15.92:0/2062213722 conn(0x7fac4c09a150 msgr2=0x7fac4c0cb320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:24:59.154 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.147+0000 7fac50e11700 1 -- 172.21.15.92:0/2062213722 shutdown_connections 2023-08-26T09:24:59.154 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:24:59.147+0000 7fac50e11700 1 -- 172.21.15.92:0/2062213722 wait complete. 2023-08-26T09:24:59.162 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-08-26T09:24:59.207 INFO:tasks.ceph.mgr.x.smithi188.stderr:2023-08-26T09:24:59.202+0000 7fcf66a31200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-26T09:24:59.238 INFO:tasks.ceph.mgr.y.smithi092.stderr:2023-08-26T09:24:59.234+0000 7f278e1b6200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-26T09:24:59.341 INFO:tasks.ceph.mgr.x.smithi188.stderr:2023-08-26T09:24:59.336+0000 7fcf66a31200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-26T09:24:59.456 INFO:tasks.ceph.mgr.y.smithi092.stderr:2023-08-26T09:24:59.452+0000 7f278e1b6200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-26T09:24:59.561 INFO:tasks.ceph.mgr.x.smithi188.stderr:2023-08-26T09:24:59.556+0000 7fcf66a31200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-26T09:24:59.610 INFO:tasks.ceph.mgr.y.smithi092.stderr:2023-08-26T09:24:59.606+0000 7f278e1b6200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-26T09:24:59.718 INFO:tasks.ceph.mgr.x.smithi188.stderr:2023-08-26T09:24:59.713+0000 7fcf66a31200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-26T09:24:59.722 INFO:tasks.ceph.mgr.y.smithi092.stderr:2023-08-26T09:24:59.718+0000 7f278e1b6200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-26T09:24:59.831 INFO:tasks.ceph.mgr.x.smithi188.stderr:2023-08-26T09:24:59.826+0000 7fcf66a31200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-26T09:25:00.041 INFO:tasks.ceph.mgr.y.smithi092.stderr:2023-08-26T09:25:00.037+0000 7f278e1b6200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-26T09:25:00.140 INFO:tasks.ceph.mgr.y.smithi092.stderr:2023-08-26T09:25:00.136+0000 7f278e1b6200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-26T09:25:00.157 INFO:tasks.ceph.mgr.x.smithi188.stderr:2023-08-26T09:25:00.152+0000 7fcf66a31200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-26T09:25:00.257 INFO:tasks.ceph.mgr.x.smithi188.stderr:2023-08-26T09:25:00.252+0000 7fcf66a31200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-26T09:25:00.324 INFO:tasks.ceph.mgr.y.smithi092.stderr:2023-08-26T09:25:00.320+0000 7f278e1b6200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-26T09:25:00.442 INFO:tasks.ceph.mgr.x.smithi188.stderr:2023-08-26T09:25:00.437+0000 7fcf66a31200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-26T09:25:00.912 INFO:tasks.ceph.mgr.y.smithi092.stderr:2023-08-26T09:25:00.908+0000 7f278e1b6200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-26T09:25:01.046 INFO:tasks.ceph.mgr.x.smithi188.stderr:2023-08-26T09:25:01.041+0000 7fcf66a31200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-26T09:25:01.802 INFO:tasks.ceph.osd.5.smithi188.stderr:2023-08-26T09:25:01.797+0000 7f5b34089640 -1 osd.5 0 log_to_monitors true 2023-08-26T09:25:01.940 INFO:tasks.ceph.mgr.y.smithi092.stderr:2023-08-26T09:25:01.933+0000 7f27461e9700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-08-26T09:25:01.940 INFO:tasks.ceph.mgr.y.smithi092.stderr:2023-08-26T09:25:01.933+0000 7f27461e9700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-08-26T09:25:01.990 INFO:tasks.ceph.osd.2.smithi092.stderr:2023-08-26T09:25:01.986+0000 7f8976ce5640 -1 osd.2 0 log_to_monitors true 2023-08-26T09:25:02.005 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-08-26T09:25:02.001+0000 7f09b34d5640 -1 osd.0 0 log_to_monitors true 2023-08-26T09:25:02.012 INFO:tasks.ceph.osd.3.smithi092.stderr:2023-08-26T09:25:02.008+0000 7f1d6a4d7640 -1 osd.3 0 log_to_monitors true 2023-08-26T09:25:02.021 INFO:tasks.ceph.osd.1.smithi092.stderr:2023-08-26T09:25:02.015+0000 7f668e515640 -1 osd.1 0 log_to_monitors true 2023-08-26T09:25:02.046 INFO:tasks.ceph.osd.6.smithi188.stderr:2023-08-26T09:25:02.041+0000 7f13c734c640 -1 osd.6 0 log_to_monitors true 2023-08-26T09:25:02.056 INFO:tasks.ceph.osd.4.smithi188.stderr:2023-08-26T09:25:02.051+0000 7f1e197bd640 -1 osd.4 0 log_to_monitors true 2023-08-26T09:25:02.083 INFO:tasks.ceph.osd.7.smithi188.stderr:2023-08-26T09:25:02.078+0000 7f9e836c0640 -1 osd.7 0 log_to_monitors true 2023-08-26T09:25:05.114 INFO:tasks.ceph.osd.7.smithi188.stderr:2023-08-26T09:25:05.109+0000 7f9e77277700 -1 osd.7 0 waiting for initial osdmap 2023-08-26T09:25:05.120 INFO:tasks.ceph.osd.6.smithi188.stderr:2023-08-26T09:25:05.115+0000 7f13baf03700 -1 osd.6 0 waiting for initial osdmap 2023-08-26T09:25:05.130 INFO:tasks.ceph.osd.7.smithi188.stderr:2023-08-26T09:25:05.124+0000 7f9e6f652700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-26T09:25:05.130 INFO:tasks.ceph.osd.6.smithi188.stderr:2023-08-26T09:25:05.124+0000 7f13b32de700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-26T09:25:05.146 INFO:tasks.ceph.osd.5.smithi188.stderr:2023-08-26T09:25:05.141+0000 7f5b27c40700 -1 osd.5 0 waiting for initial osdmap 2023-08-26T09:25:05.146 INFO:tasks.ceph.osd.2.smithi092.stderr:2023-08-26T09:25:05.140+0000 7f896a89c700 -1 osd.2 0 waiting for initial osdmap 2023-08-26T09:25:05.152 INFO:tasks.ceph.osd.4.smithi188.stderr:2023-08-26T09:25:05.146+0000 7f1e0d374700 -1 osd.4 0 waiting for initial osdmap 2023-08-26T09:25:05.156 INFO:tasks.ceph.osd.5.smithi188.stderr:2023-08-26T09:25:05.152+0000 7f5b2001b700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-26T09:25:05.157 INFO:tasks.ceph.osd.2.smithi092.stderr:2023-08-26T09:25:05.152+0000 7f8962c77700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-26T09:25:05.162 INFO:tasks.ceph.osd.3.smithi092.stderr:2023-08-26T09:25:05.157+0000 7f1d5e08e700 -1 osd.3 0 waiting for initial osdmap 2023-08-26T09:25:05.165 INFO:tasks.ceph.osd.4.smithi188.stderr:2023-08-26T09:25:05.161+0000 7f1e0574f700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-26T09:25:05.180 INFO:tasks.ceph.osd.3.smithi092.stderr:2023-08-26T09:25:05.175+0000 7f1d56469700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-26T09:25:05.185 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-08-26T09:25:05.180+0000 7f09a708c700 -1 osd.0 0 waiting for initial osdmap 2023-08-26T09:25:05.192 INFO:tasks.ceph.osd.1.smithi092.stderr:2023-08-26T09:25:05.187+0000 7f66820cc700 -1 osd.1 0 waiting for initial osdmap 2023-08-26T09:25:05.197 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-08-26T09:25:05.192+0000 7f099f467700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-26T09:25:05.207 INFO:tasks.ceph.osd.1.smithi092.stderr:2023-08-26T09:25:05.202+0000 7f667a4a7700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-26T09:25:05.969 DEBUG:teuthology.orchestra.run.smithi092:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-08-26T09:25:06.091 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.085+0000 7f125b505700 1 Processor -- start 2023-08-26T09:25:06.091 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.086+0000 7f125b505700 1 -- start start 2023-08-26T09:25:06.096 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.086+0000 7f125b505700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f125415d550 0x7f12540b6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:06.097 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.086+0000 7f125b505700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12540d10c0 con 0x7f125406b0a0 2023-08-26T09:25:06.097 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.086+0000 7f125b505700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12540cdd70 con 0x7f12540b4ab0 2023-08-26T09:25:06.097 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.086+0000 7f125b505700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f125415d930 con 0x7f125415d550 2023-08-26T09:25:06.097 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.087+0000 7f1259aa2700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f125406b0a0 0x7f12540d1b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:55884/0 (socket says 172.21.15.92:55884) 2023-08-26T09:25:06.098 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.087+0000 7f1259aa2700 1 -- 172.21.15.92:0/2265792683 learned_addr learned my addr 172.21.15.92:0/2265792683 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:06.098 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.087+0000 7f12592a1700 1 --2- 172.21.15.92:0/2265792683 >> v2:172.21.15.188:3300/0 conn(0x7f125415d550 0x7f12540b6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:06.098 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.087+0000 7f1253fff700 1 -- 172.21.15.92:0/2265792683 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 904207748 0 0) 0x7f12540d10c0 con 0x7f125406b0a0 2023-08-26T09:25:06.098 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.087+0000 7f1253fff700 1 -- 172.21.15.92:0/2265792683 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f123c0035b0 con 0x7f125406b0a0 2023-08-26T09:25:06.098 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.087+0000 7f1253fff700 1 -- 172.21.15.92:0/2265792683 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2318476585 0 0) 0x7f123c0035b0 con 0x7f125406b0a0 2023-08-26T09:25:06.098 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.087+0000 7f1253fff700 1 -- 172.21.15.92:0/2265792683 >> v2:172.21.15.188:3300/0 conn(0x7f125415d550 msgr2=0x7f12540b6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:06.099 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.087+0000 7f1253fff700 1 --2- 172.21.15.92:0/2265792683 >> v2:172.21.15.188:3300/0 conn(0x7f125415d550 0x7f12540b6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:06.099 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.087+0000 7f1253fff700 1 -- 172.21.15.92:0/2265792683 >> v1:172.21.15.188:6789/0 conn(0x7f12540b4ab0 legacy=0x7f125406a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:06.099 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.087+0000 7f1253fff700 1 -- 172.21.15.92:0/2265792683 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f125406b5a0 con 0x7f125406b0a0 2023-08-26T09:25:06.099 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.087+0000 7f1253fff700 1 -- 172.21.15.92:0/2265792683 <== mon.0 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1019361464 0 0) 0x7f12440019f0 con 0x7f125406b0a0 2023-08-26T09:25:06.099 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.087+0000 7f1253fff700 1 -- 172.21.15.92:0/2265792683 >> v1:172.21.15.92:6789/0 conn(0x7f125406b0a0 legacy=0x7f12540d1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:06.100 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.087+0000 7f1253fff700 1 --2- 172.21.15.92:0/2265792683 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f123c003a00 0x7f123c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:06.100 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.087+0000 7f1253fff700 1 --2- 172.21.15.92:0/2265792683 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f123c004850 0x7f123c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:06.100 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.087+0000 7f1253fff700 1 --2- 172.21.15.92:0/2265792683 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f123c005210 0x7f123c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:06.100 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.087+0000 7f1253fff700 1 -- 172.21.15.92:0/2265792683 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f125415d930 con 0x7f123c003a00 2023-08-26T09:25:06.100 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.087+0000 7f1253fff700 1 -- 172.21.15.92:0/2265792683 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123c00c0b0 con 0x7f123c005210 2023-08-26T09:25:06.101 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.087+0000 7f1253fff700 1 -- 172.21.15.92:0/2265792683 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f123c00c270 con 0x7f123c004850 2023-08-26T09:25:06.101 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.087+0000 7f12592a1700 1 --2- 172.21.15.92:0/2265792683 >> v2:172.21.15.188:3300/0 conn(0x7f125415d550 0x7f12540b6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-26T09:25:06.101 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.087+0000 7f12592a1700 1 --2- 172.21.15.92:0/2265792683 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f123c003a00 0x7f123c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:06.101 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.087+0000 7f1259aa2700 1 --2- 172.21.15.92:0/2265792683 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f123c005210 0x7f123c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:06.101 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.087+0000 7f1258aa0700 1 --2- 172.21.15.92:0/2265792683 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f123c004850 0x7f123c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:06.102 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.087+0000 7f12592a1700 1 -- 172.21.15.92:0/2265792683 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f123c004850 msgr2=0x7f123c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:06.102 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.087+0000 7f12592a1700 1 --2- 172.21.15.92:0/2265792683 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f123c004850 0x7f123c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:06.102 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.087+0000 7f12592a1700 1 -- 172.21.15.92:0/2265792683 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f123c005210 msgr2=0x7f123c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:06.102 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.087+0000 7f12592a1700 1 --2- 172.21.15.92:0/2265792683 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f123c005210 0x7f123c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:06.102 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.087+0000 7f12592a1700 1 -- 172.21.15.92:0/2265792683 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f123c0035b0 con 0x7f123c003a00 2023-08-26T09:25:06.103 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.087+0000 7f1259aa2700 1 -- 172.21.15.92:0/2265792683 reap_dead start 2023-08-26T09:25:06.103 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.088+0000 7f12592a1700 1 --2- 172.21.15.92:0/2265792683 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f123c003a00 0x7f123c003e20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f124c009d10 tx=0x7f123c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=590f13a9756ccd72 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:06.103 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.088+0000 7f1253fff700 1 -- 172.21.15.92:0/2265792683 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124c009e60 con 0x7f123c003a00 2023-08-26T09:25:06.103 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.088+0000 7f1253fff700 1 -- 172.21.15.92:0/2265792683 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f124c00e9a0 con 0x7f123c003a00 2023-08-26T09:25:06.103 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.088+0000 7f1253fff700 1 -- 172.21.15.92:0/2265792683 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124c00ed30 con 0x7f123c003a00 2023-08-26T09:25:06.104 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.088+0000 7f125b505700 1 -- 172.21.15.92:0/2265792683 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f123c003a00 msgr2=0x7f123c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:06.104 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.088+0000 7f125b505700 1 --2- 172.21.15.92:0/2265792683 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f123c003a00 0x7f123c003e20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f124c009d10 tx=0x7f123c005880 comp rx=0 tx=0).stop 2023-08-26T09:25:06.104 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.088+0000 7f125b505700 1 -- 172.21.15.92:0/2265792683 shutdown_connections 2023-08-26T09:25:06.104 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.088+0000 7f125b505700 1 --2- 172.21.15.92:0/2265792683 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f123c003a00 0x7f123c003e20 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:06.104 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.088+0000 7f125b505700 1 -- 172.21.15.92:0/2265792683 >> 172.21.15.92:0/2265792683 conn(0x7f12540cfab0 msgr2=0x7f12540cfec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:06.105 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.088+0000 7f125b505700 1 -- 172.21.15.92:0/2265792683 shutdown_connections 2023-08-26T09:25:06.105 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.088+0000 7f125b505700 1 -- 172.21.15.92:0/2265792683 wait complete. 2023-08-26T09:25:06.105 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.090+0000 7f125b505700 1 Processor -- start 2023-08-26T09:25:06.105 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.090+0000 7f125b505700 1 -- start start 2023-08-26T09:25:06.105 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.090+0000 7f125b505700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f123c003a00 0x7f12541f36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:06.105 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.090+0000 7f125b505700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12540b7e40 0x7f12541f20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:06.106 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.090+0000 7f125b505700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12540b82c0 0x7f12541f2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:06.106 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.090+0000 7f125b505700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12541f2b70 con 0x7f12540b7e40 2023-08-26T09:25:06.106 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.090+0000 7f125b505700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12541f3c10 con 0x7f12540b82c0 2023-08-26T09:25:06.106 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.090+0000 7f125b505700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12541f6650 con 0x7f123c003a00 2023-08-26T09:25:06.106 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.090+0000 7f1258aa0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12540b7e40 0x7f12541f20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:06.107 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.091+0000 7f1258aa0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12540b7e40 0x7f12541f20f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43880/0 (socket says 172.21.15.92:43880) 2023-08-26T09:25:06.107 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.091+0000 7f1258aa0700 1 -- 172.21.15.92:0/4195550060 learned_addr learned my addr 172.21.15.92:0/4195550060 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:06.107 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.091+0000 7f12592a1700 1 --2- 172.21.15.92:0/4195550060 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f123c003a00 0x7f12541f36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:06.107 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.091+0000 7f1259aa2700 1 --2- 172.21.15.92:0/4195550060 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12540b82c0 0x7f12541f2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:06.107 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.091+0000 7f1258aa0700 1 -- 172.21.15.92:0/4195550060 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f123c003a00 msgr2=0x7f12541f36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:06.108 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.091+0000 7f1258aa0700 1 --2- 172.21.15.92:0/4195550060 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f123c003a00 0x7f12541f36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:06.108 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.091+0000 7f1258aa0700 1 -- 172.21.15.92:0/4195550060 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12540b82c0 msgr2=0x7f12541f2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:06.108 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.091+0000 7f1258aa0700 1 --2- 172.21.15.92:0/4195550060 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12540b82c0 0x7f12541f2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:06.108 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.091+0000 7f1258aa0700 1 -- 172.21.15.92:0/4195550060 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12541f6930 con 0x7f12540b7e40 2023-08-26T09:25:06.108 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.091+0000 7f1258aa0700 1 --2- 172.21.15.92:0/4195550060 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12540b7e40 0x7f12541f20f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f124800f820 tx=0x7f124800fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:06.109 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.091+0000 7f1251ffb700 1 -- 172.21.15.92:0/4195550060 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12480052e0 con 0x7f12540b7e40 2023-08-26T09:25:06.109 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.091+0000 7f1251ffb700 1 -- 172.21.15.92:0/4195550060 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1248005440 con 0x7f12540b7e40 2023-08-26T09:25:06.109 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.091+0000 7f125b505700 1 -- 172.21.15.92:0/4195550060 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12541f6c10 con 0x7f12540b7e40 2023-08-26T09:25:06.109 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.091+0000 7f1251ffb700 1 -- 172.21.15.92:0/4195550060 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12480038a0 con 0x7f12540b7e40 2023-08-26T09:25:06.109 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.091+0000 7f125b505700 1 -- 172.21.15.92:0/4195550060 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f125415fd50 con 0x7f12540b7e40 2023-08-26T09:25:06.110 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.092+0000 7f125b505700 1 -- 172.21.15.92:0/4195550060 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12541f7130 con 0x7f12540b7e40 2023-08-26T09:25:06.110 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.092+0000 7f1251ffb700 1 -- 172.21.15.92:0/4195550060 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7f1248003a00 con 0x7f12540b7e40 2023-08-26T09:25:06.111 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.093+0000 7f1251ffb700 1 --2- 172.21.15.92:0/4195550060 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f124006a050 0x7f124006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:06.111 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.093+0000 7f1251ffb700 1 -- 172.21.15.92:0/4195550060 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f1248087190 con 0x7f12540b7e40 2023-08-26T09:25:06.111 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.093+0000 7f12592a1700 1 --2- 172.21.15.92:0/4195550060 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f124006a050 0x7f124006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:06.111 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.093+0000 7f12592a1700 1 --2- 172.21.15.92:0/4195550060 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f124006a050 0x7f124006c510 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f124c0090b0 tx=0x7f124c01e040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:06.112 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.097+0000 7f1251ffb700 1 -- 172.21.15.92:0/4195550060 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1248053850 con 0x7f12540b7e40 2023-08-26T09:25:06.300 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.295+0000 7f125b505700 1 -- 172.21.15.92:0/4195550060 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f125404e660 con 0x7f12540b7e40 2023-08-26T09:25:06.301 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.296+0000 7f1251ffb700 1 -- 172.21.15.92:0/4195550060 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10896 (secure 0 0 0) 0x7f1248003cb0 con 0x7f12540b7e40 2023-08-26T09:25:06.301 INFO:teuthology.misc.health.smithi092.stdout: 2023-08-26T09:25:06.301 INFO:teuthology.misc.health.smithi092.stdout:{"epoch":13,"fsid":"254a2d31-bd41-4507-8326-1b205ac24377","created":"2023-08-26T09:24:55.352131+0000","modified":"2023-08-26T09:25:06.124496+0000","last_up_change":"2023-08-26T09:25:06.124496+0000","last_in_change":"2023-08-26T09:24:57.840725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9e9e7638-4459-4d8d-8e40-130bcf48df66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6819","nonce":382827192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6824","nonce":382827192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6831","nonce":382827192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6827","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6829","nonce":382827192}]},"public_addr":"172.21.15.92:6819/382827192","cluster_addr":"172.21.15.92:6824/382827192","heartbeat_back_addr":"172.21.15.92:6831/382827192","heartbeat_front_addr":"172.21.15.92:6829/382827192","state":["exists","up"]},{"osd":1,"uuid":"164e68c9-aedd-4df5-9b70-f4b1ec3bda13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6809","nonce":618773438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6811","nonce":618773438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6815","nonce":618773438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6813","nonce":618773438}]},"public_addr":"172.21.15.92:6809/618773438","cluster_addr":"172.21.15.92:6811/618773438","heartbeat_back_addr":"172.21.15.92:6815/618773438","heartbeat_front_addr":"172.21.15.92:6813/618773438","state":["exists","up"]},{"osd":2,"uuid":"8701dfee-629a-4d30-82e4-b8fac340303f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6818","nonce":3697397687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6821","nonce":3697397687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6828","nonce":3697397687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6823","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6825","nonce":3697397687}]},"public_addr":"172.21.15.92:6818/3697397687","cluster_addr":"172.21.15.92:6821/3697397687","heartbeat_back_addr":"172.21.15.92:6828/3697397687","heartbeat_front_addr":"172.21.15.92:6825/3697397687","state":["exists","up"]},{"osd":3,"uuid":"93bdc94d-dc07-495f-995a-a6ad072f0247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6801","nonce":3579846453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6803","nonce":3579846453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6807","nonce":3579846453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6805","nonce":3579846453}]},"public_addr":"172.21.15.92:6801/3579846453","cluster_addr":"172.21.15.92:6803/3579846453","heartbeat_back_addr":"172.21.15.92:6807/3579846453","heartbeat_front_addr":"172.21.15.92:6805/3579846453","state":["exists","up"]},{"osd":4,"uuid":"d9d0ea80-8481-46a7-9677-c338d32cf1d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6809","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6811","nonce":3228383424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6813","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6815","nonce":3228383424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6821","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6823","nonce":3228383424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6817","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6819","nonce":3228383424}]},"public_addr":"172.21.15.188:6811/3228383424","cluster_addr":"172.21.15.188:6815/3228383424","heartbeat_back_addr":"172.21.15.188:6823/3228383424","heartbeat_front_addr":"172.21.15.188:6819/3228383424","state":["exists","up"]},{"osd":5,"uuid":"38d03253-467a-456f-bd5e-5a46532a0b18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6801","nonce":1655821054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6803","nonce":1655821054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6807","nonce":1655821054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6805","nonce":1655821054}]},"public_addr":"172.21.15.188:6801/1655821054","cluster_addr":"172.21.15.188:6803/1655821054","heartbeat_back_addr":"172.21.15.188:6807/1655821054","heartbeat_front_addr":"172.21.15.188:6805/1655821054","state":["exists","up"]},{"osd":6,"uuid":"d61564b5-136f-42e5-a843-626c2017cc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6810","nonce":2069976891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6814","nonce":2069976891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6822","nonce":2069976891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6818","nonce":2069976891}]},"public_addr":"172.21.15.188:6810/2069976891","cluster_addr":"172.21.15.188:6814/2069976891","heartbeat_back_addr":"172.21.15.188:6822/2069976891","heartbeat_front_addr":"172.21.15.188:6818/2069976891","state":["exists","up"]},{"osd":7,"uuid":"fae2949e-0d62-42cd-ba72-08f516084b20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6825","nonce":1882888860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6827","nonce":1882888860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6831","nonce":1882888860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6829","nonce":1882888860}]},"public_addr":"172.21.15.188:6825/1882888860","cluster_addr":"172.21.15.188:6827/1882888860","heartbeat_back_addr":"172.21.15.188:6831/1882888860","heartbeat_front_addr":"172.21.15.188:6829/1882888860","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-26T09:25:06.303 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.297+0000 7f125b505700 1 -- 172.21.15.92:0/4195550060 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f124006a050 msgr2=0x7f124006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:06.303 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.297+0000 7f125b505700 1 --2- 172.21.15.92:0/4195550060 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f124006a050 0x7f124006c510 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f124c0090b0 tx=0x7f124c01e040 comp rx=0 tx=0).stop 2023-08-26T09:25:06.304 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.297+0000 7f125b505700 1 -- 172.21.15.92:0/4195550060 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12540b7e40 msgr2=0x7f12541f20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:06.304 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.297+0000 7f125b505700 1 --2- 172.21.15.92:0/4195550060 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12540b7e40 0x7f12541f20f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f124800f820 tx=0x7f124800fb30 comp rx=0 tx=0).stop 2023-08-26T09:25:06.304 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.298+0000 7f125b505700 1 -- 172.21.15.92:0/4195550060 shutdown_connections 2023-08-26T09:25:06.304 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.298+0000 7f125b505700 1 --2- 172.21.15.92:0/4195550060 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f124006a050 0x7f124006c510 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:06.304 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.298+0000 7f125b505700 1 --2- 172.21.15.92:0/4195550060 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12540b82c0 0x7f12541f2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:06.305 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.298+0000 7f125b505700 1 --2- 172.21.15.92:0/4195550060 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f123c003a00 0x7f12541f36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:06.305 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.298+0000 7f125b505700 1 --2- 172.21.15.92:0/4195550060 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12540b7e40 0x7f12541f20f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:06.305 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.298+0000 7f125b505700 1 -- 172.21.15.92:0/4195550060 >> 172.21.15.92:0/4195550060 conn(0x7f12540cfab0 msgr2=0x7f125406a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:06.305 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.298+0000 7f125b505700 1 -- 172.21.15.92:0/4195550060 shutdown_connections 2023-08-26T09:25:06.305 INFO:teuthology.misc.health.smithi092.stderr:2023-08-26T09:25:06.298+0000 7f125b505700 1 -- 172.21.15.92:0/4195550060 wait complete. 2023-08-26T09:25:06.314 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-08-26T09:25:06.314 INFO:tasks.ceph:Creating RBD pool 2023-08-26T09:25:06.315 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd pool create rbd 8 2023-08-26T09:25:06.435 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.430+0000 7f9817273700 1 Processor -- start 2023-08-26T09:25:06.436 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.430+0000 7f9817273700 1 -- start start 2023-08-26T09:25:06.438 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.431+0000 7f9817273700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f9810159dd0 0x7f98100cf220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:06.438 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.431+0000 7f9817273700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9810071430 0x7f981006e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:06.438 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.431+0000 7f9817273700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98100c6200 con 0x7f981006e110 2023-08-26T09:25:06.439 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.431+0000 7f9817273700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f981006eae0 con 0x7f9810159dd0 2023-08-26T09:25:06.439 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.431+0000 7f9817273700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98100ce740 con 0x7f9810071430 2023-08-26T09:25:06.439 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.431+0000 7f981500f700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f9810159dd0 0x7f98100cf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:06.439 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.431+0000 7f981480e700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f981006e110 0x7f9810070d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:56018/0 (socket says 172.21.15.92:56018) 2023-08-26T09:25:06.439 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.431+0000 7f981480e700 1 -- 172.21.15.92:0/3970853837 learned_addr learned my addr 172.21.15.92:0/3970853837 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:06.440 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.431+0000 7f9815810700 1 --2- 172.21.15.92:0/3970853837 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9810071430 0x7f981006e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:06.440 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.432+0000 7f981500f700 1 -- 172.21.15.92:0/3970853837 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9810071430 msgr2=0x7f981006e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:06.440 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.432+0000 7f981500f700 1 --2- 172.21.15.92:0/3970853837 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9810071430 0x7f981006e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:06.440 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.432+0000 7f981500f700 1 -- 172.21.15.92:0/3970853837 >> v1:172.21.15.92:6789/0 conn(0x7f981006e110 legacy=0x7f9810070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:06.441 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.432+0000 7f981500f700 1 -- 172.21.15.92:0/3970853837 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98100cea20 con 0x7f9810159dd0 2023-08-26T09:25:06.441 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.432+0000 7f9807fff700 1 -- 172.21.15.92:0/3970853837 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 862027917 0 0) 0x7f98100c6200 con 0x7f981006e110 2023-08-26T09:25:06.441 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.432+0000 7f981500f700 1 --2- 172.21.15.92:0/3970853837 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9810159dd0 0x7f98100cf220 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9800009840 tx=0x7f9800009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64e129cc617bedb server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:06.441 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.432+0000 7f9807fff700 1 -- 172.21.15.92:0/3970853837 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9800011830 con 0x7f9810159dd0 2023-08-26T09:25:06.441 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.432+0000 7f9807fff700 1 -- 172.21.15.92:0/3970853837 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9800011990 con 0x7f9810159dd0 2023-08-26T09:25:06.442 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.432+0000 7f9807fff700 1 -- 172.21.15.92:0/3970853837 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9800011d20 con 0x7f9810159dd0 2023-08-26T09:25:06.442 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.432+0000 7f9817273700 1 -- 172.21.15.92:0/3970853837 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9810159dd0 msgr2=0x7f98100cf220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:06.442 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.432+0000 7f9817273700 1 --2- 172.21.15.92:0/3970853837 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9810159dd0 0x7f98100cf220 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9800009840 tx=0x7f9800009b50 comp rx=0 tx=0).stop 2023-08-26T09:25:06.442 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.432+0000 7f9817273700 1 -- 172.21.15.92:0/3970853837 shutdown_connections 2023-08-26T09:25:06.442 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.432+0000 7f9817273700 1 --2- 172.21.15.92:0/3970853837 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9810071430 0x7f981006e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:06.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.432+0000 7f9817273700 1 --2- 172.21.15.92:0/3970853837 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9810159dd0 0x7f98100cf220 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:06.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.432+0000 7f9817273700 1 -- 172.21.15.92:0/3970853837 >> 172.21.15.92:0/3970853837 conn(0x7f981006b430 msgr2=0x7f981006b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:06.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.433+0000 7f9817273700 1 -- 172.21.15.92:0/3970853837 shutdown_connections 2023-08-26T09:25:06.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.433+0000 7f9817273700 1 -- 172.21.15.92:0/3970853837 wait complete. 2023-08-26T09:25:06.446 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.434+0000 7f9817273700 1 Processor -- start 2023-08-26T09:25:06.446 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.434+0000 7f9817273700 1 -- start start 2023-08-26T09:25:06.446 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.434+0000 7f9817273700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f981006e110 0x7f98100b5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:06.446 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.434+0000 7f9817273700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9810071430 0x7f98101457d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:06.446 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.434+0000 7f9817273700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9810159dd0 0x7f981006a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:06.447 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.434+0000 7f9817273700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9810145d10 con 0x7f981006e110 2023-08-26T09:25:06.447 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.434+0000 7f9817273700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98101f1660 con 0x7f9810159dd0 2023-08-26T09:25:06.447 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.434+0000 7f9817273700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98101f07b0 con 0x7f9810071430 2023-08-26T09:25:06.447 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.435+0000 7f981500f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f981006e110 0x7f98100b5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:06.447 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.435+0000 7f981500f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f981006e110 0x7f98100b5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44010/0 (socket says 172.21.15.92:44010) 2023-08-26T09:25:06.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.435+0000 7f981500f700 1 -- 172.21.15.92:0/1875499836 learned_addr learned my addr 172.21.15.92:0/1875499836 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:06.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.435+0000 7f981480e700 1 --2- 172.21.15.92:0/1875499836 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9810071430 0x7f98101457d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:06.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.435+0000 7f9815810700 1 --2- 172.21.15.92:0/1875499836 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9810159dd0 0x7f981006a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:06.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.435+0000 7f981500f700 1 -- 172.21.15.92:0/1875499836 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9810071430 msgr2=0x7f98101457d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:06.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.435+0000 7f981500f700 1 --2- 172.21.15.92:0/1875499836 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9810071430 0x7f98101457d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:06.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.435+0000 7f981500f700 1 -- 172.21.15.92:0/1875499836 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9810159dd0 msgr2=0x7f981006a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:06.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.435+0000 7f981500f700 1 --2- 172.21.15.92:0/1875499836 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9810159dd0 0x7f981006a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:06.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.435+0000 7f981500f700 1 -- 172.21.15.92:0/1875499836 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98000094a0 con 0x7f981006e110 2023-08-26T09:25:06.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.435+0000 7f981500f700 1 --2- 172.21.15.92:0/1875499836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f981006e110 0x7f98100b5610 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f98000090b0 tx=0x7f9800004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:06.450 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.435+0000 7f9805ffb700 1 -- 172.21.15.92:0/1875499836 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98000036a0 con 0x7f981006e110 2023-08-26T09:25:06.450 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.435+0000 7f9805ffb700 1 -- 172.21.15.92:0/1875499836 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980001f070 con 0x7f981006e110 2023-08-26T09:25:06.450 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.435+0000 7f9805ffb700 1 -- 172.21.15.92:0/1875499836 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9800003a00 con 0x7f981006e110 2023-08-26T09:25:06.450 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.435+0000 7f9817273700 1 -- 172.21.15.92:0/1875499836 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f981015d440 con 0x7f981006e110 2023-08-26T09:25:06.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.435+0000 7f9817273700 1 -- 172.21.15.92:0/1875499836 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98101f0d30 con 0x7f981006e110 2023-08-26T09:25:06.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.436+0000 7f9817273700 1 -- 172.21.15.92:0/1875499836 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f981004eeb0 con 0x7f981006e110 2023-08-26T09:25:06.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.437+0000 7f9805ffb700 1 -- 172.21.15.92:0/1875499836 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7f9800003b60 con 0x7f981006e110 2023-08-26T09:25:06.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.437+0000 7f9805ffb700 1 --2- 172.21.15.92:0/1875499836 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f97f406a050 0x7f97f406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:06.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.437+0000 7f9805ffb700 1 -- 172.21.15.92:0/1875499836 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f9800021070 con 0x7f981006e110 2023-08-26T09:25:06.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.437+0000 7f981480e700 1 --2- 172.21.15.92:0/1875499836 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f97f406a050 0x7f97f406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:06.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.437+0000 7f981480e700 1 --2- 172.21.15.92:0/1875499836 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f97f406a050 0x7f97f406c510 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f98100b5c80 tx=0x7f980c007e70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:06.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.442+0000 7f9805ffb700 1 -- 172.21.15.92:0/1875499836 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9800055600 con 0x7f981006e110 2023-08-26T09:25:06.636 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:06.631+0000 7f9817273700 1 -- 172.21.15.92:0/1875499836 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f981006c290 con 0x7f981006e110 2023-08-26T09:25:07.398 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.393+0000 7f9805ffb700 1 -- 172.21.15.92:0/1875499836 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v14) v1 ==== 109+0+0 (secure 0 0 0) 0x7f98000150a0 con 0x7f981006e110 2023-08-26T09:25:07.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.396+0000 7f9817273700 1 -- 172.21.15.92:0/1875499836 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f97f406a050 msgr2=0x7f97f406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:07.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.396+0000 7f9817273700 1 --2- 172.21.15.92:0/1875499836 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f97f406a050 0x7f97f406c510 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f98100b5c80 tx=0x7f980c007e70 comp rx=0 tx=0).stop 2023-08-26T09:25:07.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.396+0000 7f9817273700 1 -- 172.21.15.92:0/1875499836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f981006e110 msgr2=0x7f98100b5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:07.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.396+0000 7f9817273700 1 --2- 172.21.15.92:0/1875499836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f981006e110 0x7f98100b5610 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f98000090b0 tx=0x7f9800004750 comp rx=0 tx=0).stop 2023-08-26T09:25:07.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.396+0000 7f9817273700 1 -- 172.21.15.92:0/1875499836 shutdown_connections 2023-08-26T09:25:07.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.396+0000 7f9817273700 1 --2- 172.21.15.92:0/1875499836 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f97f406a050 0x7f97f406c510 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:07.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.396+0000 7f9817273700 1 --2- 172.21.15.92:0/1875499836 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9810159dd0 0x7f981006a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:07.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.396+0000 7f9817273700 1 --2- 172.21.15.92:0/1875499836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f981006e110 0x7f98100b5610 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:07.404 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.396+0000 7f9817273700 1 --2- 172.21.15.92:0/1875499836 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9810071430 0x7f98101457d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:07.404 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.396+0000 7f9817273700 1 -- 172.21.15.92:0/1875499836 >> 172.21.15.92:0/1875499836 conn(0x7f981006b430 msgr2=0x7f981006cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:07.404 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.396+0000 7f9817273700 1 -- 172.21.15.92:0/1875499836 shutdown_connections 2023-08-26T09:25:07.404 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.397+0000 7f9817273700 1 -- 172.21.15.92:0/1875499836 wait complete. 2023-08-26T09:25:07.405 INFO:teuthology.orchestra.run.smithi092.stderr:pool 'rbd' created 2023-08-26T09:25:07.415 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-08-26T09:25:07.540 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.535+0000 7f923fbea700 1 Processor -- start 2023-08-26T09:25:07.540 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.535+0000 7f923fbea700 1 -- start start 2023-08-26T09:25:07.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.536+0000 7f923fbea700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9238070e60 0x7f92380712e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:07.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.536+0000 7f923fbea700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f923815a290 con 0x7f9238159eb0 2023-08-26T09:25:07.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.536+0000 7f923fbea700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92380cb610 con 0x7f923806c8c0 2023-08-26T09:25:07.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.536+0000 7f923fbea700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9238071820 con 0x7f9238070e60 2023-08-26T09:25:07.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.536+0000 7f923d986700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f9238159eb0 0x7f92380caa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:56052/0 (socket says 172.21.15.92:56052) 2023-08-26T09:25:07.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.536+0000 7f923d986700 1 -- 172.21.15.92:0/79243228 learned_addr learned my addr 172.21.15.92:0/79243228 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:07.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.536+0000 7f923d185700 1 --2- 172.21.15.92:0/79243228 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9238070e60 0x7f92380712e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:07.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.536+0000 7f923c984700 1 -- 172.21.15.92:0/79243228 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2391550546 0 0) 0x7f923815a290 con 0x7f9238159eb0 2023-08-26T09:25:07.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.536+0000 7f923c984700 1 -- 172.21.15.92:0/79243228 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92240035b0 con 0x7f9238159eb0 2023-08-26T09:25:07.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.536+0000 7f923c984700 1 -- 172.21.15.92:0/79243228 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1011192399 0 0) 0x7f92380cb610 con 0x7f923806c8c0 2023-08-26T09:25:07.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.536+0000 7f923c984700 1 -- 172.21.15.92:0/79243228 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f923815a290 con 0x7f923806c8c0 2023-08-26T09:25:07.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.536+0000 7f923c984700 1 -- 172.21.15.92:0/79243228 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2356570893 0 0) 0x7f92240035b0 con 0x7f9238159eb0 2023-08-26T09:25:07.553 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.536+0000 7f923c984700 1 -- 172.21.15.92:0/79243228 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9238070e60 msgr2=0x7f92380712e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:07.553 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.536+0000 7f923c984700 1 --2- 172.21.15.92:0/79243228 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9238070e60 0x7f92380712e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:07.553 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.536+0000 7f923c984700 1 -- 172.21.15.92:0/79243228 >> v1:172.21.15.188:6789/0 conn(0x7f923806c8c0 legacy=0x7f923806cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:07.553 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.536+0000 7f923c984700 1 -- 172.21.15.92:0/79243228 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92380cb8f0 con 0x7f9238159eb0 2023-08-26T09:25:07.554 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.536+0000 7f923c984700 1 -- 172.21.15.92:0/79243228 <== mon.0 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1019361464 0 0) 0x7f9234001670 con 0x7f9238159eb0 2023-08-26T09:25:07.554 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.536+0000 7f923c984700 1 -- 172.21.15.92:0/79243228 >> v1:172.21.15.92:6789/0 conn(0x7f9238159eb0 legacy=0x7f92380caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:07.554 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.536+0000 7f923c984700 1 --2- 172.21.15.92:0/79243228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9224003bc0 0x7f9224003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:07.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.536+0000 7f923c984700 1 --2- 172.21.15.92:0/79243228 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9224004850 0x7f9224004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:07.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.536+0000 7f923c984700 1 --2- 172.21.15.92:0/79243228 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9238070e60 0x7f9224005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:07.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.536+0000 7f923c984700 1 -- 172.21.15.92:0/79243228 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9238071820 con 0x7f9224003bc0 2023-08-26T09:25:07.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.536+0000 7f923c984700 1 -- 172.21.15.92:0/79243228 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922400bac0 con 0x7f9224004850 2023-08-26T09:25:07.556 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.536+0000 7f923c984700 1 -- 172.21.15.92:0/79243228 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f922400bc80 con 0x7f9238070e60 2023-08-26T09:25:07.556 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.536+0000 7f923d986700 1 --2- 172.21.15.92:0/79243228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9224003bc0 0x7f9224003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:07.556 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.536+0000 7f923d185700 1 --2- 172.21.15.92:0/79243228 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9224004850 0x7f9224004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:07.557 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.537+0000 7f923e187700 1 --2- 172.21.15.92:0/79243228 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9238070e60 0x7f9224005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:07.557 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.537+0000 7f923d986700 1 -- 172.21.15.92:0/79243228 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9238070e60 msgr2=0x7f9224005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:07.557 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.537+0000 7f923d986700 1 --2- 172.21.15.92:0/79243228 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9238070e60 0x7f9224005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:07.557 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.537+0000 7f923d986700 1 -- 172.21.15.92:0/79243228 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9224004850 msgr2=0x7f9224004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:07.558 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.537+0000 7f923d986700 1 --2- 172.21.15.92:0/79243228 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9224004850 0x7f9224004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:07.558 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.537+0000 7f923d986700 1 -- 172.21.15.92:0/79243228 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92240035b0 con 0x7f9224003bc0 2023-08-26T09:25:07.558 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.537+0000 7f923e187700 1 --2- 172.21.15.92:0/79243228 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9238070e60 0x7f9224005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:25:07.558 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.537+0000 7f923d986700 1 --2- 172.21.15.92:0/79243228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9224003bc0 0x7f9224003fc0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f923400c160 tx=0x7f9224005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb9f7ddd39863cb5 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:07.558 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.537+0000 7f923c984700 1 -- 172.21.15.92:0/79243228 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923400cca0 con 0x7f9224003bc0 2023-08-26T09:25:07.558 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.537+0000 7f923c984700 1 -- 172.21.15.92:0/79243228 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f923400ce00 con 0x7f9224003bc0 2023-08-26T09:25:07.559 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.537+0000 7f923c984700 1 -- 172.21.15.92:0/79243228 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9234005b60 con 0x7f9224003bc0 2023-08-26T09:25:07.559 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.537+0000 7f923fbea700 1 -- 172.21.15.92:0/79243228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9224003bc0 msgr2=0x7f9224003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:07.559 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.537+0000 7f923fbea700 1 --2- 172.21.15.92:0/79243228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9224003bc0 0x7f9224003fc0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f923400c160 tx=0x7f9224005880 comp rx=0 tx=0).stop 2023-08-26T09:25:07.559 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.537+0000 7f923e187700 1 -- 172.21.15.92:0/79243228 reap_dead start 2023-08-26T09:25:07.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.537+0000 7f923fbea700 1 -- 172.21.15.92:0/79243228 shutdown_connections 2023-08-26T09:25:07.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.537+0000 7f923fbea700 1 -- 172.21.15.92:0/79243228 >> 172.21.15.92:0/79243228 conn(0x7f92380cfca0 msgr2=0x7f92380d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:07.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.537+0000 7f923fbea700 1 -- 172.21.15.92:0/79243228 shutdown_connections 2023-08-26T09:25:07.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.537+0000 7f923fbea700 1 -- 172.21.15.92:0/79243228 wait complete. 2023-08-26T09:25:07.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.539+0000 7f923fbea700 1 Processor -- start 2023-08-26T09:25:07.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.539+0000 7f923fbea700 1 -- start start 2023-08-26T09:25:07.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.539+0000 7f923fbea700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9224003bc0 0x7f9238147140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:07.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.539+0000 7f923fbea700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f92380c94e0 0x7f92380c9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:07.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.539+0000 7f923fbea700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9238151ac0 0x7f9238151f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:07.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.539+0000 7f923fbea700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92380c9ea0 con 0x7f9224003bc0 2023-08-26T09:25:07.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.539+0000 7f923fbea700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9238152d40 con 0x7f92380c94e0 2023-08-26T09:25:07.562 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.539+0000 7f923fbea700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92381524b0 con 0x7f9238151ac0 2023-08-26T09:25:07.562 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.539+0000 7f923d986700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9224003bc0 0x7f9238147140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:07.562 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.539+0000 7f923d986700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9224003bc0 0x7f9238147140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44050/0 (socket says 172.21.15.92:44050) 2023-08-26T09:25:07.562 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.539+0000 7f923d986700 1 -- 172.21.15.92:0/2772578655 learned_addr learned my addr 172.21.15.92:0/2772578655 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:07.562 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.539+0000 7f923e187700 1 --2- 172.21.15.92:0/2772578655 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9238151ac0 0x7f9238151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:07.562 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.539+0000 7f923d185700 1 --2- 172.21.15.92:0/2772578655 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f92380c94e0 0x7f92380c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:07.563 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.540+0000 7f923d986700 1 -- 172.21.15.92:0/2772578655 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9238151ac0 msgr2=0x7f9238151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:07.563 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.540+0000 7f923d986700 1 --2- 172.21.15.92:0/2772578655 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9238151ac0 0x7f9238151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:07.563 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.540+0000 7f923d986700 1 -- 172.21.15.92:0/2772578655 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f92380c94e0 msgr2=0x7f92380c9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:07.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.540+0000 7f923d986700 1 --2- 172.21.15.92:0/2772578655 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f92380c94e0 0x7f92380c9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:07.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.540+0000 7f923d986700 1 -- 172.21.15.92:0/2772578655 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9238152780 con 0x7f9224003bc0 2023-08-26T09:25:07.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.540+0000 7f923d986700 1 --2- 172.21.15.92:0/2772578655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9224003bc0 0x7f9238147140 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9224005830 tx=0x7f9234001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:07.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.540+0000 7f922e7fc700 1 -- 172.21.15.92:0/2772578655 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92340070d0 con 0x7f9224003bc0 2023-08-26T09:25:07.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.540+0000 7f922e7fc700 1 -- 172.21.15.92:0/2772578655 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9234007230 con 0x7f9224003bc0 2023-08-26T09:25:07.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.540+0000 7f923fbea700 1 -- 172.21.15.92:0/2772578655 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9238152a60 con 0x7f9224003bc0 2023-08-26T09:25:07.565 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.540+0000 7f922e7fc700 1 -- 172.21.15.92:0/2772578655 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92340075e0 con 0x7f9224003bc0 2023-08-26T09:25:07.565 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.540+0000 7f923fbea700 1 -- 172.21.15.92:0/2772578655 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f923815a920 con 0x7f9224003bc0 2023-08-26T09:25:07.565 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.541+0000 7f923fbea700 1 -- 172.21.15.92:0/2772578655 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f923815aae0 con 0x7f9224003bc0 2023-08-26T09:25:07.565 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.541+0000 7f922e7fc700 1 -- 172.21.15.92:0/2772578655 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7f9234019030 con 0x7f9224003bc0 2023-08-26T09:25:07.565 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.542+0000 7f922e7fc700 1 --2- 172.21.15.92:0/2772578655 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f921c06a050 0x7f921c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:07.566 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.542+0000 7f923d185700 1 --2- 172.21.15.92:0/2772578655 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f921c06a050 0x7f921c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:07.566 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.542+0000 7f922e7fc700 1 -- 172.21.15.92:0/2772578655 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 5188+0+0 (secure 0 0 0) 0x7f9234088de0 con 0x7f9224003bc0 2023-08-26T09:25:07.566 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.542+0000 7f923d185700 1 --2- 172.21.15.92:0/2772578655 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f921c06a050 0x7f921c06c510 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f92380b4030 tx=0x7f9228009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:07.567 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.546+0000 7f922e7fc700 1 -- 172.21.15.92:0/2772578655 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f92340549a0 con 0x7f9224003bc0 2023-08-26T09:25:07.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:07.735+0000 7f923fbea700 1 -- 172.21.15.92:0/2772578655 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f923804e660 con 0x7f9224003bc0 2023-08-26T09:25:08.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.398+0000 7f922e7fc700 1 -- 172.21.15.92:0/2772578655 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v15) v1 ==== 173+0+0 (secure 0 0 0) 0x7f9234057fc0 con 0x7f9224003bc0 2023-08-26T09:25:08.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.402+0000 7f923fbea700 1 -- 172.21.15.92:0/2772578655 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f921c06a050 msgr2=0x7f921c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:08.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.402+0000 7f923fbea700 1 --2- 172.21.15.92:0/2772578655 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f921c06a050 0x7f921c06c510 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f92380b4030 tx=0x7f9228009210 comp rx=0 tx=0).stop 2023-08-26T09:25:08.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.402+0000 7f923fbea700 1 -- 172.21.15.92:0/2772578655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9224003bc0 msgr2=0x7f9238147140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:08.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.402+0000 7f923fbea700 1 --2- 172.21.15.92:0/2772578655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9224003bc0 0x7f9238147140 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9224005830 tx=0x7f9234001930 comp rx=0 tx=0).stop 2023-08-26T09:25:08.409 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.402+0000 7f923fbea700 1 -- 172.21.15.92:0/2772578655 shutdown_connections 2023-08-26T09:25:08.409 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.402+0000 7f923fbea700 1 --2- 172.21.15.92:0/2772578655 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9238151ac0 0x7f9238151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:08.409 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.402+0000 7f923fbea700 1 --2- 172.21.15.92:0/2772578655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9224003bc0 0x7f9238147140 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:08.409 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.402+0000 7f923fbea700 1 --2- 172.21.15.92:0/2772578655 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f921c06a050 0x7f921c06c510 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:08.409 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.402+0000 7f923fbea700 1 --2- 172.21.15.92:0/2772578655 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f92380c94e0 0x7f92380c9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:08.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.402+0000 7f923fbea700 1 -- 172.21.15.92:0/2772578655 >> 172.21.15.92:0/2772578655 conn(0x7f92380cfca0 msgr2=0x7f92380b49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:08.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.402+0000 7f923fbea700 1 -- 172.21.15.92:0/2772578655 shutdown_connections 2023-08-26T09:25:08.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.402+0000 7f923fbea700 1 -- 172.21.15.92:0/2772578655 wait complete. 2023-08-26T09:25:08.410 INFO:teuthology.orchestra.run.smithi092.stderr:enabled application 'rbd' on pool 'rbd' 2023-08-26T09:25:08.424 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-08-26T09:25:08.424 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-26T09:25:08.425 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-26T09:25:08.427 INFO:tasks.ceph.mds.a:Started 2023-08-26T09:25:08.427 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-26T09:25:08.428 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-26T09:25:08.430 INFO:tasks.ceph.mds.c:Started 2023-08-26T09:25:08.430 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-26T09:25:08.430 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-26T09:25:08.432 INFO:tasks.ceph.mds.b:Started 2023-08-26T09:25:08.433 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-26T09:25:08.433 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-26T09:25:08.435 INFO:tasks.ceph.mds.d:Started 2023-08-26T09:25:08.436 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-08-26T09:25:08.436 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-26T09:25:08.522 INFO:tasks.ceph.mds.a.smithi092.stdout:starting mds.a at 2023-08-26T09:25:08.523 INFO:tasks.ceph.mds.c.smithi092.stdout:starting mds.c at 2023-08-26T09:25:08.524 INFO:tasks.ceph.mds.b.smithi188.stdout:starting mds.b at 2023-08-26T09:25:08.525 INFO:tasks.ceph.mds.d.smithi188.stdout:starting mds.d at 2023-08-26T09:25:08.581 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.576+0000 7f28949e0700 1 Processor -- start 2023-08-26T09:25:08.581 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.576+0000 7f28949e0700 1 -- start start 2023-08-26T09:25:08.583 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.577+0000 7f28949e0700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f289015a090 0x7f28900cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:08.584 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.577+0000 7f28949e0700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28900cf7e0 con 0x7f289006f4e0 2023-08-26T09:25:08.584 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.577+0000 7f28949e0700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28900caec0 con 0x7f28900cb8e0 2023-08-26T09:25:08.584 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.577+0000 7f28949e0700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28900cb160 con 0x7f289015a090 2023-08-26T09:25:08.584 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.577+0000 7f288e59c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f289015a090 0x7f28900cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:08.584 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.577+0000 7f288dd9b700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f289006f4e0 0x7f28900cd900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:56126/0 (socket says 172.21.15.92:56126) 2023-08-26T09:25:08.585 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.577+0000 7f288e59c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f289015a090 0x7f28900cd2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44110/0 (socket says 172.21.15.92:44110) 2023-08-26T09:25:08.585 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.577+0000 7f288dd9b700 1 -- 172.21.15.92:0/228111847 learned_addr learned my addr 172.21.15.92:0/228111847 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:08.585 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.577+0000 7f288e59c700 1 -- 172.21.15.92:0/228111847 >> v1:172.21.15.188:6789/0 conn(0x7f28900cb8e0 legacy=0x7f289006e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:08.585 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.577+0000 7f288e59c700 1 -- 172.21.15.92:0/228111847 >> v1:172.21.15.92:6789/0 conn(0x7f289006f4e0 legacy=0x7f28900cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:08.585 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.577+0000 7f288d59a700 1 -- 172.21.15.92:0/228111847 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4151869686 0 0) 0x7f28900cf7e0 con 0x7f289006f4e0 2023-08-26T09:25:08.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.577+0000 7f288e59c700 1 -- 172.21.15.92:0/228111847 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28900cb440 con 0x7f289015a090 2023-08-26T09:25:08.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.577+0000 7f288e59c700 1 --2- 172.21.15.92:0/228111847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f289015a090 0x7f28900cd2d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2880009840 tx=0x7f2880009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b716f71b2d194972 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:08.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.577+0000 7f288d59a700 1 -- 172.21.15.92:0/228111847 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2880011830 con 0x7f289015a090 2023-08-26T09:25:08.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.577+0000 7f288d59a700 1 -- 172.21.15.92:0/228111847 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2880011990 con 0x7f289015a090 2023-08-26T09:25:08.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.578+0000 7f288d59a700 1 -- 172.21.15.92:0/228111847 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2880011d20 con 0x7f289015a090 2023-08-26T09:25:08.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.578+0000 7f28949e0700 1 -- 172.21.15.92:0/228111847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f289015a090 msgr2=0x7f28900cd2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:08.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.578+0000 7f28949e0700 1 --2- 172.21.15.92:0/228111847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f289015a090 0x7f28900cd2d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2880009840 tx=0x7f2880009b50 comp rx=0 tx=0).stop 2023-08-26T09:25:08.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.578+0000 7f28949e0700 1 -- 172.21.15.92:0/228111847 shutdown_connections 2023-08-26T09:25:08.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.578+0000 7f28949e0700 1 --2- 172.21.15.92:0/228111847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f289015a090 0x7f28900cd2d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:08.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.578+0000 7f28949e0700 1 -- 172.21.15.92:0/228111847 >> 172.21.15.92:0/228111847 conn(0x7f28900cc7b0 msgr2=0x7f28900ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:08.588 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.578+0000 7f28949e0700 1 -- 172.21.15.92:0/228111847 shutdown_connections 2023-08-26T09:25:08.588 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.578+0000 7f28949e0700 1 -- 172.21.15.92:0/228111847 wait complete. 2023-08-26T09:25:08.593 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.580+0000 7f28949e0700 1 Processor -- start 2023-08-26T09:25:08.593 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.580+0000 7f28949e0700 1 -- start start 2023-08-26T09:25:08.593 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.581+0000 7f28949e0700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f289006f4e0 0x7f289015e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:08.593 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.581+0000 7f28949e0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28900cb8e0 0x7f28900c6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:08.594 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.581+0000 7f28949e0700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f289015a090 0x7f28900c8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:08.594 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.581+0000 7f28949e0700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28900c8540 con 0x7f28900cb8e0 2023-08-26T09:25:08.594 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.581+0000 7f28949e0700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f289014da50 con 0x7f289015a090 2023-08-26T09:25:08.594 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.581+0000 7f28949e0700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f289015ead0 con 0x7f289006f4e0 2023-08-26T09:25:08.595 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.581+0000 7f288dd9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28900cb8e0 0x7f28900c6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:08.595 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.581+0000 7f288dd9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28900cb8e0 0x7f28900c6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44118/0 (socket says 172.21.15.92:44118) 2023-08-26T09:25:08.595 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.581+0000 7f288dd9b700 1 -- 172.21.15.92:0/247620315 learned_addr learned my addr 172.21.15.92:0/247620315 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:08.595 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.581+0000 7f288e59c700 1 --2- 172.21.15.92:0/247620315 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f289006f4e0 0x7f289015e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:08.595 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.581+0000 7f288ed9d700 1 --2- 172.21.15.92:0/247620315 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f289015a090 0x7f28900c8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:08.596 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.581+0000 7f288dd9b700 1 -- 172.21.15.92:0/247620315 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f289006f4e0 msgr2=0x7f289015e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:08.596 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.581+0000 7f288dd9b700 1 --2- 172.21.15.92:0/247620315 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f289006f4e0 0x7f289015e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:08.596 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.581+0000 7f288dd9b700 1 -- 172.21.15.92:0/247620315 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f289015a090 msgr2=0x7f28900c8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:08.596 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.581+0000 7f288dd9b700 1 --2- 172.21.15.92:0/247620315 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f289015a090 0x7f28900c8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:08.597 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.581+0000 7f288dd9b700 1 -- 172.21.15.92:0/247620315 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28800094a0 con 0x7f28900cb8e0 2023-08-26T09:25:08.597 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.581+0000 7f288dd9b700 1 --2- 172.21.15.92:0/247620315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28900cb8e0 0x7f28900c6e00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f288400c520 tx=0x7f288400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:08.597 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.581+0000 7f287effd700 1 -- 172.21.15.92:0/247620315 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2884004c80 con 0x7f28900cb8e0 2023-08-26T09:25:08.597 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.581+0000 7f287effd700 1 -- 172.21.15.92:0/247620315 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2884004e00 con 0x7f28900cb8e0 2023-08-26T09:25:08.597 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.582+0000 7f287effd700 1 -- 172.21.15.92:0/247620315 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2884007310 con 0x7f28900cb8e0 2023-08-26T09:25:08.598 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.582+0000 7f28949e0700 1 -- 172.21.15.92:0/247620315 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28900c78c0 con 0x7f28900cb8e0 2023-08-26T09:25:08.598 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.582+0000 7f28949e0700 1 -- 172.21.15.92:0/247620315 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28900c7e80 con 0x7f28900cb8e0 2023-08-26T09:25:08.598 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.583+0000 7f28949e0700 1 -- 172.21.15.92:0/247620315 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28900c8680 con 0x7f28900cb8e0 2023-08-26T09:25:08.598 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.583+0000 7f287effd700 1 -- 172.21.15.92:0/247620315 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7f2884007470 con 0x7f28900cb8e0 2023-08-26T09:25:08.599 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.583+0000 7f287effd700 1 --2- 172.21.15.92:0/247620315 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f287006a050 0x7f287006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:08.599 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.583+0000 7f287effd700 1 -- 172.21.15.92:0/247620315 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2884087c30 con 0x7f28900cb8e0 2023-08-26T09:25:08.599 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.583+0000 7f288e59c700 1 --2- 172.21.15.92:0/247620315 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f287006a050 0x7f287006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:08.599 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.584+0000 7f288e59c700 1 --2- 172.21.15.92:0/247620315 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f287006a050 0x7f287006c510 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f28800090b0 tx=0x7f288001c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:08.600 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.588+0000 7f287effd700 1 -- 172.21.15.92:0/247620315 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f28900c8680 con 0x7f28900cb8e0 2023-08-26T09:25:08.802 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.796+0000 7f28949e0700 1 -- 172.21.15.92:0/247620315 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28900c8680 con 0x7f28900cb8e0 2023-08-26T09:25:08.803 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.797+0000 7f287effd700 1 -- 172.21.15.92:0/247620315 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+14593 (secure 0 0 0) 0x7f28900c8680 con 0x7f28900cb8e0 2023-08-26T09:25:08.803 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:25:08.804 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":15,"fsid":"254a2d31-bd41-4507-8326-1b205ac24377","created":"2023-08-26T09:24:55.352131+0000","modified":"2023-08-26T09:25:08.392915+0000","last_up_change":"2023-08-26T09:25:06.124496+0000","last_in_change":"2023-08-26T09:24:57.840725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-26T09:25:06.650431+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-26T09:25:06.973382+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e9e7638-4459-4d8d-8e40-130bcf48df66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6819","nonce":382827192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6824","nonce":382827192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6831","nonce":382827192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6827","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6829","nonce":382827192}]},"public_addr":"172.21.15.92:6819/382827192","cluster_addr":"172.21.15.92:6824/382827192","heartbeat_back_addr":"172.21.15.92:6831/382827192","heartbeat_front_addr":"172.21.15.92:6829/382827192","state":["exists","up"]},{"osd":1,"uuid":"164e68c9-aedd-4df5-9b70-f4b1ec3bda13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6809","nonce":618773438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6811","nonce":618773438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6815","nonce":618773438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6813","nonce":618773438}]},"public_addr":"172.21.15.92:6809/618773438","cluster_addr":"172.21.15.92:6811/618773438","heartbeat_back_addr":"172.21.15.92:6815/618773438","heartbeat_front_addr":"172.21.15.92:6813/618773438","state":["exists","up"]},{"osd":2,"uuid":"8701dfee-629a-4d30-82e4-b8fac340303f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6818","nonce":3697397687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6821","nonce":3697397687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6828","nonce":3697397687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6823","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6825","nonce":3697397687}]},"public_addr":"172.21.15.92:6818/3697397687","cluster_addr":"172.21.15.92:6821/3697397687","heartbeat_back_addr":"172.21.15.92:6828/3697397687","heartbeat_front_addr":"172.21.15.92:6825/3697397687","state":["exists","up"]},{"osd":3,"uuid":"93bdc94d-dc07-495f-995a-a6ad072f0247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6801","nonce":3579846453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6803","nonce":3579846453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6807","nonce":3579846453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6805","nonce":3579846453}]},"public_addr":"172.21.15.92:6801/3579846453","cluster_addr":"172.21.15.92:6803/3579846453","heartbeat_back_addr":"172.21.15.92:6807/3579846453","heartbeat_front_addr":"172.21.15.92:6805/3579846453","state":["exists","up"]},{"osd":4,"uuid":"d9d0ea80-8481-46a7-9677-c338d32cf1d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6809","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6811","nonce":3228383424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6813","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6815","nonce":3228383424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6821","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6823","nonce":3228383424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6817","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6819","nonce":3228383424}]},"public_addr":"172.21.15.188:6811/3228383424","cluster_addr":"172.21.15.188:6815/3228383424","heartbeat_back_addr":"172.21.15.188:6823/3228383424","heartbeat_front_addr":"172.21.15.188:6819/3228383424","state":["exists","up"]},{"osd":5,"uuid":"38d03253-467a-456f-bd5e-5a46532a0b18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6801","nonce":1655821054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6803","nonce":1655821054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6807","nonce":1655821054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6805","nonce":1655821054}]},"public_addr":"172.21.15.188:6801/1655821054","cluster_addr":"172.21.15.188:6803/1655821054","heartbeat_back_addr":"172.21.15.188:6807/1655821054","heartbeat_front_addr":"172.21.15.188:6805/1655821054","state":["exists","up"]},{"osd":6,"uuid":"d61564b5-136f-42e5-a843-626c2017cc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6810","nonce":2069976891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6814","nonce":2069976891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6822","nonce":2069976891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6818","nonce":2069976891}]},"public_addr":"172.21.15.188:6810/2069976891","cluster_addr":"172.21.15.188:6814/2069976891","heartbeat_back_addr":"172.21.15.188:6822/2069976891","heartbeat_front_addr":"172.21.15.188:6818/2069976891","state":["exists","up"]},{"osd":7,"uuid":"fae2949e-0d62-42cd-ba72-08f516084b20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6825","nonce":1882888860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6827","nonce":1882888860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6831","nonce":1882888860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6829","nonce":1882888860}]},"public_addr":"172.21.15.188:6825/1882888860","cluster_addr":"172.21.15.188:6827/1882888860","heartbeat_back_addr":"172.21.15.188:6831/1882888860","heartbeat_front_addr":"172.21.15.188:6829/1882888860","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.038523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.063160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.000857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.975572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.023848+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.765194+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.081365+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:05.110745+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-26T09:25:08.805 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.799+0000 7f28949e0700 1 -- 172.21.15.92:0/247620315 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f287006a050 msgr2=0x7f287006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:08.805 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.799+0000 7f28949e0700 1 --2- 172.21.15.92:0/247620315 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f287006a050 0x7f287006c510 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f28800090b0 tx=0x7f288001c040 comp rx=0 tx=0).stop 2023-08-26T09:25:08.805 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.799+0000 7f28949e0700 1 -- 172.21.15.92:0/247620315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28900cb8e0 msgr2=0x7f28900c6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:08.805 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.799+0000 7f28949e0700 1 --2- 172.21.15.92:0/247620315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28900cb8e0 0x7f28900c6e00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f288400c520 tx=0x7f288400c830 comp rx=0 tx=0).stop 2023-08-26T09:25:08.806 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.799+0000 7f28949e0700 1 -- 172.21.15.92:0/247620315 shutdown_connections 2023-08-26T09:25:08.806 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.799+0000 7f28949e0700 1 --2- 172.21.15.92:0/247620315 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f287006a050 0x7f287006c510 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:08.806 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.799+0000 7f28949e0700 1 --2- 172.21.15.92:0/247620315 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f289015a090 0x7f28900c8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:08.806 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.799+0000 7f28949e0700 1 --2- 172.21.15.92:0/247620315 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f289006f4e0 0x7f289015e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:08.806 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.799+0000 7f28949e0700 1 --2- 172.21.15.92:0/247620315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28900cb8e0 0x7f28900c6e00 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:08.807 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.799+0000 7f28949e0700 1 -- 172.21.15.92:0/247620315 >> 172.21.15.92:0/247620315 conn(0x7f28900cc7b0 msgr2=0x7f28900c5930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:08.807 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.799+0000 7f28949e0700 1 -- 172.21.15.92:0/247620315 shutdown_connections 2023-08-26T09:25:08.807 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.799+0000 7f28949e0700 1 -- 172.21.15.92:0/247620315 wait complete. 2023-08-26T09:25:08.817 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-26T09:25:06.650431+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-26T09:25:06.973382+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-26T09:25:08.818 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-26T09:25:08.943 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.938+0000 7f53307a6700 1 Processor -- start 2023-08-26T09:25:08.944 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.938+0000 7f53307a6700 1 -- start start 2023-08-26T09:25:08.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.939+0000 7f53307a6700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f532815d220 0x7f53280af390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:08.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.939+0000 7f53307a6700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f532806db70 0x7f5328070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:08.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.939+0000 7f53307a6700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53280aee50 con 0x7f5328071260 2023-08-26T09:25:08.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.939+0000 7f53307a6700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53280af130 con 0x7f532815d220 2023-08-26T09:25:08.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.939+0000 7f53307a6700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53280c4cb0 con 0x7f532806db70 2023-08-26T09:25:08.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.939+0000 7f532ed43700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f5328071260 0x7f5328160d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:56164/0 (socket says 172.21.15.92:56164) 2023-08-26T09:25:08.949 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.939+0000 7f532ed43700 1 -- 172.21.15.92:0/1663989182 learned_addr learned my addr 172.21.15.92:0/1663989182 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:08.949 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.939+0000 7f532dd41700 1 --2- 172.21.15.92:0/1663989182 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f532806db70 0x7f5328070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:08.949 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.939+0000 7f532e542700 1 --2- 172.21.15.92:0/1663989182 >> v2:172.21.15.188:3300/0 conn(0x7f532815d220 0x7f53280af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:08.949 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.939+0000 7f532d540700 1 -- 172.21.15.92:0/1663989182 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3549952521 0 0) 0x7f53280aee50 con 0x7f5328071260 2023-08-26T09:25:08.949 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.939+0000 7f532d540700 1 -- 172.21.15.92:0/1663989182 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53140035b0 con 0x7f5328071260 2023-08-26T09:25:08.950 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.939+0000 7f532e542700 1 -- 172.21.15.92:0/1663989182 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f532806db70 msgr2=0x7f5328070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:08.950 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.939+0000 7f532e542700 1 --2- 172.21.15.92:0/1663989182 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f532806db70 0x7f5328070d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:08.950 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.939+0000 7f532e542700 1 -- 172.21.15.92:0/1663989182 >> v1:172.21.15.92:6789/0 conn(0x7f5328071260 legacy=0x7f5328160d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:08.950 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.939+0000 7f532e542700 1 -- 172.21.15.92:0/1663989182 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53280c4f90 con 0x7f532815d220 2023-08-26T09:25:08.950 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.940+0000 7f532dd41700 1 --2- 172.21.15.92:0/1663989182 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f532806db70 0x7f5328070d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-26T09:25:08.951 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.940+0000 7f532e542700 1 --2- 172.21.15.92:0/1663989182 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f532815d220 0x7f53280af390 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5324009840 tx=0x7f5324009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c6471a71b33fce2 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:08.951 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.940+0000 7f532d540700 1 -- 172.21.15.92:0/1663989182 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5324011830 con 0x7f532815d220 2023-08-26T09:25:08.951 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.940+0000 7f532d540700 1 -- 172.21.15.92:0/1663989182 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5324011990 con 0x7f532815d220 2023-08-26T09:25:08.951 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.940+0000 7f532d540700 1 -- 172.21.15.92:0/1663989182 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5324011d20 con 0x7f532815d220 2023-08-26T09:25:08.951 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.940+0000 7f53307a6700 1 -- 172.21.15.92:0/1663989182 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f532815d220 msgr2=0x7f53280af390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:08.952 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.940+0000 7f53307a6700 1 --2- 172.21.15.92:0/1663989182 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f532815d220 0x7f53280af390 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5324009840 tx=0x7f5324009b50 comp rx=0 tx=0).stop 2023-08-26T09:25:08.952 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.940+0000 7f53307a6700 1 -- 172.21.15.92:0/1663989182 shutdown_connections 2023-08-26T09:25:08.952 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.940+0000 7f53307a6700 1 --2- 172.21.15.92:0/1663989182 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f532815d220 0x7f53280af390 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:08.952 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.940+0000 7f53307a6700 1 --2- 172.21.15.92:0/1663989182 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f532806db70 0x7f5328070d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:08.952 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.940+0000 7f53307a6700 1 -- 172.21.15.92:0/1663989182 >> 172.21.15.92:0/1663989182 conn(0x7f532806b430 msgr2=0x7f532806b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:08.952 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.940+0000 7f53307a6700 1 -- 172.21.15.92:0/1663989182 shutdown_connections 2023-08-26T09:25:08.953 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.940+0000 7f53307a6700 1 -- 172.21.15.92:0/1663989182 wait complete. 2023-08-26T09:25:08.953 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.942+0000 7f53307a6700 1 Processor -- start 2023-08-26T09:25:08.953 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.942+0000 7f53307a6700 1 -- start start 2023-08-26T09:25:08.956 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.942+0000 7f53307a6700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f532806db70 0x7f53281425e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:08.956 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.942+0000 7f53307a6700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5328071260 0x7f53280b03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:08.956 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.942+0000 7f53307a6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f532815d220 0x7f53280b0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:08.956 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.942+0000 7f53307a6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f532815f470 con 0x7f532815d220 2023-08-26T09:25:08.956 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.942+0000 7f53307a6700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f532815f170 con 0x7f532806db70 2023-08-26T09:25:08.957 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.942+0000 7f53307a6700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5328142b20 con 0x7f5328071260 2023-08-26T09:25:08.957 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.942+0000 7f532e542700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f532806db70 0x7f53281425e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:08.957 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.942+0000 7f532dd41700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5328071260 0x7f53280b03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:08.957 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.942+0000 7f532ed43700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f532815d220 0x7f53280b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:08.957 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.942+0000 7f532e542700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f532806db70 0x7f53281425e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.92:32960/0 (socket says 172.21.15.92:32960) 2023-08-26T09:25:08.958 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.942+0000 7f532e542700 1 -- 172.21.15.92:0/1037125382 learned_addr learned my addr 172.21.15.92:0/1037125382 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:08.958 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.943+0000 7f532e542700 1 -- 172.21.15.92:0/1037125382 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5328071260 msgr2=0x7f53280b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:08.959 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.943+0000 7f532e542700 1 --2- 172.21.15.92:0/1037125382 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5328071260 0x7f53280b03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:08.959 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.943+0000 7f532e542700 1 -- 172.21.15.92:0/1037125382 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f532815d220 msgr2=0x7f53280b0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:08.959 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.943+0000 7f532e542700 1 --2- 172.21.15.92:0/1037125382 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f532815d220 0x7f53280b0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:08.959 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.943+0000 7f532e542700 1 -- 172.21.15.92:0/1037125382 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53180094a0 con 0x7f532806db70 2023-08-26T09:25:08.960 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.943+0000 7f532dd41700 1 --2- 172.21.15.92:0/1037125382 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5328071260 0x7f53280b03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-26T09:25:08.960 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.943+0000 7f532ed43700 1 --2- 172.21.15.92:0/1037125382 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f532815d220 0x7f53280b0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-26T09:25:08.960 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.943+0000 7f532e542700 1 --2- 172.21.15.92:0/1037125382 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f532806db70 0x7f53281425e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5324009fd0 tx=0x7f5324004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:08.960 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.943+0000 7f531effd700 1 -- 172.21.15.92:0/1037125382 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5324004590 con 0x7f532806db70 2023-08-26T09:25:08.960 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.943+0000 7f531effd700 1 -- 172.21.15.92:0/1037125382 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f532401e070 con 0x7f532806db70 2023-08-26T09:25:08.961 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.943+0000 7f531effd700 1 -- 172.21.15.92:0/1037125382 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53240038e0 con 0x7f532806db70 2023-08-26T09:25:08.961 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.943+0000 7f53307a6700 1 -- 172.21.15.92:0/1037125382 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53240094a0 con 0x7f532806db70 2023-08-26T09:25:08.961 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.943+0000 7f53307a6700 1 -- 172.21.15.92:0/1037125382 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53281448c0 con 0x7f532806db70 2023-08-26T09:25:08.961 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.944+0000 7f53307a6700 1 -- 172.21.15.92:0/1037125382 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f532815efd0 con 0x7f532806db70 2023-08-26T09:25:08.961 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.945+0000 7f531effd700 1 -- 172.21.15.92:0/1037125382 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7f5324003a40 con 0x7f532806db70 2023-08-26T09:25:08.962 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.945+0000 7f531effd700 1 --2- 172.21.15.92:0/1037125382 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f530c06a050 0x7f530c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:08.962 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.945+0000 7f531effd700 1 -- 172.21.15.92:0/1037125382 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5324088eb0 con 0x7f532806db70 2023-08-26T09:25:08.962 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.950+0000 7f531effd700 1 -- 172.21.15.92:0/1037125382 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f532815efd0 con 0x7f532806db70 2023-08-26T09:25:08.963 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.953+0000 7f532dd41700 1 --2- 172.21.15.92:0/1037125382 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f530c06a050 0x7f530c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:08.963 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:08.953+0000 7f532dd41700 1 --2- 172.21.15.92:0/1037125382 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f530c06a050 0x7f530c06c510 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5328161800 tx=0x7f5318009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:09.151 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.145+0000 7f53307a6700 1 -- 172.21.15.92:0/1037125382 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f532815efd0 con 0x7f532806db70 2023-08-26T09:25:09.151 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.146+0000 7f531effd700 1 -- 172.21.15.92:0/1037125382 <== mon.1 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v15) v1 ==== 92+0+10 (secure 0 0 0) 0x7f532815efd0 con 0x7f532806db70 2023-08-26T09:25:09.152 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 8 2023-08-26T09:25:09.154 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.148+0000 7f53307a6700 1 -- 172.21.15.92:0/1037125382 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f530c06a050 msgr2=0x7f530c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:09.154 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.148+0000 7f53307a6700 1 --2- 172.21.15.92:0/1037125382 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f530c06a050 0x7f530c06c510 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5328161800 tx=0x7f5318009210 comp rx=0 tx=0).stop 2023-08-26T09:25:09.154 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.148+0000 7f53307a6700 1 -- 172.21.15.92:0/1037125382 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f532806db70 msgr2=0x7f53281425e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:09.154 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.148+0000 7f53307a6700 1 --2- 172.21.15.92:0/1037125382 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f532806db70 0x7f53281425e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5324009fd0 tx=0x7f5324004750 comp rx=0 tx=0).stop 2023-08-26T09:25:09.155 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.148+0000 7f53307a6700 1 -- 172.21.15.92:0/1037125382 shutdown_connections 2023-08-26T09:25:09.155 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.148+0000 7f53307a6700 1 --2- 172.21.15.92:0/1037125382 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f530c06a050 0x7f530c06c510 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:09.155 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.148+0000 7f53307a6700 1 --2- 172.21.15.92:0/1037125382 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f532806db70 0x7f53281425e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:09.155 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.148+0000 7f53307a6700 1 --2- 172.21.15.92:0/1037125382 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f532815d220 0x7f53280b0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:09.155 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.148+0000 7f53307a6700 1 --2- 172.21.15.92:0/1037125382 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5328071260 0x7f53280b03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:09.155 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.148+0000 7f53307a6700 1 -- 172.21.15.92:0/1037125382 >> 172.21.15.92:0/1037125382 conn(0x7f532806b430 msgr2=0x7f53280cd890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:09.156 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.148+0000 7f53307a6700 1 -- 172.21.15.92:0/1037125382 shutdown_connections 2023-08-26T09:25:09.156 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.148+0000 7f53307a6700 1 -- 172.21.15.92:0/1037125382 wait complete. 2023-08-26T09:25:09.165 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-26T09:25:09.293 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.287+0000 7f853f124700 1 Processor -- start 2023-08-26T09:25:09.293 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.287+0000 7f853f124700 1 -- start start 2023-08-26T09:25:09.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.288+0000 7f853f124700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f85381593b0 0x7f853806bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:09.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.288+0000 7f853f124700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f8538159790 0x7f85380c4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:09.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.288+0000 7f853f124700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85380ca900 con 0x7f85380cc820 2023-08-26T09:25:09.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.288+0000 7f853f124700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85380c3f50 con 0x7f8538159790 2023-08-26T09:25:09.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.288+0000 7f853f124700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85380c3c70 con 0x7f85381593b0 2023-08-26T09:25:09.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.288+0000 7f8537fff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f8538159790 0x7f85380c4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:09.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.288+0000 7f8537fff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f8538159790 0x7f85380c4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44184/0 (socket says 172.21.15.92:44184) 2023-08-26T09:25:09.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.288+0000 7f853d6c1700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f85380cc820 0x7f85380c5380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:56200/0 (socket says 172.21.15.92:56200) 2023-08-26T09:25:09.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.288+0000 7f8537fff700 1 -- 172.21.15.92:0/2911301434 learned_addr learned my addr 172.21.15.92:0/2911301434 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:09.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.288+0000 7f853cec0700 1 --2- 172.21.15.92:0/2911301434 >> v2:172.21.15.188:3300/0 conn(0x7f85381593b0 0x7f853806bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:09.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.288+0000 7f8537fff700 1 -- 172.21.15.92:0/2911301434 >> v2:172.21.15.188:3300/0 conn(0x7f85381593b0 msgr2=0x7f853806bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:09.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.288+0000 7f8537fff700 1 --2- 172.21.15.92:0/2911301434 >> v2:172.21.15.188:3300/0 conn(0x7f85381593b0 0x7f853806bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:09.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.288+0000 7f8537fff700 1 -- 172.21.15.92:0/2911301434 >> v1:172.21.15.92:6789/0 conn(0x7f85380cc820 legacy=0x7f85380c5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:09.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.288+0000 7f8537fff700 1 -- 172.21.15.92:0/2911301434 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85380cd2f0 con 0x7f8538159790 2023-08-26T09:25:09.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.288+0000 7f85377fe700 1 -- 172.21.15.92:0/2911301434 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4186120629 0 0) 0x7f85380ca900 con 0x7f85380cc820 2023-08-26T09:25:09.304 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.289+0000 7f8537fff700 1 --2- 172.21.15.92:0/2911301434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8538159790 0x7f85380c4e40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f85380b17a0 tx=0x7f8520009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cccda1aaed2e9eff server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:09.304 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.289+0000 7f85377fe700 1 -- 172.21.15.92:0/2911301434 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852000b870 con 0x7f8538159790 2023-08-26T09:25:09.304 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.289+0000 7f85377fe700 1 -- 172.21.15.92:0/2911301434 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f852000b9d0 con 0x7f8538159790 2023-08-26T09:25:09.305 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.289+0000 7f85377fe700 1 -- 172.21.15.92:0/2911301434 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852000bd60 con 0x7f8538159790 2023-08-26T09:25:09.305 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.289+0000 7f853f124700 1 -- 172.21.15.92:0/2911301434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8538159790 msgr2=0x7f85380c4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:09.305 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.289+0000 7f853f124700 1 --2- 172.21.15.92:0/2911301434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8538159790 0x7f85380c4e40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f85380b17a0 tx=0x7f8520009bd0 comp rx=0 tx=0).stop 2023-08-26T09:25:09.305 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.289+0000 7f853f124700 1 -- 172.21.15.92:0/2911301434 shutdown_connections 2023-08-26T09:25:09.306 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.289+0000 7f853f124700 1 --2- 172.21.15.92:0/2911301434 >> v2:172.21.15.188:3300/0 conn(0x7f85381593b0 0x7f853806bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:09.306 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.289+0000 7f853f124700 1 --2- 172.21.15.92:0/2911301434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8538159790 0x7f85380c4e40 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:09.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.289+0000 7f853f124700 1 -- 172.21.15.92:0/2911301434 >> 172.21.15.92:0/2911301434 conn(0x7f85380b0880 msgr2=0x7f85380b0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:09.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.289+0000 7f853f124700 1 -- 172.21.15.92:0/2911301434 shutdown_connections 2023-08-26T09:25:09.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.289+0000 7f853f124700 1 -- 172.21.15.92:0/2911301434 wait complete. 2023-08-26T09:25:09.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.291+0000 7f853f124700 1 Processor -- start 2023-08-26T09:25:09.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.291+0000 7f853f124700 1 -- start start 2023-08-26T09:25:09.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.291+0000 7f853f124700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85380cc820 0x7f8538164310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:09.309 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.291+0000 7f853f124700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85381593b0 0x7f85381505d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:09.309 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.291+0000 7f853f124700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8538159790 0x7f85380b37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:09.309 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.291+0000 7f853f124700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8538164b40 con 0x7f8538159790 2023-08-26T09:25:09.310 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.291+0000 7f853f124700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8538164e20 con 0x7f85380cc820 2023-08-26T09:25:09.310 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.291+0000 7f853f124700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8538165100 con 0x7f85381593b0 2023-08-26T09:25:09.310 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.292+0000 7f853d6c1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8538159790 0x7f85380b37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:09.311 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.292+0000 7f853d6c1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8538159790 0x7f85380b37f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44192/0 (socket says 172.21.15.92:44192) 2023-08-26T09:25:09.311 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.292+0000 7f853d6c1700 1 -- 172.21.15.92:0/3672953887 learned_addr learned my addr 172.21.15.92:0/3672953887 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:09.311 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.292+0000 7f8537fff700 1 --2- 172.21.15.92:0/3672953887 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85381593b0 0x7f85381505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:09.312 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.292+0000 7f853cec0700 1 --2- 172.21.15.92:0/3672953887 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85380cc820 0x7f8538164310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:09.312 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.292+0000 7f853d6c1700 1 -- 172.21.15.92:0/3672953887 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85381593b0 msgr2=0x7f85381505d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:09.313 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.292+0000 7f853d6c1700 1 --2- 172.21.15.92:0/3672953887 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85381593b0 0x7f85381505d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:09.313 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.292+0000 7f853d6c1700 1 -- 172.21.15.92:0/3672953887 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85380cc820 msgr2=0x7f8538164310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:09.313 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.292+0000 7f853d6c1700 1 --2- 172.21.15.92:0/3672953887 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85380cc820 0x7f8538164310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:09.313 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.292+0000 7f853d6c1700 1 -- 172.21.15.92:0/3672953887 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8520009550 con 0x7f8538159790 2023-08-26T09:25:09.314 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.292+0000 7f853d6c1700 1 --2- 172.21.15.92:0/3672953887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8538159790 0x7f85380b37f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f852800c480 tx=0x7f852800c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:09.314 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.292+0000 7f85357fa700 1 -- 172.21.15.92:0/3672953887 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8528004c80 con 0x7f8538159790 2023-08-26T09:25:09.314 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.292+0000 7f853f124700 1 -- 172.21.15.92:0/3672953887 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85380b2ff0 con 0x7f8538159790 2023-08-26T09:25:09.314 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.292+0000 7f85357fa700 1 -- 172.21.15.92:0/3672953887 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8528004e00 con 0x7f8538159790 2023-08-26T09:25:09.314 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.292+0000 7f85357fa700 1 -- 172.21.15.92:0/3672953887 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8528007310 con 0x7f8538159790 2023-08-26T09:25:09.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.292+0000 7f853f124700 1 -- 172.21.15.92:0/3672953887 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8538164850 con 0x7f8538159790 2023-08-26T09:25:09.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.293+0000 7f853f124700 1 -- 172.21.15.92:0/3672953887 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85380b3510 con 0x7f8538159790 2023-08-26T09:25:09.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.294+0000 7f85357fa700 1 -- 172.21.15.92:0/3672953887 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7f8528007470 con 0x7f8538159790 2023-08-26T09:25:09.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.294+0000 7f85357fa700 1 --2- 172.21.15.92:0/3672953887 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f851806a050 0x7f851806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:09.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.294+0000 7f853cec0700 1 --2- 172.21.15.92:0/3672953887 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f851806a050 0x7f851806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:09.316 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.294+0000 7f85357fa700 1 -- 172.21.15.92:0/3672953887 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8528087c20 con 0x7f8538159790 2023-08-26T09:25:09.316 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.295+0000 7f853cec0700 1 --2- 172.21.15.92:0/3672953887 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f851806a050 0x7f851806c510 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8530003b30 tx=0x7f8530009830 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:09.316 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.299+0000 7f85357fa700 1 -- 172.21.15.92:0/3672953887 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8528053750 con 0x7f8538159790 2023-08-26T09:25:09.500 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.495+0000 7f853f124700 1 -- 172.21.15.92:0/3672953887 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f853804eeb0 con 0x7f8538159790 2023-08-26T09:25:09.501 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.495+0000 7f85357fa700 1 -- 172.21.15.92:0/3672953887 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8528056d70 con 0x7f8538159790 2023-08-26T09:25:09.501 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 1 2023-08-26T09:25:09.503 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.497+0000 7f853f124700 1 -- 172.21.15.92:0/3672953887 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f851806a050 msgr2=0x7f851806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:09.503 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.497+0000 7f853f124700 1 --2- 172.21.15.92:0/3672953887 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f851806a050 0x7f851806c510 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8530003b30 tx=0x7f8530009830 comp rx=0 tx=0).stop 2023-08-26T09:25:09.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.497+0000 7f853f124700 1 -- 172.21.15.92:0/3672953887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8538159790 msgr2=0x7f85380b37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:09.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.497+0000 7f853f124700 1 --2- 172.21.15.92:0/3672953887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8538159790 0x7f85380b37f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f852800c480 tx=0x7f852800c790 comp rx=0 tx=0).stop 2023-08-26T09:25:09.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.497+0000 7f853f124700 1 -- 172.21.15.92:0/3672953887 shutdown_connections 2023-08-26T09:25:09.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.497+0000 7f853f124700 1 --2- 172.21.15.92:0/3672953887 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f851806a050 0x7f851806c510 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:09.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.497+0000 7f853f124700 1 --2- 172.21.15.92:0/3672953887 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85380cc820 0x7f8538164310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:09.505 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.497+0000 7f853f124700 1 --2- 172.21.15.92:0/3672953887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8538159790 0x7f85380b37f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:09.505 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.497+0000 7f853f124700 1 --2- 172.21.15.92:0/3672953887 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85381593b0 0x7f85381505d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:09.505 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.497+0000 7f853f124700 1 -- 172.21.15.92:0/3672953887 >> 172.21.15.92:0/3672953887 conn(0x7f85380b0880 msgr2=0x7f85380c4670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:09.505 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.498+0000 7f853f124700 1 -- 172.21.15.92:0/3672953887 shutdown_connections 2023-08-26T09:25:09.505 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.498+0000 7f853f124700 1 -- 172.21.15.92:0/3672953887 wait complete. 2023-08-26T09:25:09.516 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-26T09:25:09.636 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.631+0000 7fb6244d5700 1 Processor -- start 2023-08-26T09:25:09.637 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.631+0000 7fb6244d5700 1 -- start start 2023-08-26T09:25:09.639 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.632+0000 7fb6244d5700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fb61c15e770 0x7fb61c06ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:09.639 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.632+0000 7fb6244d5700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb61c06b240 con 0x7fb61c0cbf10 2023-08-26T09:25:09.639 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.632+0000 7fb6244d5700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb61c15fb20 con 0x7fb61c06ce50 2023-08-26T09:25:09.639 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.632+0000 7fb6244d5700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb61c15eb50 con 0x7fb61c15e770 2023-08-26T09:25:09.640 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.632+0000 7fb622271700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fb61c15e770 0x7fb61c06ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:09.640 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.632+0000 7fb622a72700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fb61c0cbf10 0x7fb61c15f410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:56224/0 (socket says 172.21.15.92:56224) 2023-08-26T09:25:09.640 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.632+0000 7fb622a72700 1 -- 172.21.15.92:0/3807277974 learned_addr learned my addr 172.21.15.92:0/3807277974 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:09.640 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.633+0000 7fb622271700 1 -- 172.21.15.92:0/3807277974 >> v1:172.21.15.188:6789/0 conn(0x7fb61c06ce50 legacy=0x7fb61c15ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:09.640 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.633+0000 7fb622271700 1 -- 172.21.15.92:0/3807277974 >> v1:172.21.15.92:6789/0 conn(0x7fb61c0cbf10 legacy=0x7fb61c15f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:09.641 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.633+0000 7fb622271700 1 -- 172.21.15.92:0/3807277974 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb61c06f470 con 0x7fb61c15e770 2023-08-26T09:25:09.641 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.633+0000 7fb62126f700 1 -- 172.21.15.92:0/3807277974 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 815778499 0 0) 0x7fb61c06b240 con 0x7fb61c0cbf10 2023-08-26T09:25:09.641 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.633+0000 7fb622271700 1 --2- 172.21.15.92:0/3807277974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb61c15e770 0x7fb61c06ad00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb60c009840 tx=0x7fb60c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3c6d98898ce7024 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:09.641 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.633+0000 7fb62126f700 1 -- 172.21.15.92:0/3807277974 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60c004230 con 0x7fb61c15e770 2023-08-26T09:25:09.642 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.633+0000 7fb62126f700 1 -- 172.21.15.92:0/3807277974 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb60c004390 con 0x7fb61c15e770 2023-08-26T09:25:09.642 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.633+0000 7fb62126f700 1 -- 172.21.15.92:0/3807277974 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60c0036a0 con 0x7fb61c15e770 2023-08-26T09:25:09.642 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.634+0000 7fb6244d5700 1 -- 172.21.15.92:0/3807277974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb61c15e770 msgr2=0x7fb61c06ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:09.642 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.634+0000 7fb6244d5700 1 --2- 172.21.15.92:0/3807277974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb61c15e770 0x7fb61c06ad00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb60c009840 tx=0x7fb60c009b50 comp rx=0 tx=0).stop 2023-08-26T09:25:09.642 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.634+0000 7fb6244d5700 1 -- 172.21.15.92:0/3807277974 shutdown_connections 2023-08-26T09:25:09.642 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.634+0000 7fb6244d5700 1 --2- 172.21.15.92:0/3807277974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb61c15e770 0x7fb61c06ad00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:09.643 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.634+0000 7fb6244d5700 1 -- 172.21.15.92:0/3807277974 >> 172.21.15.92:0/3807277974 conn(0x7fb61c0cc7b0 msgr2=0x7fb61c0ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:09.643 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.634+0000 7fb6244d5700 1 -- 172.21.15.92:0/3807277974 shutdown_connections 2023-08-26T09:25:09.643 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.634+0000 7fb6244d5700 1 -- 172.21.15.92:0/3807277974 wait complete. 2023-08-26T09:25:09.646 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.635+0000 7fb6244d5700 1 Processor -- start 2023-08-26T09:25:09.646 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.635+0000 7fb6244d5700 1 -- start start 2023-08-26T09:25:09.646 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.636+0000 7fb6244d5700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb61c06ce50 0x7fb61c1502d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:09.647 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.636+0000 7fb6244d5700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb61c0cbf10 0x7fb61c0c7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:09.647 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.636+0000 7fb6244d5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb61c15e770 0x7fb61c1536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:09.647 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.636+0000 7fb6244d5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61c0c9040 con 0x7fb61c15e770 2023-08-26T09:25:09.647 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.636+0000 7fb6244d5700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61c1f0890 con 0x7fb61c06ce50 2023-08-26T09:25:09.647 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.636+0000 7fb6244d5700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb61c150810 con 0x7fb61c0cbf10 2023-08-26T09:25:09.648 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.636+0000 7fb622a72700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb61c15e770 0x7fb61c1536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:09.648 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.636+0000 7fb622a72700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb61c15e770 0x7fb61c1536b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44216/0 (socket says 172.21.15.92:44216) 2023-08-26T09:25:09.648 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.636+0000 7fb622a72700 1 -- 172.21.15.92:0/4216599982 learned_addr learned my addr 172.21.15.92:0/4216599982 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:09.648 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.636+0000 7fb622271700 1 --2- 172.21.15.92:0/4216599982 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb61c06ce50 0x7fb61c1502d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:09.648 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.636+0000 7fb621a70700 1 --2- 172.21.15.92:0/4216599982 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb61c0cbf10 0x7fb61c0c7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:09.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.636+0000 7fb622a72700 1 -- 172.21.15.92:0/4216599982 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb61c0cbf10 msgr2=0x7fb61c0c7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:09.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.636+0000 7fb622a72700 1 --2- 172.21.15.92:0/4216599982 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb61c0cbf10 0x7fb61c0c7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:09.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.636+0000 7fb622a72700 1 -- 172.21.15.92:0/4216599982 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb61c06ce50 msgr2=0x7fb61c1502d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:09.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.636+0000 7fb622a72700 1 --2- 172.21.15.92:0/4216599982 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb61c06ce50 0x7fb61c1502d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:09.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.636+0000 7fb622a72700 1 -- 172.21.15.92:0/4216599982 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb60c0094a0 con 0x7fb61c15e770 2023-08-26T09:25:09.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.636+0000 7fb622a72700 1 --2- 172.21.15.92:0/4216599982 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb61c15e770 0x7fb61c1536b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb61400cc10 tx=0x7fb61400cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:09.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.636+0000 7fb612ffd700 1 -- 172.21.15.92:0/4216599982 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61400aa60 con 0x7fb61c15e770 2023-08-26T09:25:09.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.636+0000 7fb612ffd700 1 -- 172.21.15.92:0/4216599982 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb61400abc0 con 0x7fb61c15e770 2023-08-26T09:25:09.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.636+0000 7fb6244d5700 1 -- 172.21.15.92:0/4216599982 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb61c0c84c0 con 0x7fb61c15e770 2023-08-26T09:25:09.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.636+0000 7fb612ffd700 1 -- 172.21.15.92:0/4216599982 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6140070d0 con 0x7fb61c15e770 2023-08-26T09:25:09.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.636+0000 7fb6244d5700 1 -- 172.21.15.92:0/4216599982 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb61c0c8a80 con 0x7fb61c15e770 2023-08-26T09:25:09.651 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.637+0000 7fb6244d5700 1 -- 172.21.15.92:0/4216599982 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb61c04e660 con 0x7fb61c15e770 2023-08-26T09:25:09.651 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.638+0000 7fb612ffd700 1 -- 172.21.15.92:0/4216599982 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7fb614007230 con 0x7fb61c15e770 2023-08-26T09:25:09.651 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.638+0000 7fb612ffd700 1 --2- 172.21.15.92:0/4216599982 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb60006a050 0x7fb60006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:09.651 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.638+0000 7fb612ffd700 1 -- 172.21.15.92:0/4216599982 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb614087ea0 con 0x7fb61c15e770 2023-08-26T09:25:09.651 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.638+0000 7fb622271700 1 --2- 172.21.15.92:0/4216599982 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb60006a050 0x7fb60006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:09.652 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.639+0000 7fb622271700 1 --2- 172.21.15.92:0/4216599982 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb60006a050 0x7fb60006c510 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb60c0090b0 tx=0x7fb60c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:09.652 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.643+0000 7fb612ffd700 1 -- 172.21.15.92:0/4216599982 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb614053920 con 0x7fb61c15e770 2023-08-26T09:25:09.663 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.658+0000 7fb612ffd700 1 -- 172.21.15.92:0/4216599982 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb614053cf0 con 0x7fb61c15e770 2023-08-26T09:25:09.884 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.879+0000 7fb6244d5700 1 -- 172.21.15.92:0/4216599982 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb61c1f09d0 con 0x7fb61c15e770 2023-08-26T09:25:09.885 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.880+0000 7fb612ffd700 1 -- 172.21.15.92:0/4216599982 <== mon.0 v2:172.21.15.92:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3688 (secure 0 0 0) 0x7fb6140573b0 con 0x7fb61c15e770 2023-08-26T09:25:09.886 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:25:09.886 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/856608283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6833","nonce":856608283},{"type":"v1","addr":"172.21.15.188:6835","nonce":856608283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4279,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/33581841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":33581841},{"type":"v1","addr":"172.21.15.92:6837","nonce":33581841}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6834/279535547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":279535547},{"type":"v1","addr":"172.21.15.188:6834","nonce":279535547}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2933877114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2933877114},{"type":"v1","addr":"172.21.15.92:6835","nonce":2933877114}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-08-26T09:25:09.888 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.882+0000 7fb6244d5700 1 -- 172.21.15.92:0/4216599982 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb60006a050 msgr2=0x7fb60006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:09.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.882+0000 7fb6244d5700 1 --2- 172.21.15.92:0/4216599982 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb60006a050 0x7fb60006c510 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb60c0090b0 tx=0x7fb60c008030 comp rx=0 tx=0).stop 2023-08-26T09:25:09.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.882+0000 7fb6244d5700 1 -- 172.21.15.92:0/4216599982 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb61c15e770 msgr2=0x7fb61c1536b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:09.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.882+0000 7fb6244d5700 1 --2- 172.21.15.92:0/4216599982 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb61c15e770 0x7fb61c1536b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb61400cc10 tx=0x7fb61400cf20 comp rx=0 tx=0).stop 2023-08-26T09:25:09.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.882+0000 7fb6244d5700 1 -- 172.21.15.92:0/4216599982 shutdown_connections 2023-08-26T09:25:09.890 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.882+0000 7fb6244d5700 1 --2- 172.21.15.92:0/4216599982 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb60006a050 0x7fb60006c510 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:09.890 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.882+0000 7fb6244d5700 1 --2- 172.21.15.92:0/4216599982 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb61c06ce50 0x7fb61c1502d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:09.890 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.882+0000 7fb6244d5700 1 --2- 172.21.15.92:0/4216599982 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb61c15e770 0x7fb61c1536b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:09.890 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.882+0000 7fb6244d5700 1 --2- 172.21.15.92:0/4216599982 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb61c0cbf10 0x7fb61c0c7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:09.890 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.882+0000 7fb6244d5700 1 -- 172.21.15.92:0/4216599982 >> 172.21.15.92:0/4216599982 conn(0x7fb61c0cc7b0 msgr2=0x7fb61c0c5720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:09.891 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.882+0000 7fb6244d5700 1 -- 172.21.15.92:0/4216599982 shutdown_connections 2023-08-26T09:25:09.891 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:09.882+0000 7fb6244d5700 1 -- 172.21.15.92:0/4216599982 wait complete. 2023-08-26T09:25:09.891 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 3 2023-08-26T09:25:09.899 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-26T09:25:10.019 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.013+0000 7f3934b99700 1 Processor -- start 2023-08-26T09:25:10.019 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.013+0000 7f3934b99700 1 -- start start 2023-08-26T09:25:10.021 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.014+0000 7f3934b99700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f393015a090 0x7f39300cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:10.021 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.014+0000 7f3934b99700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39300cf7e0 con 0x7f39300cb8e0 2023-08-26T09:25:10.021 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.014+0000 7f3934b99700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39300caec0 con 0x7f393006f4e0 2023-08-26T09:25:10.022 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.014+0000 7f3934b99700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39300cb160 con 0x7f393015a090 2023-08-26T09:25:10.022 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.014+0000 7f392e59c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f393015a090 0x7f39300cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:10.022 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.014+0000 7f392ed9d700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f39300cb8e0 0x7f393006e780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:56236/0 (socket says 172.21.15.92:56236) 2023-08-26T09:25:10.022 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.015+0000 7f392e59c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f393015a090 0x7f39300cd2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44220/0 (socket says 172.21.15.92:44220) 2023-08-26T09:25:10.022 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.015+0000 7f392ed9d700 1 -- 172.21.15.92:0/49520266 learned_addr learned my addr 172.21.15.92:0/49520266 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:10.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.015+0000 7f392e59c700 1 -- 172.21.15.92:0/49520266 >> v1:172.21.15.188:6789/0 conn(0x7f393006f4e0 legacy=0x7f39300cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:10.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.015+0000 7f392e59c700 1 -- 172.21.15.92:0/49520266 >> v1:172.21.15.92:6789/0 conn(0x7f39300cb8e0 legacy=0x7f393006e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:10.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.015+0000 7f392e59c700 1 -- 172.21.15.92:0/49520266 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39300cb440 con 0x7f393015a090 2023-08-26T09:25:10.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.015+0000 7f392e59c700 1 --2- 172.21.15.92:0/49520266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f393015a090 0x7f39300cd2d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3924009840 tx=0x7f3924009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f72d57afa71611e server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:10.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.015+0000 7f392d59a700 1 -- 172.21.15.92:0/49520266 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3924011830 con 0x7f393015a090 2023-08-26T09:25:10.024 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.015+0000 7f392d59a700 1 -- 172.21.15.92:0/49520266 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3924011990 con 0x7f393015a090 2023-08-26T09:25:10.024 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.015+0000 7f392d59a700 1 -- 172.21.15.92:0/49520266 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3924011d20 con 0x7f393015a090 2023-08-26T09:25:10.024 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.016+0000 7f3934b99700 1 -- 172.21.15.92:0/49520266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f393015a090 msgr2=0x7f39300cd2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:10.024 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.016+0000 7f3934b99700 1 --2- 172.21.15.92:0/49520266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f393015a090 0x7f39300cd2d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3924009840 tx=0x7f3924009b50 comp rx=0 tx=0).stop 2023-08-26T09:25:10.024 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.016+0000 7f3934b99700 1 -- 172.21.15.92:0/49520266 shutdown_connections 2023-08-26T09:25:10.025 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.016+0000 7f3934b99700 1 --2- 172.21.15.92:0/49520266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f393015a090 0x7f39300cd2d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:10.025 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.016+0000 7f3934b99700 1 -- 172.21.15.92:0/49520266 >> 172.21.15.92:0/49520266 conn(0x7f39300cc7b0 msgr2=0x7f39300ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:10.025 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.016+0000 7f3934b99700 1 -- 172.21.15.92:0/49520266 shutdown_connections 2023-08-26T09:25:10.025 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.016+0000 7f3934b99700 1 -- 172.21.15.92:0/49520266 wait complete. 2023-08-26T09:25:10.028 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.017+0000 7f3934b99700 1 Processor -- start 2023-08-26T09:25:10.028 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.017+0000 7f3934b99700 1 -- start start 2023-08-26T09:25:10.028 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.018+0000 7f3934b99700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f393006f4e0 0x7f39300ce210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:10.028 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.018+0000 7f3934b99700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39300cb8e0 0x7f3930154f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:10.029 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.018+0000 7f3934b99700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f393015a090 0x7f39300c4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:10.029 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.018+0000 7f3934b99700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39300cd4e0 con 0x7f393006f4e0 2023-08-26T09:25:10.029 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.018+0000 7f3934b99700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3930155900 con 0x7f39300cb8e0 2023-08-26T09:25:10.029 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.018+0000 7f3934b99700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39300cd730 con 0x7f393015a090 2023-08-26T09:25:10.029 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.018+0000 7f392e59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f393006f4e0 0x7f39300ce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:10.030 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.018+0000 7f392e59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f393006f4e0 0x7f39300ce210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44226/0 (socket says 172.21.15.92:44226) 2023-08-26T09:25:10.030 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.018+0000 7f392e59c700 1 -- 172.21.15.92:0/4262891195 learned_addr learned my addr 172.21.15.92:0/4262891195 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:10.030 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.018+0000 7f392ed9d700 1 --2- 172.21.15.92:0/4262891195 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f393015a090 0x7f39300c4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:10.030 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.018+0000 7f392dd9b700 1 --2- 172.21.15.92:0/4262891195 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39300cb8e0 0x7f3930154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:10.030 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.018+0000 7f392e59c700 1 -- 172.21.15.92:0/4262891195 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f393015a090 msgr2=0x7f39300c4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:10.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.018+0000 7f392e59c700 1 --2- 172.21.15.92:0/4262891195 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f393015a090 0x7f39300c4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:10.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.018+0000 7f392e59c700 1 -- 172.21.15.92:0/4262891195 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39300cb8e0 msgr2=0x7f3930154f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:10.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.018+0000 7f392e59c700 1 --2- 172.21.15.92:0/4262891195 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39300cb8e0 0x7f3930154f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:10.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.018+0000 7f392e59c700 1 -- 172.21.15.92:0/4262891195 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39240094a0 con 0x7f393006f4e0 2023-08-26T09:25:10.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.018+0000 7f392dd9b700 1 --2- 172.21.15.92:0/4262891195 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39300cb8e0 0x7f3930154f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:10.032 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.018+0000 7f392ed9d700 1 --2- 172.21.15.92:0/4262891195 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f393015a090 0x7f39300c4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:10.032 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.018+0000 7f392e59c700 1 --2- 172.21.15.92:0/4262891195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f393006f4e0 0x7f39300ce210 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3924000c00 tx=0x7f3924004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:10.032 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.018+0000 7f391effd700 1 -- 172.21.15.92:0/4262891195 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39240038a0 con 0x7f393006f4e0 2023-08-26T09:25:10.032 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.018+0000 7f391effd700 1 -- 172.21.15.92:0/4262891195 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f392401e070 con 0x7f393006f4e0 2023-08-26T09:25:10.032 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.018+0000 7f3934b99700 1 -- 172.21.15.92:0/4262891195 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39300cda10 con 0x7f393006f4e0 2023-08-26T09:25:10.033 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.018+0000 7f391effd700 1 -- 172.21.15.92:0/4262891195 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3924003c60 con 0x7f393006f4e0 2023-08-26T09:25:10.033 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.019+0000 7f3934b99700 1 -- 172.21.15.92:0/4262891195 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39300ce750 con 0x7f393006f4e0 2023-08-26T09:25:10.033 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.019+0000 7f3934b99700 1 -- 172.21.15.92:0/4262891195 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39300cdf30 con 0x7f393006f4e0 2023-08-26T09:25:10.033 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.020+0000 7f391effd700 1 -- 172.21.15.92:0/4262891195 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f392402d450 con 0x7f393006f4e0 2023-08-26T09:25:10.033 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.020+0000 7f391effd700 1 --2- 172.21.15.92:0/4262891195 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f391006a0e0 0x7f391006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:10.033 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.020+0000 7f391effd700 1 -- 172.21.15.92:0/4262891195 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f39240892e0 con 0x7f393006f4e0 2023-08-26T09:25:10.034 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.020+0000 7f392dd9b700 1 --2- 172.21.15.92:0/4262891195 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f391006a0e0 0x7f391006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:10.034 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.021+0000 7f392dd9b700 1 --2- 172.21.15.92:0/4262891195 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f391006a0e0 0x7f391006c5a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f39300ccd00 tx=0x7f3920009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:10.034 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.025+0000 7f391effd700 1 -- 172.21.15.92:0/4262891195 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f39300cdf30 con 0x7f393006f4e0 2023-08-26T09:25:10.220 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.215+0000 7f3934b99700 1 -- 172.21.15.92:0/4262891195 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39300cdf30 con 0x7f393006f4e0 2023-08-26T09:25:10.221 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.216+0000 7f391effd700 1 -- 172.21.15.92:0/4262891195 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+14567 (secure 0 0 0) 0x7f39300cdf30 con 0x7f393006f4e0 2023-08-26T09:25:10.221 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:25:10.222 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":16,"fsid":"254a2d31-bd41-4507-8326-1b205ac24377","created":"2023-08-26T09:24:55.352131+0000","modified":"2023-08-26T09:25:09.394429+0000","last_up_change":"2023-08-26T09:25:06.124496+0000","last_in_change":"2023-08-26T09:24:57.840725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-26T09:25:06.650431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-26T09:25:06.973382+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e9e7638-4459-4d8d-8e40-130bcf48df66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6819","nonce":382827192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6824","nonce":382827192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6831","nonce":382827192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6827","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6829","nonce":382827192}]},"public_addr":"172.21.15.92:6819/382827192","cluster_addr":"172.21.15.92:6824/382827192","heartbeat_back_addr":"172.21.15.92:6831/382827192","heartbeat_front_addr":"172.21.15.92:6829/382827192","state":["exists","up"]},{"osd":1,"uuid":"164e68c9-aedd-4df5-9b70-f4b1ec3bda13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6809","nonce":618773438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6811","nonce":618773438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6815","nonce":618773438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6813","nonce":618773438}]},"public_addr":"172.21.15.92:6809/618773438","cluster_addr":"172.21.15.92:6811/618773438","heartbeat_back_addr":"172.21.15.92:6815/618773438","heartbeat_front_addr":"172.21.15.92:6813/618773438","state":["exists","up"]},{"osd":2,"uuid":"8701dfee-629a-4d30-82e4-b8fac340303f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6818","nonce":3697397687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6821","nonce":3697397687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6828","nonce":3697397687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6823","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6825","nonce":3697397687}]},"public_addr":"172.21.15.92:6818/3697397687","cluster_addr":"172.21.15.92:6821/3697397687","heartbeat_back_addr":"172.21.15.92:6828/3697397687","heartbeat_front_addr":"172.21.15.92:6825/3697397687","state":["exists","up"]},{"osd":3,"uuid":"93bdc94d-dc07-495f-995a-a6ad072f0247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6801","nonce":3579846453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6803","nonce":3579846453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6807","nonce":3579846453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6805","nonce":3579846453}]},"public_addr":"172.21.15.92:6801/3579846453","cluster_addr":"172.21.15.92:6803/3579846453","heartbeat_back_addr":"172.21.15.92:6807/3579846453","heartbeat_front_addr":"172.21.15.92:6805/3579846453","state":["exists","up"]},{"osd":4,"uuid":"d9d0ea80-8481-46a7-9677-c338d32cf1d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6809","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6811","nonce":3228383424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6813","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6815","nonce":3228383424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6821","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6823","nonce":3228383424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6817","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6819","nonce":3228383424}]},"public_addr":"172.21.15.188:6811/3228383424","cluster_addr":"172.21.15.188:6815/3228383424","heartbeat_back_addr":"172.21.15.188:6823/3228383424","heartbeat_front_addr":"172.21.15.188:6819/3228383424","state":["exists","up"]},{"osd":5,"uuid":"38d03253-467a-456f-bd5e-5a46532a0b18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6801","nonce":1655821054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6803","nonce":1655821054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6807","nonce":1655821054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6805","nonce":1655821054}]},"public_addr":"172.21.15.188:6801/1655821054","cluster_addr":"172.21.15.188:6803/1655821054","heartbeat_back_addr":"172.21.15.188:6807/1655821054","heartbeat_front_addr":"172.21.15.188:6805/1655821054","state":["exists","up"]},{"osd":6,"uuid":"d61564b5-136f-42e5-a843-626c2017cc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6810","nonce":2069976891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6814","nonce":2069976891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6822","nonce":2069976891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6818","nonce":2069976891}]},"public_addr":"172.21.15.188:6810/2069976891","cluster_addr":"172.21.15.188:6814/2069976891","heartbeat_back_addr":"172.21.15.188:6822/2069976891","heartbeat_front_addr":"172.21.15.188:6818/2069976891","state":["exists","up"]},{"osd":7,"uuid":"fae2949e-0d62-42cd-ba72-08f516084b20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6825","nonce":1882888860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6827","nonce":1882888860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6831","nonce":1882888860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6829","nonce":1882888860}]},"public_addr":"172.21.15.188:6825/1882888860","cluster_addr":"172.21.15.188:6827/1882888860","heartbeat_back_addr":"172.21.15.188:6831/1882888860","heartbeat_front_addr":"172.21.15.188:6829/1882888860","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.038523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.063160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.000857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.975572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.023848+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.765194+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.081365+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:05.110745+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-26T09:25:10.223 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.218+0000 7f3934b99700 1 -- 172.21.15.92:0/4262891195 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f391006a0e0 msgr2=0x7f391006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:10.224 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.218+0000 7f3934b99700 1 --2- 172.21.15.92:0/4262891195 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f391006a0e0 0x7f391006c5a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f39300ccd00 tx=0x7f3920009040 comp rx=0 tx=0).stop 2023-08-26T09:25:10.224 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.218+0000 7f3934b99700 1 -- 172.21.15.92:0/4262891195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f393006f4e0 msgr2=0x7f39300ce210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:10.224 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.218+0000 7f3934b99700 1 --2- 172.21.15.92:0/4262891195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f393006f4e0 0x7f39300ce210 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3924000c00 tx=0x7f3924004750 comp rx=0 tx=0).stop 2023-08-26T09:25:10.224 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.218+0000 7f3934b99700 1 -- 172.21.15.92:0/4262891195 shutdown_connections 2023-08-26T09:25:10.225 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.218+0000 7f3934b99700 1 --2- 172.21.15.92:0/4262891195 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f393015a090 0x7f39300c4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:10.225 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.218+0000 7f3934b99700 1 --2- 172.21.15.92:0/4262891195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f393006f4e0 0x7f39300ce210 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:10.225 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.218+0000 7f3934b99700 1 --2- 172.21.15.92:0/4262891195 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f391006a0e0 0x7f391006c5a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:10.225 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.218+0000 7f3934b99700 1 --2- 172.21.15.92:0/4262891195 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39300cb8e0 0x7f3930154f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:10.225 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.218+0000 7f3934b99700 1 -- 172.21.15.92:0/4262891195 >> 172.21.15.92:0/4262891195 conn(0x7f39300cc7b0 msgr2=0x7f393006a320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:10.226 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.218+0000 7f3934b99700 1 -- 172.21.15.92:0/4262891195 shutdown_connections 2023-08-26T09:25:10.226 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.218+0000 7f3934b99700 1 -- 172.21.15.92:0/4262891195 wait complete. 2023-08-26T09:25:10.235 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-26T09:25:06.650431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-26T09:25:06.973382+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-26T09:25:10.236 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-26T09:25:10.359 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.354+0000 7f1bdc181700 1 Processor -- start 2023-08-26T09:25:10.359 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.354+0000 7f1bdc181700 1 -- start start 2023-08-26T09:25:10.363 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.355+0000 7f1bdc181700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f1bd406e110 0x7f1bd406e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:10.363 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.355+0000 7f1bdc181700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bd40c6200 con 0x7f1bd4070d20 2023-08-26T09:25:10.363 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.355+0000 7f1bdc181700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bd40ce740 con 0x7f1bd4159dd0 2023-08-26T09:25:10.363 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.355+0000 7f1bdc181700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bd406eae0 con 0x7f1bd406e110 2023-08-26T09:25:10.364 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.355+0000 7f1bda71e700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f1bd4070d20 0x7f1bd4071170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:56252/0 (socket says 172.21.15.92:56252) 2023-08-26T09:25:10.364 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.355+0000 7f1bda71e700 1 -- 172.21.15.92:0/1597792069 learned_addr learned my addr 172.21.15.92:0/1597792069 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:10.364 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.355+0000 7f1bd971c700 1 --2- 172.21.15.92:0/1597792069 >> v2:172.21.15.188:3300/0 conn(0x7f1bd406e110 0x7f1bd406e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:10.364 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.355+0000 7f1bd8f1b700 1 -- 172.21.15.92:0/1597792069 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2220183002 0 0) 0x7f1bd40c6200 con 0x7f1bd4070d20 2023-08-26T09:25:10.364 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.355+0000 7f1bd8f1b700 1 -- 172.21.15.92:0/1597792069 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bc00035b0 con 0x7f1bd4070d20 2023-08-26T09:25:10.365 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.355+0000 7f1bd971c700 1 -- 172.21.15.92:0/1597792069 >> v1:172.21.15.188:6789/0 conn(0x7f1bd4159dd0 legacy=0x7f1bd40cf220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:10.365 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.355+0000 7f1bd971c700 1 -- 172.21.15.92:0/1597792069 >> v1:172.21.15.92:6789/0 conn(0x7f1bd4070d20 legacy=0x7f1bd4071170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:10.365 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.355+0000 7f1bd8f1b700 1 -- 172.21.15.92:0/1597792069 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2185762265 0 0) 0x7f1bc00035b0 con 0x7f1bd4070d20 2023-08-26T09:25:10.365 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.355+0000 7f1bd971c700 1 -- 172.21.15.92:0/1597792069 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd40cea20 con 0x7f1bd406e110 2023-08-26T09:25:10.365 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.355+0000 7f1bd971c700 1 --2- 172.21.15.92:0/1597792069 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1bd406e110 0x7f1bd406e5a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4009840 tx=0x7f1bc4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d05cba48ae2458ac server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:10.366 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.356+0000 7f1bd8f1b700 1 -- 172.21.15.92:0/1597792069 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc0019f0 con 0x7f1bd406e110 2023-08-26T09:25:10.366 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.356+0000 7f1bd8f1b700 1 -- 172.21.15.92:0/1597792069 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc4004030 con 0x7f1bd406e110 2023-08-26T09:25:10.366 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.356+0000 7f1bd8f1b700 1 -- 172.21.15.92:0/1597792069 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc40043c0 con 0x7f1bd406e110 2023-08-26T09:25:10.366 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.356+0000 7f1bdc181700 1 -- 172.21.15.92:0/1597792069 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1bd406e110 msgr2=0x7f1bd406e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:10.366 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.356+0000 7f1bdc181700 1 --2- 172.21.15.92:0/1597792069 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1bd406e110 0x7f1bd406e5a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4009840 tx=0x7f1bc4009b50 comp rx=0 tx=0).stop 2023-08-26T09:25:10.366 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.356+0000 7f1bdc181700 1 -- 172.21.15.92:0/1597792069 shutdown_connections 2023-08-26T09:25:10.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.356+0000 7f1bdc181700 1 --2- 172.21.15.92:0/1597792069 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1bd406e110 0x7f1bd406e5a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:10.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.356+0000 7f1bdc181700 1 -- 172.21.15.92:0/1597792069 >> 172.21.15.92:0/1597792069 conn(0x7f1bd406b430 msgr2=0x7f1bd406b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:10.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.356+0000 7f1bdc181700 1 -- 172.21.15.92:0/1597792069 shutdown_connections 2023-08-26T09:25:10.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.356+0000 7f1bdc181700 1 -- 172.21.15.92:0/1597792069 wait complete. 2023-08-26T09:25:10.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.357+0000 7f1bdc181700 1 Processor -- start 2023-08-26T09:25:10.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.357+0000 7f1bdc181700 1 -- start start 2023-08-26T09:25:10.371 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.358+0000 7f1bdc181700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1bd406e110 0x7f1bd413c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:10.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.358+0000 7f1bdc181700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1bd4070d20 0x7f1bd413e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:10.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.358+0000 7f1bdc181700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1bd4159dd0 0x7f1bd413ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:10.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.358+0000 7f1bdc181700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd4151910 con 0x7f1bd406e110 2023-08-26T09:25:10.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.358+0000 7f1bdc181700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd4152490 con 0x7f1bd4159dd0 2023-08-26T09:25:10.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.358+0000 7f1bdc181700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd4151b60 con 0x7f1bd4070d20 2023-08-26T09:25:10.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.358+0000 7f1bd9f1d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1bd406e110 0x7f1bd413c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:10.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.358+0000 7f1bd9f1d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1bd406e110 0x7f1bd413c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44242/0 (socket says 172.21.15.92:44242) 2023-08-26T09:25:10.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.358+0000 7f1bd9f1d700 1 -- 172.21.15.92:0/4232659123 learned_addr learned my addr 172.21.15.92:0/4232659123 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:10.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.358+0000 7f1bd971c700 1 --2- 172.21.15.92:0/4232659123 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1bd4070d20 0x7f1bd413e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:10.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.358+0000 7f1bda71e700 1 --2- 172.21.15.92:0/4232659123 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1bd4159dd0 0x7f1bd413ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:10.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.359+0000 7f1bd9f1d700 1 -- 172.21.15.92:0/4232659123 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1bd4070d20 msgr2=0x7f1bd413e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:10.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.359+0000 7f1bd9f1d700 1 --2- 172.21.15.92:0/4232659123 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1bd4070d20 0x7f1bd413e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:10.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.359+0000 7f1bd9f1d700 1 -- 172.21.15.92:0/4232659123 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1bd4159dd0 msgr2=0x7f1bd413ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:10.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.359+0000 7f1bd9f1d700 1 --2- 172.21.15.92:0/4232659123 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1bd4159dd0 0x7f1bd413ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:10.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.359+0000 7f1bd9f1d700 1 -- 172.21.15.92:0/4232659123 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc40094a0 con 0x7f1bd406e110 2023-08-26T09:25:10.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.359+0000 7f1bd9f1d700 1 --2- 172.21.15.92:0/4232659123 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1bd406e110 0x7f1bd413c430 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1bd000c480 tx=0x7f1bd000c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:10.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.359+0000 7f1bca7fc700 1 -- 172.21.15.92:0/4232659123 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd00052d0 con 0x7f1bd406e110 2023-08-26T09:25:10.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.359+0000 7f1bca7fc700 1 -- 172.21.15.92:0/4232659123 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd0005430 con 0x7f1bd406e110 2023-08-26T09:25:10.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.359+0000 7f1bdc181700 1 -- 172.21.15.92:0/4232659123 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bd4151e40 con 0x7f1bd406e110 2023-08-26T09:25:10.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.359+0000 7f1bca7fc700 1 -- 172.21.15.92:0/4232659123 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd00038c0 con 0x7f1bd406e110 2023-08-26T09:25:10.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.359+0000 7f1bdc181700 1 -- 172.21.15.92:0/4232659123 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bd413c970 con 0x7f1bd406e110 2023-08-26T09:25:10.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.360+0000 7f1bdc181700 1 -- 172.21.15.92:0/4232659123 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bd404eeb0 con 0x7f1bd406e110 2023-08-26T09:25:10.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.360+0000 7f1bca7fc700 1 -- 172.21.15.92:0/4232659123 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1bd0003a20 con 0x7f1bd406e110 2023-08-26T09:25:10.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.361+0000 7f1bca7fc700 1 --2- 172.21.15.92:0/4232659123 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f1bb806a0e0 0x7f1bb806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:10.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.361+0000 7f1bca7fc700 1 -- 172.21.15.92:0/4232659123 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1bd0087520 con 0x7f1bd406e110 2023-08-26T09:25:10.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.361+0000 7f1bd971c700 1 --2- 172.21.15.92:0/4232659123 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f1bb806a0e0 0x7f1bb806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:10.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.361+0000 7f1bd971c700 1 --2- 172.21.15.92:0/4232659123 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f1bb806a0e0 0x7f1bb806c5a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1bc40090b0 tx=0x7f1bc4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:10.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.365+0000 7f1bca7fc700 1 -- 172.21.15.92:0/4232659123 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1bd0052f60 con 0x7f1bd406e110 2023-08-26T09:25:10.557 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.552+0000 7f1bdc181700 1 -- 172.21.15.92:0/4232659123 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1bd406c290 con 0x7f1bd406e110 2023-08-26T09:25:10.557 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.552+0000 7f1bca7fc700 1 -- 172.21.15.92:0/4232659123 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1bd0056580 con 0x7f1bd406e110 2023-08-26T09:25:10.558 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 8 2023-08-26T09:25:10.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.554+0000 7f1bdc181700 1 -- 172.21.15.92:0/4232659123 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f1bb806a0e0 msgr2=0x7f1bb806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:10.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.554+0000 7f1bdc181700 1 --2- 172.21.15.92:0/4232659123 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f1bb806a0e0 0x7f1bb806c5a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1bc40090b0 tx=0x7f1bc4008030 comp rx=0 tx=0).stop 2023-08-26T09:25:10.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.554+0000 7f1bdc181700 1 -- 172.21.15.92:0/4232659123 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1bd406e110 msgr2=0x7f1bd413c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:10.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.554+0000 7f1bdc181700 1 --2- 172.21.15.92:0/4232659123 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1bd406e110 0x7f1bd413c430 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1bd000c480 tx=0x7f1bd000c790 comp rx=0 tx=0).stop 2023-08-26T09:25:10.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.555+0000 7f1bdc181700 1 -- 172.21.15.92:0/4232659123 shutdown_connections 2023-08-26T09:25:10.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.555+0000 7f1bdc181700 1 --2- 172.21.15.92:0/4232659123 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f1bb806a0e0 0x7f1bb806c5a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:10.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.555+0000 7f1bdc181700 1 --2- 172.21.15.92:0/4232659123 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1bd4159dd0 0x7f1bd413ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:10.562 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.555+0000 7f1bdc181700 1 --2- 172.21.15.92:0/4232659123 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1bd406e110 0x7f1bd413c430 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:10.562 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.555+0000 7f1bdc181700 1 --2- 172.21.15.92:0/4232659123 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1bd4070d20 0x7f1bd413e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:10.562 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.555+0000 7f1bdc181700 1 -- 172.21.15.92:0/4232659123 >> 172.21.15.92:0/4232659123 conn(0x7f1bd406b430 msgr2=0x7f1bd406a320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:10.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.555+0000 7f1bdc181700 1 -- 172.21.15.92:0/4232659123 shutdown_connections 2023-08-26T09:25:10.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.555+0000 7f1bdc181700 1 -- 172.21.15.92:0/4232659123 wait complete. 2023-08-26T09:25:10.572 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-26T09:25:10.694 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.689+0000 7f4eaa074700 1 Processor -- start 2023-08-26T09:25:10.694 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.689+0000 7f4eaa074700 1 -- start start 2023-08-26T09:25:10.697 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.690+0000 7f4eaa074700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4ea4159dd0 0x7f4ea40cf220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:10.697 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.690+0000 7f4eaa074700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4ea406e110 0x7f4ea406e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:10.697 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.690+0000 7f4eaa074700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ea406eab0 con 0x7f4ea4070d20 2023-08-26T09:25:10.697 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.690+0000 7f4eaa074700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ea40c6200 con 0x7f4ea406e110 2023-08-26T09:25:10.697 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.690+0000 7f4eaa074700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea40ce740 con 0x7f4ea4159dd0 2023-08-26T09:25:10.698 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.690+0000 7f4ea2ffd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4ea406e110 0x7f4ea406e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:10.698 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.690+0000 7f4ea3fff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f4ea4070d20 0x7f4ea40711b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:56266/0 (socket says 172.21.15.92:56266) 2023-08-26T09:25:10.698 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.690+0000 7f4ea3fff700 1 -- 172.21.15.92:0/697143694 learned_addr learned my addr 172.21.15.92:0/697143694 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:10.698 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.690+0000 7f4ea37fe700 1 --2- 172.21.15.92:0/697143694 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4ea4159dd0 0x7f4ea40cf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:10.698 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.690+0000 7f4ea27fc700 1 -- 172.21.15.92:0/697143694 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3687089926 0 0) 0x7f4ea406eab0 con 0x7f4ea4070d20 2023-08-26T09:25:10.699 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.690+0000 7f4ea2ffd700 1 -- 172.21.15.92:0/697143694 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4ea4159dd0 msgr2=0x7f4ea40cf220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:10.699 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.690+0000 7f4ea2ffd700 1 --2- 172.21.15.92:0/697143694 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4ea4159dd0 0x7f4ea40cf220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:10.699 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.690+0000 7f4ea2ffd700 1 -- 172.21.15.92:0/697143694 >> v1:172.21.15.92:6789/0 conn(0x7f4ea4070d20 legacy=0x7f4ea40711b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:10.699 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.690+0000 7f4ea2ffd700 1 -- 172.21.15.92:0/697143694 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea40cea20 con 0x7f4ea406e110 2023-08-26T09:25:10.700 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.690+0000 7f4ea2ffd700 1 --2- 172.21.15.92:0/697143694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ea406e110 0x7f4ea406e570 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4e94009840 tx=0x7f4e94009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b418515e80b17f8 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:10.700 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.690+0000 7f4ea27fc700 1 -- 172.21.15.92:0/697143694 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e94011830 con 0x7f4ea406e110 2023-08-26T09:25:10.700 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.691+0000 7f4ea27fc700 1 -- 172.21.15.92:0/697143694 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e94011990 con 0x7f4ea406e110 2023-08-26T09:25:10.700 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.691+0000 7f4ea27fc700 1 -- 172.21.15.92:0/697143694 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e94011d20 con 0x7f4ea406e110 2023-08-26T09:25:10.700 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.691+0000 7f4eaa074700 1 -- 172.21.15.92:0/697143694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ea406e110 msgr2=0x7f4ea406e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:10.701 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.691+0000 7f4eaa074700 1 --2- 172.21.15.92:0/697143694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ea406e110 0x7f4ea406e570 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4e94009840 tx=0x7f4e94009b50 comp rx=0 tx=0).stop 2023-08-26T09:25:10.701 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.691+0000 7f4eaa074700 1 -- 172.21.15.92:0/697143694 shutdown_connections 2023-08-26T09:25:10.701 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.691+0000 7f4eaa074700 1 --2- 172.21.15.92:0/697143694 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4ea4159dd0 0x7f4ea40cf220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:10.701 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.691+0000 7f4eaa074700 1 --2- 172.21.15.92:0/697143694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ea406e110 0x7f4ea406e570 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:10.701 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.691+0000 7f4eaa074700 1 -- 172.21.15.92:0/697143694 >> 172.21.15.92:0/697143694 conn(0x7f4ea406b430 msgr2=0x7f4ea406b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:10.702 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.691+0000 7f4eaa074700 1 -- 172.21.15.92:0/697143694 shutdown_connections 2023-08-26T09:25:10.702 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.691+0000 7f4eaa074700 1 -- 172.21.15.92:0/697143694 wait complete. 2023-08-26T09:25:10.704 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.693+0000 7f4eaa074700 1 Processor -- start 2023-08-26T09:25:10.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.693+0000 7f4eaa074700 1 -- start start 2023-08-26T09:25:10.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.694+0000 7f4eaa074700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ea406e110 0x7f4ea414aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:10.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.694+0000 7f4eaa074700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4ea4070d20 0x7f4ea4153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:10.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.694+0000 7f4eaa074700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4ea4159dd0 0x7f4ea4153dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:10.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.694+0000 7f4eaa074700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea41588e0 con 0x7f4ea406e110 2023-08-26T09:25:10.706 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.694+0000 7f4eaa074700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea40a9000 con 0x7f4ea4070d20 2023-08-26T09:25:10.706 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.694+0000 7f4eaa074700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea40a8660 con 0x7f4ea4159dd0 2023-08-26T09:25:10.706 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.694+0000 7f4ea37fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ea406e110 0x7f4ea414aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:10.706 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.694+0000 7f4ea37fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ea406e110 0x7f4ea414aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44254/0 (socket says 172.21.15.92:44254) 2023-08-26T09:25:10.706 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.694+0000 7f4ea37fe700 1 -- 172.21.15.92:0/4219917975 learned_addr learned my addr 172.21.15.92:0/4219917975 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:10.707 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.694+0000 7f4ea37fe700 1 -- 172.21.15.92:0/4219917975 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4ea4159dd0 msgr2=0x7f4ea4153dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:10.707 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.694+0000 7f4ea3fff700 1 --2- 172.21.15.92:0/4219917975 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4ea4159dd0 0x7f4ea4153dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:10.707 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.694+0000 7f4ea37fe700 1 --2- 172.21.15.92:0/4219917975 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4ea4159dd0 0x7f4ea4153dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:10.707 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.694+0000 7f4ea37fe700 1 -- 172.21.15.92:0/4219917975 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4ea4070d20 msgr2=0x7f4ea4153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:10.707 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.694+0000 7f4ea37fe700 1 --2- 172.21.15.92:0/4219917975 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4ea4070d20 0x7f4ea4153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:10.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.694+0000 7f4ea37fe700 1 -- 172.21.15.92:0/4219917975 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e940094a0 con 0x7f4ea406e110 2023-08-26T09:25:10.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.694+0000 7f4ea37fe700 1 --2- 172.21.15.92:0/4219917975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ea406e110 0x7f4ea414aa40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4e9800e840 tx=0x7f4e9800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:10.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.694+0000 7f4e8bfff700 1 -- 172.21.15.92:0/4219917975 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e98013610 con 0x7f4ea406e110 2023-08-26T09:25:10.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.694+0000 7f4e8bfff700 1 -- 172.21.15.92:0/4219917975 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e98013770 con 0x7f4ea406e110 2023-08-26T09:25:10.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.694+0000 7f4eaa074700 1 -- 172.21.15.92:0/4219917975 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ea40a8940 con 0x7f4ea406e110 2023-08-26T09:25:10.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.694+0000 7f4e8bfff700 1 -- 172.21.15.92:0/4219917975 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e98013b00 con 0x7f4ea406e110 2023-08-26T09:25:10.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.694+0000 7f4eaa074700 1 -- 172.21.15.92:0/4219917975 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ea40a9420 con 0x7f4ea406e110 2023-08-26T09:25:10.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.695+0000 7f4eaa074700 1 -- 172.21.15.92:0/4219917975 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ea404eeb0 con 0x7f4ea406e110 2023-08-26T09:25:10.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.696+0000 7f4e8bfff700 1 -- 172.21.15.92:0/4219917975 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4e98013c60 con 0x7f4ea406e110 2023-08-26T09:25:10.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.696+0000 7f4e8bfff700 1 --2- 172.21.15.92:0/4219917975 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f4e9006a0e0 0x7f4e9006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:10.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.696+0000 7f4ea2ffd700 1 --2- 172.21.15.92:0/4219917975 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f4e9006a0e0 0x7f4e9006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:10.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.696+0000 7f4e8bfff700 1 -- 172.21.15.92:0/4219917975 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4e98087ef0 con 0x7f4ea406e110 2023-08-26T09:25:10.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.697+0000 7f4ea2ffd700 1 --2- 172.21.15.92:0/4219917975 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f4e9006a0e0 0x7f4e9006c5a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4ea41f4210 tx=0x7f4e94010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:10.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.701+0000 7f4e8bfff700 1 -- 172.21.15.92:0/4219917975 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4e980573c0 con 0x7f4ea406e110 2023-08-26T09:25:10.892 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.887+0000 7f4eaa074700 1 -- 172.21.15.92:0/4219917975 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4ea406c290 con 0x7f4ea406e110 2023-08-26T09:25:10.892 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.887+0000 7f4e8bfff700 1 -- 172.21.15.92:0/4219917975 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4e98056f50 con 0x7f4ea406e110 2023-08-26T09:25:10.893 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 1 2023-08-26T09:25:10.895 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.889+0000 7f4eaa074700 1 -- 172.21.15.92:0/4219917975 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f4e9006a0e0 msgr2=0x7f4e9006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:10.895 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.889+0000 7f4eaa074700 1 --2- 172.21.15.92:0/4219917975 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f4e9006a0e0 0x7f4e9006c5a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4ea41f4210 tx=0x7f4e94010000 comp rx=0 tx=0).stop 2023-08-26T09:25:10.895 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.889+0000 7f4eaa074700 1 -- 172.21.15.92:0/4219917975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ea406e110 msgr2=0x7f4ea414aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:10.895 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.889+0000 7f4eaa074700 1 --2- 172.21.15.92:0/4219917975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ea406e110 0x7f4ea414aa40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4e9800e840 tx=0x7f4e9800ec00 comp rx=0 tx=0).stop 2023-08-26T09:25:10.896 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.889+0000 7f4eaa074700 1 -- 172.21.15.92:0/4219917975 shutdown_connections 2023-08-26T09:25:10.896 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.889+0000 7f4eaa074700 1 --2- 172.21.15.92:0/4219917975 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4ea4159dd0 0x7f4ea4153dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:10.896 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.889+0000 7f4eaa074700 1 --2- 172.21.15.92:0/4219917975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ea406e110 0x7f4ea414aa40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:10.896 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.889+0000 7f4eaa074700 1 --2- 172.21.15.92:0/4219917975 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f4e9006a0e0 0x7f4e9006c5a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:10.896 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.889+0000 7f4eaa074700 1 --2- 172.21.15.92:0/4219917975 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4ea4070d20 0x7f4ea4153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:10.897 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.889+0000 7f4eaa074700 1 -- 172.21.15.92:0/4219917975 >> 172.21.15.92:0/4219917975 conn(0x7f4ea406b430 msgr2=0x7f4ea40cbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:10.897 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.889+0000 7f4eaa074700 1 -- 172.21.15.92:0/4219917975 shutdown_connections 2023-08-26T09:25:10.897 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:10.889+0000 7f4eaa074700 1 -- 172.21.15.92:0/4219917975 wait complete. 2023-08-26T09:25:10.906 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-26T09:25:11.027 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.022+0000 7fd00f59e700 1 Processor -- start 2023-08-26T09:25:11.027 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.022+0000 7fd00f59e700 1 -- start start 2023-08-26T09:25:11.032 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.023+0000 7fd00f59e700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd0080cb630 0x7fd008161e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:11.032 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.023+0000 7fd00f59e700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0081627f0 con 0x7fd0080cd4c0 2023-08-26T09:25:11.032 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.023+0000 7fd00f59e700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd00806a320 con 0x7fd0081623a0 2023-08-26T09:25:11.033 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.023+0000 7fd00f59e700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd00806abc0 con 0x7fd0080cb630 2023-08-26T09:25:11.033 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.023+0000 7fd00e59c700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fd0080cd4c0 0x7fd0080704c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:56276/0 (socket says 172.21.15.92:56276) 2023-08-26T09:25:11.033 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.023+0000 7fd00e59c700 1 -- 172.21.15.92:0/3248795351 learned_addr learned my addr 172.21.15.92:0/3248795351 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:11.033 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.023+0000 7fd00dd9b700 1 --2- 172.21.15.92:0/3248795351 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd0080cb630 0x7fd008161e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:11.033 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.023+0000 7fd00d59a700 1 -- 172.21.15.92:0/3248795351 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 828106905 0 0) 0x7fcffc001110 con 0x7fd0080cd4c0 2023-08-26T09:25:11.034 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.023+0000 7fd00d59a700 1 -- 172.21.15.92:0/3248795351 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcff40035b0 con 0x7fd0080cd4c0 2023-08-26T09:25:11.034 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.023+0000 7fd00d59a700 1 -- 172.21.15.92:0/3248795351 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 313091134 0 0) 0x7fcff40035b0 con 0x7fd0080cd4c0 2023-08-26T09:25:11.034 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.023+0000 7fd00d59a700 1 -- 172.21.15.92:0/3248795351 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd0080cb630 msgr2=0x7fd008161e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:11.034 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.023+0000 7fd00d59a700 1 --2- 172.21.15.92:0/3248795351 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd0080cb630 0x7fd008161e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:11.034 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.023+0000 7fd00d59a700 1 -- 172.21.15.92:0/3248795351 >> v1:172.21.15.188:6789/0 conn(0x7fd0081623a0 legacy=0x7fd00806b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:11.035 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.023+0000 7fd00d59a700 1 -- 172.21.15.92:0/3248795351 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd00815d750 con 0x7fd0080cd4c0 2023-08-26T09:25:11.035 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.023+0000 7fd00d59a700 1 -- 172.21.15.92:0/3248795351 <== mon.0 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1019361464 0 0) 0x7fcffc001800 con 0x7fd0080cd4c0 2023-08-26T09:25:11.035 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.024+0000 7fd00d59a700 1 -- 172.21.15.92:0/3248795351 >> v1:172.21.15.92:6789/0 conn(0x7fd0080cd4c0 legacy=0x7fd0080704c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:11.035 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.024+0000 7fd00d59a700 1 --2- 172.21.15.92:0/3248795351 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd0080cb630 0x7fcff4003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:11.035 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.024+0000 7fd00d59a700 1 --2- 172.21.15.92:0/3248795351 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcff4003fb0 0x7fcff4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:11.036 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.024+0000 7fd00d59a700 1 --2- 172.21.15.92:0/3248795351 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcff4004d90 0x7fcff4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:11.036 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.024+0000 7fd00d59a700 1 -- 172.21.15.92:0/3248795351 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00806abc0 con 0x7fcff4003fb0 2023-08-26T09:25:11.036 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.024+0000 7fd00d59a700 1 -- 172.21.15.92:0/3248795351 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff400bc50 con 0x7fcff4004d90 2023-08-26T09:25:11.036 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.024+0000 7fd00d59a700 1 -- 172.21.15.92:0/3248795351 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcff400be10 con 0x7fd0080cb630 2023-08-26T09:25:11.036 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.024+0000 7fd00dd9b700 1 --2- 172.21.15.92:0/3248795351 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcff4003fb0 0x7fcff4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:11.037 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.024+0000 7fd00e59c700 1 --2- 172.21.15.92:0/3248795351 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd0080cb630 0x7fcff4003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:11.037 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.024+0000 7fd00ed9d700 1 --2- 172.21.15.92:0/3248795351 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcff4004d90 0x7fcff4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:11.037 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.024+0000 7fd00dd9b700 1 -- 172.21.15.92:0/3248795351 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd0080cb630 msgr2=0x7fcff4003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:11.037 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.024+0000 7fd00dd9b700 1 --2- 172.21.15.92:0/3248795351 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd0080cb630 0x7fcff4003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:11.037 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.024+0000 7fd00dd9b700 1 -- 172.21.15.92:0/3248795351 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcff4004d90 msgr2=0x7fcff4005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:11.037 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.024+0000 7fd00dd9b700 1 --2- 172.21.15.92:0/3248795351 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcff4004d90 0x7fcff4005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:11.038 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.024+0000 7fd00dd9b700 1 -- 172.21.15.92:0/3248795351 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff40035b0 con 0x7fcff4003fb0 2023-08-26T09:25:11.038 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.024+0000 7fd00dd9b700 1 --2- 172.21.15.92:0/3248795351 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcff4003fb0 0x7fcff4004850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd000009b60 tx=0x7fcff4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=920ff8da64f82007 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:11.038 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.024+0000 7fd00d59a700 1 -- 172.21.15.92:0/3248795351 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00000e6c0 con 0x7fcff4003fb0 2023-08-26T09:25:11.038 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.024+0000 7fd00d59a700 1 -- 172.21.15.92:0/3248795351 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd00000e820 con 0x7fcff4003fb0 2023-08-26T09:25:11.038 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.024+0000 7fd00d59a700 1 -- 172.21.15.92:0/3248795351 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00000eb90 con 0x7fcff4003fb0 2023-08-26T09:25:11.039 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.025+0000 7fd00f59e700 1 -- 172.21.15.92:0/3248795351 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcff4003fb0 msgr2=0x7fcff4004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:11.039 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.025+0000 7fd00f59e700 1 --2- 172.21.15.92:0/3248795351 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcff4003fb0 0x7fcff4004850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd000009b60 tx=0x7fcff4005880 comp rx=0 tx=0).stop 2023-08-26T09:25:11.039 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.025+0000 7fd00ed9d700 1 -- 172.21.15.92:0/3248795351 reap_dead start 2023-08-26T09:25:11.039 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.025+0000 7fd00f59e700 1 -- 172.21.15.92:0/3248795351 shutdown_connections 2023-08-26T09:25:11.039 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.025+0000 7fd00f59e700 1 -- 172.21.15.92:0/3248795351 >> 172.21.15.92:0/3248795351 conn(0x7fd0080cbdd0 msgr2=0x7fd0080cc1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:11.040 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.025+0000 7fd00f59e700 1 -- 172.21.15.92:0/3248795351 shutdown_connections 2023-08-26T09:25:11.040 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.025+0000 7fd00f59e700 1 -- 172.21.15.92:0/3248795351 wait complete. 2023-08-26T09:25:11.040 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.027+0000 7fd00f59e700 1 Processor -- start 2023-08-26T09:25:11.040 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.027+0000 7fd00f59e700 1 -- start start 2023-08-26T09:25:11.043 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.027+0000 7fd00f59e700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcff4003fb0 0x7fd0081f3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:11.043 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.027+0000 7fd00f59e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd0080b3cb0 0x7fd0081f4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:11.043 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.028+0000 7fd00f59e700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd0080b0030 0x7fd0080b04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:11.044 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.028+0000 7fd00f59e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0080b09f0 con 0x7fd0080b3cb0 2023-08-26T09:25:11.044 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.028+0000 7fd00f59e700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0080c6420 con 0x7fd0080b0030 2023-08-26T09:25:11.044 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.028+0000 7fd00f59e700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0080c7280 con 0x7fcff4003fb0 2023-08-26T09:25:11.044 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.028+0000 7fd00dd9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd0080b3cb0 0x7fd0081f4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:11.044 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.028+0000 7fd00dd9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd0080b3cb0 0x7fd0081f4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44276/0 (socket says 172.21.15.92:44276) 2023-08-26T09:25:11.044 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.028+0000 7fd00dd9b700 1 -- 172.21.15.92:0/3016031552 learned_addr learned my addr 172.21.15.92:0/3016031552 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:11.045 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.028+0000 7fd00e59c700 1 --2- 172.21.15.92:0/3016031552 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcff4003fb0 0x7fd0081f3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:11.045 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.028+0000 7fd00ed9d700 1 --2- 172.21.15.92:0/3016031552 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd0080b0030 0x7fd0080b04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:11.045 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.028+0000 7fd00dd9b700 1 -- 172.21.15.92:0/3016031552 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcff4003fb0 msgr2=0x7fd0081f3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:11.045 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.028+0000 7fd00dd9b700 1 --2- 172.21.15.92:0/3016031552 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcff4003fb0 0x7fd0081f3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:11.045 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.028+0000 7fd00dd9b700 1 -- 172.21.15.92:0/3016031552 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd0080b0030 msgr2=0x7fd0080b04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:11.046 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.028+0000 7fd00dd9b700 1 --2- 172.21.15.92:0/3016031552 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd0080b0030 0x7fd0080b04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:11.046 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.028+0000 7fd00dd9b700 1 -- 172.21.15.92:0/3016031552 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0081f4370 con 0x7fd0080b3cb0 2023-08-26T09:25:11.046 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.028+0000 7fd00e59c700 1 --2- 172.21.15.92:0/3016031552 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcff4003fb0 0x7fd0081f3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:25:11.046 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.028+0000 7fd00dd9b700 1 --2- 172.21.15.92:0/3016031552 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd0080b3cb0 0x7fd0081f4570 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd00000e4b0 tx=0x7fd0000047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:11.046 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.028+0000 7fcffaffd700 1 -- 172.21.15.92:0/3016031552 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd000021070 con 0x7fd0080b3cb0 2023-08-26T09:25:11.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.028+0000 7fcffaffd700 1 -- 172.21.15.92:0/3016031552 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd000004580 con 0x7fd0080b3cb0 2023-08-26T09:25:11.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.028+0000 7fd00f59e700 1 -- 172.21.15.92:0/3016031552 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0080c6670 con 0x7fd0080b3cb0 2023-08-26T09:25:11.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.028+0000 7fcffaffd700 1 -- 172.21.15.92:0/3016031552 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00000e6c0 con 0x7fd0080b3cb0 2023-08-26T09:25:11.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.028+0000 7fd00f59e700 1 -- 172.21.15.92:0/3016031552 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0080c6c30 con 0x7fd0080b3cb0 2023-08-26T09:25:11.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.029+0000 7fd00f59e700 1 -- 172.21.15.92:0/3016031552 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd00806d4c0 con 0x7fd0080b3cb0 2023-08-26T09:25:11.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.029+0000 7fcffaffd700 1 -- 172.21.15.92:0/3016031552 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd000025070 con 0x7fd0080b3cb0 2023-08-26T09:25:11.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.030+0000 7fcffaffd700 1 --2- 172.21.15.92:0/3016031552 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fcfec06a0e0 0x7fcfec06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:11.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.030+0000 7fcffaffd700 1 -- 172.21.15.92:0/3016031552 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd000089430 con 0x7fd0080b3cb0 2023-08-26T09:25:11.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.030+0000 7fd00e59c700 1 --2- 172.21.15.92:0/3016031552 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fcfec06a0e0 0x7fcfec06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:11.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.030+0000 7fd00e59c700 1 --2- 172.21.15.92:0/3016031552 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fcfec06a0e0 0x7fcfec06c5a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcffc001270 tx=0x7fcffc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:11.049 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.034+0000 7fcffaffd700 1 -- 172.21.15.92:0/3016031552 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd000055020 con 0x7fd0080b3cb0 2023-08-26T09:25:11.228 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.223+0000 7fd00f59e700 1 -- 172.21.15.92:0/3016031552 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd0080b09f0 con 0x7fd0080b3cb0 2023-08-26T09:25:11.229 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.223+0000 7fcffaffd700 1 -- 172.21.15.92:0/3016031552 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+126 (secure 0 0 0) 0x7fd0080b09f0 con 0x7fd0080b3cb0 2023-08-26T09:25:11.229 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:25:11.229 INFO:teuthology.orchestra.run.smithi092.stdout:[ 2023-08-26T09:25:11.230 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-08-26T09:25:11.230 INFO:teuthology.orchestra.run.smithi092.stdout: "poolnum": 1, 2023-08-26T09:25:11.230 INFO:teuthology.orchestra.run.smithi092.stdout: "poolname": "rbd" 2023-08-26T09:25:11.230 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-08-26T09:25:11.230 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-08-26T09:25:11.231 INFO:teuthology.orchestra.run.smithi092.stdout: "poolnum": 2, 2023-08-26T09:25:11.231 INFO:teuthology.orchestra.run.smithi092.stdout: "poolname": ".mgr" 2023-08-26T09:25:11.231 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-08-26T09:25:11.231 INFO:teuthology.orchestra.run.smithi092.stdout:] 2023-08-26T09:25:11.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.225+0000 7fd00f59e700 1 -- 172.21.15.92:0/3016031552 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fcfec06a0e0 msgr2=0x7fcfec06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:11.233 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.225+0000 7fd00f59e700 1 --2- 172.21.15.92:0/3016031552 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fcfec06a0e0 0x7fcfec06c5a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcffc001270 tx=0x7fcffc009040 comp rx=0 tx=0).stop 2023-08-26T09:25:11.233 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.225+0000 7fd00f59e700 1 -- 172.21.15.92:0/3016031552 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd0080b3cb0 msgr2=0x7fd0081f4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:11.233 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.225+0000 7fd00f59e700 1 --2- 172.21.15.92:0/3016031552 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd0080b3cb0 0x7fd0081f4570 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd00000e4b0 tx=0x7fd0000047c0 comp rx=0 tx=0).stop 2023-08-26T09:25:11.233 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.225+0000 7fd00f59e700 1 -- 172.21.15.92:0/3016031552 shutdown_connections 2023-08-26T09:25:11.234 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.225+0000 7fd00f59e700 1 --2- 172.21.15.92:0/3016031552 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fcfec06a0e0 0x7fcfec06c5a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:11.234 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.225+0000 7fd00f59e700 1 --2- 172.21.15.92:0/3016031552 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd0080b0030 0x7fd0080b04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:11.234 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.225+0000 7fd00f59e700 1 --2- 172.21.15.92:0/3016031552 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcff4003fb0 0x7fd0081f3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:11.234 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.225+0000 7fd00f59e700 1 --2- 172.21.15.92:0/3016031552 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd0080b3cb0 0x7fd0081f4570 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:11.234 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.225+0000 7fd00f59e700 1 -- 172.21.15.92:0/3016031552 >> 172.21.15.92:0/3016031552 conn(0x7fd0080cbdd0 msgr2=0x7fd008159340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:11.234 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.225+0000 7fd00f59e700 1 -- 172.21.15.92:0/3016031552 shutdown_connections 2023-08-26T09:25:11.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.225+0000 7fd00f59e700 1 -- 172.21.15.92:0/3016031552 wait complete. 2023-08-26T09:25:11.242 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-26T09:25:11.243 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-26T09:25:11.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.362+0000 7fd6f2efd700 1 Processor -- start 2023-08-26T09:25:11.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.362+0000 7fd6f2efd700 1 -- start start 2023-08-26T09:25:11.370 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.362+0000 7fd6f2efd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fd6ec0ced90 0x7fd6ec06a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:11.370 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.363+0000 7fd6f2efd700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd6ec0ca180 0x7fd6ec0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:11.370 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.363+0000 7fd6f2efd700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6ec15e8c0 con 0x7fd6ec160fe0 2023-08-26T09:25:11.370 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.363+0000 7fd6f2efd700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6ec06bc10 con 0x7fd6ec0ced90 2023-08-26T09:25:11.371 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.363+0000 7fd6f2efd700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6ec06ab70 con 0x7fd6ec0ca180 2023-08-26T09:25:11.371 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.363+0000 7fd6f0c99700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fd6ec0ced90 0x7fd6ec06a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:11.371 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.363+0000 7fd6f0c99700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fd6ec0ced90 0x7fd6ec06a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44282/0 (socket says 172.21.15.92:44282) 2023-08-26T09:25:11.371 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.363+0000 7fd6f0c99700 1 -- 172.21.15.92:0/3632441699 learned_addr learned my addr 172.21.15.92:0/3632441699 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:11.371 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.363+0000 7fd6f149a700 1 --2- 172.21.15.92:0/3632441699 >> v2:172.21.15.188:3300/0 conn(0x7fd6ec0ca180 0x7fd6ec0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:11.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.363+0000 7fd6f0c99700 1 -- 172.21.15.92:0/3632441699 >> v2:172.21.15.188:3300/0 conn(0x7fd6ec0ca180 msgr2=0x7fd6ec0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:11.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.363+0000 7fd6f0c99700 1 --2- 172.21.15.92:0/3632441699 >> v2:172.21.15.188:3300/0 conn(0x7fd6ec0ca180 0x7fd6ec0cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:11.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.363+0000 7fd6f0c99700 1 -- 172.21.15.92:0/3632441699 >> v1:172.21.15.188:6789/0 conn(0x7fd6ec160fe0 legacy=0x7fd6ec0c9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:11.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.363+0000 7fd6f0c99700 1 -- 172.21.15.92:0/3632441699 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6ec06ae50 con 0x7fd6ec0ced90 2023-08-26T09:25:11.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.363+0000 7fd6f0c99700 1 --2- 172.21.15.92:0/3632441699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd6ec0ced90 0x7fd6ec06a320 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec0aeef0 tx=0x7fd6e0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31ec51f55c4107f9 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:11.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.363+0000 7fd6eb7fe700 1 -- 172.21.15.92:0/3632441699 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e0011830 con 0x7fd6ec0ced90 2023-08-26T09:25:11.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.363+0000 7fd6eb7fe700 1 -- 172.21.15.92:0/3632441699 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e0011990 con 0x7fd6ec0ced90 2023-08-26T09:25:11.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.363+0000 7fd6eb7fe700 1 -- 172.21.15.92:0/3632441699 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e0011d20 con 0x7fd6ec0ced90 2023-08-26T09:25:11.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.364+0000 7fd6f2efd700 1 -- 172.21.15.92:0/3632441699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd6ec0ced90 msgr2=0x7fd6ec06a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:11.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.364+0000 7fd6f2efd700 1 --2- 172.21.15.92:0/3632441699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd6ec0ced90 0x7fd6ec06a320 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec0aeef0 tx=0x7fd6e0009bd0 comp rx=0 tx=0).stop 2023-08-26T09:25:11.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.364+0000 7fd6f2efd700 1 -- 172.21.15.92:0/3632441699 shutdown_connections 2023-08-26T09:25:11.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.364+0000 7fd6f2efd700 1 --2- 172.21.15.92:0/3632441699 >> v2:172.21.15.188:3300/0 conn(0x7fd6ec0ca180 0x7fd6ec0cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:11.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.364+0000 7fd6f2efd700 1 --2- 172.21.15.92:0/3632441699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd6ec0ced90 0x7fd6ec06a320 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:11.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.364+0000 7fd6f2efd700 1 -- 172.21.15.92:0/3632441699 >> 172.21.15.92:0/3632441699 conn(0x7fd6ec0cf420 msgr2=0x7fd6ec0cf830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:11.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.364+0000 7fd6f2efd700 1 -- 172.21.15.92:0/3632441699 shutdown_connections 2023-08-26T09:25:11.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.364+0000 7fd6f2efd700 1 -- 172.21.15.92:0/3632441699 wait complete. 2023-08-26T09:25:11.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.365+0000 7fd6f2efd700 1 Processor -- start 2023-08-26T09:25:11.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.365+0000 7fd6f2efd700 1 -- start start 2023-08-26T09:25:11.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.366+0000 7fd6f2efd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd6ec0ca180 0x7fd6ec1f5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:11.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.366+0000 7fd6f2efd700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6ec0ced90 0x7fd6ec15fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:11.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.366+0000 7fd6f2efd700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6ec160fe0 0x7fd6ec1600b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:11.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.366+0000 7fd6f2efd700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec0b4f90 con 0x7fd6ec0ca180 2023-08-26T09:25:11.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.366+0000 7fd6f2efd700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec1f5e90 con 0x7fd6ec160fe0 2023-08-26T09:25:11.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.366+0000 7fd6f2efd700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec0b40c0 con 0x7fd6ec0ced90 2023-08-26T09:25:11.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.366+0000 7fd6f0c99700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd6ec0ca180 0x7fd6ec1f5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:11.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.366+0000 7fd6f0c99700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd6ec0ca180 0x7fd6ec1f5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44288/0 (socket says 172.21.15.92:44288) 2023-08-26T09:25:11.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.366+0000 7fd6f0c99700 1 -- 172.21.15.92:0/4092947879 learned_addr learned my addr 172.21.15.92:0/4092947879 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:11.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.366+0000 7fd6f0c99700 1 -- 172.21.15.92:0/4092947879 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6ec0ced90 msgr2=0x7fd6ec15fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:11.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.366+0000 7fd6f0c99700 1 --2- 172.21.15.92:0/4092947879 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6ec0ced90 0x7fd6ec15fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:11.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.366+0000 7fd6f0c99700 1 -- 172.21.15.92:0/4092947879 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6ec160fe0 msgr2=0x7fd6ec1600b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:11.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.366+0000 7fd6f0c99700 1 --2- 172.21.15.92:0/4092947879 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6ec160fe0 0x7fd6ec1600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:11.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.366+0000 7fd6f0c99700 1 -- 172.21.15.92:0/4092947879 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e0009550 con 0x7fd6ec0ca180 2023-08-26T09:25:11.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.366+0000 7fd6f0c99700 1 --2- 172.21.15.92:0/4092947879 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd6ec0ca180 0x7fd6ec1f5950 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0000c00 tx=0x7fd6e0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:11.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.366+0000 7fd6e97fa700 1 -- 172.21.15.92:0/4092947879 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e00044f0 con 0x7fd6ec0ca180 2023-08-26T09:25:11.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.366+0000 7fd6e97fa700 1 -- 172.21.15.92:0/4092947879 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e001f070 con 0x7fd6ec0ca180 2023-08-26T09:25:11.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.366+0000 7fd6f2efd700 1 -- 172.21.15.92:0/4092947879 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6ec0c3bc0 con 0x7fd6ec0ca180 2023-08-26T09:25:11.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.367+0000 7fd6e97fa700 1 -- 172.21.15.92:0/4092947879 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e00038e0 con 0x7fd6ec0ca180 2023-08-26T09:25:11.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.367+0000 7fd6f2efd700 1 -- 172.21.15.92:0/4092947879 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6ec0b45f0 con 0x7fd6ec0ca180 2023-08-26T09:25:11.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.367+0000 7fd6f2efd700 1 -- 172.21.15.92:0/4092947879 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6ec073d50 con 0x7fd6ec0ca180 2023-08-26T09:25:11.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.368+0000 7fd6e97fa700 1 -- 172.21.15.92:0/4092947879 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd6e0021030 con 0x7fd6ec0ca180 2023-08-26T09:25:11.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.368+0000 7fd6e97fa700 1 --2- 172.21.15.92:0/4092947879 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fd6d006a0e0 0x7fd6d006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:11.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.368+0000 7fd6e97fa700 1 -- 172.21.15.92:0/4092947879 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd6e00895f0 con 0x7fd6ec0ca180 2023-08-26T09:25:11.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.368+0000 7fd6ebfff700 1 --2- 172.21.15.92:0/4092947879 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fd6d006a0e0 0x7fd6d006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:11.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.369+0000 7fd6ebfff700 1 --2- 172.21.15.92:0/4092947879 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fd6d006a0e0 0x7fd6d006c5a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd6d8000f60 tx=0x7fd6d8007a40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:11.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.373+0000 7fd6e97fa700 1 -- 172.21.15.92:0/4092947879 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd6e00550c0 con 0x7fd6ec0ca180 2023-08-26T09:25:11.570 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:11.564+0000 7fd6f2efd700 1 -- 172.21.15.92:0/4092947879 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd6ec04e660 con 0x7fd6ec0ca180 2023-08-26T09:25:12.447 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.442+0000 7fd6e97fa700 1 -- 172.21.15.92:0/4092947879 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd6e0003a40 con 0x7fd6ec0ca180 2023-08-26T09:25:12.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.446+0000 7fd6f2efd700 1 -- 172.21.15.92:0/4092947879 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fd6d006a0e0 msgr2=0x7fd6d006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:12.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.446+0000 7fd6f2efd700 1 --2- 172.21.15.92:0/4092947879 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fd6d006a0e0 0x7fd6d006c5a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd6d8000f60 tx=0x7fd6d8007a40 comp rx=0 tx=0).stop 2023-08-26T09:25:12.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.446+0000 7fd6f2efd700 1 -- 172.21.15.92:0/4092947879 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd6ec0ca180 msgr2=0x7fd6ec1f5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:12.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.446+0000 7fd6f2efd700 1 --2- 172.21.15.92:0/4092947879 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd6ec0ca180 0x7fd6ec1f5950 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0000c00 tx=0x7fd6e0004750 comp rx=0 tx=0).stop 2023-08-26T09:25:12.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.447+0000 7fd6f2efd700 1 -- 172.21.15.92:0/4092947879 shutdown_connections 2023-08-26T09:25:12.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.447+0000 7fd6f2efd700 1 --2- 172.21.15.92:0/4092947879 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fd6d006a0e0 0x7fd6d006c5a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:12.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.447+0000 7fd6f2efd700 1 --2- 172.21.15.92:0/4092947879 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6ec160fe0 0x7fd6ec1600b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:12.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.447+0000 7fd6f2efd700 1 --2- 172.21.15.92:0/4092947879 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd6ec0ca180 0x7fd6ec1f5950 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:12.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.447+0000 7fd6f2efd700 1 --2- 172.21.15.92:0/4092947879 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6ec0ced90 0x7fd6ec15fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:12.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.447+0000 7fd6f2efd700 1 -- 172.21.15.92:0/4092947879 >> 172.21.15.92:0/4092947879 conn(0x7fd6ec0cf420 msgr2=0x7fd6ec0b07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:12.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.447+0000 7fd6f2efd700 1 -- 172.21.15.92:0/4092947879 shutdown_connections 2023-08-26T09:25:12.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.448+0000 7fd6f2efd700 1 -- 172.21.15.92:0/4092947879 wait complete. 2023-08-26T09:25:12.455 INFO:teuthology.orchestra.run.smithi092.stderr:pool 'cephfs_metadata' created 2023-08-26T09:25:12.468 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-26T09:25:12.601 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.596+0000 7fbf83c67700 1 Processor -- start 2023-08-26T09:25:12.601 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.596+0000 7fbf83c67700 1 -- start start 2023-08-26T09:25:12.604 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.597+0000 7fbf83c67700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbf7c0b2d70 0x7fbf7c15edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:12.604 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.597+0000 7fbf83c67700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fbf7c0d0a30 0x7fbf7c0cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:12.604 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.597+0000 7fbf83c67700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf7c06de90 con 0x7fbf7c0cb4a0 2023-08-26T09:25:12.604 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.597+0000 7fbf83c67700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf7c06eb10 con 0x7fbf7c0d0a30 2023-08-26T09:25:12.604 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.597+0000 7fbf83c67700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7c06e170 con 0x7fbf7c0b2d70 2023-08-26T09:25:12.605 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.597+0000 7fbf81202700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fbf7c0cb4a0 0x7fbf7c0d0320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:56312/0 (socket says 172.21.15.92:56312) 2023-08-26T09:25:12.605 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.597+0000 7fbf81202700 1 -- 172.21.15.92:0/1230395283 learned_addr learned my addr 172.21.15.92:0/1230395283 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:12.605 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.597+0000 7fbf82204700 1 --2- 172.21.15.92:0/1230395283 >> v2:172.21.15.92:3300/0 conn(0x7fbf7c0d0a30 0x7fbf7c0cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:12.605 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.597+0000 7fbf81a03700 1 --2- 172.21.15.92:0/1230395283 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbf7c0b2d70 0x7fbf7c15edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:12.605 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.597+0000 7fbf82204700 1 -- 172.21.15.92:0/1230395283 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbf7c0b2d70 msgr2=0x7fbf7c15edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:12.606 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.597+0000 7fbf82204700 1 --2- 172.21.15.92:0/1230395283 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbf7c0b2d70 0x7fbf7c15edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:12.606 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.597+0000 7fbf82204700 1 -- 172.21.15.92:0/1230395283 >> v1:172.21.15.92:6789/0 conn(0x7fbf7c0cb4a0 legacy=0x7fbf7c0d0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:12.606 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.597+0000 7fbf82204700 1 -- 172.21.15.92:0/1230395283 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf7c06e450 con 0x7fbf7c0d0a30 2023-08-26T09:25:12.606 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.597+0000 7fbf80a01700 1 -- 172.21.15.92:0/1230395283 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1783757250 0 0) 0x7fbf7c06de90 con 0x7fbf7c0cb4a0 2023-08-26T09:25:12.606 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.598+0000 7fbf82204700 1 --2- 172.21.15.92:0/1230395283 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf7c0d0a30 0x7fbf7c0cb920 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbf74009d90 tx=0x7fbf7400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=841ac625632488be server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:12.607 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.598+0000 7fbf80a01700 1 -- 172.21.15.92:0/1230395283 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7400e070 con 0x7fbf7c0d0a30 2023-08-26T09:25:12.607 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.598+0000 7fbf80a01700 1 -- 172.21.15.92:0/1230395283 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf7400bb20 con 0x7fbf7c0d0a30 2023-08-26T09:25:12.607 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.598+0000 7fbf80a01700 1 -- 172.21.15.92:0/1230395283 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf74012430 con 0x7fbf7c0d0a30 2023-08-26T09:25:12.607 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.598+0000 7fbf83c67700 1 -- 172.21.15.92:0/1230395283 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf7c0d0a30 msgr2=0x7fbf7c0cb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:12.607 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.598+0000 7fbf83c67700 1 --2- 172.21.15.92:0/1230395283 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf7c0d0a30 0x7fbf7c0cb920 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbf74009d90 tx=0x7fbf7400b330 comp rx=0 tx=0).stop 2023-08-26T09:25:12.607 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.598+0000 7fbf83c67700 1 -- 172.21.15.92:0/1230395283 shutdown_connections 2023-08-26T09:25:12.608 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.598+0000 7fbf83c67700 1 --2- 172.21.15.92:0/1230395283 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf7c0d0a30 0x7fbf7c0cb920 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:12.608 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.598+0000 7fbf83c67700 1 --2- 172.21.15.92:0/1230395283 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbf7c0b2d70 0x7fbf7c15edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:12.608 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.598+0000 7fbf83c67700 1 -- 172.21.15.92:0/1230395283 >> 172.21.15.92:0/1230395283 conn(0x7fbf7c0cd8d0 msgr2=0x7fbf7c0cdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:12.608 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.599+0000 7fbf83c67700 1 -- 172.21.15.92:0/1230395283 shutdown_connections 2023-08-26T09:25:12.608 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.599+0000 7fbf83c67700 1 -- 172.21.15.92:0/1230395283 wait complete. 2023-08-26T09:25:12.612 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.600+0000 7fbf83c67700 1 Processor -- start 2023-08-26T09:25:12.612 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.600+0000 7fbf83c67700 1 -- start start 2023-08-26T09:25:12.612 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.601+0000 7fbf83c67700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbf7c0b2d70 0x7fbf7c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:12.612 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.601+0000 7fbf83c67700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf7c0cb4a0 0x7fbf7c06cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:12.613 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.601+0000 7fbf83c67700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf7c0d0a30 0x7fbf7c06bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:12.613 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.601+0000 7fbf83c67700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7c150dc0 con 0x7fbf7c0d0a30 2023-08-26T09:25:12.613 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.601+0000 7fbf83c67700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7c0ca350 con 0x7fbf7c0cb4a0 2023-08-26T09:25:12.613 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.601+0000 7fbf83c67700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7c06bc90 con 0x7fbf7c0b2d70 2023-08-26T09:25:12.613 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.601+0000 7fbf82204700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf7c0d0a30 0x7fbf7c06bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:12.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.601+0000 7fbf82204700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf7c0d0a30 0x7fbf7c06bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44306/0 (socket says 172.21.15.92:44306) 2023-08-26T09:25:12.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.601+0000 7fbf82204700 1 -- 172.21.15.92:0/940632617 learned_addr learned my addr 172.21.15.92:0/940632617 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:12.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.601+0000 7fbf81a03700 1 --2- 172.21.15.92:0/940632617 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbf7c0b2d70 0x7fbf7c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:12.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.601+0000 7fbf81202700 1 --2- 172.21.15.92:0/940632617 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf7c0cb4a0 0x7fbf7c06cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:12.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.601+0000 7fbf82204700 1 -- 172.21.15.92:0/940632617 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbf7c0b2d70 msgr2=0x7fbf7c06b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:12.615 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.601+0000 7fbf82204700 1 --2- 172.21.15.92:0/940632617 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbf7c0b2d70 0x7fbf7c06b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:12.615 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.601+0000 7fbf82204700 1 -- 172.21.15.92:0/940632617 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf7c0cb4a0 msgr2=0x7fbf7c06cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:12.615 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.601+0000 7fbf82204700 1 --2- 172.21.15.92:0/940632617 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf7c0cb4a0 0x7fbf7c06cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:12.615 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.601+0000 7fbf82204700 1 -- 172.21.15.92:0/940632617 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf74009a70 con 0x7fbf7c0d0a30 2023-08-26T09:25:12.615 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.601+0000 7fbf81202700 1 --2- 172.21.15.92:0/940632617 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf7c0cb4a0 0x7fbf7c06cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:25:12.615 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.601+0000 7fbf82204700 1 --2- 172.21.15.92:0/940632617 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf7c0d0a30 0x7fbf7c06bec0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c066f10 tx=0x7fbf74004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:12.616 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.601+0000 7fbf727fc700 1 -- 172.21.15.92:0/940632617 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf74012430 con 0x7fbf7c0d0a30 2023-08-26T09:25:12.616 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.601+0000 7fbf727fc700 1 -- 172.21.15.92:0/940632617 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf74020070 con 0x7fbf7c0d0a30 2023-08-26T09:25:12.616 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.601+0000 7fbf727fc700 1 -- 172.21.15.92:0/940632617 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf74004280 con 0x7fbf7c0d0a30 2023-08-26T09:25:12.616 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.601+0000 7fbf83c67700 1 -- 172.21.15.92:0/940632617 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf7c06d430 con 0x7fbf7c0d0a30 2023-08-26T09:25:12.616 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.601+0000 7fbf83c67700 1 -- 172.21.15.92:0/940632617 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf7c1f6880 con 0x7fbf7c0d0a30 2023-08-26T09:25:12.617 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.602+0000 7fbf83c67700 1 -- 172.21.15.92:0/940632617 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf7c04eeb0 con 0x7fbf7c0d0a30 2023-08-26T09:25:12.617 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.603+0000 7fbf727fc700 1 -- 172.21.15.92:0/940632617 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbf740043e0 con 0x7fbf7c0d0a30 2023-08-26T09:25:12.617 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.603+0000 7fbf727fc700 1 --2- 172.21.15.92:0/940632617 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fbf6006a0e0 0x7fbf6006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:12.617 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.603+0000 7fbf727fc700 1 -- 172.21.15.92:0/940632617 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fbf74022070 con 0x7fbf7c0d0a30 2023-08-26T09:25:12.617 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.603+0000 7fbf81a03700 1 --2- 172.21.15.92:0/940632617 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fbf6006a0e0 0x7fbf6006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:12.618 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.603+0000 7fbf81a03700 1 --2- 172.21.15.92:0/940632617 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fbf6006a0e0 0x7fbf6006c5a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbf78009b70 tx=0x7fbf78008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:12.618 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.608+0000 7fbf727fc700 1 -- 172.21.15.92:0/940632617 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fbf740559d0 con 0x7fbf7c0d0a30 2023-08-26T09:25:12.800 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:12.795+0000 7fbf83c67700 1 -- 172.21.15.92:0/940632617 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fbf7c0b37f0 con 0x7fbf7c0d0a30 2023-08-26T09:25:13.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.448+0000 7fbf727fc700 1 -- 172.21.15.92:0/940632617 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7fbf74058ff0 con 0x7fbf7c0d0a30 2023-08-26T09:25:13.460 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.454+0000 7fbf83c67700 1 -- 172.21.15.92:0/940632617 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fbf6006a0e0 msgr2=0x7fbf6006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:13.460 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.454+0000 7fbf83c67700 1 --2- 172.21.15.92:0/940632617 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fbf6006a0e0 0x7fbf6006c5a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbf78009b70 tx=0x7fbf78008040 comp rx=0 tx=0).stop 2023-08-26T09:25:13.460 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.454+0000 7fbf83c67700 1 -- 172.21.15.92:0/940632617 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf7c0d0a30 msgr2=0x7fbf7c06bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:13.461 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.454+0000 7fbf83c67700 1 --2- 172.21.15.92:0/940632617 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf7c0d0a30 0x7fbf7c06bec0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c066f10 tx=0x7fbf74004ad0 comp rx=0 tx=0).stop 2023-08-26T09:25:13.461 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.455+0000 7fbf83c67700 1 -- 172.21.15.92:0/940632617 shutdown_connections 2023-08-26T09:25:13.461 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.455+0000 7fbf83c67700 1 --2- 172.21.15.92:0/940632617 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf7c0d0a30 0x7fbf7c06bec0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:13.461 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.455+0000 7fbf83c67700 1 --2- 172.21.15.92:0/940632617 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbf7c0b2d70 0x7fbf7c06b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:13.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.455+0000 7fbf83c67700 1 --2- 172.21.15.92:0/940632617 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fbf6006a0e0 0x7fbf6006c5a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:13.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.455+0000 7fbf83c67700 1 --2- 172.21.15.92:0/940632617 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf7c0cb4a0 0x7fbf7c06cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:13.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.455+0000 7fbf83c67700 1 -- 172.21.15.92:0/940632617 >> 172.21.15.92:0/940632617 conn(0x7fbf7c0cd8d0 msgr2=0x7fbf7c0ce050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:13.463 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.456+0000 7fbf83c67700 1 -- 172.21.15.92:0/940632617 shutdown_connections 2023-08-26T09:25:13.463 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.457+0000 7fbf83c67700 1 -- 172.21.15.92:0/940632617 wait complete. 2023-08-26T09:25:13.466 INFO:teuthology.orchestra.run.smithi092.stderr:pool 'cephfs_data' created 2023-08-26T09:25:13.483 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-26T09:25:13.610 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.605+0000 7f54661df700 1 Processor -- start 2023-08-26T09:25:13.610 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.605+0000 7f54661df700 1 -- start start 2023-08-26T09:25:13.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.605+0000 7f54661df700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f546015da10 0x7f546015ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:13.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.605+0000 7f54661df700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f546015e9b0 con 0x7f54600b28d0 2023-08-26T09:25:13.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.605+0000 7f54661df700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54601614a0 con 0x7f54600ce450 2023-08-26T09:25:13.615 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.605+0000 7f54661df700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f546015e3f0 con 0x7f546015da10 2023-08-26T09:25:13.615 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.606+0000 7f545f7fe700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f54600b28d0 0x7f54600b2cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:56324/0 (socket says 172.21.15.92:56324) 2023-08-26T09:25:13.618 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.606+0000 7f545f7fe700 1 -- 172.21.15.92:0/196659062 learned_addr learned my addr 172.21.15.92:0/196659062 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:13.618 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.606+0000 7f545effd700 1 -- 172.21.15.92:0/196659062 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 270884709 0 0) 0x7f546015e9b0 con 0x7f54600b28d0 2023-08-26T09:25:13.619 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.606+0000 7f545effd700 1 -- 172.21.15.92:0/196659062 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f544c0035b0 con 0x7f54600b28d0 2023-08-26T09:25:13.619 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.606+0000 7f545ffff700 1 --2- 172.21.15.92:0/196659062 >> v2:172.21.15.188:3300/0 conn(0x7f546015da10 0x7f546015ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:13.619 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.606+0000 7f545effd700 1 -- 172.21.15.92:0/196659062 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1634074817 0 0) 0x7f544c0035b0 con 0x7f54600b28d0 2023-08-26T09:25:13.619 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.606+0000 7f545effd700 1 -- 172.21.15.92:0/196659062 >> v2:172.21.15.188:3300/0 conn(0x7f546015da10 msgr2=0x7f546015ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:13.619 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.606+0000 7f545effd700 1 --2- 172.21.15.92:0/196659062 >> v2:172.21.15.188:3300/0 conn(0x7f546015da10 0x7f546015ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:13.620 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.606+0000 7f545effd700 1 -- 172.21.15.92:0/196659062 >> v1:172.21.15.188:6789/0 conn(0x7f54600ce450 legacy=0x7f5460161930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:13.620 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.606+0000 7f545effd700 1 -- 172.21.15.92:0/196659062 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f546015e6d0 con 0x7f54600b28d0 2023-08-26T09:25:13.620 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.606+0000 7f545effd700 1 -- 172.21.15.92:0/196659062 <== mon.0 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1019361464 0 0) 0x7f5450001670 con 0x7f54600b28d0 2023-08-26T09:25:13.620 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.606+0000 7f545effd700 1 -- 172.21.15.92:0/196659062 >> v1:172.21.15.92:6789/0 conn(0x7f54600b28d0 legacy=0x7f54600b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:13.620 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.606+0000 7f545effd700 1 --2- 172.21.15.92:0/196659062 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f544c003a00 0x7f544c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:13.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.606+0000 7f545effd700 1 --2- 172.21.15.92:0/196659062 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f544c004850 0x7f544c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:13.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.606+0000 7f545effd700 1 --2- 172.21.15.92:0/196659062 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f544c005210 0x7f544c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:13.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.606+0000 7f545effd700 1 -- 172.21.15.92:0/196659062 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546015e3f0 con 0x7f544c005210 2023-08-26T09:25:13.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.606+0000 7f545effd700 1 -- 172.21.15.92:0/196659062 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f544c00c1b0 con 0x7f544c004850 2023-08-26T09:25:13.622 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.606+0000 7f545effd700 1 -- 172.21.15.92:0/196659062 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f544c00c370 con 0x7f544c003a00 2023-08-26T09:25:13.622 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.606+0000 7f545ffff700 1 --2- 172.21.15.92:0/196659062 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f544c005210 0x7f544c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:13.622 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.606+0000 7f545f7fe700 1 --2- 172.21.15.92:0/196659062 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f544c003a00 0x7f544c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:13.622 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.606+0000 7f5456ffd700 1 --2- 172.21.15.92:0/196659062 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f544c004850 0x7f544c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:13.622 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.606+0000 7f545ffff700 1 -- 172.21.15.92:0/196659062 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f544c003a00 msgr2=0x7f544c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:13.623 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.607+0000 7f545ffff700 1 --2- 172.21.15.92:0/196659062 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f544c003a00 0x7f544c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:13.623 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.607+0000 7f545ffff700 1 -- 172.21.15.92:0/196659062 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f544c004850 msgr2=0x7f544c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:13.623 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.607+0000 7f545ffff700 1 --2- 172.21.15.92:0/196659062 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f544c004850 0x7f544c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:13.623 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.607+0000 7f545ffff700 1 -- 172.21.15.92:0/196659062 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f544c0035b0 con 0x7f544c005210 2023-08-26T09:25:13.624 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.607+0000 7f545ffff700 1 -- 172.21.15.92:0/196659062 reap_dead start 2023-08-26T09:25:13.624 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.607+0000 7f545ffff700 1 --2- 172.21.15.92:0/196659062 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f544c005210 0x7f544c00ba10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5458009fc0 tx=0x7f544c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c67986290ecb1eed server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:13.624 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.607+0000 7f545effd700 1 -- 172.21.15.92:0/196659062 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5458003a20 con 0x7f544c005210 2023-08-26T09:25:13.624 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.607+0000 7f545effd700 1 -- 172.21.15.92:0/196659062 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f545800f040 con 0x7f544c005210 2023-08-26T09:25:13.624 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.607+0000 7f545effd700 1 -- 172.21.15.92:0/196659062 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5458003da0 con 0x7f544c005210 2023-08-26T09:25:13.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.607+0000 7f54661df700 1 -- 172.21.15.92:0/196659062 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f544c005210 msgr2=0x7f544c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:13.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.607+0000 7f54661df700 1 --2- 172.21.15.92:0/196659062 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f544c005210 0x7f544c00ba10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5458009fc0 tx=0x7f544c005880 comp rx=0 tx=0).stop 2023-08-26T09:25:13.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.607+0000 7f54661df700 1 -- 172.21.15.92:0/196659062 shutdown_connections 2023-08-26T09:25:13.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.607+0000 7f54661df700 1 --2- 172.21.15.92:0/196659062 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f544c005210 0x7f544c00ba10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:13.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.607+0000 7f54661df700 1 -- 172.21.15.92:0/196659062 >> 172.21.15.92:0/196659062 conn(0x7f54600cd8d0 msgr2=0x7f54600cdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:13.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.607+0000 7f54661df700 1 -- 172.21.15.92:0/196659062 shutdown_connections 2023-08-26T09:25:13.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.607+0000 7f54661df700 1 -- 172.21.15.92:0/196659062 wait complete. 2023-08-26T09:25:13.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.609+0000 7f54661df700 1 Processor -- start 2023-08-26T09:25:13.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.609+0000 7f54661df700 1 -- start start 2023-08-26T09:25:13.630 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.609+0000 7f54661df700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f544c005210 0x7f5460157090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:13.630 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.609+0000 7f54661df700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f54600b5f30 0x7f54600b63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:13.630 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.609+0000 7f54661df700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54600ac8e0 0x7f54600acd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:13.631 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.609+0000 7f54661df700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54600b68f0 con 0x7f54600ac8e0 2023-08-26T09:25:13.631 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.609+0000 7f54661df700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54600ad2a0 con 0x7f544c005210 2023-08-26T09:25:13.631 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.609+0000 7f54661df700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54600b4a90 con 0x7f54600b5f30 2023-08-26T09:25:13.631 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.610+0000 7f545ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54600ac8e0 0x7f54600acd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:13.632 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.610+0000 7f545ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54600ac8e0 0x7f54600acd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44326/0 (socket says 172.21.15.92:44326) 2023-08-26T09:25:13.632 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.610+0000 7f545ffff700 1 -- 172.21.15.92:0/2945168775 learned_addr learned my addr 172.21.15.92:0/2945168775 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:13.632 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.610+0000 7f5456ffd700 1 --2- 172.21.15.92:0/2945168775 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f54600b5f30 0x7f54600b63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:13.632 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.610+0000 7f545f7fe700 1 --2- 172.21.15.92:0/2945168775 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f544c005210 0x7f5460157090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:13.633 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.610+0000 7f545ffff700 1 -- 172.21.15.92:0/2945168775 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f54600b5f30 msgr2=0x7f54600b63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:13.633 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.610+0000 7f545ffff700 1 --2- 172.21.15.92:0/2945168775 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f54600b5f30 0x7f54600b63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:13.633 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.610+0000 7f545ffff700 1 -- 172.21.15.92:0/2945168775 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f544c005210 msgr2=0x7f5460157090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:13.633 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.610+0000 7f545ffff700 1 --2- 172.21.15.92:0/2945168775 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f544c005210 0x7f5460157090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:13.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.610+0000 7f545ffff700 1 -- 172.21.15.92:0/2945168775 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54600b4d30 con 0x7f54600ac8e0 2023-08-26T09:25:13.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.610+0000 7f545ffff700 1 --2- 172.21.15.92:0/2945168775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54600ac8e0 0x7f54600acd60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f54600b37c0 tx=0x7f5458009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:13.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.610+0000 7f545cff9700 1 -- 172.21.15.92:0/2945168775 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5458003e90 con 0x7f54600ac8e0 2023-08-26T09:25:13.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.610+0000 7f545cff9700 1 -- 172.21.15.92:0/2945168775 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5458004250 con 0x7f54600ac8e0 2023-08-26T09:25:13.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.610+0000 7f54661df700 1 -- 172.21.15.92:0/2945168775 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54600b5010 con 0x7f54600ac8e0 2023-08-26T09:25:13.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.610+0000 7f545cff9700 1 -- 172.21.15.92:0/2945168775 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5458004620 con 0x7f54600ac8e0 2023-08-26T09:25:13.635 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.610+0000 7f54661df700 1 -- 172.21.15.92:0/2945168775 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54600b55d0 con 0x7f54600ac8e0 2023-08-26T09:25:13.635 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.611+0000 7f54661df700 1 -- 172.21.15.92:0/2945168775 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54600b5760 con 0x7f54600ac8e0 2023-08-26T09:25:13.635 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.612+0000 7f545cff9700 1 -- 172.21.15.92:0/2945168775 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5458004780 con 0x7f54600ac8e0 2023-08-26T09:25:13.635 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.612+0000 7f545cff9700 1 --2- 172.21.15.92:0/2945168775 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f544006a0e0 0x7f544006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:13.635 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.612+0000 7f545cff9700 1 -- 172.21.15.92:0/2945168775 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f5458089cc0 con 0x7f54600ac8e0 2023-08-26T09:25:13.636 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.612+0000 7f545f7fe700 1 --2- 172.21.15.92:0/2945168775 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f544006a0e0 0x7f544006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:13.636 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.612+0000 7f545f7fe700 1 --2- 172.21.15.92:0/2945168775 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f544006a0e0 0x7f544006c5a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5450000c00 tx=0x7f5450009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:13.636 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.617+0000 7f545cff9700 1 -- 172.21.15.92:0/2945168775 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f54580555c0 con 0x7f54600ac8e0 2023-08-26T09:25:13.854 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:13.849+0000 7f54661df700 1 -- 172.21.15.92:0/2945168775 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f546004eeb0 con 0x7f54600ac8e0 2023-08-26T09:25:14.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.450+0000 7f545cff9700 1 -- 172.21.15.92:0/2945168775 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f5458018020 con 0x7f54600ac8e0 2023-08-26T09:25:14.460 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.455+0000 7f54661df700 1 -- 172.21.15.92:0/2945168775 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f544006a0e0 msgr2=0x7f544006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:14.460 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.455+0000 7f54661df700 1 --2- 172.21.15.92:0/2945168775 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f544006a0e0 0x7f544006c5a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5450000c00 tx=0x7f5450009040 comp rx=0 tx=0).stop 2023-08-26T09:25:14.460 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.455+0000 7f54661df700 1 -- 172.21.15.92:0/2945168775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54600ac8e0 msgr2=0x7f54600acd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:14.461 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.455+0000 7f54661df700 1 --2- 172.21.15.92:0/2945168775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54600ac8e0 0x7f54600acd60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f54600b37c0 tx=0x7f5458009750 comp rx=0 tx=0).stop 2023-08-26T09:25:14.461 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.455+0000 7f54661df700 1 -- 172.21.15.92:0/2945168775 shutdown_connections 2023-08-26T09:25:14.461 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.455+0000 7f54661df700 1 --2- 172.21.15.92:0/2945168775 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f544006a0e0 0x7f544006c5a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:14.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.455+0000 7f54661df700 1 --2- 172.21.15.92:0/2945168775 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f544c005210 0x7f5460157090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:14.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.455+0000 7f54661df700 1 --2- 172.21.15.92:0/2945168775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54600ac8e0 0x7f54600acd60 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:14.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.455+0000 7f54661df700 1 --2- 172.21.15.92:0/2945168775 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f54600b5f30 0x7f54600b63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:14.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.455+0000 7f54661df700 1 -- 172.21.15.92:0/2945168775 >> 172.21.15.92:0/2945168775 conn(0x7f54600cd8d0 msgr2=0x7f54600b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:14.463 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.457+0000 7f54661df700 1 -- 172.21.15.92:0/2945168775 shutdown_connections 2023-08-26T09:25:14.463 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.457+0000 7f54661df700 1 -- 172.21.15.92:0/2945168775 wait complete. 2023-08-26T09:25:14.472 INFO:teuthology.orchestra.run.smithi092.stderr:new fs with metadata pool 3 and data pool 4 2023-08-26T09:25:14.488 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-26T09:25:14.611 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.606+0000 7f0ce8209700 1 Processor -- start 2023-08-26T09:25:14.612 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.606+0000 7f0ce8209700 1 -- start start 2023-08-26T09:25:14.615 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.607+0000 7f0ce8209700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f0ce015a090 0x7f0ce00cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:14.615 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.607+0000 7f0ce8209700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ce00cf7e0 con 0x7f0ce00cb8e0 2023-08-26T09:25:14.615 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.607+0000 7f0ce8209700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ce00caec0 con 0x7f0ce006f4e0 2023-08-26T09:25:14.616 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.607+0000 7f0ce8209700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ce00cb160 con 0x7f0ce015a090 2023-08-26T09:25:14.616 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.607+0000 7f0ce67a6700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f0ce00cb8e0 0x7f0ce006e780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:56358/0 (socket says 172.21.15.92:56358) 2023-08-26T09:25:14.616 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.608+0000 7f0ce67a6700 1 -- 172.21.15.92:0/1006177967 learned_addr learned my addr 172.21.15.92:0/1006177967 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:14.616 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.608+0000 7f0ce5fa5700 1 --2- 172.21.15.92:0/1006177967 >> v2:172.21.15.188:3300/0 conn(0x7f0ce015a090 0x7f0ce00cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:14.616 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.608+0000 7f0ce4fa3700 1 -- 172.21.15.92:0/1006177967 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 953363958 0 0) 0x7f0ce00cf7e0 con 0x7f0ce00cb8e0 2023-08-26T09:25:14.616 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.608+0000 7f0ce4fa3700 1 -- 172.21.15.92:0/1006177967 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ccc0035b0 con 0x7f0ce00cb8e0 2023-08-26T09:25:14.617 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.608+0000 7f0ce4fa3700 1 -- 172.21.15.92:0/1006177967 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2279983347 0 0) 0x7f0ccc0035b0 con 0x7f0ce00cb8e0 2023-08-26T09:25:14.617 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.608+0000 7f0ce4fa3700 1 -- 172.21.15.92:0/1006177967 >> v2:172.21.15.188:3300/0 conn(0x7f0ce015a090 msgr2=0x7f0ce00cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:14.617 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.608+0000 7f0ce4fa3700 1 --2- 172.21.15.92:0/1006177967 >> v2:172.21.15.188:3300/0 conn(0x7f0ce015a090 0x7f0ce00cd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:14.617 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.608+0000 7f0ce4fa3700 1 -- 172.21.15.92:0/1006177967 >> v1:172.21.15.188:6789/0 conn(0x7f0ce006f4e0 legacy=0x7f0ce00cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:14.617 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.608+0000 7f0ce4fa3700 1 -- 172.21.15.92:0/1006177967 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce00cb440 con 0x7f0ce00cb8e0 2023-08-26T09:25:14.618 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.608+0000 7f0ce4fa3700 1 -- 172.21.15.92:0/1006177967 <== mon.0 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1019361464 0 0) 0x7f0cd80019f0 con 0x7f0ce00cb8e0 2023-08-26T09:25:14.618 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.608+0000 7f0ce4fa3700 1 -- 172.21.15.92:0/1006177967 >> v1:172.21.15.92:6789/0 conn(0x7f0ce00cb8e0 legacy=0x7f0ce006e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:14.618 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.608+0000 7f0ce4fa3700 1 --2- 172.21.15.92:0/1006177967 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ccc003a00 0x7f0ccc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:14.618 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.608+0000 7f0ce4fa3700 1 --2- 172.21.15.92:0/1006177967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ccc004850 0x7f0ccc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:14.618 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.608+0000 7f0ce4fa3700 1 --2- 172.21.15.92:0/1006177967 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0ccc005210 0x7f0ccc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:14.619 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.608+0000 7f0ce4fa3700 1 -- 172.21.15.92:0/1006177967 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce00cb160 con 0x7f0ccc004850 2023-08-26T09:25:14.619 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.608+0000 7f0ce4fa3700 1 -- 172.21.15.92:0/1006177967 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ccc00c1b0 con 0x7f0ccc003a00 2023-08-26T09:25:14.619 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.608+0000 7f0ce4fa3700 1 -- 172.21.15.92:0/1006177967 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ccc00c370 con 0x7f0ccc005210 2023-08-26T09:25:14.619 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.608+0000 7f0ce57a4700 1 --2- 172.21.15.92:0/1006177967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ccc004850 0x7f0ccc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:14.619 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.608+0000 7f0ce5fa5700 1 --2- 172.21.15.92:0/1006177967 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ccc003a00 0x7f0ccc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:14.620 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.608+0000 7f0ce67a6700 1 --2- 172.21.15.92:0/1006177967 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0ccc005210 0x7f0ccc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:14.620 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.608+0000 7f0ce57a4700 1 -- 172.21.15.92:0/1006177967 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0ccc005210 msgr2=0x7f0ccc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:14.620 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.608+0000 7f0ce57a4700 1 --2- 172.21.15.92:0/1006177967 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0ccc005210 0x7f0ccc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:14.620 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.608+0000 7f0ce57a4700 1 -- 172.21.15.92:0/1006177967 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ccc003a00 msgr2=0x7f0ccc003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:14.620 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.608+0000 7f0ce57a4700 1 --2- 172.21.15.92:0/1006177967 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ccc003a00 0x7f0ccc003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:14.620 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.608+0000 7f0ce67a6700 1 -- 172.21.15.92:0/1006177967 reap_dead start 2023-08-26T09:25:14.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.608+0000 7f0ce57a4700 1 -- 172.21.15.92:0/1006177967 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ccc0035b0 con 0x7f0ccc004850 2023-08-26T09:25:14.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.609+0000 7f0ce57a4700 1 --2- 172.21.15.92:0/1006177967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ccc004850 0x7f0ccc004cd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc0017c0 tx=0x7f0ccc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72d1dbb09416908a server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:14.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.609+0000 7f0ce4fa3700 1 -- 172.21.15.92:0/1006177967 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc0052d0 con 0x7f0ccc004850 2023-08-26T09:25:14.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.609+0000 7f0ce4fa3700 1 -- 172.21.15.92:0/1006177967 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cdc005450 con 0x7f0ccc004850 2023-08-26T09:25:14.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.609+0000 7f0ce4fa3700 1 -- 172.21.15.92:0/1006177967 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc0038c0 con 0x7f0ccc004850 2023-08-26T09:25:14.622 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.609+0000 7f0ce8209700 1 -- 172.21.15.92:0/1006177967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ccc004850 msgr2=0x7f0ccc004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:14.622 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.609+0000 7f0ce8209700 1 --2- 172.21.15.92:0/1006177967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ccc004850 0x7f0ccc004cd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc0017c0 tx=0x7f0ccc005880 comp rx=0 tx=0).stop 2023-08-26T09:25:14.622 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.609+0000 7f0ce8209700 1 -- 172.21.15.92:0/1006177967 shutdown_connections 2023-08-26T09:25:14.622 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.609+0000 7f0ce8209700 1 --2- 172.21.15.92:0/1006177967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ccc004850 0x7f0ccc004cd0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:14.622 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.609+0000 7f0ce8209700 1 -- 172.21.15.92:0/1006177967 >> 172.21.15.92:0/1006177967 conn(0x7f0ce00cc7b0 msgr2=0x7f0ce00ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:14.623 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.609+0000 7f0ce8209700 1 -- 172.21.15.92:0/1006177967 shutdown_connections 2023-08-26T09:25:14.623 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.609+0000 7f0ce8209700 1 -- 172.21.15.92:0/1006177967 wait complete. 2023-08-26T09:25:14.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.611+0000 7f0ce8209700 1 Processor -- start 2023-08-26T09:25:14.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.611+0000 7f0ce8209700 1 -- start start 2023-08-26T09:25:14.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.611+0000 7f0ce8209700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ccc004850 0x7f0ce00c76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:14.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.611+0000 7f0ce8209700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0ce006e680 0x7f0ce006eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:14.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.611+0000 7f0ce8209700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ce00c9060 0x7f0ce00c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:14.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.611+0000 7f0ce8209700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce006f040 con 0x7f0ce00c9060 2023-08-26T09:25:14.627 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.611+0000 7f0ce8209700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce0147a60 con 0x7f0ccc004850 2023-08-26T09:25:14.627 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.611+0000 7f0ce8209700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce0156600 con 0x7f0ce006e680 2023-08-26T09:25:14.627 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.611+0000 7f0ce67a6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ce00c9060 0x7f0ce00c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:14.627 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.611+0000 7f0ce67a6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ce00c9060 0x7f0ce00c94e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44356/0 (socket says 172.21.15.92:44356) 2023-08-26T09:25:14.627 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.611+0000 7f0ce67a6700 1 -- 172.21.15.92:0/2490536823 learned_addr learned my addr 172.21.15.92:0/2490536823 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:14.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.611+0000 7f0ce5fa5700 1 --2- 172.21.15.92:0/2490536823 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ccc004850 0x7f0ce00c76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:14.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.611+0000 7f0ce57a4700 1 --2- 172.21.15.92:0/2490536823 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0ce006e680 0x7f0ce006eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:14.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.612+0000 7f0ce67a6700 1 -- 172.21.15.92:0/2490536823 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0ce006e680 msgr2=0x7f0ce006eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:14.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.612+0000 7f0ce67a6700 1 --2- 172.21.15.92:0/2490536823 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0ce006e680 0x7f0ce006eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:14.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.612+0000 7f0ce67a6700 1 -- 172.21.15.92:0/2490536823 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ccc004850 msgr2=0x7f0ce00c76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:14.629 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.612+0000 7f0ce67a6700 1 --2- 172.21.15.92:0/2490536823 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ccc004850 0x7f0ce00c76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:14.629 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.612+0000 7f0ce67a6700 1 -- 172.21.15.92:0/2490536823 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce00c7bf0 con 0x7f0ce00c9060 2023-08-26T09:25:14.629 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.612+0000 7f0ce67a6700 1 --2- 172.21.15.92:0/2490536823 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ce00c9060 0x7f0ce00c94e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0ce006f990 tx=0x7f0cd800a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:14.629 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.612+0000 7f0cd67fc700 1 -- 172.21.15.92:0/2490536823 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd800ad00 con 0x7f0ce00c9060 2023-08-26T09:25:14.629 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.612+0000 7f0cd67fc700 1 -- 172.21.15.92:0/2490536823 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd800ae60 con 0x7f0ce00c9060 2023-08-26T09:25:14.629 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.612+0000 7f0ce8209700 1 -- 172.21.15.92:0/2490536823 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ce00c9d40 con 0x7f0ce00c9060 2023-08-26T09:25:14.630 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.612+0000 7f0cd67fc700 1 -- 172.21.15.92:0/2490536823 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd8013630 con 0x7f0ce00c9060 2023-08-26T09:25:14.630 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.612+0000 7f0ce8209700 1 -- 172.21.15.92:0/2490536823 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ce00ca300 con 0x7f0ce00c9060 2023-08-26T09:25:14.630 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.613+0000 7f0ce8209700 1 -- 172.21.15.92:0/2490536823 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ce00ca4c0 con 0x7f0ce00c9060 2023-08-26T09:25:14.630 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.613+0000 7f0cd67fc700 1 -- 172.21.15.92:0/2490536823 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0cd8013790 con 0x7f0ce00c9060 2023-08-26T09:25:14.630 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.614+0000 7f0cd67fc700 1 --2- 172.21.15.92:0/2490536823 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f0cc406a0e0 0x7f0cc406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:14.631 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.614+0000 7f0cd67fc700 1 -- 172.21.15.92:0/2490536823 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0cd8088db0 con 0x7f0ce00c9060 2023-08-26T09:25:14.631 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.614+0000 7f0ce5fa5700 1 --2- 172.21.15.92:0/2490536823 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f0cc406a0e0 0x7f0cc406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:14.631 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.614+0000 7f0ce5fa5700 1 --2- 172.21.15.92:0/2490536823 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f0cc406a0e0 0x7f0cc406c5a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0ce00c70a0 tx=0x7f0cd0009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:14.631 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.618+0000 7f0cd67fc700 1 -- 172.21.15.92:0/2490536823 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0cd808d070 con 0x7f0ce00c9060 2023-08-26T09:25:14.813 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.808+0000 7f0ce8209700 1 -- 172.21.15.92:0/2490536823 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ce004e660 con 0x7f0ce00c9060 2023-08-26T09:25:14.815 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.809+0000 7f0cd67fc700 1 -- 172.21.15.92:0/2490536823 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+18222 (secure 0 0 0) 0x7f0cd8054400 con 0x7f0ce00c9060 2023-08-26T09:25:14.815 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:25:14.816 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"fsid":"254a2d31-bd41-4507-8326-1b205ac24377","created":"2023-08-26T09:24:55.352131+0000","modified":"2023-08-26T09:25:13.850873+0000","last_up_change":"2023-08-26T09:25:06.124496+0000","last_in_change":"2023-08-26T09:24:57.840725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-26T09:25:06.650431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-26T09:25:06.973382+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-26T09:25:11.584141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-26T09:25:12.814990+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e9e7638-4459-4d8d-8e40-130bcf48df66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6819","nonce":382827192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6824","nonce":382827192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6831","nonce":382827192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6827","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6829","nonce":382827192}]},"public_addr":"172.21.15.92:6819/382827192","cluster_addr":"172.21.15.92:6824/382827192","heartbeat_back_addr":"172.21.15.92:6831/382827192","heartbeat_front_addr":"172.21.15.92:6829/382827192","state":["exists","up"]},{"osd":1,"uuid":"164e68c9-aedd-4df5-9b70-f4b1ec3bda13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6809","nonce":618773438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6811","nonce":618773438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6815","nonce":618773438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6813","nonce":618773438}]},"public_addr":"172.21.15.92:6809/618773438","cluster_addr":"172.21.15.92:6811/618773438","heartbeat_back_addr":"172.21.15.92:6815/618773438","heartbeat_front_addr":"172.21.15.92:6813/618773438","state":["exists","up"]},{"osd":2,"uuid":"8701dfee-629a-4d30-82e4-b8fac340303f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6818","nonce":3697397687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6821","nonce":3697397687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6828","nonce":3697397687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6823","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6825","nonce":3697397687}]},"public_addr":"172.21.15.92:6818/3697397687","cluster_addr":"172.21.15.92:6821/3697397687","heartbeat_back_addr":"172.21.15.92:6828/3697397687","heartbeat_front_addr":"172.21.15.92:6825/3697397687","state":["exists","up"]},{"osd":3,"uuid":"93bdc94d-dc07-495f-995a-a6ad072f0247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6801","nonce":3579846453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6803","nonce":3579846453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6807","nonce":3579846453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6805","nonce":3579846453}]},"public_addr":"172.21.15.92:6801/3579846453","cluster_addr":"172.21.15.92:6803/3579846453","heartbeat_back_addr":"172.21.15.92:6807/3579846453","heartbeat_front_addr":"172.21.15.92:6805/3579846453","state":["exists","up"]},{"osd":4,"uuid":"d9d0ea80-8481-46a7-9677-c338d32cf1d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6809","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6811","nonce":3228383424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6813","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6815","nonce":3228383424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6821","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6823","nonce":3228383424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6817","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6819","nonce":3228383424}]},"public_addr":"172.21.15.188:6811/3228383424","cluster_addr":"172.21.15.188:6815/3228383424","heartbeat_back_addr":"172.21.15.188:6823/3228383424","heartbeat_front_addr":"172.21.15.188:6819/3228383424","state":["exists","up"]},{"osd":5,"uuid":"38d03253-467a-456f-bd5e-5a46532a0b18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6801","nonce":1655821054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6803","nonce":1655821054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6807","nonce":1655821054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6805","nonce":1655821054}]},"public_addr":"172.21.15.188:6801/1655821054","cluster_addr":"172.21.15.188:6803/1655821054","heartbeat_back_addr":"172.21.15.188:6807/1655821054","heartbeat_front_addr":"172.21.15.188:6805/1655821054","state":["exists","up"]},{"osd":6,"uuid":"d61564b5-136f-42e5-a843-626c2017cc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6810","nonce":2069976891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6814","nonce":2069976891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6822","nonce":2069976891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6818","nonce":2069976891}]},"public_addr":"172.21.15.188:6810/2069976891","cluster_addr":"172.21.15.188:6814/2069976891","heartbeat_back_addr":"172.21.15.188:6822/2069976891","heartbeat_front_addr":"172.21.15.188:6818/2069976891","state":["exists","up"]},{"osd":7,"uuid":"fae2949e-0d62-42cd-ba72-08f516084b20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6825","nonce":1882888860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6827","nonce":1882888860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6831","nonce":1882888860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6829","nonce":1882888860}]},"public_addr":"172.21.15.188:6825/1882888860","cluster_addr":"172.21.15.188:6827/1882888860","heartbeat_back_addr":"172.21.15.188:6831/1882888860","heartbeat_front_addr":"172.21.15.188:6829/1882888860","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.038523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.063160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.000857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.975572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.023848+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.765194+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.081365+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:05.110745+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-26T09:25:14.818 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.812+0000 7f0ce8209700 1 -- 172.21.15.92:0/2490536823 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f0cc406a0e0 msgr2=0x7f0cc406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:14.818 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.812+0000 7f0ce8209700 1 --2- 172.21.15.92:0/2490536823 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f0cc406a0e0 0x7f0cc406c5a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0ce00c70a0 tx=0x7f0cd0009210 comp rx=0 tx=0).stop 2023-08-26T09:25:14.818 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.812+0000 7f0ce8209700 1 -- 172.21.15.92:0/2490536823 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ce00c9060 msgr2=0x7f0ce00c94e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:14.818 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.812+0000 7f0ce8209700 1 --2- 172.21.15.92:0/2490536823 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ce00c9060 0x7f0ce00c94e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0ce006f990 tx=0x7f0cd800a5f0 comp rx=0 tx=0).stop 2023-08-26T09:25:14.819 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.812+0000 7f0ce8209700 1 -- 172.21.15.92:0/2490536823 shutdown_connections 2023-08-26T09:25:14.819 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.812+0000 7f0ce8209700 1 --2- 172.21.15.92:0/2490536823 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f0cc406a0e0 0x7f0cc406c5a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:14.819 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.812+0000 7f0ce8209700 1 --2- 172.21.15.92:0/2490536823 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ccc004850 0x7f0ce00c76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:14.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.812+0000 7f0ce8209700 1 --2- 172.21.15.92:0/2490536823 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ce00c9060 0x7f0ce00c94e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:14.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.812+0000 7f0ce8209700 1 --2- 172.21.15.92:0/2490536823 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0ce006e680 0x7f0ce006eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:14.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.812+0000 7f0ce8209700 1 -- 172.21.15.92:0/2490536823 >> 172.21.15.92:0/2490536823 conn(0x7f0ce00cc7b0 msgr2=0x7f0ce0158e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:14.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.812+0000 7f0ce8209700 1 -- 172.21.15.92:0/2490536823 shutdown_connections 2023-08-26T09:25:14.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.812+0000 7f0ce8209700 1 -- 172.21.15.92:0/2490536823 wait complete. 2023-08-26T09:25:14.829 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-26T09:25:14.950 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.945+0000 7fc7d58cb700 1 Processor -- start 2023-08-26T09:25:14.951 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.945+0000 7fc7d58cb700 1 -- start start 2023-08-26T09:25:14.958 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.946+0000 7fc7d58cb700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc7d015d550 0x7fc7d00b6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:14.958 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.946+0000 7fc7d58cb700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7d00d10c0 con 0x7fc7d00b4ab0 2023-08-26T09:25:14.958 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.946+0000 7fc7d58cb700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7d00cdd70 con 0x7fc7d006b0a0 2023-08-26T09:25:14.958 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.946+0000 7fc7d58cb700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d015d930 con 0x7fc7d015d550 2023-08-26T09:25:14.958 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.946+0000 7fc7ce7fc700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fc7d00b4ab0 0x7fc7d006a990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:56374/0 (socket says 172.21.15.92:56374) 2023-08-26T09:25:14.959 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.946+0000 7fc7ce7fc700 1 -- 172.21.15.92:0/3432465911 learned_addr learned my addr 172.21.15.92:0/3432465911 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:14.959 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.946+0000 7fc7ceffd700 1 --2- 172.21.15.92:0/3432465911 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc7d015d550 0x7fc7d00b6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:14.959 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.946+0000 7fc7cdffb700 1 -- 172.21.15.92:0/3432465911 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1613777406 0 0) 0x7fc7d00d10c0 con 0x7fc7d00b4ab0 2023-08-26T09:25:14.959 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.946+0000 7fc7cdffb700 1 -- 172.21.15.92:0/3432465911 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7b80035b0 con 0x7fc7d00b4ab0 2023-08-26T09:25:14.960 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.946+0000 7fc7cdffb700 1 -- 172.21.15.92:0/3432465911 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1375117139 0 0) 0x7fc7b80035b0 con 0x7fc7d00b4ab0 2023-08-26T09:25:14.960 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.946+0000 7fc7cdffb700 1 -- 172.21.15.92:0/3432465911 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc7d015d550 msgr2=0x7fc7d00b6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:14.960 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.946+0000 7fc7cdffb700 1 --2- 172.21.15.92:0/3432465911 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc7d015d550 0x7fc7d00b6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:14.960 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.946+0000 7fc7cdffb700 1 -- 172.21.15.92:0/3432465911 >> v1:172.21.15.188:6789/0 conn(0x7fc7d006b0a0 legacy=0x7fc7d00d1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:14.960 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.946+0000 7fc7cdffb700 1 -- 172.21.15.92:0/3432465911 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d006b5a0 con 0x7fc7d00b4ab0 2023-08-26T09:25:14.961 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.946+0000 7fc7cdffb700 1 -- 172.21.15.92:0/3432465911 <== mon.0 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1019361464 0 0) 0x7fc7c0001670 con 0x7fc7d00b4ab0 2023-08-26T09:25:14.961 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.947+0000 7fc7cdffb700 1 -- 172.21.15.92:0/3432465911 >> v1:172.21.15.92:6789/0 conn(0x7fc7d00b4ab0 legacy=0x7fc7d006a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:14.961 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.947+0000 7fc7cdffb700 1 --2- 172.21.15.92:0/3432465911 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc7d015d550 0x7fc7b8003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:14.961 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.947+0000 7fc7cdffb700 1 --2- 172.21.15.92:0/3432465911 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7b8003f70 0x7fc7b8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:14.961 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.947+0000 7fc7cdffb700 1 --2- 172.21.15.92:0/3432465911 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc7b8004d90 0x7fc7b8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:14.962 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.947+0000 7fc7cdffb700 1 -- 172.21.15.92:0/3432465911 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d015d930 con 0x7fc7b8003f70 2023-08-26T09:25:14.962 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.947+0000 7fc7cdffb700 1 -- 172.21.15.92:0/3432465911 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b800ba70 con 0x7fc7b8004d90 2023-08-26T09:25:14.962 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.947+0000 7fc7cdffb700 1 -- 172.21.15.92:0/3432465911 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b800bc30 con 0x7fc7d015d550 2023-08-26T09:25:14.962 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.947+0000 7fc7ce7fc700 1 --2- 172.21.15.92:0/3432465911 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7b8003f70 0x7fc7b8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:14.962 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.947+0000 7fc7ceffd700 1 --2- 172.21.15.92:0/3432465911 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc7d015d550 0x7fc7b8003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:14.963 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.947+0000 7fc7cf7fe700 1 --2- 172.21.15.92:0/3432465911 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc7b8004d90 0x7fc7b8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:14.963 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.947+0000 7fc7ce7fc700 1 -- 172.21.15.92:0/3432465911 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc7d015d550 msgr2=0x7fc7b8003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:14.963 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.947+0000 7fc7ce7fc700 1 --2- 172.21.15.92:0/3432465911 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc7d015d550 0x7fc7b8003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:14.963 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.947+0000 7fc7ce7fc700 1 -- 172.21.15.92:0/3432465911 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc7b8004d90 msgr2=0x7fc7b8005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:14.963 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.947+0000 7fc7ce7fc700 1 --2- 172.21.15.92:0/3432465911 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc7b8004d90 0x7fc7b8005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:14.964 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.947+0000 7fc7ce7fc700 1 -- 172.21.15.92:0/3432465911 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b80035b0 con 0x7fc7b8003f70 2023-08-26T09:25:14.964 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.947+0000 7fc7cf7fe700 1 --2- 172.21.15.92:0/3432465911 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc7b8004d90 0x7fc7b8005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:14.964 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.947+0000 7fc7ce7fc700 1 --2- 172.21.15.92:0/3432465911 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7b8003f70 0x7fc7b8004850 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc7c000c2f0 tx=0x7fc7b8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cdccabed394c4a8 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:14.964 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.947+0000 7fc7cdffb700 1 -- 172.21.15.92:0/3432465911 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c000cd70 con 0x7fc7b8003f70 2023-08-26T09:25:14.964 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.947+0000 7fc7cdffb700 1 -- 172.21.15.92:0/3432465911 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c0005960 con 0x7fc7b8003f70 2023-08-26T09:25:14.965 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.947+0000 7fc7cdffb700 1 -- 172.21.15.92:0/3432465911 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c0005d10 con 0x7fc7b8003f70 2023-08-26T09:25:14.965 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.948+0000 7fc7d58cb700 1 -- 172.21.15.92:0/3432465911 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7b8003f70 msgr2=0x7fc7b8004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:14.965 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.948+0000 7fc7d58cb700 1 --2- 172.21.15.92:0/3432465911 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7b8003f70 0x7fc7b8004850 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc7c000c2f0 tx=0x7fc7b8005880 comp rx=0 tx=0).stop 2023-08-26T09:25:14.965 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.948+0000 7fc7cf7fe700 1 -- 172.21.15.92:0/3432465911 reap_dead start 2023-08-26T09:25:14.965 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.948+0000 7fc7d58cb700 1 -- 172.21.15.92:0/3432465911 shutdown_connections 2023-08-26T09:25:14.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.948+0000 7fc7d58cb700 1 -- 172.21.15.92:0/3432465911 >> 172.21.15.92:0/3432465911 conn(0x7fc7d00cfab0 msgr2=0x7fc7d00cfec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:14.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.948+0000 7fc7d58cb700 1 -- 172.21.15.92:0/3432465911 shutdown_connections 2023-08-26T09:25:14.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.948+0000 7fc7d58cb700 1 -- 172.21.15.92:0/3432465911 wait complete. 2023-08-26T09:25:14.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.949+0000 7fc7d58cb700 1 Processor -- start 2023-08-26T09:25:14.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.949+0000 7fc7d58cb700 1 -- start start 2023-08-26T09:25:14.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.950+0000 7fc7d58cb700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc7b8003f70 0x7fc7d0151060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:14.967 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.950+0000 7fc7d58cb700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7d00c9880 0x7fc7d015b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:14.967 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.950+0000 7fc7d58cb700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc7d01f2a80 0x7fc7d01f2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:14.967 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.950+0000 7fc7d58cb700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d01515a0 con 0x7fc7d00c9880 2023-08-26T09:25:14.967 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.950+0000 7fc7d58cb700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d015ba40 con 0x7fc7b8003f70 2023-08-26T09:25:14.967 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.950+0000 7fc7d58cb700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d015bd20 con 0x7fc7d01f2a80 2023-08-26T09:25:14.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.950+0000 7fc7ce7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7d00c9880 0x7fc7d015b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:14.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.950+0000 7fc7ce7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7d00c9880 0x7fc7d015b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44372/0 (socket says 172.21.15.92:44372) 2023-08-26T09:25:14.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.950+0000 7fc7ce7fc700 1 -- 172.21.15.92:0/3549311175 learned_addr learned my addr 172.21.15.92:0/3549311175 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:14.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.950+0000 7fc7ce7fc700 1 -- 172.21.15.92:0/3549311175 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc7d01f2a80 msgr2=0x7fc7d01f2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:14.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.950+0000 7fc7ce7fc700 1 --2- 172.21.15.92:0/3549311175 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc7d01f2a80 0x7fc7d01f2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:14.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.950+0000 7fc7ce7fc700 1 -- 172.21.15.92:0/3549311175 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc7b8003f70 msgr2=0x7fc7d0151060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:14.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.950+0000 7fc7ce7fc700 1 --2- 172.21.15.92:0/3549311175 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc7b8003f70 0x7fc7d0151060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:14.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.950+0000 7fc7ce7fc700 1 -- 172.21.15.92:0/3549311175 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d0152110 con 0x7fc7d00c9880 2023-08-26T09:25:14.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.950+0000 7fc7ce7fc700 1 --2- 172.21.15.92:0/3549311175 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7d00c9880 0x7fc7d015b210 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc7b800ba40 tx=0x7fc7c0001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:14.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.950+0000 7fc7b7fff700 1 -- 172.21.15.92:0/3549311175 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c0004a80 con 0x7fc7d00c9880 2023-08-26T09:25:14.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.950+0000 7fc7b7fff700 1 -- 172.21.15.92:0/3549311175 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c0004be0 con 0x7fc7d00c9880 2023-08-26T09:25:14.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.950+0000 7fc7b7fff700 1 -- 172.21.15.92:0/3549311175 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c0004d90 con 0x7fc7d00c9880 2023-08-26T09:25:14.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.951+0000 7fc7d58cb700 1 -- 172.21.15.92:0/3549311175 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7d01523f0 con 0x7fc7d00c9880 2023-08-26T09:25:14.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.951+0000 7fc7d58cb700 1 -- 172.21.15.92:0/3549311175 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7d00cb280 con 0x7fc7d00c9880 2023-08-26T09:25:14.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.951+0000 7fc7d58cb700 1 -- 172.21.15.92:0/3549311175 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7d004e660 con 0x7fc7d00c9880 2023-08-26T09:25:14.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.952+0000 7fc7b7fff700 1 -- 172.21.15.92:0/3549311175 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc7c00070d0 con 0x7fc7d00c9880 2023-08-26T09:25:14.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.952+0000 7fc7b7fff700 1 --2- 172.21.15.92:0/3549311175 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fc7bc06a0e0 0x7fc7bc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:14.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.952+0000 7fc7ceffd700 1 --2- 172.21.15.92:0/3549311175 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fc7bc06a0e0 0x7fc7bc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:14.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.952+0000 7fc7b7fff700 1 -- 172.21.15.92:0/3549311175 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc7c0089b50 con 0x7fc7d00c9880 2023-08-26T09:25:14.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.953+0000 7fc7ceffd700 1 --2- 172.21.15.92:0/3549311175 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fc7bc06a0e0 0x7fc7bc06c5a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc7d00b84e0 tx=0x7fc7c4009670 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:14.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:14.957+0000 7fc7b7fff700 1 -- 172.21.15.92:0/3549311175 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc7c00552f0 con 0x7fc7d00c9880 2023-08-26T09:25:15.156 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.151+0000 7fc7d58cb700 1 -- 172.21.15.92:0/3549311175 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7d00d12e0 con 0x7fc7d00c9880 2023-08-26T09:25:15.157 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.152+0000 7fc7b7fff700 1 -- 172.21.15.92:0/3549311175 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+18222 (secure 0 0 0) 0x7fc7c0007da0 con 0x7fc7d00c9880 2023-08-26T09:25:15.157 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:25:15.158 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"fsid":"254a2d31-bd41-4507-8326-1b205ac24377","created":"2023-08-26T09:24:55.352131+0000","modified":"2023-08-26T09:25:13.850873+0000","last_up_change":"2023-08-26T09:25:06.124496+0000","last_in_change":"2023-08-26T09:24:57.840725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-26T09:25:06.650431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-26T09:25:06.973382+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-26T09:25:11.584141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-26T09:25:12.814990+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e9e7638-4459-4d8d-8e40-130bcf48df66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6819","nonce":382827192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6824","nonce":382827192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6831","nonce":382827192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6827","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6829","nonce":382827192}]},"public_addr":"172.21.15.92:6819/382827192","cluster_addr":"172.21.15.92:6824/382827192","heartbeat_back_addr":"172.21.15.92:6831/382827192","heartbeat_front_addr":"172.21.15.92:6829/382827192","state":["exists","up"]},{"osd":1,"uuid":"164e68c9-aedd-4df5-9b70-f4b1ec3bda13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6809","nonce":618773438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6811","nonce":618773438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6815","nonce":618773438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6813","nonce":618773438}]},"public_addr":"172.21.15.92:6809/618773438","cluster_addr":"172.21.15.92:6811/618773438","heartbeat_back_addr":"172.21.15.92:6815/618773438","heartbeat_front_addr":"172.21.15.92:6813/618773438","state":["exists","up"]},{"osd":2,"uuid":"8701dfee-629a-4d30-82e4-b8fac340303f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6818","nonce":3697397687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6821","nonce":3697397687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6828","nonce":3697397687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6823","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6825","nonce":3697397687}]},"public_addr":"172.21.15.92:6818/3697397687","cluster_addr":"172.21.15.92:6821/3697397687","heartbeat_back_addr":"172.21.15.92:6828/3697397687","heartbeat_front_addr":"172.21.15.92:6825/3697397687","state":["exists","up"]},{"osd":3,"uuid":"93bdc94d-dc07-495f-995a-a6ad072f0247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6801","nonce":3579846453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6803","nonce":3579846453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6807","nonce":3579846453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6805","nonce":3579846453}]},"public_addr":"172.21.15.92:6801/3579846453","cluster_addr":"172.21.15.92:6803/3579846453","heartbeat_back_addr":"172.21.15.92:6807/3579846453","heartbeat_front_addr":"172.21.15.92:6805/3579846453","state":["exists","up"]},{"osd":4,"uuid":"d9d0ea80-8481-46a7-9677-c338d32cf1d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6809","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6811","nonce":3228383424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6813","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6815","nonce":3228383424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6821","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6823","nonce":3228383424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6817","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6819","nonce":3228383424}]},"public_addr":"172.21.15.188:6811/3228383424","cluster_addr":"172.21.15.188:6815/3228383424","heartbeat_back_addr":"172.21.15.188:6823/3228383424","heartbeat_front_addr":"172.21.15.188:6819/3228383424","state":["exists","up"]},{"osd":5,"uuid":"38d03253-467a-456f-bd5e-5a46532a0b18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6801","nonce":1655821054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6803","nonce":1655821054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6807","nonce":1655821054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6805","nonce":1655821054}]},"public_addr":"172.21.15.188:6801/1655821054","cluster_addr":"172.21.15.188:6803/1655821054","heartbeat_back_addr":"172.21.15.188:6807/1655821054","heartbeat_front_addr":"172.21.15.188:6805/1655821054","state":["exists","up"]},{"osd":6,"uuid":"d61564b5-136f-42e5-a843-626c2017cc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6810","nonce":2069976891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6814","nonce":2069976891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6822","nonce":2069976891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6818","nonce":2069976891}]},"public_addr":"172.21.15.188:6810/2069976891","cluster_addr":"172.21.15.188:6814/2069976891","heartbeat_back_addr":"172.21.15.188:6822/2069976891","heartbeat_front_addr":"172.21.15.188:6818/2069976891","state":["exists","up"]},{"osd":7,"uuid":"fae2949e-0d62-42cd-ba72-08f516084b20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6825","nonce":1882888860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6827","nonce":1882888860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6831","nonce":1882888860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6829","nonce":1882888860}]},"public_addr":"172.21.15.188:6825/1882888860","cluster_addr":"172.21.15.188:6827/1882888860","heartbeat_back_addr":"172.21.15.188:6831/1882888860","heartbeat_front_addr":"172.21.15.188:6829/1882888860","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.038523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.063160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.000857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.975572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.023848+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.765194+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.081365+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:05.110745+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-26T09:25:15.159 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.154+0000 7fc7d58cb700 1 -- 172.21.15.92:0/3549311175 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fc7bc06a0e0 msgr2=0x7fc7bc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:15.160 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.154+0000 7fc7d58cb700 1 --2- 172.21.15.92:0/3549311175 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fc7bc06a0e0 0x7fc7bc06c5a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc7d00b84e0 tx=0x7fc7c4009670 comp rx=0 tx=0).stop 2023-08-26T09:25:15.160 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.154+0000 7fc7d58cb700 1 -- 172.21.15.92:0/3549311175 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7d00c9880 msgr2=0x7fc7d015b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:15.160 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.154+0000 7fc7d58cb700 1 --2- 172.21.15.92:0/3549311175 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7d00c9880 0x7fc7d015b210 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc7b800ba40 tx=0x7fc7c0001a00 comp rx=0 tx=0).stop 2023-08-26T09:25:15.160 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.154+0000 7fc7d58cb700 1 -- 172.21.15.92:0/3549311175 shutdown_connections 2023-08-26T09:25:15.160 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.154+0000 7fc7d58cb700 1 --2- 172.21.15.92:0/3549311175 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fc7bc06a0e0 0x7fc7bc06c5a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:15.161 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.154+0000 7fc7d58cb700 1 --2- 172.21.15.92:0/3549311175 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc7b8003f70 0x7fc7d0151060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:15.161 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.154+0000 7fc7d58cb700 1 --2- 172.21.15.92:0/3549311175 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc7d01f2a80 0x7fc7d01f2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:15.163 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.154+0000 7fc7d58cb700 1 --2- 172.21.15.92:0/3549311175 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7d00c9880 0x7fc7d015b210 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:15.164 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.154+0000 7fc7d58cb700 1 -- 172.21.15.92:0/3549311175 >> 172.21.15.92:0/3549311175 conn(0x7fc7d00cfab0 msgr2=0x7fc7d00cdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:15.164 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.154+0000 7fc7d58cb700 1 -- 172.21.15.92:0/3549311175 shutdown_connections 2023-08-26T09:25:15.164 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.154+0000 7fc7d58cb700 1 -- 172.21.15.92:0/3549311175 wait complete. 2023-08-26T09:25:15.172 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-26T09:25:15.296 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.290+0000 7ff114922700 1 Processor -- start 2023-08-26T09:25:15.296 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.290+0000 7ff114922700 1 -- start start 2023-08-26T09:25:15.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.291+0000 7ff114922700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff1100af390 0x7ff110070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:15.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.291+0000 7ff114922700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7ff110071260 0x7ff11006a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:15.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.291+0000 7ff114922700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1100aee50 con 0x7ff11015d220 2023-08-26T09:25:15.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.291+0000 7ff114922700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1100af130 con 0x7ff1100af390 2023-08-26T09:25:15.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.291+0000 7ff114922700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1100c4cb0 con 0x7ff110071260 2023-08-26T09:25:15.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.291+0000 7ff10dd9b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff1100af390 0x7ff110070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:15.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.291+0000 7ff10dd9b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff1100af390 0x7ff110070d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44382/0 (socket says 172.21.15.92:44382) 2023-08-26T09:25:15.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.291+0000 7ff10dd9b700 1 -- 172.21.15.92:0/1927240301 learned_addr learned my addr 172.21.15.92:0/1927240301 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:15.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.291+0000 7ff10ed9d700 1 --2- 172.21.15.92:0/1927240301 >> v2:172.21.15.188:3300/0 conn(0x7ff110071260 0x7ff11006a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:15.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.291+0000 7ff10dd9b700 1 -- 172.21.15.92:0/1927240301 >> v2:172.21.15.188:3300/0 conn(0x7ff110071260 msgr2=0x7ff11006a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:15.304 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.291+0000 7ff10dd9b700 1 --2- 172.21.15.92:0/1927240301 >> v2:172.21.15.188:3300/0 conn(0x7ff110071260 0x7ff11006a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:15.304 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.291+0000 7ff10dd9b700 1 -- 172.21.15.92:0/1927240301 >> v1:172.21.15.188:6789/0 conn(0x7ff11015d220 legacy=0x7ff11006db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:15.304 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.291+0000 7ff10dd9b700 1 -- 172.21.15.92:0/1927240301 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1100c4f90 con 0x7ff1100af390 2023-08-26T09:25:15.305 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.291+0000 7ff10dd9b700 1 --2- 172.21.15.92:0/1927240301 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1100af390 0x7ff110070d20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff11006d8b0 tx=0x7ff104009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31793bbcd69db1ae server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:15.305 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.291+0000 7ff10d59a700 1 -- 172.21.15.92:0/1927240301 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10400b870 con 0x7ff1100af390 2023-08-26T09:25:15.305 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.291+0000 7ff10d59a700 1 -- 172.21.15.92:0/1927240301 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff10400b9d0 con 0x7ff1100af390 2023-08-26T09:25:15.305 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.291+0000 7ff10d59a700 1 -- 172.21.15.92:0/1927240301 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10400bd60 con 0x7ff1100af390 2023-08-26T09:25:15.306 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.292+0000 7ff114922700 1 -- 172.21.15.92:0/1927240301 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1100af390 msgr2=0x7ff110070d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:15.306 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.292+0000 7ff114922700 1 --2- 172.21.15.92:0/1927240301 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1100af390 0x7ff110070d20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff11006d8b0 tx=0x7ff104009bd0 comp rx=0 tx=0).stop 2023-08-26T09:25:15.306 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.292+0000 7ff114922700 1 -- 172.21.15.92:0/1927240301 shutdown_connections 2023-08-26T09:25:15.306 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.292+0000 7ff114922700 1 --2- 172.21.15.92:0/1927240301 >> v2:172.21.15.188:3300/0 conn(0x7ff110071260 0x7ff11006a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:15.306 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.292+0000 7ff114922700 1 --2- 172.21.15.92:0/1927240301 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1100af390 0x7ff110070d20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:15.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.292+0000 7ff114922700 1 -- 172.21.15.92:0/1927240301 >> 172.21.15.92:0/1927240301 conn(0x7ff11006b430 msgr2=0x7ff11006b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:15.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.292+0000 7ff114922700 1 -- 172.21.15.92:0/1927240301 shutdown_connections 2023-08-26T09:25:15.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.292+0000 7ff114922700 1 -- 172.21.15.92:0/1927240301 wait complete. 2023-08-26T09:25:15.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.293+0000 7ff114922700 1 Processor -- start 2023-08-26T09:25:15.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.293+0000 7ff114922700 1 -- start start 2023-08-26T09:25:15.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.294+0000 7ff114922700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff110071260 0x7ff1100cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:15.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.294+0000 7ff114922700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff1100af390 0x7ff110146d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:15.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.294+0000 7ff114922700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff11015d220 0x7ff1101437b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:15.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.294+0000 7ff114922700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1101f6a00 con 0x7ff110071260 2023-08-26T09:25:15.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.294+0000 7ff114922700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff110157430 con 0x7ff1100af390 2023-08-26T09:25:15.309 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.294+0000 7ff114922700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff110143cf0 con 0x7ff11015d220 2023-08-26T09:25:15.309 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.294+0000 7ff10e59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff110071260 0x7ff1100cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:15.309 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.294+0000 7ff10e59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff110071260 0x7ff1100cbff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44388/0 (socket says 172.21.15.92:44388) 2023-08-26T09:25:15.309 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.294+0000 7ff10e59c700 1 -- 172.21.15.92:0/2781250231 learned_addr learned my addr 172.21.15.92:0/2781250231 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:15.310 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.294+0000 7ff10dd9b700 1 --2- 172.21.15.92:0/2781250231 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff1100af390 0x7ff110146d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:15.310 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.294+0000 7ff10ed9d700 1 --2- 172.21.15.92:0/2781250231 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff11015d220 0x7ff1101437b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:15.310 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.294+0000 7ff10e59c700 1 -- 172.21.15.92:0/2781250231 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff11015d220 msgr2=0x7ff1101437b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:15.310 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.294+0000 7ff10e59c700 1 --2- 172.21.15.92:0/2781250231 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff11015d220 0x7ff1101437b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:15.310 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.294+0000 7ff10e59c700 1 -- 172.21.15.92:0/2781250231 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff1100af390 msgr2=0x7ff110146d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:15.311 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.294+0000 7ff10e59c700 1 --2- 172.21.15.92:0/2781250231 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff1100af390 0x7ff110146d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:15.311 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.294+0000 7ff10e59c700 1 -- 172.21.15.92:0/2781250231 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff104009550 con 0x7ff110071260 2023-08-26T09:25:15.311 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.294+0000 7ff10ed9d700 1 --2- 172.21.15.92:0/2781250231 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff11015d220 0x7ff1101437b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:15.311 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.295+0000 7ff10e59c700 1 --2- 172.21.15.92:0/2781250231 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff110071260 0x7ff1100cbff0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff10000c430 tx=0x7ff10000c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:15.311 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.295+0000 7ff0feffd700 1 -- 172.21.15.92:0/2781250231 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1000052d0 con 0x7ff110071260 2023-08-26T09:25:15.312 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.295+0000 7ff0feffd700 1 -- 172.21.15.92:0/2781250231 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff100005450 con 0x7ff110071260 2023-08-26T09:25:15.312 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.295+0000 7ff114922700 1 -- 172.21.15.92:0/2781250231 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1101f6440 con 0x7ff110071260 2023-08-26T09:25:15.312 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.295+0000 7ff0feffd700 1 -- 172.21.15.92:0/2781250231 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff100006aa0 con 0x7ff110071260 2023-08-26T09:25:15.312 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.295+0000 7ff114922700 1 -- 172.21.15.92:0/2781250231 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff110154170 con 0x7ff110071260 2023-08-26T09:25:15.312 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.296+0000 7ff114922700 1 -- 172.21.15.92:0/2781250231 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff110153fd0 con 0x7ff110071260 2023-08-26T09:25:15.314 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.296+0000 7ff0feffd700 1 -- 172.21.15.92:0/2781250231 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff100003680 con 0x7ff110071260 2023-08-26T09:25:15.314 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.297+0000 7ff0feffd700 1 --2- 172.21.15.92:0/2781250231 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7ff0f006a0e0 0x7ff0f006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:15.314 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.297+0000 7ff0feffd700 1 -- 172.21.15.92:0/2781250231 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff100087690 con 0x7ff110071260 2023-08-26T09:25:15.314 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.297+0000 7ff10dd9b700 1 --2- 172.21.15.92:0/2781250231 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7ff0f006a0e0 0x7ff0f006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:15.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.297+0000 7ff10dd9b700 1 --2- 172.21.15.92:0/2781250231 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7ff0f006a0e0 0x7ff0f006c5a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff104000c00 tx=0x7ff104008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:15.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.301+0000 7ff0feffd700 1 -- 172.21.15.92:0/2781250231 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff110153fd0 con 0x7ff110071260 2023-08-26T09:25:15.541 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:15.536+0000 7ff114922700 1 -- 172.21.15.92:0/2781250231 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff110153fd0 con 0x7ff110071260 2023-08-26T09:25:16.487 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.482+0000 7ff0feffd700 1 -- 172.21.15.92:0/2781250231 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff110153fd0 con 0x7ff110071260 2023-08-26T09:25:16.490 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.485+0000 7ff114922700 1 -- 172.21.15.92:0/2781250231 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7ff0f006a0e0 msgr2=0x7ff0f006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:16.491 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.485+0000 7ff114922700 1 --2- 172.21.15.92:0/2781250231 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7ff0f006a0e0 0x7ff0f006c5a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff104000c00 tx=0x7ff104008030 comp rx=0 tx=0).stop 2023-08-26T09:25:16.491 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.485+0000 7ff114922700 1 -- 172.21.15.92:0/2781250231 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff110071260 msgr2=0x7ff1100cbff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:16.491 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.485+0000 7ff114922700 1 --2- 172.21.15.92:0/2781250231 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff110071260 0x7ff1100cbff0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff10000c430 tx=0x7ff10000c740 comp rx=0 tx=0).stop 2023-08-26T09:25:16.491 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.485+0000 7ff114922700 1 -- 172.21.15.92:0/2781250231 shutdown_connections 2023-08-26T09:25:16.491 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.485+0000 7ff114922700 1 --2- 172.21.15.92:0/2781250231 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff11015d220 0x7ff1101437b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:16.492 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.485+0000 7ff114922700 1 --2- 172.21.15.92:0/2781250231 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff110071260 0x7ff1100cbff0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:16.492 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.485+0000 7ff114922700 1 --2- 172.21.15.92:0/2781250231 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7ff0f006a0e0 0x7ff0f006c5a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:16.492 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.485+0000 7ff114922700 1 --2- 172.21.15.92:0/2781250231 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff1100af390 0x7ff110146d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:16.492 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.485+0000 7ff114922700 1 -- 172.21.15.92:0/2781250231 >> 172.21.15.92:0/2781250231 conn(0x7ff11006b430 msgr2=0x7ff1100732c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:16.492 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.485+0000 7ff114922700 1 -- 172.21.15.92:0/2781250231 shutdown_connections 2023-08-26T09:25:16.493 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.485+0000 7ff114922700 1 -- 172.21.15.92:0/2781250231 wait complete. 2023-08-26T09:25:16.505 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-26T09:25:16.506 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-26T09:25:16.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.629+0000 7f10fa0f8700 1 Processor -- start 2023-08-26T09:25:16.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.629+0000 7f10fa0f8700 1 -- start start 2023-08-26T09:25:16.637 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.629+0000 7f10fa0f8700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f10f415d220 0x7f10f40af390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:16.637 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.630+0000 7f10fa0f8700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f10f4071430 0x7f10f406a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:16.637 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.630+0000 7f10fa0f8700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10f40718c0 con 0x7f10f406db70 2023-08-26T09:25:16.637 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.630+0000 7f10fa0f8700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10f40aee50 con 0x7f10f415d220 2023-08-26T09:25:16.637 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.630+0000 7f10fa0f8700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f40af130 con 0x7f10f4071430 2023-08-26T09:25:16.638 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.630+0000 7f10f37fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f10f415d220 0x7f10f40af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:16.638 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.630+0000 7f10f37fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f10f415d220 0x7f10f40af390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44394/0 (socket says 172.21.15.92:44394) 2023-08-26T09:25:16.638 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.630+0000 7f10f37fe700 1 -- 172.21.15.92:0/2649074302 learned_addr learned my addr 172.21.15.92:0/2649074302 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:16.638 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.630+0000 7f10f37fe700 1 -- 172.21.15.92:0/2649074302 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f10f4071430 msgr2=0x7f10f406a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:16.638 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.630+0000 7f10f37fe700 1 --2- 172.21.15.92:0/2649074302 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f10f4071430 0x7f10f406a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:16.639 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.630+0000 7f10f37fe700 1 -- 172.21.15.92:0/2649074302 >> v1:172.21.15.188:6789/0 conn(0x7f10f406db70 legacy=0x7f10f4070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:16.640 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.630+0000 7f10f37fe700 1 -- 172.21.15.92:0/2649074302 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f40c4cb0 con 0x7f10f415d220 2023-08-26T09:25:16.640 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.630+0000 7f10f37fe700 1 --2- 172.21.15.92:0/2649074302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10f415d220 0x7f10f40af390 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f10e40098f0 tx=0x7f10e4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a9385adac0e11ce server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:16.640 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.630+0000 7f10f27fc700 1 -- 172.21.15.92:0/2649074302 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e4004230 con 0x7f10f415d220 2023-08-26T09:25:16.640 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.630+0000 7f10f27fc700 1 -- 172.21.15.92:0/2649074302 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e4004390 con 0x7f10f415d220 2023-08-26T09:25:16.640 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.630+0000 7f10f27fc700 1 -- 172.21.15.92:0/2649074302 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e40036a0 con 0x7f10f415d220 2023-08-26T09:25:16.641 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.631+0000 7f10fa0f8700 1 -- 172.21.15.92:0/2649074302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10f415d220 msgr2=0x7f10f40af390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:16.641 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.631+0000 7f10fa0f8700 1 --2- 172.21.15.92:0/2649074302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10f415d220 0x7f10f40af390 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f10e40098f0 tx=0x7f10e4009c00 comp rx=0 tx=0).stop 2023-08-26T09:25:16.641 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.631+0000 7f10fa0f8700 1 -- 172.21.15.92:0/2649074302 shutdown_connections 2023-08-26T09:25:16.641 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.631+0000 7f10fa0f8700 1 --2- 172.21.15.92:0/2649074302 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f10f4071430 0x7f10f406a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:16.641 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.631+0000 7f10fa0f8700 1 --2- 172.21.15.92:0/2649074302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10f415d220 0x7f10f40af390 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:16.642 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.631+0000 7f10fa0f8700 1 -- 172.21.15.92:0/2649074302 >> 172.21.15.92:0/2649074302 conn(0x7f10f406b430 msgr2=0x7f10f406b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:16.642 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.631+0000 7f10fa0f8700 1 -- 172.21.15.92:0/2649074302 shutdown_connections 2023-08-26T09:25:16.642 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.631+0000 7f10fa0f8700 1 -- 172.21.15.92:0/2649074302 wait complete. 2023-08-26T09:25:16.645 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.632+0000 7f10fa0f8700 1 Processor -- start 2023-08-26T09:25:16.646 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.633+0000 7f10fa0f8700 1 -- start start 2023-08-26T09:25:16.646 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.633+0000 7f10fa0f8700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f10f406db70 0x7f10f4145db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:16.646 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.633+0000 7f10fa0f8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10f4071430 0x7f10f40b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:16.646 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.633+0000 7f10fa0f8700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f10f415d220 0x7f10f40b4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:16.646 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.633+0000 7f10fa0f8700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f415b760 con 0x7f10f4071430 2023-08-26T09:25:16.647 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.633+0000 7f10fa0f8700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f415b480 con 0x7f10f415d220 2023-08-26T09:25:16.647 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.633+0000 7f10fa0f8700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f4146600 con 0x7f10f406db70 2023-08-26T09:25:16.647 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.633+0000 7f10f2ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10f4071430 0x7f10f40b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:16.647 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.634+0000 7f10f2ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10f4071430 0x7f10f40b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44402/0 (socket says 172.21.15.92:44402) 2023-08-26T09:25:16.647 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.634+0000 7f10f2ffd700 1 -- 172.21.15.92:0/2511770354 learned_addr learned my addr 172.21.15.92:0/2511770354 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:16.648 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.634+0000 7f10f37fe700 1 --2- 172.21.15.92:0/2511770354 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f10f406db70 0x7f10f4145db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:16.648 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.634+0000 7f10f3fff700 1 --2- 172.21.15.92:0/2511770354 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f10f415d220 0x7f10f40b4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:16.648 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.634+0000 7f10f2ffd700 1 -- 172.21.15.92:0/2511770354 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f10f406db70 msgr2=0x7f10f4145db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:16.648 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.634+0000 7f10f2ffd700 1 --2- 172.21.15.92:0/2511770354 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f10f406db70 0x7f10f4145db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:16.648 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.634+0000 7f10f2ffd700 1 -- 172.21.15.92:0/2511770354 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f10f415d220 msgr2=0x7f10f40b4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:16.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.634+0000 7f10f2ffd700 1 --2- 172.21.15.92:0/2511770354 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f10f415d220 0x7f10f40b4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:16.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.634+0000 7f10f2ffd700 1 -- 172.21.15.92:0/2511770354 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e4009550 con 0x7f10f4071430 2023-08-26T09:25:16.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.634+0000 7f10f2ffd700 1 --2- 172.21.15.92:0/2511770354 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10f4071430 0x7f10f40b47d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f10e800c4a0 tx=0x7f10e800c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:16.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.634+0000 7f10dbfff700 1 -- 172.21.15.92:0/2511770354 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e80054e0 con 0x7f10f4071430 2023-08-26T09:25:16.651 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.634+0000 7f10dbfff700 1 -- 172.21.15.92:0/2511770354 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e8003680 con 0x7f10f4071430 2023-08-26T09:25:16.651 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.634+0000 7f10fa0f8700 1 -- 172.21.15.92:0/2511770354 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10f41468e0 con 0x7f10f4071430 2023-08-26T09:25:16.651 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.634+0000 7f10dbfff700 1 -- 172.21.15.92:0/2511770354 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e8003a30 con 0x7f10f4071430 2023-08-26T09:25:16.651 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.634+0000 7f10fa0f8700 1 -- 172.21.15.92:0/2511770354 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10f415a7c0 con 0x7f10f4071430 2023-08-26T09:25:16.652 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.635+0000 7f10fa0f8700 1 -- 172.21.15.92:0/2511770354 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10f404eeb0 con 0x7f10f4071430 2023-08-26T09:25:16.652 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.635+0000 7f10dbfff700 1 -- 172.21.15.92:0/2511770354 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f10e8003b90 con 0x7f10f4071430 2023-08-26T09:25:16.652 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.636+0000 7f10dbfff700 1 --2- 172.21.15.92:0/2511770354 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f10e006a0e0 0x7f10e006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:16.652 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.636+0000 7f10dbfff700 1 -- 172.21.15.92:0/2511770354 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f10e80878e0 con 0x7f10f4071430 2023-08-26T09:25:16.652 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.636+0000 7f10f37fe700 1 --2- 172.21.15.92:0/2511770354 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f10e006a0e0 0x7f10e006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:16.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.636+0000 7f10f37fe700 1 --2- 172.21.15.92:0/2511770354 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f10e006a0e0 0x7f10e006c5a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f10e4009130 tx=0x7f10e4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:16.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.640+0000 7f10dbfff700 1 -- 172.21.15.92:0/2511770354 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f10e8053060 con 0x7f10f4071430 2023-08-26T09:25:16.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:16.873+0000 7f10fa0f8700 1 -- 172.21.15.92:0/2511770354 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f10f4161ad0 con 0x7f10f4071430 2023-08-26T09:25:17.492 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.487+0000 7f10dbfff700 1 -- 172.21.15.92:0/2511770354 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7f10e80170c0 con 0x7f10f4071430 2023-08-26T09:25:17.495 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.489+0000 7f10fa0f8700 1 -- 172.21.15.92:0/2511770354 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f10e006a0e0 msgr2=0x7f10e006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:17.495 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.489+0000 7f10fa0f8700 1 --2- 172.21.15.92:0/2511770354 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f10e006a0e0 0x7f10e006c5a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f10e4009130 tx=0x7f10e4008030 comp rx=0 tx=0).stop 2023-08-26T09:25:17.495 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.489+0000 7f10fa0f8700 1 -- 172.21.15.92:0/2511770354 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10f4071430 msgr2=0x7f10f40b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:17.496 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.489+0000 7f10fa0f8700 1 --2- 172.21.15.92:0/2511770354 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10f4071430 0x7f10f40b47d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f10e800c4a0 tx=0x7f10e800c7b0 comp rx=0 tx=0).stop 2023-08-26T09:25:17.496 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.489+0000 7f10fa0f8700 1 -- 172.21.15.92:0/2511770354 shutdown_connections 2023-08-26T09:25:17.496 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.489+0000 7f10fa0f8700 1 --2- 172.21.15.92:0/2511770354 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f10e006a0e0 0x7f10e006c5a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:17.496 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.489+0000 7f10fa0f8700 1 --2- 172.21.15.92:0/2511770354 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f10f415d220 0x7f10f40b4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:17.497 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.489+0000 7f10fa0f8700 1 --2- 172.21.15.92:0/2511770354 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f10f406db70 0x7f10f4145db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:17.497 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.489+0000 7f10fa0f8700 1 --2- 172.21.15.92:0/2511770354 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10f4071430 0x7f10f40b47d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:17.497 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.489+0000 7f10fa0f8700 1 -- 172.21.15.92:0/2511770354 >> 172.21.15.92:0/2511770354 conn(0x7f10f406b430 msgr2=0x7f10f40cd890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:17.497 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.489+0000 7f10fa0f8700 1 -- 172.21.15.92:0/2511770354 shutdown_connections 2023-08-26T09:25:17.498 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.489+0000 7f10fa0f8700 1 -- 172.21.15.92:0/2511770354 wait complete. 2023-08-26T09:25:17.507 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-26T09:25:17.508 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-26T09:25:17.629 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.624+0000 7f753cfa2700 1 Processor -- start 2023-08-26T09:25:17.629 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.624+0000 7f753cfa2700 1 -- start start 2023-08-26T09:25:17.633 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.625+0000 7f753cfa2700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f753815eae0 0x7f75380c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:17.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.625+0000 7f753cfa2700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75380cbb50 con 0x7f75380d1a60 2023-08-26T09:25:17.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.625+0000 7f753cfa2700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75380cffb0 con 0x7f75380cd8e0 2023-08-26T09:25:17.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.625+0000 7f753cfa2700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75380cbe10 con 0x7f753815eae0 2023-08-26T09:25:17.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.625+0000 7f7535d9b700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f75380d1a60 0x7f75380cc2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:56424/0 (socket says 172.21.15.92:56424) 2023-08-26T09:25:17.635 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.625+0000 7f7535d9b700 1 -- 172.21.15.92:0/544998629 learned_addr learned my addr 172.21.15.92:0/544998629 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:17.635 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.625+0000 7f7536d9d700 1 --2- 172.21.15.92:0/544998629 >> v2:172.21.15.188:3300/0 conn(0x7f753815eae0 0x7f75380c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:17.635 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.625+0000 7f753559a700 1 -- 172.21.15.92:0/544998629 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2547947144 0 0) 0x7f75380cbb50 con 0x7f75380d1a60 2023-08-26T09:25:17.635 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.625+0000 7f753559a700 1 -- 172.21.15.92:0/544998629 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75200035b0 con 0x7f75380d1a60 2023-08-26T09:25:17.636 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.625+0000 7f753559a700 1 -- 172.21.15.92:0/544998629 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2286629163 0 0) 0x7f75200035b0 con 0x7f75380d1a60 2023-08-26T09:25:17.636 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.625+0000 7f753559a700 1 -- 172.21.15.92:0/544998629 >> v2:172.21.15.188:3300/0 conn(0x7f753815eae0 msgr2=0x7f75380c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:17.636 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.625+0000 7f753559a700 1 --2- 172.21.15.92:0/544998629 >> v2:172.21.15.188:3300/0 conn(0x7f753815eae0 0x7f75380c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:17.636 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.625+0000 7f753559a700 1 -- 172.21.15.92:0/544998629 >> v1:172.21.15.188:6789/0 conn(0x7f75380cd8e0 legacy=0x7f753815e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:17.637 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.625+0000 7f753559a700 1 -- 172.21.15.92:0/544998629 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75380cf730 con 0x7f75380d1a60 2023-08-26T09:25:17.637 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.625+0000 7f753559a700 1 -- 172.21.15.92:0/544998629 <== mon.0 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1019361464 0 0) 0x7f752c001670 con 0x7f75380d1a60 2023-08-26T09:25:17.637 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.625+0000 7f753559a700 1 -- 172.21.15.92:0/544998629 >> v1:172.21.15.92:6789/0 conn(0x7f75380d1a60 legacy=0x7f75380cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:17.637 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.625+0000 7f753559a700 1 --2- 172.21.15.92:0/544998629 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7520003a00 0x7f7520003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:17.638 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.625+0000 7f753559a700 1 --2- 172.21.15.92:0/544998629 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7520004850 0x7f7520004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:17.638 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.625+0000 7f753559a700 1 --2- 172.21.15.92:0/544998629 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7520005210 0x7f752000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:17.638 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.625+0000 7f753559a700 1 -- 172.21.15.92:0/544998629 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75380cbe10 con 0x7f7520005210 2023-08-26T09:25:17.638 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.625+0000 7f753559a700 1 -- 172.21.15.92:0/544998629 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752000c0b0 con 0x7f7520004850 2023-08-26T09:25:17.639 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.625+0000 7f753559a700 1 -- 172.21.15.92:0/544998629 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f752000c270 con 0x7f7520003a00 2023-08-26T09:25:17.639 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.626+0000 7f7536d9d700 1 --2- 172.21.15.92:0/544998629 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7520005210 0x7f752000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:17.639 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.626+0000 7f753659c700 1 --2- 172.21.15.92:0/544998629 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7520003a00 0x7f7520003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:17.639 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.626+0000 7f7535d9b700 1 --2- 172.21.15.92:0/544998629 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7520004850 0x7f7520004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:17.639 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.626+0000 7f7536d9d700 1 -- 172.21.15.92:0/544998629 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7520003a00 msgr2=0x7f7520003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:17.640 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.626+0000 7f7536d9d700 1 --2- 172.21.15.92:0/544998629 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7520003a00 0x7f7520003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:17.640 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.626+0000 7f7536d9d700 1 -- 172.21.15.92:0/544998629 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7520004850 msgr2=0x7f7520004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:17.640 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.626+0000 7f7536d9d700 1 --2- 172.21.15.92:0/544998629 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7520004850 0x7f7520004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:17.640 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.626+0000 7f7536d9d700 1 -- 172.21.15.92:0/544998629 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75200035b0 con 0x7f7520005210 2023-08-26T09:25:17.640 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.626+0000 7f753659c700 1 --2- 172.21.15.92:0/544998629 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7520003a00 0x7f7520003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:17.641 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.626+0000 7f7536d9d700 1 -- 172.21.15.92:0/544998629 reap_dead start 2023-08-26T09:25:17.641 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.626+0000 7f7536d9d700 1 --2- 172.21.15.92:0/544998629 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7520005210 0x7f752000ba10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7530009fc0 tx=0x7f7520005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aebbd7d221bf9920 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:17.641 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.626+0000 7f753559a700 1 -- 172.21.15.92:0/544998629 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7530003a20 con 0x7f7520005210 2023-08-26T09:25:17.641 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.626+0000 7f753559a700 1 -- 172.21.15.92:0/544998629 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f753000f040 con 0x7f7520005210 2023-08-26T09:25:17.641 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.626+0000 7f753559a700 1 -- 172.21.15.92:0/544998629 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7530003da0 con 0x7f7520005210 2023-08-26T09:25:17.642 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.626+0000 7f753cfa2700 1 -- 172.21.15.92:0/544998629 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7520005210 msgr2=0x7f752000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:17.642 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.626+0000 7f753cfa2700 1 --2- 172.21.15.92:0/544998629 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7520005210 0x7f752000ba10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7530009fc0 tx=0x7f7520005880 comp rx=0 tx=0).stop 2023-08-26T09:25:17.642 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.627+0000 7f753cfa2700 1 -- 172.21.15.92:0/544998629 shutdown_connections 2023-08-26T09:25:17.642 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.627+0000 7f753cfa2700 1 --2- 172.21.15.92:0/544998629 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7520005210 0x7f752000ba10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:17.642 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.627+0000 7f753cfa2700 1 -- 172.21.15.92:0/544998629 >> 172.21.15.92:0/544998629 conn(0x7f75380d0f40 msgr2=0x7f75380d1350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:17.643 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.627+0000 7f753cfa2700 1 -- 172.21.15.92:0/544998629 shutdown_connections 2023-08-26T09:25:17.643 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.627+0000 7f753cfa2700 1 -- 172.21.15.92:0/544998629 wait complete. 2023-08-26T09:25:17.643 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.628+0000 7f753cfa2700 1 Processor -- start 2023-08-26T09:25:17.643 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.628+0000 7f753cfa2700 1 -- start start 2023-08-26T09:25:17.645 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.629+0000 7f753cfa2700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7520005210 0x7f753814b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:17.646 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.629+0000 7f753cfa2700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f75380b1510 0x7f75380b2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:17.646 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.629+0000 7f753cfa2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75380b3150 0x7f75380af720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:17.646 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.629+0000 7f753cfa2700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75380b35d0 con 0x7f75380b3150 2023-08-26T09:25:17.646 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.629+0000 7f753cfa2700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75380addc0 con 0x7f75380b1510 2023-08-26T09:25:17.646 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.629+0000 7f753cfa2700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75380b1080 con 0x7f7520005210 2023-08-26T09:25:17.647 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.629+0000 7f7536d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75380b3150 0x7f75380af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:17.647 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.629+0000 7f7536d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75380b3150 0x7f75380af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44424/0 (socket says 172.21.15.92:44424) 2023-08-26T09:25:17.647 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.629+0000 7f7536d9d700 1 -- 172.21.15.92:0/226222718 learned_addr learned my addr 172.21.15.92:0/226222718 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:17.647 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.629+0000 7f7535d9b700 1 --2- 172.21.15.92:0/226222718 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f75380b1510 0x7f75380b2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:17.647 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.629+0000 7f7536d9d700 1 -- 172.21.15.92:0/226222718 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7520005210 msgr2=0x7f753814b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:17.648 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.629+0000 7f7536d9d700 1 --2- 172.21.15.92:0/226222718 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7520005210 0x7f753814b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:17.648 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.629+0000 7f7536d9d700 1 -- 172.21.15.92:0/226222718 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f75380b1510 msgr2=0x7f75380b2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:17.648 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.629+0000 7f7536d9d700 1 --2- 172.21.15.92:0/226222718 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f75380b1510 0x7f75380b2c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:17.648 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.629+0000 7f7536d9d700 1 -- 172.21.15.92:0/226222718 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75380b0470 con 0x7f75380b3150 2023-08-26T09:25:17.648 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.629+0000 7f7536d9d700 1 --2- 172.21.15.92:0/226222718 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75380b3150 0x7f75380af720 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f753808b3b0 tx=0x7f7530009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:17.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.629+0000 7f7526ffd700 1 -- 172.21.15.92:0/226222718 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7530003e10 con 0x7f75380b3150 2023-08-26T09:25:17.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.629+0000 7f7526ffd700 1 -- 172.21.15.92:0/226222718 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7530004230 con 0x7f75380b3150 2023-08-26T09:25:17.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.629+0000 7f7526ffd700 1 -- 172.21.15.92:0/226222718 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75300045e0 con 0x7f75380b3150 2023-08-26T09:25:17.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.629+0000 7f753cfa2700 1 -- 172.21.15.92:0/226222718 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75380b0750 con 0x7f75380b3150 2023-08-26T09:25:17.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.630+0000 7f753cfa2700 1 -- 172.21.15.92:0/226222718 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75380b0d10 con 0x7f75380b3150 2023-08-26T09:25:17.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.631+0000 7f753cfa2700 1 -- 172.21.15.92:0/226222718 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75380b0ed0 con 0x7f75380b3150 2023-08-26T09:25:17.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.631+0000 7f7526ffd700 1 -- 172.21.15.92:0/226222718 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7530024070 con 0x7f75380b3150 2023-08-26T09:25:17.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.631+0000 7f7526ffd700 1 --2- 172.21.15.92:0/226222718 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f751806a0e0 0x7f751806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:17.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.631+0000 7f753659c700 1 --2- 172.21.15.92:0/226222718 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f751806a0e0 0x7f751806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:17.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.631+0000 7f7526ffd700 1 -- 172.21.15.92:0/226222718 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7530089ce0 con 0x7f75380b3150 2023-08-26T09:25:17.651 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.632+0000 7f753659c700 1 --2- 172.21.15.92:0/226222718 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f751806a0e0 0x7f751806c5a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7528007fd0 tx=0x7f7528009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:17.651 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.636+0000 7f7526ffd700 1 -- 172.21.15.92:0/226222718 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7530055460 con 0x7f75380b3150 2023-08-26T09:25:17.874 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.869+0000 7f753cfa2700 1 -- 172.21.15.92:0/226222718 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75380b11f0 con 0x7f75380b3150 2023-08-26T09:25:17.875 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.870+0000 7f7526ffd700 1 -- 172.21.15.92:0/226222718 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4863 (secure 0 0 0) 0x7f7530018020 con 0x7f75380b3150 2023-08-26T09:25:17.875 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:25:17.876 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/856608283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6833","nonce":856608283},{"type":"v1","addr":"172.21.15.188:6835","nonce":856608283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4279,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/33581841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":33581841},{"type":"v1","addr":"172.21.15.92:6837","nonce":33581841}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6834/279535547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":279535547},{"type":"v1","addr":"172.21.15.188:6834","nonce":279535547}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-26T09:25:13.851186+0000","modified":"2023-08-26T09:25:17.482682+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6835/2933877114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2933877114},{"type":"v1","addr":"172.21.15.92:6835","nonce":2933877114}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-26T09:25:17.877 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.871+0000 7f753cfa2700 1 -- 172.21.15.92:0/226222718 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f751806a0e0 msgr2=0x7f751806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:17.877 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.872+0000 7f753cfa2700 1 --2- 172.21.15.92:0/226222718 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f751806a0e0 0x7f751806c5a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7528007fd0 tx=0x7f7528009040 comp rx=0 tx=0).stop 2023-08-26T09:25:17.877 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.872+0000 7f753cfa2700 1 -- 172.21.15.92:0/226222718 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75380b3150 msgr2=0x7f75380af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:17.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.872+0000 7f753cfa2700 1 --2- 172.21.15.92:0/226222718 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75380b3150 0x7f75380af720 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f753808b3b0 tx=0x7f7530009750 comp rx=0 tx=0).stop 2023-08-26T09:25:17.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.872+0000 7f753cfa2700 1 -- 172.21.15.92:0/226222718 shutdown_connections 2023-08-26T09:25:17.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.872+0000 7f753cfa2700 1 --2- 172.21.15.92:0/226222718 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75380b3150 0x7f75380af720 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:17.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.872+0000 7f753cfa2700 1 --2- 172.21.15.92:0/226222718 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7520005210 0x7f753814b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:17.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.872+0000 7f753cfa2700 1 --2- 172.21.15.92:0/226222718 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f751806a0e0 0x7f751806c5a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:17.879 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.872+0000 7f753cfa2700 1 --2- 172.21.15.92:0/226222718 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f75380b1510 0x7f75380b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:17.879 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.872+0000 7f753cfa2700 1 -- 172.21.15.92:0/226222718 >> 172.21.15.92:0/226222718 conn(0x7f75380d0f40 msgr2=0x7f753815c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:17.879 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.872+0000 7f753cfa2700 1 -- 172.21.15.92:0/226222718 shutdown_connections 2023-08-26T09:25:17.879 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:17.872+0000 7f753cfa2700 1 -- 172.21.15.92:0/226222718 wait complete. 2023-08-26T09:25:17.880 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 7 2023-08-26T09:25:17.889 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-26T09:25:18.012 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.004+0000 7f310e9b1700 1 Processor -- start 2023-08-26T09:25:18.012 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.004+0000 7f310e9b1700 1 -- start start 2023-08-26T09:25:18.012 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.005+0000 7f310e9b1700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f310815d6c0 0x7f31080cea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:18.012 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.005+0000 7f310e9b1700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f31080cef70 0x7f310806cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:18.013 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.005+0000 7f310e9b1700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31080cf4d0 con 0x7f31080ca620 2023-08-26T09:25:18.013 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.005+0000 7f310e9b1700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31080cb4a0 con 0x7f31080cef70 2023-08-26T09:25:18.013 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.005+0000 7f310e9b1700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31080ce3b0 con 0x7f310815d6c0 2023-08-26T09:25:18.013 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.005+0000 7f310cf4e700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f31080cef70 0x7f310806cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:18.013 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.005+0000 7f310cf4e700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f31080cef70 0x7f310806cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44432/0 (socket says 172.21.15.92:44432) 2023-08-26T09:25:18.014 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.005+0000 7f310cf4e700 1 -- 172.21.15.92:0/3233290531 learned_addr learned my addr 172.21.15.92:0/3233290531 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:18.014 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.005+0000 7f3107fff700 1 --1- 172.21.15.92:0/3233290531 >> v1:172.21.15.92:6789/0 conn(0x7f31080ca620 0x7f31080caa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:56442/0 (socket says 172.21.15.92:56442) 2023-08-26T09:25:18.014 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.005+0000 7f31077fe700 1 --2- 172.21.15.92:0/3233290531 >> v2:172.21.15.188:3300/0 conn(0x7f310815d6c0 0x7f31080cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:18.014 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.005+0000 7f310cf4e700 1 -- 172.21.15.92:0/3233290531 >> v2:172.21.15.188:3300/0 conn(0x7f310815d6c0 msgr2=0x7f31080cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:18.014 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.005+0000 7f310cf4e700 1 --2- 172.21.15.92:0/3233290531 >> v2:172.21.15.188:3300/0 conn(0x7f310815d6c0 0x7f31080cea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:18.014 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.005+0000 7f310cf4e700 1 -- 172.21.15.92:0/3233290531 >> v1:172.21.15.92:6789/0 conn(0x7f31080ca620 legacy=0x7f31080caa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:18.015 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.005+0000 7f3106ffd700 1 -- 172.21.15.92:0/3233290531 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4013317740 0 0) 0x7f31080cf4d0 con 0x7f31080ca620 2023-08-26T09:25:18.015 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.005+0000 7f310cf4e700 1 -- 172.21.15.92:0/3233290531 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31080ce690 con 0x7f31080cef70 2023-08-26T09:25:18.015 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.005+0000 7f31077fe700 1 --2- 172.21.15.92:0/3233290531 >> v2:172.21.15.188:3300/0 conn(0x7f310815d6c0 0x7f31080cea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:25:18.015 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.005+0000 7f310cf4e700 1 --2- 172.21.15.92:0/3233290531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31080cef70 0x7f310806cd60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3108066a80 tx=0x7f310000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca5a29bd216f27af server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:18.015 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.005+0000 7f3106ffd700 1 -- 172.21.15.92:0/3233290531 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310000e070 con 0x7f31080cef70 2023-08-26T09:25:18.016 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.005+0000 7f3106ffd700 1 -- 172.21.15.92:0/3233290531 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f310000b9c0 con 0x7f31080cef70 2023-08-26T09:25:18.016 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.005+0000 7f3106ffd700 1 -- 172.21.15.92:0/3233290531 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310000bd70 con 0x7f31080cef70 2023-08-26T09:25:18.016 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.006+0000 7f310e9b1700 1 -- 172.21.15.92:0/3233290531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31080cef70 msgr2=0x7f310806cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:18.016 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.006+0000 7f310e9b1700 1 --2- 172.21.15.92:0/3233290531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31080cef70 0x7f310806cd60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3108066a80 tx=0x7f310000b330 comp rx=0 tx=0).stop 2023-08-26T09:25:18.016 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.006+0000 7f310e9b1700 1 -- 172.21.15.92:0/3233290531 shutdown_connections 2023-08-26T09:25:18.017 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.006+0000 7f310e9b1700 1 --2- 172.21.15.92:0/3233290531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31080cef70 0x7f310806cd60 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:18.017 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.006+0000 7f310e9b1700 1 --2- 172.21.15.92:0/3233290531 >> v2:172.21.15.188:3300/0 conn(0x7f310815d6c0 0x7f31080cea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:18.017 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.006+0000 7f310e9b1700 1 -- 172.21.15.92:0/3233290531 >> 172.21.15.92:0/3233290531 conn(0x7f31080cc7b0 msgr2=0x7f31080ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:18.017 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.006+0000 7f310e9b1700 1 -- 172.21.15.92:0/3233290531 shutdown_connections 2023-08-26T09:25:18.017 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.006+0000 7f310e9b1700 1 -- 172.21.15.92:0/3233290531 wait complete. 2023-08-26T09:25:18.020 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.007+0000 7f310e9b1700 1 Processor -- start 2023-08-26T09:25:18.020 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.007+0000 7f310e9b1700 1 -- start start 2023-08-26T09:25:18.020 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.008+0000 7f310e9b1700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f31080ca620 0x7f3108158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:18.021 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.008+0000 7f310e9b1700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f31080cef70 0x7f310806cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:18.021 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.008+0000 7f310e9b1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f310815d6c0 0x7f31080c7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:18.021 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.008+0000 7f310e9b1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310806e2e0 con 0x7f310815d6c0 2023-08-26T09:25:18.021 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.008+0000 7f310e9b1700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310806e700 con 0x7f31080ca620 2023-08-26T09:25:18.021 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.008+0000 7f310e9b1700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f310806d660 con 0x7f31080cef70 2023-08-26T09:25:18.021 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.008+0000 7f310cf4e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f310815d6c0 0x7f31080c7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:18.022 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.008+0000 7f310cf4e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f310815d6c0 0x7f31080c7d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44438/0 (socket says 172.21.15.92:44438) 2023-08-26T09:25:18.022 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.008+0000 7f310cf4e700 1 -- 172.21.15.92:0/1621763036 learned_addr learned my addr 172.21.15.92:0/1621763036 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:18.022 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.008+0000 7f3107fff700 1 --2- 172.21.15.92:0/1621763036 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f31080ca620 0x7f3108158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:18.022 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.008+0000 7f31077fe700 1 --2- 172.21.15.92:0/1621763036 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f31080cef70 0x7f310806cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:18.022 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.008+0000 7f310cf4e700 1 -- 172.21.15.92:0/1621763036 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f31080cef70 msgr2=0x7f310806cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:18.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.008+0000 7f310cf4e700 1 --2- 172.21.15.92:0/1621763036 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f31080cef70 0x7f310806cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:18.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.008+0000 7f310cf4e700 1 -- 172.21.15.92:0/1621763036 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f31080ca620 msgr2=0x7f3108158f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:18.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.008+0000 7f310cf4e700 1 --2- 172.21.15.92:0/1621763036 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f31080ca620 0x7f3108158f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:18.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.008+0000 7f310cf4e700 1 -- 172.21.15.92:0/1621763036 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3100009b30 con 0x7f310815d6c0 2023-08-26T09:25:18.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.009+0000 7f310cf4e700 1 --2- 172.21.15.92:0/1621763036 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f310815d6c0 0x7f31080c7d10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f310000b370 tx=0x7f3100004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:18.024 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.009+0000 7f3104ff9700 1 -- 172.21.15.92:0/1621763036 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31000092e0 con 0x7f310815d6c0 2023-08-26T09:25:18.024 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.009+0000 7f3104ff9700 1 -- 172.21.15.92:0/1621763036 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31000099b0 con 0x7f310815d6c0 2023-08-26T09:25:18.024 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.009+0000 7f310e9b1700 1 -- 172.21.15.92:0/1621763036 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f310806d940 con 0x7f310815d6c0 2023-08-26T09:25:18.024 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.009+0000 7f3104ff9700 1 -- 172.21.15.92:0/1621763036 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310001c680 con 0x7f310815d6c0 2023-08-26T09:25:18.024 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.009+0000 7f310e9b1700 1 -- 172.21.15.92:0/1621763036 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f310806df00 con 0x7f310815d6c0 2023-08-26T09:25:18.025 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.010+0000 7f310e9b1700 1 -- 172.21.15.92:0/1621763036 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f310806e420 con 0x7f310815d6c0 2023-08-26T09:25:18.025 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.010+0000 7f3104ff9700 1 -- 172.21.15.92:0/1621763036 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f310001c7e0 con 0x7f310815d6c0 2023-08-26T09:25:18.025 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.010+0000 7f3104ff9700 1 --2- 172.21.15.92:0/1621763036 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f30f406a0e0 0x7f30f406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:18.025 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.011+0000 7f3104ff9700 1 -- 172.21.15.92:0/1621763036 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3100089d20 con 0x7f310815d6c0 2023-08-26T09:25:18.025 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.011+0000 7f3107fff700 1 --2- 172.21.15.92:0/1621763036 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f30f406a0e0 0x7f30f406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:18.026 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.011+0000 7f3107fff700 1 --2- 172.21.15.92:0/1621763036 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f30f406a0e0 0x7f30f406c5a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f30fc000f60 tx=0x7f30fc007be0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:18.026 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.015+0000 7f3104ff9700 1 -- 172.21.15.92:0/1621763036 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f310806e420 con 0x7f310815d6c0 2023-08-26T09:25:18.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.205+0000 7f310e9b1700 1 -- 172.21.15.92:0/1621763036 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f310806e420 con 0x7f310815d6c0 2023-08-26T09:25:18.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.206+0000 7f3104ff9700 1 -- 172.21.15.92:0/1621763036 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+18209 (secure 0 0 0) 0x7f310806e420 con 0x7f310815d6c0 2023-08-26T09:25:18.212 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:25:18.212 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":20,"fsid":"254a2d31-bd41-4507-8326-1b205ac24377","created":"2023-08-26T09:24:55.352131+0000","modified":"2023-08-26T09:25:15.447635+0000","last_up_change":"2023-08-26T09:25:06.124496+0000","last_in_change":"2023-08-26T09:24:57.840725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-26T09:25:06.650431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-26T09:25:06.973382+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-26T09:25:11.584141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-26T09:25:12.814990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e9e7638-4459-4d8d-8e40-130bcf48df66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6819","nonce":382827192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6824","nonce":382827192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6831","nonce":382827192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6827","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6829","nonce":382827192}]},"public_addr":"172.21.15.92:6819/382827192","cluster_addr":"172.21.15.92:6824/382827192","heartbeat_back_addr":"172.21.15.92:6831/382827192","heartbeat_front_addr":"172.21.15.92:6829/382827192","state":["exists","up"]},{"osd":1,"uuid":"164e68c9-aedd-4df5-9b70-f4b1ec3bda13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6809","nonce":618773438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6811","nonce":618773438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6815","nonce":618773438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6813","nonce":618773438}]},"public_addr":"172.21.15.92:6809/618773438","cluster_addr":"172.21.15.92:6811/618773438","heartbeat_back_addr":"172.21.15.92:6815/618773438","heartbeat_front_addr":"172.21.15.92:6813/618773438","state":["exists","up"]},{"osd":2,"uuid":"8701dfee-629a-4d30-82e4-b8fac340303f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6818","nonce":3697397687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6821","nonce":3697397687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6828","nonce":3697397687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6823","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6825","nonce":3697397687}]},"public_addr":"172.21.15.92:6818/3697397687","cluster_addr":"172.21.15.92:6821/3697397687","heartbeat_back_addr":"172.21.15.92:6828/3697397687","heartbeat_front_addr":"172.21.15.92:6825/3697397687","state":["exists","up"]},{"osd":3,"uuid":"93bdc94d-dc07-495f-995a-a6ad072f0247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6801","nonce":3579846453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6803","nonce":3579846453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6807","nonce":3579846453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6805","nonce":3579846453}]},"public_addr":"172.21.15.92:6801/3579846453","cluster_addr":"172.21.15.92:6803/3579846453","heartbeat_back_addr":"172.21.15.92:6807/3579846453","heartbeat_front_addr":"172.21.15.92:6805/3579846453","state":["exists","up"]},{"osd":4,"uuid":"d9d0ea80-8481-46a7-9677-c338d32cf1d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6809","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6811","nonce":3228383424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6813","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6815","nonce":3228383424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6821","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6823","nonce":3228383424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6817","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6819","nonce":3228383424}]},"public_addr":"172.21.15.188:6811/3228383424","cluster_addr":"172.21.15.188:6815/3228383424","heartbeat_back_addr":"172.21.15.188:6823/3228383424","heartbeat_front_addr":"172.21.15.188:6819/3228383424","state":["exists","up"]},{"osd":5,"uuid":"38d03253-467a-456f-bd5e-5a46532a0b18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6801","nonce":1655821054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6803","nonce":1655821054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6807","nonce":1655821054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6805","nonce":1655821054}]},"public_addr":"172.21.15.188:6801/1655821054","cluster_addr":"172.21.15.188:6803/1655821054","heartbeat_back_addr":"172.21.15.188:6807/1655821054","heartbeat_front_addr":"172.21.15.188:6805/1655821054","state":["exists","up"]},{"osd":6,"uuid":"d61564b5-136f-42e5-a843-626c2017cc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6810","nonce":2069976891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6814","nonce":2069976891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6822","nonce":2069976891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6818","nonce":2069976891}]},"public_addr":"172.21.15.188:6810/2069976891","cluster_addr":"172.21.15.188:6814/2069976891","heartbeat_back_addr":"172.21.15.188:6822/2069976891","heartbeat_front_addr":"172.21.15.188:6818/2069976891","state":["exists","up"]},{"osd":7,"uuid":"fae2949e-0d62-42cd-ba72-08f516084b20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6825","nonce":1882888860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6827","nonce":1882888860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6831","nonce":1882888860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6829","nonce":1882888860}]},"public_addr":"172.21.15.188:6825/1882888860","cluster_addr":"172.21.15.188:6827/1882888860","heartbeat_back_addr":"172.21.15.188:6831/1882888860","heartbeat_front_addr":"172.21.15.188:6829/1882888860","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.038523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.063160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.000857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.975572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.023848+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.765194+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.081365+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:05.110745+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-26T09:25:18.213 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.208+0000 7f310e9b1700 1 -- 172.21.15.92:0/1621763036 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f30f406a0e0 msgr2=0x7f30f406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:18.214 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.208+0000 7f310e9b1700 1 --2- 172.21.15.92:0/1621763036 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f30f406a0e0 0x7f30f406c5a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f30fc000f60 tx=0x7f30fc007be0 comp rx=0 tx=0).stop 2023-08-26T09:25:18.214 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.208+0000 7f310e9b1700 1 -- 172.21.15.92:0/1621763036 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f310815d6c0 msgr2=0x7f31080c7d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:18.214 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.208+0000 7f310e9b1700 1 --2- 172.21.15.92:0/1621763036 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f310815d6c0 0x7f31080c7d10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f310000b370 tx=0x7f3100004ad0 comp rx=0 tx=0).stop 2023-08-26T09:25:18.214 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.208+0000 7f310e9b1700 1 -- 172.21.15.92:0/1621763036 shutdown_connections 2023-08-26T09:25:18.215 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.208+0000 7f310e9b1700 1 --2- 172.21.15.92:0/1621763036 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f30f406a0e0 0x7f30f406c5a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:18.215 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.208+0000 7f310e9b1700 1 --2- 172.21.15.92:0/1621763036 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f31080ca620 0x7f3108158f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:18.215 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.208+0000 7f310e9b1700 1 --2- 172.21.15.92:0/1621763036 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f310815d6c0 0x7f31080c7d10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:18.215 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.208+0000 7f310e9b1700 1 --2- 172.21.15.92:0/1621763036 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f31080cef70 0x7f310806cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:18.215 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.208+0000 7f310e9b1700 1 -- 172.21.15.92:0/1621763036 >> 172.21.15.92:0/1621763036 conn(0x7f31080cc7b0 msgr2=0x7f31080cdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:18.216 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.208+0000 7f310e9b1700 1 -- 172.21.15.92:0/1621763036 shutdown_connections 2023-08-26T09:25:18.216 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.208+0000 7f310e9b1700 1 -- 172.21.15.92:0/1621763036 wait complete. 2023-08-26T09:25:18.226 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-26T09:25:18.227 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-26T09:25:18.349 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.341+0000 7ffb2208c700 1 Processor -- start 2023-08-26T09:25:18.349 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.341+0000 7ffb2208c700 1 -- start start 2023-08-26T09:25:18.349 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.342+0000 7ffb2208c700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7ffb1c0aea60 0x7ffb1c06d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:18.350 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.342+0000 7ffb2208c700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffb1c06a980 0x7ffb1c06d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:18.350 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.342+0000 7ffb2208c700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb1c06dd60 con 0x7ffb1c0cf0f0 2023-08-26T09:25:18.350 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.342+0000 7ffb2208c700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb1c159ea0 con 0x7ffb1c0aea60 2023-08-26T09:25:18.350 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.342+0000 7ffb2208c700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1c0cf690 con 0x7ffb1c06a980 2023-08-26T09:25:18.350 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.342+0000 7ffb1bfff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7ffb1c0cf0f0 0x7ffb1c0cc060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:56460/0 (socket says 172.21.15.92:56460) 2023-08-26T09:25:18.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.342+0000 7ffb1bfff700 1 -- 172.21.15.92:0/1891309022 learned_addr learned my addr 172.21.15.92:0/1891309022 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:18.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.342+0000 7ffb1b7fe700 1 --2- 172.21.15.92:0/1891309022 >> v2:172.21.15.188:3300/0 conn(0x7ffb1c0aea60 0x7ffb1c06d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:18.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.342+0000 7ffb1affd700 1 --2- 172.21.15.92:0/1891309022 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffb1c06a980 0x7ffb1c06d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:18.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.342+0000 7ffb1a7fc700 1 -- 172.21.15.92:0/1891309022 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2477874945 0 0) 0x7ffb1c06dd60 con 0x7ffb1c0cf0f0 2023-08-26T09:25:18.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.343+0000 7ffb1a7fc700 1 -- 172.21.15.92:0/1891309022 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb040035b0 con 0x7ffb1c0cf0f0 2023-08-26T09:25:18.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.343+0000 7ffb1a7fc700 1 -- 172.21.15.92:0/1891309022 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2911592693 0 0) 0x7ffb040035b0 con 0x7ffb1c0cf0f0 2023-08-26T09:25:18.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.343+0000 7ffb1b7fe700 1 -- 172.21.15.92:0/1891309022 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffb1c06a980 msgr2=0x7ffb1c06d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:18.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.343+0000 7ffb1b7fe700 1 --2- 172.21.15.92:0/1891309022 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffb1c06a980 0x7ffb1c06d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:18.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.343+0000 7ffb1b7fe700 1 -- 172.21.15.92:0/1891309022 >> v1:172.21.15.92:6789/0 conn(0x7ffb1c0cf0f0 legacy=0x7ffb1c0cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:18.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.343+0000 7ffb1b7fe700 1 -- 172.21.15.92:0/1891309022 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb1c0cf970 con 0x7ffb1c0aea60 2023-08-26T09:25:18.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.343+0000 7ffb1b7fe700 1 --2- 172.21.15.92:0/1891309022 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffb1c0aea60 0x7ffb1c06d2e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ffb10009820 tx=0x7ffb10009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcaadc5f782c676a server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:18.353 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.343+0000 7ffb1a7fc700 1 -- 172.21.15.92:0/1891309022 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb140019f0 con 0x7ffb1c0aea60 2023-08-26T09:25:18.353 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.343+0000 7ffb1a7fc700 1 -- 172.21.15.92:0/1891309022 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb10005c30 con 0x7ffb1c0aea60 2023-08-26T09:25:18.353 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.343+0000 7ffb1a7fc700 1 -- 172.21.15.92:0/1891309022 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb10004030 con 0x7ffb1c0aea60 2023-08-26T09:25:18.353 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.344+0000 7ffb2208c700 1 -- 172.21.15.92:0/1891309022 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffb1c0aea60 msgr2=0x7ffb1c06d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:18.353 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.344+0000 7ffb2208c700 1 --2- 172.21.15.92:0/1891309022 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffb1c0aea60 0x7ffb1c06d2e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ffb10009820 tx=0x7ffb10009b30 comp rx=0 tx=0).stop 2023-08-26T09:25:18.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.344+0000 7ffb2208c700 1 -- 172.21.15.92:0/1891309022 shutdown_connections 2023-08-26T09:25:18.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.344+0000 7ffb2208c700 1 --2- 172.21.15.92:0/1891309022 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffb1c0aea60 0x7ffb1c06d2e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:18.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.344+0000 7ffb2208c700 1 --2- 172.21.15.92:0/1891309022 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffb1c06a980 0x7ffb1c06d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:18.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.344+0000 7ffb2208c700 1 -- 172.21.15.92:0/1891309022 >> 172.21.15.92:0/1891309022 conn(0x7ffb1c0b23c0 msgr2=0x7ffb1c0b27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:18.355 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.344+0000 7ffb2208c700 1 -- 172.21.15.92:0/1891309022 shutdown_connections 2023-08-26T09:25:18.355 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.344+0000 7ffb2208c700 1 -- 172.21.15.92:0/1891309022 wait complete. 2023-08-26T09:25:18.358 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.345+0000 7ffb2208c700 1 Processor -- start 2023-08-26T09:25:18.358 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.345+0000 7ffb2208c700 1 -- start start 2023-08-26T09:25:18.358 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.346+0000 7ffb2208c700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffb1c06a980 0x7ffb1c0c1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:18.358 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.346+0000 7ffb2208c700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffb1c0aea60 0x7ffb1c0af320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:18.359 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.346+0000 7ffb2208c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb1c0cf0f0 0x7ffb1c0af860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:18.359 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.346+0000 7ffb2208c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1c0c50e0 con 0x7ffb1c0cf0f0 2023-08-26T09:25:18.359 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.346+0000 7ffb2208c700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1c0b1140 con 0x7ffb1c0aea60 2023-08-26T09:25:18.359 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.346+0000 7ffb2208c700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1c0b1420 con 0x7ffb1c06a980 2023-08-26T09:25:18.359 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.346+0000 7ffb1bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb1c0cf0f0 0x7ffb1c0af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:18.360 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.346+0000 7ffb1bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb1c0cf0f0 0x7ffb1c0af860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44452/0 (socket says 172.21.15.92:44452) 2023-08-26T09:25:18.360 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.346+0000 7ffb1bfff700 1 -- 172.21.15.92:0/821691597 learned_addr learned my addr 172.21.15.92:0/821691597 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:18.360 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.346+0000 7ffb1affd700 1 --2- 172.21.15.92:0/821691597 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffb1c0aea60 0x7ffb1c0af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:18.360 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.346+0000 7ffb1b7fe700 1 --2- 172.21.15.92:0/821691597 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffb1c06a980 0x7ffb1c0c1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:18.360 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.346+0000 7ffb1bfff700 1 -- 172.21.15.92:0/821691597 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffb1c06a980 msgr2=0x7ffb1c0c1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:18.360 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.346+0000 7ffb1bfff700 1 --2- 172.21.15.92:0/821691597 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffb1c06a980 0x7ffb1c0c1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:18.361 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.346+0000 7ffb1bfff700 1 -- 172.21.15.92:0/821691597 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffb1c0aea60 msgr2=0x7ffb1c0af320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:18.361 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.346+0000 7ffb1bfff700 1 --2- 172.21.15.92:0/821691597 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffb1c0aea60 0x7ffb1c0af320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:18.361 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.346+0000 7ffb1bfff700 1 -- 172.21.15.92:0/821691597 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb10009430 con 0x7ffb1c0cf0f0 2023-08-26T09:25:18.361 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.346+0000 7ffb1affd700 1 --2- 172.21.15.92:0/821691597 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffb1c0aea60 0x7ffb1c0af320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:25:18.361 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.346+0000 7ffb1b7fe700 1 --2- 172.21.15.92:0/821691597 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffb1c06a980 0x7ffb1c0c1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:25:18.362 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.346+0000 7ffb1bfff700 1 --2- 172.21.15.92:0/821691597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb1c0cf0f0 0x7ffb1c0af860 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ffb1400cbe0 tx=0x7ffb1400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:18.362 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.347+0000 7ffb03fff700 1 -- 172.21.15.92:0/821691597 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1400ab80 con 0x7ffb1c0cf0f0 2023-08-26T09:25:18.362 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.347+0000 7ffb03fff700 1 -- 172.21.15.92:0/821691597 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb1400ad00 con 0x7ffb1c0cf0f0 2023-08-26T09:25:18.362 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.347+0000 7ffb03fff700 1 -- 172.21.15.92:0/821691597 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb14007310 con 0x7ffb1c0cf0f0 2023-08-26T09:25:18.362 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.347+0000 7ffb2208c700 1 -- 172.21.15.92:0/821691597 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb1c0b1700 con 0x7ffb1c0cf0f0 2023-08-26T09:25:18.362 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.347+0000 7ffb2208c700 1 -- 172.21.15.92:0/821691597 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb1c0c22b0 con 0x7ffb1c0cf0f0 2023-08-26T09:25:18.363 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.348+0000 7ffb2208c700 1 -- 172.21.15.92:0/821691597 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb1c096350 con 0x7ffb1c0cf0f0 2023-08-26T09:25:18.363 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.348+0000 7ffb03fff700 1 -- 172.21.15.92:0/821691597 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ffb14007470 con 0x7ffb1c0cf0f0 2023-08-26T09:25:18.363 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.348+0000 7ffb03fff700 1 --2- 172.21.15.92:0/821691597 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7ffb0806a0e0 0x7ffb0806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:18.363 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.348+0000 7ffb03fff700 1 -- 172.21.15.92:0/821691597 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffb14088040 con 0x7ffb1c0cf0f0 2023-08-26T09:25:18.363 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.348+0000 7ffb1b7fe700 1 --2- 172.21.15.92:0/821691597 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7ffb0806a0e0 0x7ffb0806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:18.364 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.349+0000 7ffb1b7fe700 1 --2- 172.21.15.92:0/821691597 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7ffb0806a0e0 0x7ffb0806c5a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c0c3b90 tx=0x7ffb10008070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:18.364 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.353+0000 7ffb03fff700 1 -- 172.21.15.92:0/821691597 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ffb1c096350 con 0x7ffb1c0cf0f0 2023-08-26T09:25:18.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.541+0000 7ffb2208c700 1 -- 172.21.15.92:0/821691597 --> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffb1c0cff30 con 0x7ffb0806a0e0 2023-08-26T09:25:18.554 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.549+0000 7ffb03fff700 1 -- 172.21.15.92:0/821691597 <== mgr.4107 v2:172.21.15.92:6832/1988454907 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+272207 (secure 0 0 0) 0x7ffb10021070 con 0x7ffb0806a0e0 2023-08-26T09:25:18.557 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:25:18.559 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.552+0000 7ffb2208c700 1 -- 172.21.15.92:0/821691597 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7ffb0806a0e0 msgr2=0x7ffb0806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:18.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.552+0000 7ffb2208c700 1 --2- 172.21.15.92:0/821691597 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7ffb0806a0e0 0x7ffb0806c5a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c0c3b90 tx=0x7ffb10008070 comp rx=0 tx=0).stop 2023-08-26T09:25:18.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.552+0000 7ffb2208c700 1 -- 172.21.15.92:0/821691597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb1c0cf0f0 msgr2=0x7ffb1c0af860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:18.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.552+0000 7ffb2208c700 1 --2- 172.21.15.92:0/821691597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb1c0cf0f0 0x7ffb1c0af860 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ffb1400cbe0 tx=0x7ffb1400a060 comp rx=0 tx=0).stop 2023-08-26T09:25:18.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.552+0000 7ffb2208c700 1 -- 172.21.15.92:0/821691597 shutdown_connections 2023-08-26T09:25:18.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.552+0000 7ffb2208c700 1 --2- 172.21.15.92:0/821691597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb1c0cf0f0 0x7ffb1c0af860 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:18.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.552+0000 7ffb2208c700 1 --2- 172.21.15.92:0/821691597 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffb1c06a980 0x7ffb1c0c1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:18.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.552+0000 7ffb2208c700 1 --2- 172.21.15.92:0/821691597 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7ffb0806a0e0 0x7ffb0806c5a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:18.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.552+0000 7ffb2208c700 1 --2- 172.21.15.92:0/821691597 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffb1c0aea60 0x7ffb1c0af320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:18.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.552+0000 7ffb2208c700 1 -- 172.21.15.92:0/821691597 >> 172.21.15.92:0/821691597 conn(0x7ffb1c0b23c0 msgr2=0x7ffb1c06d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:18.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.552+0000 7ffb2208c700 1 -- 172.21.15.92:0/821691597 shutdown_connections 2023-08-26T09:25:18.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.552+0000 7ffb2208c700 1 -- 172.21.15.92:0/821691597 wait complete. 2023-08-26T09:25:18.562 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2023-08-26T09:25:18.569 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2023-08-26T09:25:16.929031+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218696,"kb_used_data":2368,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754756024,"statfs":{"total":773094113280,"available":772870168576,"internally_reserved":0,"allocated":2424832,"data_stored":1560870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.487112"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:12.436134+0000","last_change":"2023-08-26T09:25:12.436134+0000","last_active":"2023-08-26T09:25:12.436134+0000","last_peered":"2023-08-26T09:25:12.436134+0000","last_clean":"2023-08-26T09:25:12.436134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:12.436134+0000","last_undegraded":"2023-08-26T09:25:12.436134+0000","last_fullsized":"2023-08-26T09:25:12.436134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:12.436134+0000","last_change":"2023-08-26T09:25:12.436134+0000","last_active":"2023-08-26T09:25:12.436134+0000","last_peered":"2023-08-26T09:25:12.436134+0000","last_clean":"2023-08-26T09:25:12.436134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:12.436134+0000","last_undegraded":"2023-08-26T09:25:12.436134+0000","last_fullsized":"2023-08-26T09:25:12.436134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:12.436134+0000","last_change":"2023-08-26T09:25:12.436134+0000","last_active":"2023-08-26T09:25:12.436134+0000","last_peered":"2023-08-26T09:25:12.436134+0000","last_clean":"2023-08-26T09:25:12.436134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:12.436134+0000","last_undegraded":"2023-08-26T09:25:12.436134+0000","last_fullsized":"2023-08-26T09:25:12.436134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:12.436134+0000","last_change":"2023-08-26T09:25:12.436134+0000","last_active":"2023-08-26T09:25:12.436134+0000","last_peered":"2023-08-26T09:25:12.436134+0000","last_clean":"2023-08-26T09:25:12.436134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:12.436134+0000","last_undegraded":"2023-08-26T09:25:12.436134+0000","last_fullsized":"2023-08-26T09:25:12.436134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:12.436134+0000","last_change":"2023-08-26T09:25:12.436134+0000","last_active":"2023-08-26T09:25:12.436134+0000","last_peered":"2023-08-26T09:25:12.436134+0000","last_clean":"2023-08-26T09:25:12.436134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:12.436134+0000","last_undegraded":"2023-08-26T09:25:12.436134+0000","last_fullsized":"2023-08-26T09:25:12.436134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:12.436134+0000","last_change":"2023-08-26T09:25:12.436134+0000","last_active":"2023-08-26T09:25:12.436134+0000","last_peered":"2023-08-26T09:25:12.436134+0000","last_clean":"2023-08-26T09:25:12.436134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:12.436134+0000","last_undegraded":"2023-08-26T09:25:12.436134+0000","last_fullsized":"2023-08-26T09:25:12.436134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:12.436134+0000","last_change":"2023-08-26T09:25:12.436134+0000","last_active":"2023-08-26T09:25:12.436134+0000","last_peered":"2023-08-26T09:25:12.436134+0000","last_clean":"2023-08-26T09:25:12.436134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:12.436134+0000","last_undegraded":"2023-08-26T09:25:12.436134+0000","last_fullsized":"2023-08-26T09:25:12.436134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:12.436134+0000","last_change":"2023-08-26T09:25:12.436134+0000","last_active":"2023-08-26T09:25:12.436134+0000","last_peered":"2023-08-26T09:25:12.436134+0000","last_clean":"2023-08-26T09:25:12.436134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:12.436134+0000","last_undegraded":"2023-08-26T09:25:12.436134+0000","last_fullsized":"2023-08-26T09:25:12.436134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:12.436134+0000","last_change":"2023-08-26T09:25:12.436134+0000","last_active":"2023-08-26T09:25:12.436134+0000","last_peered":"2023-08-26T09:25:12.436134+0000","last_clean":"2023-08-26T09:25:12.436134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:12.436134+0000","last_undegraded":"2023-08-26T09:25:12.436134+0000","last_fullsized":"2023-08-26T09:25:12.436134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:12.436134+0000","last_change":"2023-08-26T09:25:12.436134+0000","last_active":"2023-08-26T09:25:12.436134+0000","last_peered":"2023-08-26T09:25:12.436134+0000","last_clean":"2023-08-26T09:25:12.436134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:12.436134+0000","last_undegraded":"2023-08-26T09:25:12.436134+0000","last_fullsized":"2023-08-26T09:25:12.436134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:12.436134+0000","last_change":"2023-08-26T09:25:12.436134+0000","last_active":"2023-08-26T09:25:12.436134+0000","last_peered":"2023-08-26T09:25:12.436134+0000","last_clean":"2023-08-26T09:25:12.436134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:12.436134+0000","last_undegraded":"2023-08-26T09:25:12.436134+0000","last_fullsized":"2023-08-26T09:25:12.436134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:12.436134+0000","last_change":"2023-08-26T09:25:12.436134+0000","last_active":"2023-08-26T09:25:12.436134+0000","last_peered":"2023-08-26T09:25:12.436134+0000","last_clean":"2023-08-26T09:25:12.436134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:12.436134+0000","last_undegraded":"2023-08-26T09:25:12.436134+0000","last_fullsized":"2023-08-26T09:25:12.436134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:12.436134+0000","last_change":"2023-08-26T09:25:12.436134+0000","last_active":"2023-08-26T09:25:12.436134+0000","last_peered":"2023-08-26T09:25:12.436134+0000","last_clean":"2023-08-26T09:25:12.436134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:12.436134+0000","last_undegraded":"2023-08-26T09:25:12.436134+0000","last_fullsized":"2023-08-26T09:25:12.436134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:12.436134+0000","last_change":"2023-08-26T09:25:12.436134+0000","last_active":"2023-08-26T09:25:12.436134+0000","last_peered":"2023-08-26T09:25:12.436134+0000","last_clean":"2023-08-26T09:25:12.436134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:12.436134+0000","last_undegraded":"2023-08-26T09:25:12.436134+0000","last_fullsized":"2023-08-26T09:25:12.436134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:12.436134+0000","last_change":"2023-08-26T09:25:12.436134+0000","last_active":"2023-08-26T09:25:12.436134+0000","last_peered":"2023-08-26T09:25:12.436134+0000","last_clean":"2023-08-26T09:25:12.436134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:12.436134+0000","last_undegraded":"2023-08-26T09:25:12.436134+0000","last_fullsized":"2023-08-26T09:25:12.436134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:12.436134+0000","last_change":"2023-08-26T09:25:12.436134+0000","last_active":"2023-08-26T09:25:12.436134+0000","last_peered":"2023-08-26T09:25:12.436134+0000","last_clean":"2023-08-26T09:25:12.436134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:12.436134+0000","last_undegraded":"2023-08-26T09:25:12.436134+0000","last_fullsized":"2023-08-26T09:25:12.436134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:12.436134+0000","last_change":"2023-08-26T09:25:12.436134+0000","last_active":"2023-08-26T09:25:12.436134+0000","last_peered":"2023-08-26T09:25:12.436134+0000","last_clean":"2023-08-26T09:25:12.436134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:12.436134+0000","last_undegraded":"2023-08-26T09:25:12.436134+0000","last_fullsized":"2023-08-26T09:25:12.436134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:12.436134+0000","last_change":"2023-08-26T09:25:12.436134+0000","last_active":"2023-08-26T09:25:12.436134+0000","last_peered":"2023-08-26T09:25:12.436134+0000","last_clean":"2023-08-26T09:25:12.436134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:12.436134+0000","last_undegraded":"2023-08-26T09:25:12.436134+0000","last_fullsized":"2023-08-26T09:25:12.436134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:12.436134+0000","last_change":"2023-08-26T09:25:12.436134+0000","last_active":"2023-08-26T09:25:12.436134+0000","last_peered":"2023-08-26T09:25:12.436134+0000","last_clean":"2023-08-26T09:25:12.436134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:12.436134+0000","last_undegraded":"2023-08-26T09:25:12.436134+0000","last_fullsized":"2023-08-26T09:25:12.436134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:12.436134+0000","last_change":"2023-08-26T09:25:12.436134+0000","last_active":"2023-08-26T09:25:12.436134+0000","last_peered":"2023-08-26T09:25:12.436134+0000","last_clean":"2023-08-26T09:25:12.436134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:12.436134+0000","last_undegraded":"2023-08-26T09:25:12.436134+0000","last_fullsized":"2023-08-26T09:25:12.436134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-26T09:25:09.519850+0000","last_change":"2023-08-26T09:25:08.404814+0000","last_active":"2023-08-26T09:25:09.519850+0000","last_peered":"2023-08-26T09:25:09.519850+0000","last_clean":"2023-08-26T09:25:09.519850+0000","last_became_active":"2023-08-26T09:25:08.404465+0000","last_became_peered":"2023-08-26T09:25:08.404465+0000","last_unstale":"2023-08-26T09:25:09.519850+0000","last_undegraded":"2023-08-26T09:25:09.519850+0000","last_fullsized":"2023-08-26T09:25:09.519850+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T12:42:15.185914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-26T09:25:09.423258+0000","last_change":"2023-08-26T09:25:08.405372+0000","last_active":"2023-08-26T09:25:09.423258+0000","last_peered":"2023-08-26T09:25:09.423258+0000","last_clean":"2023-08-26T09:25:09.423258+0000","last_became_active":"2023-08-26T09:25:08.404984+0000","last_became_peered":"2023-08-26T09:25:08.404984+0000","last_unstale":"2023-08-26T09:25:09.423258+0000","last_undegraded":"2023-08-26T09:25:09.423258+0000","last_fullsized":"2023-08-26T09:25:09.423258+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T20:01:01.749385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:12.436134+0000","last_change":"2023-08-26T09:25:12.436134+0000","last_active":"2023-08-26T09:25:12.436134+0000","last_peered":"2023-08-26T09:25:12.436134+0000","last_clean":"2023-08-26T09:25:12.436134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:12.436134+0000","last_undegraded":"2023-08-26T09:25:12.436134+0000","last_fullsized":"2023-08-26T09:25:12.436134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-26T09:25:09.423961+0000","last_change":"2023-08-26T09:25:08.410050+0000","last_active":"2023-08-26T09:25:09.423961+0000","last_peered":"2023-08-26T09:25:09.423961+0000","last_clean":"2023-08-26T09:25:09.423961+0000","last_became_active":"2023-08-26T09:25:08.409798+0000","last_became_peered":"2023-08-26T09:25:08.409798+0000","last_unstale":"2023-08-26T09:25:09.423961+0000","last_undegraded":"2023-08-26T09:25:09.423961+0000","last_fullsized":"2023-08-26T09:25:09.423961+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T16:29:37.612546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":161,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-26T09:25:09.443233+0000","last_change":"2023-08-26T09:25:08.409089+0000","last_active":"2023-08-26T09:25:09.443233+0000","last_peered":"2023-08-26T09:25:09.443233+0000","last_clean":"2023-08-26T09:25:09.443233+0000","last_became_active":"2023-08-26T09:25:08.408185+0000","last_became_peered":"2023-08-26T09:25:08.408185+0000","last_unstale":"2023-08-26T09:25:09.443233+0000","last_undegraded":"2023-08-26T09:25:09.443233+0000","last_fullsized":"2023-08-26T09:25:09.443233+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T20:01:01.749385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:12.436134+0000","last_change":"2023-08-26T09:25:12.436134+0000","last_active":"2023-08-26T09:25:12.436134+0000","last_peered":"2023-08-26T09:25:12.436134+0000","last_clean":"2023-08-26T09:25:12.436134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:12.436134+0000","last_undegraded":"2023-08-26T09:25:12.436134+0000","last_fullsized":"2023-08-26T09:25:12.436134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-26T09:25:09.427075+0000","last_change":"2023-08-26T09:25:08.448979+0000","last_active":"2023-08-26T09:25:09.427075+0000","last_peered":"2023-08-26T09:25:09.427075+0000","last_clean":"2023-08-26T09:25:09.427075+0000","last_became_active":"2023-08-26T09:25:08.448706+0000","last_became_peered":"2023-08-26T09:25:08.448706+0000","last_unstale":"2023-08-26T09:25:09.427075+0000","last_undegraded":"2023-08-26T09:25:09.427075+0000","last_fullsized":"2023-08-26T09:25:09.427075+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:26:14.096548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:12.436134+0000","last_change":"2023-08-26T09:25:12.436134+0000","last_active":"2023-08-26T09:25:12.436134+0000","last_peered":"2023-08-26T09:25:12.436134+0000","last_clean":"2023-08-26T09:25:12.436134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:12.436134+0000","last_undegraded":"2023-08-26T09:25:12.436134+0000","last_fullsized":"2023-08-26T09:25:12.436134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-26T09:25:09.427065+0000","last_change":"2023-08-26T09:25:08.448601+0000","last_active":"2023-08-26T09:25:09.427065+0000","last_peered":"2023-08-26T09:25:09.427065+0000","last_clean":"2023-08-26T09:25:09.427065+0000","last_became_active":"2023-08-26T09:25:08.448275+0000","last_became_peered":"2023-08-26T09:25:08.448275+0000","last_unstale":"2023-08-26T09:25:09.427065+0000","last_undegraded":"2023-08-26T09:25:09.427065+0000","last_fullsized":"2023-08-26T09:25:09.427065+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T21:11:33.740615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:12.436134+0000","last_change":"2023-08-26T09:25:12.436134+0000","last_active":"2023-08-26T09:25:12.436134+0000","last_peered":"2023-08-26T09:25:12.436134+0000","last_clean":"2023-08-26T09:25:12.436134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:12.436134+0000","last_undegraded":"2023-08-26T09:25:12.436134+0000","last_fullsized":"2023-08-26T09:25:12.436134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-26T09:25:09.423782+0000","last_change":"2023-08-26T09:25:08.449014+0000","last_active":"2023-08-26T09:25:09.423782+0000","last_peered":"2023-08-26T09:25:09.423782+0000","last_clean":"2023-08-26T09:25:09.423782+0000","last_became_active":"2023-08-26T09:25:08.448671+0000","last_became_peered":"2023-08-26T09:25:08.448671+0000","last_unstale":"2023-08-26T09:25:09.423782+0000","last_undegraded":"2023-08-26T09:25:09.423782+0000","last_fullsized":"2023-08-26T09:25:09.423782+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T16:29:37.612546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:12.436134+0000","last_change":"2023-08-26T09:25:12.436134+0000","last_active":"2023-08-26T09:25:12.436134+0000","last_peered":"2023-08-26T09:25:12.436134+0000","last_clean":"2023-08-26T09:25:12.436134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:12.436134+0000","last_undegraded":"2023-08-26T09:25:12.436134+0000","last_fullsized":"2023-08-26T09:25:12.436134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-26T09:25:09.519743+0000","last_change":"2023-08-26T09:25:08.449159+0000","last_active":"2023-08-26T09:25:09.519743+0000","last_peered":"2023-08-26T09:25:09.519743+0000","last_clean":"2023-08-26T09:25:09.519743+0000","last_became_active":"2023-08-26T09:25:08.448870+0000","last_became_peered":"2023-08-26T09:25:08.448870+0000","last_unstale":"2023-08-26T09:25:09.519743+0000","last_undegraded":"2023-08-26T09:25:09.519743+0000","last_fullsized":"2023-08-26T09:25:09.519743+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T20:01:01.749385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:12.436134+0000","last_change":"2023-08-26T09:25:12.436134+0000","last_active":"2023-08-26T09:25:12.436134+0000","last_peered":"2023-08-26T09:25:12.436134+0000","last_clean":"2023-08-26T09:25:12.436134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:12.436134+0000","last_undegraded":"2023-08-26T09:25:12.436134+0000","last_fullsized":"2023-08-26T09:25:12.436134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-26T09:25:09.519767+0000","last_change":"2023-08-26T09:25:08.403552+0000","last_active":"2023-08-26T09:25:09.519767+0000","last_peered":"2023-08-26T09:25:09.519767+0000","last_clean":"2023-08-26T09:25:09.519767+0000","last_became_active":"2023-08-26T09:25:08.403261+0000","last_became_peered":"2023-08-26T09:25:08.403261+0000","last_unstale":"2023-08-26T09:25:09.519767+0000","last_undegraded":"2023-08-26T09:25:09.519767+0000","last_fullsized":"2023-08-26T09:25:09.519767+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T21:11:33.740615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:12.436134+0000","last_change":"2023-08-26T09:25:12.436134+0000","last_active":"2023-08-26T09:25:12.436134+0000","last_peered":"2023-08-26T09:25:12.436134+0000","last_clean":"2023-08-26T09:25:12.436134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:12.436134+0000","last_undegraded":"2023-08-26T09:25:12.436134+0000","last_fullsized":"2023-08-26T09:25:12.436134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:12.436134+0000","last_change":"2023-08-26T09:25:12.436134+0000","last_active":"2023-08-26T09:25:12.436134+0000","last_peered":"2023-08-26T09:25:12.436134+0000","last_clean":"2023-08-26T09:25:12.436134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:12.436134+0000","last_undegraded":"2023-08-26T09:25:12.436134+0000","last_fullsized":"2023-08-26T09:25:12.436134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:12.436134+0000","last_change":"2023-08-26T09:25:12.436134+0000","last_active":"2023-08-26T09:25:12.436134+0000","last_peered":"2023-08-26T09:25:12.436134+0000","last_clean":"2023-08-26T09:25:12.436134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:12.436134+0000","last_undegraded":"2023-08-26T09:25:12.436134+0000","last_fullsized":"2023-08-26T09:25:12.436134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:12.436134+0000","last_change":"2023-08-26T09:25:12.436134+0000","last_active":"2023-08-26T09:25:12.436134+0000","last_peered":"2023-08-26T09:25:12.436134+0000","last_clean":"2023-08-26T09:25:12.436134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:12.436134+0000","last_undegraded":"2023-08-26T09:25:12.436134+0000","last_fullsized":"2023-08-26T09:25:12.436134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:12.436134+0000","last_change":"2023-08-26T09:25:12.436134+0000","last_active":"2023-08-26T09:25:12.436134+0000","last_peered":"2023-08-26T09:25:12.436134+0000","last_clean":"2023-08-26T09:25:12.436134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:12.436134+0000","last_undegraded":"2023-08-26T09:25:12.436134+0000","last_fullsized":"2023-08-26T09:25:12.436134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:12.436134+0000","last_change":"2023-08-26T09:25:12.436134+0000","last_active":"2023-08-26T09:25:12.436134+0000","last_peered":"2023-08-26T09:25:12.436134+0000","last_clean":"2023-08-26T09:25:12.436134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:12.436134+0000","last_undegraded":"2023-08-26T09:25:12.436134+0000","last_fullsized":"2023-08-26T09:25:12.436134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-26T09:25:13.441487+0000","last_change":"2023-08-26T09:25:13.441487+0000","last_active":"2023-08-26T09:25:13.441487+0000","last_peered":"2023-08-26T09:25:13.441487+0000","last_clean":"2023-08-26T09:25:13.441487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-26T09:25:13.441487+0000","last_undegraded":"2023-08-26T09:25:13.441487+0000","last_fullsized":"2023-08-26T09:25:13.441487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":749568,"data_stored":638225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":47857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":749568,"data_stored":638225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":151552,"data_stored":46496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":151552,"data_stored":46496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":47857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":47857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":47857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-26T09:25:18.576 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-26T09:25:18.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.724+0000 7fe6f9d33700 1 Processor -- start 2023-08-26T09:25:18.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.724+0000 7fe6f9d33700 1 -- start start 2023-08-26T09:25:18.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.725+0000 7fe6f9d33700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe6f415d670 0x7fe6f40cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:18.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.725+0000 7fe6f9d33700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6f40cbcf0 con 0x7fe6f406aa30 2023-08-26T09:25:18.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.725+0000 7fe6f9d33700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6f40cbfd0 con 0x7fe6f4066230 2023-08-26T09:25:18.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.725+0000 7fe6f9d33700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f40cc2b0 con 0x7fe6f415d670 2023-08-26T09:25:18.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.725+0000 7fe6f3fff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fe6f406aa30 0x7fe6f406ca00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:56474/0 (socket says 172.21.15.92:56474) 2023-08-26T09:25:18.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.725+0000 7fe6f3fff700 1 -- 172.21.15.92:0/1404172056 learned_addr learned my addr 172.21.15.92:0/1404172056 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:18.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.725+0000 7fe6f37fe700 1 --2- 172.21.15.92:0/1404172056 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe6f415d670 0x7fe6f40cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:18.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.725+0000 7fe6f27fc700 1 -- 172.21.15.92:0/1404172056 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2461604412 0 0) 0x7fe6f40cbcf0 con 0x7fe6f406aa30 2023-08-26T09:25:18.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.725+0000 7fe6f27fc700 1 -- 172.21.15.92:0/1404172056 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6e00035b0 con 0x7fe6f406aa30 2023-08-26T09:25:18.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.725+0000 7fe6f27fc700 1 -- 172.21.15.92:0/1404172056 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2504614665 0 0) 0x7fe6f40cbfd0 con 0x7fe6f4066230 2023-08-26T09:25:18.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.726+0000 7fe6f27fc700 1 -- 172.21.15.92:0/1404172056 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6f40cbcf0 con 0x7fe6f4066230 2023-08-26T09:25:18.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.726+0000 7fe6f27fc700 1 -- 172.21.15.92:0/1404172056 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 194995796 0 0) 0x7fe6e00035b0 con 0x7fe6f406aa30 2023-08-26T09:25:18.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.726+0000 7fe6f27fc700 1 -- 172.21.15.92:0/1404172056 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe6f415d670 msgr2=0x7fe6f40cfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:18.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.726+0000 7fe6f27fc700 1 --2- 172.21.15.92:0/1404172056 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe6f415d670 0x7fe6f40cfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:18.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.726+0000 7fe6f27fc700 1 -- 172.21.15.92:0/1404172056 >> v1:172.21.15.188:6789/0 conn(0x7fe6f4066230 legacy=0x7fe6f406a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:18.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.726+0000 7fe6f27fc700 1 -- 172.21.15.92:0/1404172056 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f40cc590 con 0x7fe6f406aa30 2023-08-26T09:25:18.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.726+0000 7fe6f27fc700 1 -- 172.21.15.92:0/1404172056 <== mon.0 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1019361464 0 0) 0x7fe6ec0019f0 con 0x7fe6f406aa30 2023-08-26T09:25:18.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.726+0000 7fe6f27fc700 1 -- 172.21.15.92:0/1404172056 >> v1:172.21.15.92:6789/0 conn(0x7fe6f406aa30 legacy=0x7fe6f406ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:18.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.726+0000 7fe6f27fc700 1 --2- 172.21.15.92:0/1404172056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6e0003bc0 0x7fe6e0003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:18.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.726+0000 7fe6f27fc700 1 --2- 172.21.15.92:0/1404172056 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe6e0004850 0x7fe6e0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:18.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.726+0000 7fe6f27fc700 1 --2- 172.21.15.92:0/1404172056 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6e00051d0 0x7fe6e000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:18.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.726+0000 7fe6f27fc700 1 -- 172.21.15.92:0/1404172056 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f40cc2b0 con 0x7fe6e0003bc0 2023-08-26T09:25:18.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.726+0000 7fe6f27fc700 1 -- 172.21.15.92:0/1404172056 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e000bf50 con 0x7fe6e00051d0 2023-08-26T09:25:18.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.726+0000 7fe6f27fc700 1 -- 172.21.15.92:0/1404172056 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e000c090 con 0x7fe6e0004850 2023-08-26T09:25:18.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.726+0000 7fe6f37fe700 1 --2- 172.21.15.92:0/1404172056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6e0003bc0 0x7fe6e0003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:18.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.726+0000 7fe6f3fff700 1 --2- 172.21.15.92:0/1404172056 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6e00051d0 0x7fe6e000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:18.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.726+0000 7fe6f2ffd700 1 --2- 172.21.15.92:0/1404172056 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe6e0004850 0x7fe6e0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:18.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.726+0000 7fe6f37fe700 1 -- 172.21.15.92:0/1404172056 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe6e0004850 msgr2=0x7fe6e0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:18.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.726+0000 7fe6f37fe700 1 --2- 172.21.15.92:0/1404172056 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe6e0004850 0x7fe6e0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:18.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.726+0000 7fe6f37fe700 1 -- 172.21.15.92:0/1404172056 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6e00051d0 msgr2=0x7fe6e000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:18.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.726+0000 7fe6f37fe700 1 --2- 172.21.15.92:0/1404172056 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6e00051d0 0x7fe6e000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:18.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.726+0000 7fe6f37fe700 1 -- 172.21.15.92:0/1404172056 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e00035b0 con 0x7fe6e0003bc0 2023-08-26T09:25:18.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.726+0000 7fe6f37fe700 1 --2- 172.21.15.92:0/1404172056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6e0003bc0 0x7fe6e0003fc0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc009b40 tx=0x7fe6e0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df1e062a5bd8fd23 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:18.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.726+0000 7fe6f27fc700 1 -- 172.21.15.92:0/1404172056 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc005a20 con 0x7fe6e0003bc0 2023-08-26T09:25:18.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.726+0000 7fe6f27fc700 1 -- 172.21.15.92:0/1404172056 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6dc005b80 con 0x7fe6e0003bc0 2023-08-26T09:25:18.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.726+0000 7fe6f27fc700 1 -- 172.21.15.92:0/1404172056 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc00e6c0 con 0x7fe6e0003bc0 2023-08-26T09:25:18.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.727+0000 7fe6f9d33700 1 -- 172.21.15.92:0/1404172056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6e0003bc0 msgr2=0x7fe6e0003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:18.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.727+0000 7fe6f9d33700 1 --2- 172.21.15.92:0/1404172056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6e0003bc0 0x7fe6e0003fc0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc009b40 tx=0x7fe6e0005880 comp rx=0 tx=0).stop 2023-08-26T09:25:18.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.727+0000 7fe6f3fff700 1 -- 172.21.15.92:0/1404172056 reap_dead start 2023-08-26T09:25:18.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.727+0000 7fe6f9d33700 1 -- 172.21.15.92:0/1404172056 shutdown_connections 2023-08-26T09:25:18.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.727+0000 7fe6f9d33700 1 -- 172.21.15.92:0/1404172056 >> 172.21.15.92:0/1404172056 conn(0x7fe6f40b23c0 msgr2=0x7fe6f40b27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:18.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.727+0000 7fe6f9d33700 1 -- 172.21.15.92:0/1404172056 shutdown_connections 2023-08-26T09:25:18.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.727+0000 7fe6f9d33700 1 -- 172.21.15.92:0/1404172056 wait complete. 2023-08-26T09:25:18.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.728+0000 7fe6f9d33700 1 Processor -- start 2023-08-26T09:25:18.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.728+0000 7fe6f9d33700 1 -- start start 2023-08-26T09:25:18.744 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:25:18.747 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.729+0000 7fe6f9d33700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6e0003bc0 0x7fe6f4098a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:18.747 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.729+0000 7fe6f9d33700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe6f41e2f30 0x7fe6f41e33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:18.748 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.729+0000 7fe6f9d33700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6f41e6330 0x7fe6f41e67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:18.748 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.729+0000 7fe6f9d33700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f4098f60 con 0x7fe6f41e6330 2023-08-26T09:25:18.748 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.729+0000 7fe6f9d33700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f41e38f0 con 0x7fe6e0003bc0 2023-08-26T09:25:18.748 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.729+0000 7fe6f9d33700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f41e6ff0 con 0x7fe6f41e2f30 2023-08-26T09:25:18.748 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.729+0000 7fe6f3fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6f41e6330 0x7fe6f41e67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:18.749 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.729+0000 7fe6f3fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6f41e6330 0x7fe6f41e67b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44470/0 (socket says 172.21.15.92:44470) 2023-08-26T09:25:18.749 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.729+0000 7fe6f3fff700 1 -- 172.21.15.92:0/552999186 learned_addr learned my addr 172.21.15.92:0/552999186 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:18.749 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.729+0000 7fe6f37fe700 1 --2- 172.21.15.92:0/552999186 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6e0003bc0 0x7fe6f4098a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:18.749 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.729+0000 7fe6f2ffd700 1 --2- 172.21.15.92:0/552999186 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe6f41e2f30 0x7fe6f41e33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:18.749 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.729+0000 7fe6f3fff700 1 -- 172.21.15.92:0/552999186 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe6f41e2f30 msgr2=0x7fe6f41e33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:18.749 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.729+0000 7fe6f3fff700 1 --2- 172.21.15.92:0/552999186 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe6f41e2f30 0x7fe6f41e33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:18.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.729+0000 7fe6f3fff700 1 -- 172.21.15.92:0/552999186 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6e0003bc0 msgr2=0x7fe6f4098a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:18.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.729+0000 7fe6f3fff700 1 --2- 172.21.15.92:0/552999186 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6e0003bc0 0x7fe6f4098a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:18.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.729+0000 7fe6f3fff700 1 -- 172.21.15.92:0/552999186 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f41e72d0 con 0x7fe6f41e6330 2023-08-26T09:25:18.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.729+0000 7fe6f37fe700 1 --2- 172.21.15.92:0/552999186 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6e0003bc0 0x7fe6f4098a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:18.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.730+0000 7fe6f3fff700 1 --2- 172.21.15.92:0/552999186 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6f41e6330 0x7fe6f41e67b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec001330 tx=0x7fe6ec00a5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:18.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.730+0000 7fe6ebfff700 1 -- 172.21.15.92:0/552999186 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec00aea0 con 0x7fe6f41e6330 2023-08-26T09:25:18.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.730+0000 7fe6ebfff700 1 -- 172.21.15.92:0/552999186 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6ec0133f0 con 0x7fe6f41e6330 2023-08-26T09:25:18.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.730+0000 7fe6f9d33700 1 -- 172.21.15.92:0/552999186 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6f41e75b0 con 0x7fe6f41e6330 2023-08-26T09:25:18.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.730+0000 7fe6ebfff700 1 -- 172.21.15.92:0/552999186 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec0137a0 con 0x7fe6f41e6330 2023-08-26T09:25:18.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.730+0000 7fe6f9d33700 1 -- 172.21.15.92:0/552999186 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6f41e6cf0 con 0x7fe6f41e6330 2023-08-26T09:25:18.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.731+0000 7fe6f9d33700 1 -- 172.21.15.92:0/552999186 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6f404e660 con 0x7fe6f41e6330 2023-08-26T09:25:18.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.731+0000 7fe6ebfff700 1 -- 172.21.15.92:0/552999186 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe6ec013900 con 0x7fe6f41e6330 2023-08-26T09:25:18.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.731+0000 7fe6ebfff700 1 --2- 172.21.15.92:0/552999186 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fe6d406a0e0 0x7fe6d406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:18.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.731+0000 7fe6ebfff700 1 -- 172.21.15.92:0/552999186 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe6ec0891e0 con 0x7fe6f41e6330 2023-08-26T09:25:18.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.731+0000 7fe6f37fe700 1 --2- 172.21.15.92:0/552999186 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fe6d406a0e0 0x7fe6d406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:18.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.732+0000 7fe6f37fe700 1 --2- 172.21.15.92:0/552999186 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fe6d406a0e0 0x7fe6d406c5a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc000c00 tx=0x7fe6dc008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:18.753 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.736+0000 7fe6ebfff700 1 -- 172.21.15.92:0/552999186 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe6ec054960 con 0x7fe6f41e6330 2023-08-26T09:25:18.754 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:25:18.933 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.928+0000 7fe6f9d33700 1 -- 172.21.15.92:0/552999186 --> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe6f40ccd90 con 0x7fe6d406a0e0 2023-08-26T09:25:18.940 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.936+0000 7fe6ebfff700 1 -- 172.21.15.92:0/552999186 <== mgr.4107 v2:172.21.15.92:6832/1988454907 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286994 (secure 0 0 0) 0x7fe6dc021040 con 0x7fe6d406a0e0 2023-08-26T09:25:18.944 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:25:18.946 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.939+0000 7fe6f9d33700 1 -- 172.21.15.92:0/552999186 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fe6d406a0e0 msgr2=0x7fe6d406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:18.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.939+0000 7fe6f9d33700 1 --2- 172.21.15.92:0/552999186 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fe6d406a0e0 0x7fe6d406c5a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc000c00 tx=0x7fe6dc008030 comp rx=0 tx=0).stop 2023-08-26T09:25:18.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.939+0000 7fe6f9d33700 1 -- 172.21.15.92:0/552999186 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6f41e6330 msgr2=0x7fe6f41e67b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:18.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.939+0000 7fe6f9d33700 1 --2- 172.21.15.92:0/552999186 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6f41e6330 0x7fe6f41e67b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec001330 tx=0x7fe6ec00a5b0 comp rx=0 tx=0).stop 2023-08-26T09:25:18.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.939+0000 7fe6f9d33700 1 -- 172.21.15.92:0/552999186 shutdown_connections 2023-08-26T09:25:18.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.939+0000 7fe6f9d33700 1 --2- 172.21.15.92:0/552999186 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fe6d406a0e0 0x7fe6d406c5a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:18.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.939+0000 7fe6f9d33700 1 --2- 172.21.15.92:0/552999186 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6e0003bc0 0x7fe6f4098a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:18.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.939+0000 7fe6f9d33700 1 --2- 172.21.15.92:0/552999186 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6f41e6330 0x7fe6f41e67b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:18.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.939+0000 7fe6f9d33700 1 --2- 172.21.15.92:0/552999186 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe6f41e2f30 0x7fe6f41e33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:18.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.939+0000 7fe6f9d33700 1 -- 172.21.15.92:0/552999186 >> 172.21.15.92:0/552999186 conn(0x7fe6f40b23c0 msgr2=0x7fe6f41535a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:18.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.939+0000 7fe6f9d33700 1 -- 172.21.15.92:0/552999186 shutdown_connections 2023-08-26T09:25:18.949 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:18.939+0000 7fe6f9d33700 1 -- 172.21.15.92:0/552999186 wait complete. 2023-08-26T09:25:18.949 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2023-08-26T09:25:18.956 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-08-26T09:25:18.929409+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219032,"kb_used_data":2816,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755688,"statfs":{"total":773094113280,"available":772869824512,"internally_reserved":0,"allocated":2883584,"data_stored":1778258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001224"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912486+0000","last_change":"2023-08-26T09:25:14.464286+0000","last_active":"2023-08-26T09:25:15.912486+0000","last_peered":"2023-08-26T09:25:15.912486+0000","last_clean":"2023-08-26T09:25:15.912486+0000","last_became_active":"2023-08-26T09:25:14.463990+0000","last_became_peered":"2023-08-26T09:25:14.463990+0000","last_unstale":"2023-08-26T09:25:15.912486+0000","last_undegraded":"2023-08-26T09:25:15.912486+0000","last_fullsized":"2023-08-26T09:25:15.912486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T10:28:24.469066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912986+0000","last_change":"2023-08-26T09:25:14.478324+0000","last_active":"2023-08-26T09:25:15.912986+0000","last_peered":"2023-08-26T09:25:15.912986+0000","last_clean":"2023-08-26T09:25:15.912986+0000","last_became_active":"2023-08-26T09:25:14.477999+0000","last_became_peered":"2023-08-26T09:25:14.477999+0000","last_unstale":"2023-08-26T09:25:15.912986+0000","last_undegraded":"2023-08-26T09:25:15.912986+0000","last_fullsized":"2023-08-26T09:25:15.912986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:40:12.427554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456847+0000","last_change":"2023-08-26T09:25:14.480250+0000","last_active":"2023-08-26T09:25:15.456847+0000","last_peered":"2023-08-26T09:25:15.456847+0000","last_clean":"2023-08-26T09:25:15.456847+0000","last_became_active":"2023-08-26T09:25:14.478388+0000","last_became_peered":"2023-08-26T09:25:14.478388+0000","last_unstale":"2023-08-26T09:25:15.456847+0000","last_undegraded":"2023-08-26T09:25:15.456847+0000","last_fullsized":"2023-08-26T09:25:15.456847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:47:09.883784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914035+0000","last_change":"2023-08-26T09:25:14.465651+0000","last_active":"2023-08-26T09:25:15.914035+0000","last_peered":"2023-08-26T09:25:15.914035+0000","last_clean":"2023-08-26T09:25:15.914035+0000","last_became_active":"2023-08-26T09:25:14.465256+0000","last_became_peered":"2023-08-26T09:25:14.465256+0000","last_unstale":"2023-08-26T09:25:15.914035+0000","last_undegraded":"2023-08-26T09:25:15.914035+0000","last_fullsized":"2023-08-26T09:25:15.914035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T12:36:01.054979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912897+0000","last_change":"2023-08-26T09:25:14.464842+0000","last_active":"2023-08-26T09:25:15.912897+0000","last_peered":"2023-08-26T09:25:15.912897+0000","last_clean":"2023-08-26T09:25:15.912897+0000","last_became_active":"2023-08-26T09:25:14.464583+0000","last_became_peered":"2023-08-26T09:25:14.464583+0000","last_unstale":"2023-08-26T09:25:15.912897+0000","last_undegraded":"2023-08-26T09:25:15.912897+0000","last_fullsized":"2023-08-26T09:25:15.912897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:40:12.427554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456323+0000","last_change":"2023-08-26T09:25:14.477270+0000","last_active":"2023-08-26T09:25:15.456323+0000","last_peered":"2023-08-26T09:25:15.456323+0000","last_clean":"2023-08-26T09:25:15.456323+0000","last_became_active":"2023-08-26T09:25:14.476947+0000","last_became_peered":"2023-08-26T09:25:14.476947+0000","last_unstale":"2023-08-26T09:25:15.456323+0000","last_undegraded":"2023-08-26T09:25:15.456323+0000","last_fullsized":"2023-08-26T09:25:15.456323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:57:39.300454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914251+0000","last_change":"2023-08-26T09:25:14.481184+0000","last_active":"2023-08-26T09:25:15.914251+0000","last_peered":"2023-08-26T09:25:15.914251+0000","last_clean":"2023-08-26T09:25:15.914251+0000","last_became_active":"2023-08-26T09:25:14.480546+0000","last_became_peered":"2023-08-26T09:25:14.480546+0000","last_unstale":"2023-08-26T09:25:15.914251+0000","last_undegraded":"2023-08-26T09:25:15.914251+0000","last_fullsized":"2023-08-26T09:25:15.914251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T12:08:55.397933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912826+0000","last_change":"2023-08-26T09:25:14.476072+0000","last_active":"2023-08-26T09:25:15.912826+0000","last_peered":"2023-08-26T09:25:15.912826+0000","last_clean":"2023-08-26T09:25:15.912826+0000","last_became_active":"2023-08-26T09:25:14.475757+0000","last_became_peered":"2023-08-26T09:25:14.475757+0000","last_unstale":"2023-08-26T09:25:15.912826+0000","last_undegraded":"2023-08-26T09:25:15.912826+0000","last_fullsized":"2023-08-26T09:25:15.912826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:35:42.200335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912764+0000","last_change":"2023-08-26T09:25:14.465769+0000","last_active":"2023-08-26T09:25:15.912764+0000","last_peered":"2023-08-26T09:25:15.912764+0000","last_clean":"2023-08-26T09:25:15.912764+0000","last_became_active":"2023-08-26T09:25:14.465320+0000","last_became_peered":"2023-08-26T09:25:14.465320+0000","last_unstale":"2023-08-26T09:25:15.912764+0000","last_undegraded":"2023-08-26T09:25:15.912764+0000","last_fullsized":"2023-08-26T09:25:15.912764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:35:42.200335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.913305+0000","last_change":"2023-08-26T09:25:14.474303+0000","last_active":"2023-08-26T09:25:15.913305+0000","last_peered":"2023-08-26T09:25:15.913305+0000","last_clean":"2023-08-26T09:25:15.913305+0000","last_became_active":"2023-08-26T09:25:14.474007+0000","last_became_peered":"2023-08-26T09:25:14.474007+0000","last_unstale":"2023-08-26T09:25:15.913305+0000","last_undegraded":"2023-08-26T09:25:15.913305+0000","last_fullsized":"2023-08-26T09:25:15.913305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:08:30.313992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456892+0000","last_change":"2023-08-26T09:25:14.481555+0000","last_active":"2023-08-26T09:25:15.456892+0000","last_peered":"2023-08-26T09:25:15.456892+0000","last_clean":"2023-08-26T09:25:15.456892+0000","last_became_active":"2023-08-26T09:25:14.481266+0000","last_became_peered":"2023-08-26T09:25:14.481266+0000","last_unstale":"2023-08-26T09:25:15.456892+0000","last_undegraded":"2023-08-26T09:25:15.456892+0000","last_fullsized":"2023-08-26T09:25:15.456892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T16:56:24.503758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912603+0000","last_change":"2023-08-26T09:25:14.483240+0000","last_active":"2023-08-26T09:25:15.912603+0000","last_peered":"2023-08-26T09:25:15.912603+0000","last_clean":"2023-08-26T09:25:15.912603+0000","last_became_active":"2023-08-26T09:25:14.482944+0000","last_became_peered":"2023-08-26T09:25:14.482944+0000","last_unstale":"2023-08-26T09:25:15.912603+0000","last_undegraded":"2023-08-26T09:25:15.912603+0000","last_fullsized":"2023-08-26T09:25:15.912603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T19:09:52.055178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912575+0000","last_change":"2023-08-26T09:25:14.467043+0000","last_active":"2023-08-26T09:25:15.912575+0000","last_peered":"2023-08-26T09:25:15.912575+0000","last_clean":"2023-08-26T09:25:15.912575+0000","last_became_active":"2023-08-26T09:25:14.466612+0000","last_became_peered":"2023-08-26T09:25:14.466612+0000","last_unstale":"2023-08-26T09:25:15.912575+0000","last_undegraded":"2023-08-26T09:25:15.912575+0000","last_fullsized":"2023-08-26T09:25:15.912575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T13:47:16.562890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.913110+0000","last_change":"2023-08-26T09:25:14.475578+0000","last_active":"2023-08-26T09:25:15.913110+0000","last_peered":"2023-08-26T09:25:15.913110+0000","last_clean":"2023-08-26T09:25:15.913110+0000","last_became_active":"2023-08-26T09:25:14.475270+0000","last_became_peered":"2023-08-26T09:25:14.475270+0000","last_unstale":"2023-08-26T09:25:15.913110+0000","last_undegraded":"2023-08-26T09:25:15.913110+0000","last_fullsized":"2023-08-26T09:25:15.913110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:39:35.210853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914404+0000","last_change":"2023-08-26T09:25:14.481338+0000","last_active":"2023-08-26T09:25:15.914404+0000","last_peered":"2023-08-26T09:25:15.914404+0000","last_clean":"2023-08-26T09:25:15.914404+0000","last_became_active":"2023-08-26T09:25:14.480937+0000","last_became_peered":"2023-08-26T09:25:14.480937+0000","last_unstale":"2023-08-26T09:25:15.914404+0000","last_undegraded":"2023-08-26T09:25:15.914404+0000","last_fullsized":"2023-08-26T09:25:15.914404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T10:30:08.408755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456272+0000","last_change":"2023-08-26T09:25:14.478860+0000","last_active":"2023-08-26T09:25:15.456272+0000","last_peered":"2023-08-26T09:25:15.456272+0000","last_clean":"2023-08-26T09:25:15.456272+0000","last_became_active":"2023-08-26T09:25:14.475252+0000","last_became_peered":"2023-08-26T09:25:14.475252+0000","last_unstale":"2023-08-26T09:25:15.456272+0000","last_undegraded":"2023-08-26T09:25:15.456272+0000","last_fullsized":"2023-08-26T09:25:15.456272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:08:30.313992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912833+0000","last_change":"2023-08-26T09:25:14.465951+0000","last_active":"2023-08-26T09:25:15.912833+0000","last_peered":"2023-08-26T09:25:15.912833+0000","last_clean":"2023-08-26T09:25:15.912833+0000","last_became_active":"2023-08-26T09:25:14.465336+0000","last_became_peered":"2023-08-26T09:25:14.465336+0000","last_unstale":"2023-08-26T09:25:15.912833+0000","last_undegraded":"2023-08-26T09:25:15.912833+0000","last_fullsized":"2023-08-26T09:25:15.912833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T17:36:47.712402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.457012+0000","last_change":"2023-08-26T09:25:14.480642+0000","last_active":"2023-08-26T09:25:15.457012+0000","last_peered":"2023-08-26T09:25:15.457012+0000","last_clean":"2023-08-26T09:25:15.457012+0000","last_became_active":"2023-08-26T09:25:14.477065+0000","last_became_peered":"2023-08-26T09:25:14.477065+0000","last_unstale":"2023-08-26T09:25:15.457012+0000","last_undegraded":"2023-08-26T09:25:15.457012+0000","last_fullsized":"2023-08-26T09:25:15.457012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T16:55:45.411292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912654+0000","last_change":"2023-08-26T09:25:14.473064+0000","last_active":"2023-08-26T09:25:15.912654+0000","last_peered":"2023-08-26T09:25:15.912654+0000","last_clean":"2023-08-26T09:25:15.912654+0000","last_became_active":"2023-08-26T09:25:14.472726+0000","last_became_peered":"2023-08-26T09:25:14.472726+0000","last_unstale":"2023-08-26T09:25:15.912654+0000","last_undegraded":"2023-08-26T09:25:15.912654+0000","last_fullsized":"2023-08-26T09:25:15.912654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T14:27:21.893277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456821+0000","last_change":"2023-08-26T09:25:14.477899+0000","last_active":"2023-08-26T09:25:15.456821+0000","last_peered":"2023-08-26T09:25:15.456821+0000","last_clean":"2023-08-26T09:25:15.456821+0000","last_became_active":"2023-08-26T09:25:14.477646+0000","last_became_peered":"2023-08-26T09:25:14.477646+0000","last_unstale":"2023-08-26T09:25:15.456821+0000","last_undegraded":"2023-08-26T09:25:15.456821+0000","last_fullsized":"2023-08-26T09:25:15.456821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T21:16:03.436585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914892+0000","last_change":"2023-08-26T09:25:14.474723+0000","last_active":"2023-08-26T09:25:15.914892+0000","last_peered":"2023-08-26T09:25:15.914892+0000","last_clean":"2023-08-26T09:25:15.914892+0000","last_became_active":"2023-08-26T09:25:14.474265+0000","last_became_peered":"2023-08-26T09:25:14.474265+0000","last_unstale":"2023-08-26T09:25:15.914892+0000","last_undegraded":"2023-08-26T09:25:15.914892+0000","last_fullsized":"2023-08-26T09:25:15.914892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:50:25.845586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912833+0000","last_change":"2023-08-26T09:25:14.480019+0000","last_active":"2023-08-26T09:25:15.912833+0000","last_peered":"2023-08-26T09:25:15.912833+0000","last_clean":"2023-08-26T09:25:15.912833+0000","last_became_active":"2023-08-26T09:25:14.479765+0000","last_became_peered":"2023-08-26T09:25:14.479765+0000","last_unstale":"2023-08-26T09:25:15.912833+0000","last_undegraded":"2023-08-26T09:25:15.912833+0000","last_fullsized":"2023-08-26T09:25:15.912833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:53:08.855565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.450667+0000","last_change":"2023-08-26T09:25:14.467611+0000","last_active":"2023-08-26T09:25:15.450667+0000","last_peered":"2023-08-26T09:25:15.450667+0000","last_clean":"2023-08-26T09:25:15.450667+0000","last_became_active":"2023-08-26T09:25:14.467315+0000","last_became_peered":"2023-08-26T09:25:14.467315+0000","last_unstale":"2023-08-26T09:25:15.450667+0000","last_undegraded":"2023-08-26T09:25:15.450667+0000","last_fullsized":"2023-08-26T09:25:15.450667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T20:25:04.985842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914297+0000","last_change":"2023-08-26T09:25:14.474950+0000","last_active":"2023-08-26T09:25:15.914297+0000","last_peered":"2023-08-26T09:25:15.914297+0000","last_clean":"2023-08-26T09:25:15.914297+0000","last_became_active":"2023-08-26T09:25:14.474642+0000","last_became_peered":"2023-08-26T09:25:14.474642+0000","last_unstale":"2023-08-26T09:25:15.914297+0000","last_undegraded":"2023-08-26T09:25:15.914297+0000","last_fullsized":"2023-08-26T09:25:15.914297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T19:36:33.198355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.455614+0000","last_change":"2023-08-26T09:25:14.477808+0000","last_active":"2023-08-26T09:25:15.455614+0000","last_peered":"2023-08-26T09:25:15.455614+0000","last_clean":"2023-08-26T09:25:15.455614+0000","last_became_active":"2023-08-26T09:25:14.477502+0000","last_became_peered":"2023-08-26T09:25:14.477502+0000","last_unstale":"2023-08-26T09:25:15.455614+0000","last_undegraded":"2023-08-26T09:25:15.455614+0000","last_fullsized":"2023-08-26T09:25:15.455614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:40:12.427554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.455764+0000","last_change":"2023-08-26T09:25:14.478759+0000","last_active":"2023-08-26T09:25:15.455764+0000","last_peered":"2023-08-26T09:25:15.455764+0000","last_clean":"2023-08-26T09:25:15.455764+0000","last_became_active":"2023-08-26T09:25:14.478540+0000","last_became_peered":"2023-08-26T09:25:14.478540+0000","last_unstale":"2023-08-26T09:25:15.455764+0000","last_undegraded":"2023-08-26T09:25:15.455764+0000","last_fullsized":"2023-08-26T09:25:15.455764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T13:55:45.487107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.913386+0000","last_change":"2023-08-26T09:25:14.479900+0000","last_active":"2023-08-26T09:25:15.913386+0000","last_peered":"2023-08-26T09:25:15.913386+0000","last_clean":"2023-08-26T09:25:15.913386+0000","last_became_active":"2023-08-26T09:25:14.479407+0000","last_became_peered":"2023-08-26T09:25:14.479407+0000","last_unstale":"2023-08-26T09:25:15.913386+0000","last_undegraded":"2023-08-26T09:25:15.913386+0000","last_fullsized":"2023-08-26T09:25:15.913386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:41:19.138754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456515+0000","last_change":"2023-08-26T09:25:13.467208+0000","last_active":"2023-08-26T09:25:15.456515+0000","last_peered":"2023-08-26T09:25:15.456515+0000","last_clean":"2023-08-26T09:25:15.456515+0000","last_became_active":"2023-08-26T09:25:13.466920+0000","last_became_peered":"2023-08-26T09:25:13.466920+0000","last_unstale":"2023-08-26T09:25:15.456515+0000","last_undegraded":"2023-08-26T09:25:15.456515+0000","last_fullsized":"2023-08-26T09:25:15.456515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T13:12:05.420158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.450851+0000","last_change":"2023-08-26T09:25:14.474437+0000","last_active":"2023-08-26T09:25:15.450851+0000","last_peered":"2023-08-26T09:25:15.450851+0000","last_clean":"2023-08-26T09:25:15.450851+0000","last_became_active":"2023-08-26T09:25:14.474159+0000","last_became_peered":"2023-08-26T09:25:14.474159+0000","last_unstale":"2023-08-26T09:25:15.450851+0000","last_undegraded":"2023-08-26T09:25:15.450851+0000","last_fullsized":"2023-08-26T09:25:15.450851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T19:36:33.198355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.455463+0000","last_change":"2023-08-26T09:25:13.473039+0000","last_active":"2023-08-26T09:25:15.455463+0000","last_peered":"2023-08-26T09:25:15.455463+0000","last_clean":"2023-08-26T09:25:15.455463+0000","last_became_active":"2023-08-26T09:25:13.472691+0000","last_became_peered":"2023-08-26T09:25:13.472691+0000","last_unstale":"2023-08-26T09:25:15.455463+0000","last_undegraded":"2023-08-26T09:25:15.455463+0000","last_fullsized":"2023-08-26T09:25:15.455463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T17:36:46.707048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.913417+0000","last_change":"2023-08-26T09:25:14.476192+0000","last_active":"2023-08-26T09:25:15.913417+0000","last_peered":"2023-08-26T09:25:15.913417+0000","last_clean":"2023-08-26T09:25:15.913417+0000","last_became_active":"2023-08-26T09:25:14.475936+0000","last_became_peered":"2023-08-26T09:25:14.475936+0000","last_unstale":"2023-08-26T09:25:15.913417+0000","last_undegraded":"2023-08-26T09:25:15.913417+0000","last_fullsized":"2023-08-26T09:25:15.913417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:08:05.287372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.451045+0000","last_change":"2023-08-26T09:25:13.464715+0000","last_active":"2023-08-26T09:25:15.451045+0000","last_peered":"2023-08-26T09:25:15.451045+0000","last_clean":"2023-08-26T09:25:15.451045+0000","last_became_active":"2023-08-26T09:25:13.462699+0000","last_became_peered":"2023-08-26T09:25:13.462699+0000","last_unstale":"2023-08-26T09:25:15.451045+0000","last_undegraded":"2023-08-26T09:25:15.451045+0000","last_fullsized":"2023-08-26T09:25:15.451045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T17:21:10.806672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914232+0000","last_change":"2023-08-26T09:25:14.468187+0000","last_active":"2023-08-26T09:25:15.914232+0000","last_peered":"2023-08-26T09:25:15.914232+0000","last_clean":"2023-08-26T09:25:15.914232+0000","last_became_active":"2023-08-26T09:25:14.467908+0000","last_became_peered":"2023-08-26T09:25:14.467908+0000","last_unstale":"2023-08-26T09:25:15.914232+0000","last_undegraded":"2023-08-26T09:25:15.914232+0000","last_fullsized":"2023-08-26T09:25:15.914232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:35:42.200335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912929+0000","last_change":"2023-08-26T09:25:13.465714+0000","last_active":"2023-08-26T09:25:15.912929+0000","last_peered":"2023-08-26T09:25:15.912929+0000","last_clean":"2023-08-26T09:25:15.912929+0000","last_became_active":"2023-08-26T09:25:13.465457+0000","last_became_peered":"2023-08-26T09:25:13.465457+0000","last_unstale":"2023-08-26T09:25:15.912929+0000","last_undegraded":"2023-08-26T09:25:15.912929+0000","last_fullsized":"2023-08-26T09:25:15.912929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T16:12:41.071106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.450927+0000","last_change":"2023-08-26T09:25:14.480898+0000","last_active":"2023-08-26T09:25:15.450927+0000","last_peered":"2023-08-26T09:25:15.450927+0000","last_clean":"2023-08-26T09:25:15.450927+0000","last_became_active":"2023-08-26T09:25:14.480599+0000","last_became_peered":"2023-08-26T09:25:14.480599+0000","last_unstale":"2023-08-26T09:25:15.450927+0000","last_undegraded":"2023-08-26T09:25:15.450927+0000","last_fullsized":"2023-08-26T09:25:15.450927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T10:30:08.408755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.913038+0000","last_change":"2023-08-26T09:25:13.465637+0000","last_active":"2023-08-26T09:25:15.913038+0000","last_peered":"2023-08-26T09:25:15.913038+0000","last_clean":"2023-08-26T09:25:15.913038+0000","last_became_active":"2023-08-26T09:25:13.465347+0000","last_became_peered":"2023-08-26T09:25:13.465347+0000","last_unstale":"2023-08-26T09:25:15.913038+0000","last_undegraded":"2023-08-26T09:25:15.913038+0000","last_fullsized":"2023-08-26T09:25:15.913038+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T16:12:41.071106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.450800+0000","last_change":"2023-08-26T09:25:14.481625+0000","last_active":"2023-08-26T09:25:15.450800+0000","last_peered":"2023-08-26T09:25:15.450800+0000","last_clean":"2023-08-26T09:25:15.450800+0000","last_became_active":"2023-08-26T09:25:14.481225+0000","last_became_peered":"2023-08-26T09:25:14.481225+0000","last_unstale":"2023-08-26T09:25:15.450800+0000","last_undegraded":"2023-08-26T09:25:15.450800+0000","last_fullsized":"2023-08-26T09:25:15.450800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:57:39.300454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914883+0000","last_change":"2023-08-26T09:25:13.472891+0000","last_active":"2023-08-26T09:25:15.914883+0000","last_peered":"2023-08-26T09:25:15.914883+0000","last_clean":"2023-08-26T09:25:15.914883+0000","last_became_active":"2023-08-26T09:25:13.472559+0000","last_became_peered":"2023-08-26T09:25:13.472559+0000","last_unstale":"2023-08-26T09:25:15.914883+0000","last_undegraded":"2023-08-26T09:25:15.914883+0000","last_fullsized":"2023-08-26T09:25:15.914883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:47:08.878431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.455409+0000","last_change":"2023-08-26T09:25:14.477752+0000","last_active":"2023-08-26T09:25:15.455409+0000","last_peered":"2023-08-26T09:25:15.455409+0000","last_clean":"2023-08-26T09:25:15.455409+0000","last_became_active":"2023-08-26T09:25:14.477352+0000","last_became_peered":"2023-08-26T09:25:14.477352+0000","last_unstale":"2023-08-26T09:25:15.455409+0000","last_undegraded":"2023-08-26T09:25:15.455409+0000","last_fullsized":"2023-08-26T09:25:15.455409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:35:42.200335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456948+0000","last_change":"2023-08-26T09:25:13.463758+0000","last_active":"2023-08-26T09:25:15.456948+0000","last_peered":"2023-08-26T09:25:15.456948+0000","last_clean":"2023-08-26T09:25:15.456948+0000","last_became_active":"2023-08-26T09:25:13.462510+0000","last_became_peered":"2023-08-26T09:25:13.462510+0000","last_unstale":"2023-08-26T09:25:15.456948+0000","last_undegraded":"2023-08-26T09:25:15.456948+0000","last_fullsized":"2023-08-26T09:25:15.456948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T17:28:48.518473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456875+0000","last_change":"2023-08-26T09:25:14.471833+0000","last_active":"2023-08-26T09:25:15.456875+0000","last_peered":"2023-08-26T09:25:15.456875+0000","last_clean":"2023-08-26T09:25:15.456875+0000","last_became_active":"2023-08-26T09:25:14.471529+0000","last_became_peered":"2023-08-26T09:25:14.471529+0000","last_unstale":"2023-08-26T09:25:15.456875+0000","last_undegraded":"2023-08-26T09:25:15.456875+0000","last_fullsized":"2023-08-26T09:25:15.456875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:50:25.845586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914699+0000","last_change":"2023-08-26T09:25:13.467178+0000","last_active":"2023-08-26T09:25:15.914699+0000","last_peered":"2023-08-26T09:25:15.914699+0000","last_clean":"2023-08-26T09:25:15.914699+0000","last_became_active":"2023-08-26T09:25:13.466871+0000","last_became_peered":"2023-08-26T09:25:13.466871+0000","last_unstale":"2023-08-26T09:25:15.914699+0000","last_undegraded":"2023-08-26T09:25:15.914699+0000","last_fullsized":"2023-08-26T09:25:15.914699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T20:38:25.405572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.451584+0000","last_change":"2023-08-26T09:25:14.474363+0000","last_active":"2023-08-26T09:25:15.451584+0000","last_peered":"2023-08-26T09:25:15.451584+0000","last_clean":"2023-08-26T09:25:15.451584+0000","last_became_active":"2023-08-26T09:25:14.473676+0000","last_became_peered":"2023-08-26T09:25:14.473676+0000","last_unstale":"2023-08-26T09:25:15.451584+0000","last_undegraded":"2023-08-26T09:25:15.451584+0000","last_fullsized":"2023-08-26T09:25:15.451584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:32:16.860545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912984+0000","last_change":"2023-08-26T09:25:13.465320+0000","last_active":"2023-08-26T09:25:15.912984+0000","last_peered":"2023-08-26T09:25:15.912984+0000","last_clean":"2023-08-26T09:25:15.912984+0000","last_became_active":"2023-08-26T09:25:13.465025+0000","last_became_peered":"2023-08-26T09:25:13.465025+0000","last_unstale":"2023-08-26T09:25:15.912984+0000","last_undegraded":"2023-08-26T09:25:15.912984+0000","last_fullsized":"2023-08-26T09:25:15.912984+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:39:34.205499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.913337+0000","last_change":"2023-08-26T09:25:14.479704+0000","last_active":"2023-08-26T09:25:15.913337+0000","last_peered":"2023-08-26T09:25:15.913337+0000","last_clean":"2023-08-26T09:25:15.913337+0000","last_became_active":"2023-08-26T09:25:14.479039+0000","last_became_peered":"2023-08-26T09:25:14.479039+0000","last_unstale":"2023-08-26T09:25:15.913337+0000","last_undegraded":"2023-08-26T09:25:15.913337+0000","last_fullsized":"2023-08-26T09:25:15.913337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:57:39.300454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914313+0000","last_change":"2023-08-26T09:25:13.465191+0000","last_active":"2023-08-26T09:25:15.914313+0000","last_peered":"2023-08-26T09:25:15.914313+0000","last_clean":"2023-08-26T09:25:15.914313+0000","last_became_active":"2023-08-26T09:25:13.464895+0000","last_became_peered":"2023-08-26T09:25:13.464895+0000","last_unstale":"2023-08-26T09:25:15.914313+0000","last_undegraded":"2023-08-26T09:25:15.914313+0000","last_fullsized":"2023-08-26T09:25:15.914313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:08:04.282019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.913110+0000","last_change":"2023-08-26T09:25:14.461784+0000","last_active":"2023-08-26T09:25:15.913110+0000","last_peered":"2023-08-26T09:25:15.913110+0000","last_clean":"2023-08-26T09:25:15.913110+0000","last_became_active":"2023-08-26T09:25:14.461510+0000","last_became_peered":"2023-08-26T09:25:14.461510+0000","last_unstale":"2023-08-26T09:25:15.913110+0000","last_undegraded":"2023-08-26T09:25:15.913110+0000","last_fullsized":"2023-08-26T09:25:15.913110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:57:39.300454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.913708+0000","last_change":"2023-08-26T09:25:13.459408+0000","last_active":"2023-08-26T09:25:15.913708+0000","last_peered":"2023-08-26T09:25:15.913708+0000","last_clean":"2023-08-26T09:25:15.913708+0000","last_became_active":"2023-08-26T09:25:13.459125+0000","last_became_peered":"2023-08-26T09:25:13.459125+0000","last_unstale":"2023-08-26T09:25:15.913708+0000","last_undegraded":"2023-08-26T09:25:15.913708+0000","last_fullsized":"2023-08-26T09:25:15.913708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:20:02.388922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.451246+0000","last_change":"2023-08-26T09:25:14.479451+0000","last_active":"2023-08-26T09:25:15.451246+0000","last_peered":"2023-08-26T09:25:15.451246+0000","last_clean":"2023-08-26T09:25:15.451246+0000","last_became_active":"2023-08-26T09:25:14.479170+0000","last_became_peered":"2023-08-26T09:25:14.479170+0000","last_unstale":"2023-08-26T09:25:15.451246+0000","last_undegraded":"2023-08-26T09:25:15.451246+0000","last_fullsized":"2023-08-26T09:25:15.451246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:47:09.883784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914856+0000","last_change":"2023-08-26T09:25:13.466893+0000","last_active":"2023-08-26T09:25:15.914856+0000","last_peered":"2023-08-26T09:25:15.914856+0000","last_clean":"2023-08-26T09:25:15.914856+0000","last_became_active":"2023-08-26T09:25:13.466554+0000","last_became_peered":"2023-08-26T09:25:13.466554+0000","last_unstale":"2023-08-26T09:25:15.914856+0000","last_undegraded":"2023-08-26T09:25:15.914856+0000","last_fullsized":"2023-08-26T09:25:15.914856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T21:16:02.431231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912867+0000","last_change":"2023-08-26T09:25:14.479478+0000","last_active":"2023-08-26T09:25:15.912867+0000","last_peered":"2023-08-26T09:25:15.912867+0000","last_clean":"2023-08-26T09:25:15.912867+0000","last_became_active":"2023-08-26T09:25:14.479194+0000","last_became_peered":"2023-08-26T09:25:14.479194+0000","last_unstale":"2023-08-26T09:25:15.912867+0000","last_undegraded":"2023-08-26T09:25:15.912867+0000","last_fullsized":"2023-08-26T09:25:15.912867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T17:36:47.712402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914741+0000","last_change":"2023-08-26T09:25:13.465149+0000","last_active":"2023-08-26T09:25:15.914741+0000","last_peered":"2023-08-26T09:25:15.914741+0000","last_clean":"2023-08-26T09:25:15.914741+0000","last_became_active":"2023-08-26T09:25:13.464867+0000","last_became_peered":"2023-08-26T09:25:13.464867+0000","last_unstale":"2023-08-26T09:25:15.914741+0000","last_undegraded":"2023-08-26T09:25:15.914741+0000","last_fullsized":"2023-08-26T09:25:15.914741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:32:15.855191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456388+0000","last_change":"2023-08-26T09:25:14.482569+0000","last_active":"2023-08-26T09:25:15.456388+0000","last_peered":"2023-08-26T09:25:15.456388+0000","last_clean":"2023-08-26T09:25:15.456388+0000","last_became_active":"2023-08-26T09:25:14.482335+0000","last_became_peered":"2023-08-26T09:25:14.482335+0000","last_unstale":"2023-08-26T09:25:15.456388+0000","last_undegraded":"2023-08-26T09:25:15.456388+0000","last_fullsized":"2023-08-26T09:25:15.456388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T12:08:55.397933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914864+0000","last_change":"2023-08-26T09:25:13.465796+0000","last_active":"2023-08-26T09:25:15.914864+0000","last_peered":"2023-08-26T09:25:15.914864+0000","last_clean":"2023-08-26T09:25:15.914864+0000","last_became_active":"2023-08-26T09:25:13.465506+0000","last_became_peered":"2023-08-26T09:25:13.465506+0000","last_unstale":"2023-08-26T09:25:15.914864+0000","last_undegraded":"2023-08-26T09:25:15.914864+0000","last_fullsized":"2023-08-26T09:25:15.914864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:34:55.483540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914351+0000","last_change":"2023-08-26T09:25:14.478582+0000","last_active":"2023-08-26T09:25:15.914351+0000","last_peered":"2023-08-26T09:25:15.914351+0000","last_clean":"2023-08-26T09:25:15.914351+0000","last_became_active":"2023-08-26T09:25:14.478305+0000","last_became_peered":"2023-08-26T09:25:14.478305+0000","last_unstale":"2023-08-26T09:25:15.914351+0000","last_undegraded":"2023-08-26T09:25:15.914351+0000","last_fullsized":"2023-08-26T09:25:15.914351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:53:08.855565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.913249+0000","last_change":"2023-08-26T09:25:13.472805+0000","last_active":"2023-08-26T09:25:15.913249+0000","last_peered":"2023-08-26T09:25:15.913249+0000","last_clean":"2023-08-26T09:25:15.913249+0000","last_became_active":"2023-08-26T09:25:13.472533+0000","last_became_peered":"2023-08-26T09:25:13.472533+0000","last_unstale":"2023-08-26T09:25:15.913249+0000","last_undegraded":"2023-08-26T09:25:15.913249+0000","last_fullsized":"2023-08-26T09:25:15.913249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T13:55:44.481753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.913084+0000","last_change":"2023-08-26T09:25:14.475468+0000","last_active":"2023-08-26T09:25:15.913084+0000","last_peered":"2023-08-26T09:25:15.913084+0000","last_clean":"2023-08-26T09:25:15.913084+0000","last_became_active":"2023-08-26T09:25:14.475180+0000","last_became_peered":"2023-08-26T09:25:14.475180+0000","last_unstale":"2023-08-26T09:25:15.913084+0000","last_undegraded":"2023-08-26T09:25:15.913084+0000","last_fullsized":"2023-08-26T09:25:15.913084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:08:30.313992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.451147+0000","last_change":"2023-08-26T09:25:13.462794+0000","last_active":"2023-08-26T09:25:15.451147+0000","last_peered":"2023-08-26T09:25:15.451147+0000","last_clean":"2023-08-26T09:25:15.451147+0000","last_became_active":"2023-08-26T09:25:13.462517+0000","last_became_peered":"2023-08-26T09:25:13.462517+0000","last_unstale":"2023-08-26T09:25:15.451147+0000","last_undegraded":"2023-08-26T09:25:15.451147+0000","last_fullsized":"2023-08-26T09:25:15.451147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T21:16:02.431231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456794+0000","last_change":"2023-08-26T09:25:14.476660+0000","last_active":"2023-08-26T09:25:15.456794+0000","last_peered":"2023-08-26T09:25:15.456794+0000","last_clean":"2023-08-26T09:25:15.456794+0000","last_became_active":"2023-08-26T09:25:14.476382+0000","last_became_peered":"2023-08-26T09:25:14.476382+0000","last_unstale":"2023-08-26T09:25:15.456794+0000","last_undegraded":"2023-08-26T09:25:15.456794+0000","last_fullsized":"2023-08-26T09:25:15.456794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:34:56.488893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914383+0000","last_change":"2023-08-26T09:25:13.461050+0000","last_active":"2023-08-26T09:25:15.914383+0000","last_peered":"2023-08-26T09:25:15.914383+0000","last_clean":"2023-08-26T09:25:15.914383+0000","last_became_active":"2023-08-26T09:25:13.460752+0000","last_became_peered":"2023-08-26T09:25:13.460752+0000","last_unstale":"2023-08-26T09:25:15.914383+0000","last_undegraded":"2023-08-26T09:25:15.914383+0000","last_fullsized":"2023-08-26T09:25:15.914383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:40:11.422201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.457068+0000","last_change":"2023-08-26T09:25:14.475179+0000","last_active":"2023-08-26T09:25:15.457068+0000","last_peered":"2023-08-26T09:25:15.457068+0000","last_clean":"2023-08-26T09:25:15.457068+0000","last_became_active":"2023-08-26T09:25:14.474740+0000","last_became_peered":"2023-08-26T09:25:14.474740+0000","last_unstale":"2023-08-26T09:25:15.457068+0000","last_undegraded":"2023-08-26T09:25:15.457068+0000","last_fullsized":"2023-08-26T09:25:15.457068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:43:46.388415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456598+0000","last_change":"2023-08-26T09:25:13.460000+0000","last_active":"2023-08-26T09:25:15.456598+0000","last_peered":"2023-08-26T09:25:15.456598+0000","last_clean":"2023-08-26T09:25:15.456598+0000","last_became_active":"2023-08-26T09:25:13.459242+0000","last_became_peered":"2023-08-26T09:25:13.459242+0000","last_unstale":"2023-08-26T09:25:15.456598+0000","last_undegraded":"2023-08-26T09:25:15.456598+0000","last_fullsized":"2023-08-26T09:25:15.456598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T10:30:07.403402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.457088+0000","last_change":"2023-08-26T09:25:14.476877+0000","last_active":"2023-08-26T09:25:15.457088+0000","last_peered":"2023-08-26T09:25:15.457088+0000","last_clean":"2023-08-26T09:25:15.457088+0000","last_became_active":"2023-08-26T09:25:14.475838+0000","last_became_peered":"2023-08-26T09:25:14.475838+0000","last_unstale":"2023-08-26T09:25:15.457088+0000","last_undegraded":"2023-08-26T09:25:15.457088+0000","last_fullsized":"2023-08-26T09:25:15.457088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:11:33.355206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.450670+0000","last_change":"2023-08-26T09:25:13.462482+0000","last_active":"2023-08-26T09:25:15.450670+0000","last_peered":"2023-08-26T09:25:15.450670+0000","last_clean":"2023-08-26T09:25:15.450670+0000","last_became_active":"2023-08-26T09:25:13.461712+0000","last_became_peered":"2023-08-26T09:25:13.461712+0000","last_unstale":"2023-08-26T09:25:15.450670+0000","last_undegraded":"2023-08-26T09:25:15.450670+0000","last_fullsized":"2023-08-26T09:25:15.450670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T13:55:44.481753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.455779+0000","last_change":"2023-08-26T09:25:14.477795+0000","last_active":"2023-08-26T09:25:15.455779+0000","last_peered":"2023-08-26T09:25:15.455779+0000","last_clean":"2023-08-26T09:25:15.455779+0000","last_became_active":"2023-08-26T09:25:14.477279+0000","last_became_peered":"2023-08-26T09:25:14.477279+0000","last_unstale":"2023-08-26T09:25:15.455779+0000","last_undegraded":"2023-08-26T09:25:15.455779+0000","last_fullsized":"2023-08-26T09:25:15.455779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:08:30.313992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.451120+0000","last_change":"2023-08-26T09:25:13.464458+0000","last_active":"2023-08-26T09:25:15.451120+0000","last_peered":"2023-08-26T09:25:15.451120+0000","last_clean":"2023-08-26T09:25:15.451120+0000","last_became_active":"2023-08-26T09:25:13.464108+0000","last_became_peered":"2023-08-26T09:25:13.464108+0000","last_unstale":"2023-08-26T09:25:15.451120+0000","last_undegraded":"2023-08-26T09:25:15.451120+0000","last_fullsized":"2023-08-26T09:25:15.451120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:34:55.483540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456941+0000","last_change":"2023-08-26T09:25:08.404814+0000","last_active":"2023-08-26T09:25:15.456941+0000","last_peered":"2023-08-26T09:25:15.456941+0000","last_clean":"2023-08-26T09:25:15.456941+0000","last_became_active":"2023-08-26T09:25:08.404465+0000","last_became_peered":"2023-08-26T09:25:08.404465+0000","last_unstale":"2023-08-26T09:25:15.456941+0000","last_undegraded":"2023-08-26T09:25:15.456941+0000","last_fullsized":"2023-08-26T09:25:15.456941+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T17:16:37.346278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.451541+0000","last_change":"2023-08-26T09:25:14.481693+0000","last_active":"2023-08-26T09:25:15.451541+0000","last_peered":"2023-08-26T09:25:15.451541+0000","last_clean":"2023-08-26T09:25:15.451541+0000","last_became_active":"2023-08-26T09:25:14.481214+0000","last_became_peered":"2023-08-26T09:25:14.481214+0000","last_unstale":"2023-08-26T09:25:15.451541+0000","last_undegraded":"2023-08-26T09:25:15.451541+0000","last_fullsized":"2023-08-26T09:25:15.451541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:41:19.138754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.450798+0000","last_change":"2023-08-26T09:25:08.405372+0000","last_active":"2023-08-26T09:25:15.450798+0000","last_peered":"2023-08-26T09:25:15.450798+0000","last_clean":"2023-08-26T09:25:15.450798+0000","last_became_active":"2023-08-26T09:25:08.404984+0000","last_became_peered":"2023-08-26T09:25:08.404984+0000","last_unstale":"2023-08-26T09:25:15.450798+0000","last_undegraded":"2023-08-26T09:25:15.450798+0000","last_fullsized":"2023-08-26T09:25:15.450798+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T12:08:49.341773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.913530+0000","last_change":"2023-08-26T09:25:13.462159+0000","last_active":"2023-08-26T09:25:15.913530+0000","last_peered":"2023-08-26T09:25:15.913530+0000","last_clean":"2023-08-26T09:25:15.913530+0000","last_became_active":"2023-08-26T09:25:13.461876+0000","last_became_peered":"2023-08-26T09:25:13.461876+0000","last_unstale":"2023-08-26T09:25:15.913530+0000","last_undegraded":"2023-08-26T09:25:15.913530+0000","last_fullsized":"2023-08-26T09:25:15.913530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T19:36:32.193002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456480+0000","last_change":"2023-08-26T09:25:14.472318+0000","last_active":"2023-08-26T09:25:15.456480+0000","last_peered":"2023-08-26T09:25:15.456480+0000","last_clean":"2023-08-26T09:25:15.456480+0000","last_became_active":"2023-08-26T09:25:14.472047+0000","last_became_peered":"2023-08-26T09:25:14.472047+0000","last_unstale":"2023-08-26T09:25:15.456480+0000","last_undegraded":"2023-08-26T09:25:15.456480+0000","last_fullsized":"2023-08-26T09:25:15.456480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:08:05.287372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.455460+0000","last_change":"2023-08-26T09:25:08.410050+0000","last_active":"2023-08-26T09:25:15.455460+0000","last_peered":"2023-08-26T09:25:15.455460+0000","last_clean":"2023-08-26T09:25:15.455460+0000","last_became_active":"2023-08-26T09:25:08.409798+0000","last_became_peered":"2023-08-26T09:25:08.409798+0000","last_unstale":"2023-08-26T09:25:15.455460+0000","last_undegraded":"2023-08-26T09:25:15.455460+0000","last_fullsized":"2023-08-26T09:25:15.455460+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:53:02.799405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":169,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914315+0000","last_change":"2023-08-26T09:25:08.409089+0000","last_active":"2023-08-26T09:25:15.914315+0000","last_peered":"2023-08-26T09:25:15.914315+0000","last_clean":"2023-08-26T09:25:15.914315+0000","last_became_active":"2023-08-26T09:25:08.408185+0000","last_became_peered":"2023-08-26T09:25:08.408185+0000","last_unstale":"2023-08-26T09:25:15.914315+0000","last_undegraded":"2023-08-26T09:25:15.914315+0000","last_fullsized":"2023-08-26T09:25:15.914315+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T13:12:00.369352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912672+0000","last_change":"2023-08-26T09:25:13.460120+0000","last_active":"2023-08-26T09:25:15.912672+0000","last_peered":"2023-08-26T09:25:15.912672+0000","last_clean":"2023-08-26T09:25:15.912672+0000","last_became_active":"2023-08-26T09:25:13.459827+0000","last_became_peered":"2023-08-26T09:25:13.459827+0000","last_unstale":"2023-08-26T09:25:15.912672+0000","last_undegraded":"2023-08-26T09:25:15.912672+0000","last_fullsized":"2023-08-26T09:25:15.912672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T12:36:00.049625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.913234+0000","last_change":"2023-08-26T09:25:14.480583+0000","last_active":"2023-08-26T09:25:15.913234+0000","last_peered":"2023-08-26T09:25:15.913234+0000","last_clean":"2023-08-26T09:25:15.913234+0000","last_became_active":"2023-08-26T09:25:14.480314+0000","last_became_peered":"2023-08-26T09:25:14.480314+0000","last_unstale":"2023-08-26T09:25:15.913234+0000","last_undegraded":"2023-08-26T09:25:15.913234+0000","last_fullsized":"2023-08-26T09:25:15.913234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T12:08:55.397933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914494+0000","last_change":"2023-08-26T09:25:08.448979+0000","last_active":"2023-08-26T09:25:15.914494+0000","last_peered":"2023-08-26T09:25:15.914494+0000","last_clean":"2023-08-26T09:25:15.914494+0000","last_became_active":"2023-08-26T09:25:08.448706+0000","last_became_peered":"2023-08-26T09:25:08.448706+0000","last_unstale":"2023-08-26T09:25:15.914494+0000","last_undegraded":"2023-08-26T09:25:15.914494+0000","last_fullsized":"2023-08-26T09:25:15.914494+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T17:21:05.755866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.455347+0000","last_change":"2023-08-26T09:25:13.466718+0000","last_active":"2023-08-26T09:25:15.455347+0000","last_peered":"2023-08-26T09:25:15.455347+0000","last_clean":"2023-08-26T09:25:15.455347+0000","last_became_active":"2023-08-26T09:25:13.466411+0000","last_became_peered":"2023-08-26T09:25:13.466411+0000","last_unstale":"2023-08-26T09:25:15.455347+0000","last_undegraded":"2023-08-26T09:25:15.455347+0000","last_fullsized":"2023-08-26T09:25:15.455347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T12:36:00.049625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.455738+0000","last_change":"2023-08-26T09:25:14.477603+0000","last_active":"2023-08-26T09:25:15.455738+0000","last_peered":"2023-08-26T09:25:15.455738+0000","last_clean":"2023-08-26T09:25:15.455738+0000","last_became_active":"2023-08-26T09:25:14.476929+0000","last_became_peered":"2023-08-26T09:25:14.476929+0000","last_unstale":"2023-08-26T09:25:15.455738+0000","last_undegraded":"2023-08-26T09:25:15.455738+0000","last_fullsized":"2023-08-26T09:25:15.455738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:41:19.138754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914092+0000","last_change":"2023-08-26T09:25:08.448601+0000","last_active":"2023-08-26T09:25:15.914092+0000","last_peered":"2023-08-26T09:25:15.914092+0000","last_clean":"2023-08-26T09:25:15.914092+0000","last_became_active":"2023-08-26T09:25:08.448275+0000","last_became_peered":"2023-08-26T09:25:08.448275+0000","last_unstale":"2023-08-26T09:25:15.914092+0000","last_undegraded":"2023-08-26T09:25:15.914092+0000","last_fullsized":"2023-08-26T09:25:15.914092+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:57:33.244294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.450893+0000","last_change":"2023-08-26T09:25:13.464379+0000","last_active":"2023-08-26T09:25:15.450893+0000","last_peered":"2023-08-26T09:25:15.450893+0000","last_clean":"2023-08-26T09:25:15.450893+0000","last_became_active":"2023-08-26T09:25:13.463777+0000","last_became_peered":"2023-08-26T09:25:13.463777+0000","last_unstale":"2023-08-26T09:25:15.450893+0000","last_undegraded":"2023-08-26T09:25:15.450893+0000","last_fullsized":"2023-08-26T09:25:15.450893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T13:12:05.420158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914233+0000","last_change":"2023-08-26T09:25:14.479040+0000","last_active":"2023-08-26T09:25:15.914233+0000","last_peered":"2023-08-26T09:25:15.914233+0000","last_clean":"2023-08-26T09:25:15.914233+0000","last_became_active":"2023-08-26T09:25:14.478759+0000","last_became_peered":"2023-08-26T09:25:14.478759+0000","last_unstale":"2023-08-26T09:25:15.914233+0000","last_undegraded":"2023-08-26T09:25:15.914233+0000","last_fullsized":"2023-08-26T09:25:15.914233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T17:36:47.712402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912847+0000","last_change":"2023-08-26T09:25:08.449014+0000","last_active":"2023-08-26T09:25:15.912847+0000","last_peered":"2023-08-26T09:25:15.912847+0000","last_clean":"2023-08-26T09:25:15.912847+0000","last_became_active":"2023-08-26T09:25:08.448671+0000","last_became_peered":"2023-08-26T09:25:08.448671+0000","last_unstale":"2023-08-26T09:25:15.912847+0000","last_undegraded":"2023-08-26T09:25:15.912847+0000","last_fullsized":"2023-08-26T09:25:15.912847+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:53:02.799405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456678+0000","last_change":"2023-08-26T09:25:13.460870+0000","last_active":"2023-08-26T09:25:15.456678+0000","last_peered":"2023-08-26T09:25:15.456678+0000","last_clean":"2023-08-26T09:25:15.456678+0000","last_became_active":"2023-08-26T09:25:13.460491+0000","last_became_peered":"2023-08-26T09:25:13.460491+0000","last_unstale":"2023-08-26T09:25:15.456678+0000","last_undegraded":"2023-08-26T09:25:15.456678+0000","last_fullsized":"2023-08-26T09:25:15.456678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T20:38:25.405572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.455773+0000","last_change":"2023-08-26T09:25:14.477148+0000","last_active":"2023-08-26T09:25:15.455773+0000","last_peered":"2023-08-26T09:25:15.455773+0000","last_clean":"2023-08-26T09:25:15.455773+0000","last_became_active":"2023-08-26T09:25:14.476854+0000","last_became_peered":"2023-08-26T09:25:14.476854+0000","last_unstale":"2023-08-26T09:25:15.455773+0000","last_undegraded":"2023-08-26T09:25:15.455773+0000","last_fullsized":"2023-08-26T09:25:15.455773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:57:39.300454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.913808+0000","last_change":"2023-08-26T09:25:08.449159+0000","last_active":"2023-08-26T09:25:15.913808+0000","last_peered":"2023-08-26T09:25:15.913808+0000","last_clean":"2023-08-26T09:25:15.913808+0000","last_became_active":"2023-08-26T09:25:08.448870+0000","last_became_peered":"2023-08-26T09:25:08.448870+0000","last_unstale":"2023-08-26T09:25:15.913808+0000","last_undegraded":"2023-08-26T09:25:15.913808+0000","last_fullsized":"2023-08-26T09:25:15.913808+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T19:52:03.570007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.455740+0000","last_change":"2023-08-26T09:25:13.466685+0000","last_active":"2023-08-26T09:25:15.455740+0000","last_peered":"2023-08-26T09:25:15.455740+0000","last_clean":"2023-08-26T09:25:15.455740+0000","last_became_active":"2023-08-26T09:25:13.465771+0000","last_became_peered":"2023-08-26T09:25:13.465771+0000","last_unstale":"2023-08-26T09:25:15.455740+0000","last_undegraded":"2023-08-26T09:25:15.455740+0000","last_fullsized":"2023-08-26T09:25:15.455740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T20:25:03.980488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912999+0000","last_change":"2023-08-26T09:25:14.470265+0000","last_active":"2023-08-26T09:25:15.912999+0000","last_peered":"2023-08-26T09:25:15.912999+0000","last_clean":"2023-08-26T09:25:15.912999+0000","last_became_active":"2023-08-26T09:25:14.469955+0000","last_became_peered":"2023-08-26T09:25:14.469955+0000","last_unstale":"2023-08-26T09:25:15.912999+0000","last_undegraded":"2023-08-26T09:25:15.912999+0000","last_fullsized":"2023-08-26T09:25:15.912999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T20:25:04.985842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914470+0000","last_change":"2023-08-26T09:25:08.403552+0000","last_active":"2023-08-26T09:25:15.914470+0000","last_peered":"2023-08-26T09:25:15.914470+0000","last_clean":"2023-08-26T09:25:15.914470+0000","last_became_active":"2023-08-26T09:25:08.403261+0000","last_became_peered":"2023-08-26T09:25:08.403261+0000","last_unstale":"2023-08-26T09:25:15.914470+0000","last_undegraded":"2023-08-26T09:25:15.914470+0000","last_fullsized":"2023-08-26T09:25:15.914470+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T16:12:36.020300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.913475+0000","last_change":"2023-08-26T09:25:13.472922+0000","last_active":"2023-08-26T09:25:15.913475+0000","last_peered":"2023-08-26T09:25:15.913475+0000","last_clean":"2023-08-26T09:25:15.913475+0000","last_became_active":"2023-08-26T09:25:13.472617+0000","last_became_peered":"2023-08-26T09:25:13.472617+0000","last_unstale":"2023-08-26T09:25:15.913475+0000","last_undegraded":"2023-08-26T09:25:15.913475+0000","last_fullsized":"2023-08-26T09:25:15.913475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T12:08:54.392580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.455804+0000","last_change":"2023-08-26T09:25:14.478564+0000","last_active":"2023-08-26T09:25:15.455804+0000","last_peered":"2023-08-26T09:25:15.455804+0000","last_clean":"2023-08-26T09:25:15.455804+0000","last_became_active":"2023-08-26T09:25:14.476929+0000","last_became_peered":"2023-08-26T09:25:14.476929+0000","last_unstale":"2023-08-26T09:25:15.455804+0000","last_undegraded":"2023-08-26T09:25:15.455804+0000","last_fullsized":"2023-08-26T09:25:15.455804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T16:12:42.076460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.913060+0000","last_change":"2023-08-26T09:25:13.461920+0000","last_active":"2023-08-26T09:25:15.913060+0000","last_peered":"2023-08-26T09:25:15.913060+0000","last_clean":"2023-08-26T09:25:15.913060+0000","last_became_active":"2023-08-26T09:25:13.459797+0000","last_became_peered":"2023-08-26T09:25:13.459797+0000","last_unstale":"2023-08-26T09:25:15.913060+0000","last_undegraded":"2023-08-26T09:25:15.913060+0000","last_fullsized":"2023-08-26T09:25:15.913060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T13:55:44.481753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912637+0000","last_change":"2023-08-26T09:25:14.478962+0000","last_active":"2023-08-26T09:25:15.912637+0000","last_peered":"2023-08-26T09:25:15.912637+0000","last_clean":"2023-08-26T09:25:15.912637+0000","last_became_active":"2023-08-26T09:25:14.478697+0000","last_became_peered":"2023-08-26T09:25:14.478697+0000","last_unstale":"2023-08-26T09:25:15.912637+0000","last_undegraded":"2023-08-26T09:25:15.912637+0000","last_fullsized":"2023-08-26T09:25:15.912637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T16:51:33.426902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.913245+0000","last_change":"2023-08-26T09:25:13.462877+0000","last_active":"2023-08-26T09:25:15.913245+0000","last_peered":"2023-08-26T09:25:15.913245+0000","last_clean":"2023-08-26T09:25:15.913245+0000","last_became_active":"2023-08-26T09:25:13.462284+0000","last_became_peered":"2023-08-26T09:25:13.462284+0000","last_unstale":"2023-08-26T09:25:15.913245+0000","last_undegraded":"2023-08-26T09:25:15.913245+0000","last_fullsized":"2023-08-26T09:25:15.913245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T20:25:03.980488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456631+0000","last_change":"2023-08-26T09:25:14.474944+0000","last_active":"2023-08-26T09:25:15.456631+0000","last_peered":"2023-08-26T09:25:15.456631+0000","last_clean":"2023-08-26T09:25:15.456631+0000","last_became_active":"2023-08-26T09:25:14.474660+0000","last_became_peered":"2023-08-26T09:25:14.474660+0000","last_unstale":"2023-08-26T09:25:15.456631+0000","last_undegraded":"2023-08-26T09:25:15.456631+0000","last_fullsized":"2023-08-26T09:25:15.456631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T17:21:11.812026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.913501+0000","last_change":"2023-08-26T09:25:13.466963+0000","last_active":"2023-08-26T09:25:15.913501+0000","last_peered":"2023-08-26T09:25:15.913501+0000","last_clean":"2023-08-26T09:25:15.913501+0000","last_became_active":"2023-08-26T09:25:13.466504+0000","last_became_peered":"2023-08-26T09:25:13.466504+0000","last_unstale":"2023-08-26T09:25:15.913501+0000","last_undegraded":"2023-08-26T09:25:15.913501+0000","last_fullsized":"2023-08-26T09:25:15.913501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:08:04.282019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456682+0000","last_change":"2023-08-26T09:25:14.475505+0000","last_active":"2023-08-26T09:25:15.456682+0000","last_peered":"2023-08-26T09:25:15.456682+0000","last_clean":"2023-08-26T09:25:15.456682+0000","last_became_active":"2023-08-26T09:25:14.475212+0000","last_became_peered":"2023-08-26T09:25:14.475212+0000","last_unstale":"2023-08-26T09:25:15.456682+0000","last_undegraded":"2023-08-26T09:25:15.456682+0000","last_fullsized":"2023-08-26T09:25:15.456682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:32:16.860545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.451108+0000","last_change":"2023-08-26T09:25:13.460544+0000","last_active":"2023-08-26T09:25:15.451108+0000","last_peered":"2023-08-26T09:25:15.451108+0000","last_clean":"2023-08-26T09:25:15.451108+0000","last_became_active":"2023-08-26T09:25:13.460251+0000","last_became_peered":"2023-08-26T09:25:13.460251+0000","last_unstale":"2023-08-26T09:25:15.451108+0000","last_undegraded":"2023-08-26T09:25:15.451108+0000","last_fullsized":"2023-08-26T09:25:15.451108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T20:38:25.405572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.450863+0000","last_change":"2023-08-26T09:25:14.474840+0000","last_active":"2023-08-26T09:25:15.450863+0000","last_peered":"2023-08-26T09:25:15.450863+0000","last_clean":"2023-08-26T09:25:15.450863+0000","last_became_active":"2023-08-26T09:25:14.474547+0000","last_became_peered":"2023-08-26T09:25:14.474547+0000","last_unstale":"2023-08-26T09:25:15.450863+0000","last_undegraded":"2023-08-26T09:25:15.450863+0000","last_fullsized":"2023-08-26T09:25:15.450863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:08:05.287372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912985+0000","last_change":"2023-08-26T09:25:13.466467+0000","last_active":"2023-08-26T09:25:15.912985+0000","last_peered":"2023-08-26T09:25:15.912985+0000","last_clean":"2023-08-26T09:25:15.912985+0000","last_became_active":"2023-08-26T09:25:13.466096+0000","last_became_peered":"2023-08-26T09:25:13.466096+0000","last_unstale":"2023-08-26T09:25:15.912985+0000","last_undegraded":"2023-08-26T09:25:15.912985+0000","last_fullsized":"2023-08-26T09:25:15.912985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:41:18.133401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456227+0000","last_change":"2023-08-26T09:25:14.471815+0000","last_active":"2023-08-26T09:25:15.456227+0000","last_peered":"2023-08-26T09:25:15.456227+0000","last_clean":"2023-08-26T09:25:15.456227+0000","last_became_active":"2023-08-26T09:25:14.471544+0000","last_became_peered":"2023-08-26T09:25:14.471544+0000","last_unstale":"2023-08-26T09:25:15.456227+0000","last_undegraded":"2023-08-26T09:25:15.456227+0000","last_fullsized":"2023-08-26T09:25:15.456227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T13:55:45.487107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914618+0000","last_change":"2023-08-26T09:25:14.473782+0000","last_active":"2023-08-26T09:25:15.914618+0000","last_peered":"2023-08-26T09:25:15.914618+0000","last_clean":"2023-08-26T09:25:15.914618+0000","last_became_active":"2023-08-26T09:25:14.473475+0000","last_became_peered":"2023-08-26T09:25:14.473475+0000","last_unstale":"2023-08-26T09:25:15.914618+0000","last_undegraded":"2023-08-26T09:25:15.914618+0000","last_fullsized":"2023-08-26T09:25:15.914618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:39:35.210853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.450708+0000","last_change":"2023-08-26T09:25:14.482778+0000","last_active":"2023-08-26T09:25:15.450708+0000","last_peered":"2023-08-26T09:25:15.450708+0000","last_clean":"2023-08-26T09:25:15.450708+0000","last_became_active":"2023-08-26T09:25:14.482218+0000","last_became_peered":"2023-08-26T09:25:14.482218+0000","last_unstale":"2023-08-26T09:25:15.450708+0000","last_undegraded":"2023-08-26T09:25:15.450708+0000","last_fullsized":"2023-08-26T09:25:15.450708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:08:30.313992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456397+0000","last_change":"2023-08-26T09:25:14.476104+0000","last_active":"2023-08-26T09:25:15.456397+0000","last_peered":"2023-08-26T09:25:15.456397+0000","last_clean":"2023-08-26T09:25:15.456397+0000","last_became_active":"2023-08-26T09:25:14.475809+0000","last_became_peered":"2023-08-26T09:25:14.475809+0000","last_unstale":"2023-08-26T09:25:15.456397+0000","last_undegraded":"2023-08-26T09:25:15.456397+0000","last_fullsized":"2023-08-26T09:25:15.456397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T19:36:33.198355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.451275+0000","last_change":"2023-08-26T09:25:14.478934+0000","last_active":"2023-08-26T09:25:15.451275+0000","last_peered":"2023-08-26T09:25:15.451275+0000","last_clean":"2023-08-26T09:25:15.451275+0000","last_became_active":"2023-08-26T09:25:14.474961+0000","last_became_peered":"2023-08-26T09:25:14.474961+0000","last_unstale":"2023-08-26T09:25:15.451275+0000","last_undegraded":"2023-08-26T09:25:15.451275+0000","last_fullsized":"2023-08-26T09:25:15.451275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:50:25.845586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.455647+0000","last_change":"2023-08-26T09:25:14.476525+0000","last_active":"2023-08-26T09:25:15.455647+0000","last_peered":"2023-08-26T09:25:15.455647+0000","last_clean":"2023-08-26T09:25:15.455647+0000","last_became_active":"2023-08-26T09:25:14.476195+0000","last_became_peered":"2023-08-26T09:25:14.476195+0000","last_unstale":"2023-08-26T09:25:15.455647+0000","last_undegraded":"2023-08-26T09:25:15.455647+0000","last_fullsized":"2023-08-26T09:25:15.455647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:39:35.210853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":827392,"data_stored":666624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":74428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":798720,"data_stored":664796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":73649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":200704,"data_stored":73067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":74518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":76096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":75080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-26T09:25:18.964 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-26T09:25:18.965 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-08-26T09:25:18.965 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-08-26T09:25:18.965 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-08-26T09:25:18.966 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-08-26T09:25:19.115 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.110+0000 7f7f14dd3700 1 Processor -- start 2023-08-26T09:25:19.116 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.110+0000 7f7f14dd3700 1 -- start start 2023-08-26T09:25:19.122 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.111+0000 7f7f14dd3700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7f10159d90 0x7f7f100ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:19.122 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.111+0000 7f7f14dd3700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f7f100cdd10 0x7f7f100ce930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:19.122 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.111+0000 7f7f14dd3700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f100cbc30 con 0x7f7f100718e0 2023-08-26T09:25:19.123 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.111+0000 7f7f14dd3700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f100cb020 con 0x7f7f100cdd10 2023-08-26T09:25:19.123 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.111+0000 7f7f14dd3700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f100cb300 con 0x7f7f10159d90 2023-08-26T09:25:19.123 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.111+0000 7f7f0dd9b700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f7f100718e0 0x7f7f1006c7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:56490/0 (socket says 172.21.15.92:56490) 2023-08-26T09:25:19.123 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.111+0000 7f7f0dd9b700 1 -- 172.21.15.92:0/3188882651 learned_addr learned my addr 172.21.15.92:0/3188882651 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:19.124 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.112+0000 7f7f0d59a700 1 -- 172.21.15.92:0/3188882651 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2794608779 0 0) 0x7f7f100cbc30 con 0x7f7f100718e0 2023-08-26T09:25:19.124 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.112+0000 7f7f0d59a700 1 -- 172.21.15.92:0/3188882651 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ef80035b0 con 0x7f7f100718e0 2023-08-26T09:25:19.125 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.112+0000 7f7f0e59c700 1 --2- 172.21.15.92:0/3188882651 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7f10159d90 0x7f7f100ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:19.125 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.112+0000 7f7f0ed9d700 1 --2- 172.21.15.92:0/3188882651 >> v2:172.21.15.188:3300/0 conn(0x7f7f100cdd10 0x7f7f100ce930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:19.125 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.112+0000 7f7f0d59a700 1 -- 172.21.15.92:0/3188882651 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 575535686 0 0) 0x7f7ef80035b0 con 0x7f7f100718e0 2023-08-26T09:25:19.125 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.112+0000 7f7f0d59a700 1 -- 172.21.15.92:0/3188882651 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7f10159d90 msgr2=0x7f7f100ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:19.125 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.112+0000 7f7f0d59a700 1 --2- 172.21.15.92:0/3188882651 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7f10159d90 0x7f7f100ce3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:19.126 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.112+0000 7f7f0d59a700 1 -- 172.21.15.92:0/3188882651 >> v2:172.21.15.188:3300/0 conn(0x7f7f100cdd10 msgr2=0x7f7f100ce930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:19.126 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.112+0000 7f7f0d59a700 1 --2- 172.21.15.92:0/3188882651 >> v2:172.21.15.188:3300/0 conn(0x7f7f100cdd10 0x7f7f100ce930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:19.126 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.112+0000 7f7f0d59a700 1 -- 172.21.15.92:0/3188882651 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f100cb5e0 con 0x7f7f100718e0 2023-08-26T09:25:19.126 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.112+0000 7f7f0d59a700 1 -- 172.21.15.92:0/3188882651 <== mon.0 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1019361464 0 0) 0x7f7f00001670 con 0x7f7f100718e0 2023-08-26T09:25:19.126 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.112+0000 7f7f0d59a700 1 -- 172.21.15.92:0/3188882651 >> v1:172.21.15.92:6789/0 conn(0x7f7f100718e0 legacy=0x7f7f1006c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:19.127 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.112+0000 7f7f0d59a700 1 --2- 172.21.15.92:0/3188882651 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7f10159d90 0x7f7ef8003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:19.127 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.112+0000 7f7f0d59a700 1 --2- 172.21.15.92:0/3188882651 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ef8003f80 0x7f7ef8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:19.127 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.112+0000 7f7f0d59a700 1 --2- 172.21.15.92:0/3188882651 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7ef8004d90 0x7f7ef8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:19.127 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.112+0000 7f7f0d59a700 1 -- 172.21.15.92:0/3188882651 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f100cb020 con 0x7f7ef8003f80 2023-08-26T09:25:19.127 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.112+0000 7f7f0d59a700 1 -- 172.21.15.92:0/3188882651 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f100cb300 con 0x7f7ef8004d90 2023-08-26T09:25:19.128 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.112+0000 7f7f0d59a700 1 -- 172.21.15.92:0/3188882651 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef800ba10 con 0x7f7f10159d90 2023-08-26T09:25:19.128 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.112+0000 7f7f0dd9b700 1 --2- 172.21.15.92:0/3188882651 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ef8003f80 0x7f7ef8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:19.128 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.112+0000 7f7f0e59c700 1 --2- 172.21.15.92:0/3188882651 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7f10159d90 0x7f7ef8003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:19.128 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.112+0000 7f7f0ed9d700 1 --2- 172.21.15.92:0/3188882651 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7ef8004d90 0x7f7ef8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:19.128 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.112+0000 7f7f0dd9b700 1 -- 172.21.15.92:0/3188882651 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7f10159d90 msgr2=0x7f7ef8003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:19.129 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.112+0000 7f7f0dd9b700 1 --2- 172.21.15.92:0/3188882651 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7f10159d90 0x7f7ef8003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:19.129 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.112+0000 7f7f0dd9b700 1 -- 172.21.15.92:0/3188882651 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7ef8004d90 msgr2=0x7f7ef8005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:19.129 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.112+0000 7f7f0dd9b700 1 --2- 172.21.15.92:0/3188882651 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7ef8004d90 0x7f7ef8005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:19.129 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.112+0000 7f7f0dd9b700 1 -- 172.21.15.92:0/3188882651 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef80035b0 con 0x7f7ef8003f80 2023-08-26T09:25:19.129 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.112+0000 7f7f0ed9d700 1 --2- 172.21.15.92:0/3188882651 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7ef8004d90 0x7f7ef8005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:25:19.130 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.112+0000 7f7f0dd9b700 1 --2- 172.21.15.92:0/3188882651 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ef8003f80 0x7f7ef8004850 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7f10071cc0 tx=0x7f7ef8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a0396b5bb29c37b server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:19.130 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.113+0000 7f7f0d59a700 1 -- 172.21.15.92:0/3188882651 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0000cda0 con 0x7f7ef8003f80 2023-08-26T09:25:19.130 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.113+0000 7f7f0d59a700 1 -- 172.21.15.92:0/3188882651 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f00005960 con 0x7f7ef8003f80 2023-08-26T09:25:19.131 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.113+0000 7f7f0d59a700 1 -- 172.21.15.92:0/3188882651 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f00005d10 con 0x7f7ef8003f80 2023-08-26T09:25:19.131 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.113+0000 7f7f14dd3700 1 -- 172.21.15.92:0/3188882651 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ef8003f80 msgr2=0x7f7ef8004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:19.131 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.113+0000 7f7f14dd3700 1 --2- 172.21.15.92:0/3188882651 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ef8003f80 0x7f7ef8004850 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7f10071cc0 tx=0x7f7ef8005880 comp rx=0 tx=0).stop 2023-08-26T09:25:19.131 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.113+0000 7f7f0ed9d700 1 -- 172.21.15.92:0/3188882651 reap_dead start 2023-08-26T09:25:19.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.113+0000 7f7f14dd3700 1 -- 172.21.15.92:0/3188882651 shutdown_connections 2023-08-26T09:25:19.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.113+0000 7f7f14dd3700 1 -- 172.21.15.92:0/3188882651 >> 172.21.15.92:0/3188882651 conn(0x7f7f100cfca0 msgr2=0x7f7f100d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:19.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.113+0000 7f7f14dd3700 1 -- 172.21.15.92:0/3188882651 shutdown_connections 2023-08-26T09:25:19.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.113+0000 7f7f14dd3700 1 -- 172.21.15.92:0/3188882651 wait complete. 2023-08-26T09:25:19.133 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.114+0000 7f7f14dd3700 1 Processor -- start 2023-08-26T09:25:19.133 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.115+0000 7f7f14dd3700 1 -- start start 2023-08-26T09:25:19.133 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.115+0000 7f7f14dd3700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7ef8003f80 0x7f7f100c6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:19.133 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.115+0000 7f7f14dd3700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7f10149c20 0x7f7f101490d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:19.133 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.115+0000 7f7f14dd3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f100ce3b0 0x7f7f100ce830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:19.134 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.115+0000 7f7f14dd3700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f100ced70 con 0x7f7f100ce3b0 2023-08-26T09:25:19.134 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.115+0000 7f7f14dd3700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f100c7880 con 0x7f7f10149c20 2023-08-26T09:25:19.134 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.115+0000 7f7f14dd3700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1014a300 con 0x7f7ef8003f80 2023-08-26T09:25:19.135 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.115+0000 7f7f0ed9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f100ce3b0 0x7f7f100ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:19.135 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.115+0000 7f7f0ed9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f100ce3b0 0x7f7f100ce830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44492/0 (socket says 172.21.15.92:44492) 2023-08-26T09:25:19.135 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.115+0000 7f7f0ed9d700 1 -- 172.21.15.92:0/3520473356 learned_addr learned my addr 172.21.15.92:0/3520473356 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:19.135 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.115+0000 7f7f0e59c700 1 --2- 172.21.15.92:0/3520473356 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7ef8003f80 0x7f7f100c6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:19.135 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.115+0000 7f7f0dd9b700 1 --2- 172.21.15.92:0/3520473356 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7f10149c20 0x7f7f101490d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:19.136 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.116+0000 7f7f0ed9d700 1 -- 172.21.15.92:0/3520473356 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7ef8003f80 msgr2=0x7f7f100c6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:19.136 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.116+0000 7f7f0ed9d700 1 --2- 172.21.15.92:0/3520473356 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7ef8003f80 0x7f7f100c6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:19.136 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.116+0000 7f7f0ed9d700 1 -- 172.21.15.92:0/3520473356 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7f10149c20 msgr2=0x7f7f101490d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:19.136 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.116+0000 7f7f0ed9d700 1 --2- 172.21.15.92:0/3520473356 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7f10149c20 0x7f7f101490d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:19.136 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.116+0000 7f7f0ed9d700 1 -- 172.21.15.92:0/3520473356 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f1014a5e0 con 0x7f7f100ce3b0 2023-08-26T09:25:19.137 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.116+0000 7f7f0ed9d700 1 --2- 172.21.15.92:0/3520473356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f100ce3b0 0x7f7f100ce830 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7f100ce380 tx=0x7f7f0800f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:19.137 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.116+0000 7f7efeffd700 1 -- 172.21.15.92:0/3520473356 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0800fca0 con 0x7f7f100ce3b0 2023-08-26T09:25:19.137 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.116+0000 7f7efeffd700 1 -- 172.21.15.92:0/3520473356 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f08011040 con 0x7f7f100ce3b0 2023-08-26T09:25:19.137 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.116+0000 7f7f14dd3700 1 -- 172.21.15.92:0/3520473356 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f1014a8c0 con 0x7f7f100ce3b0 2023-08-26T09:25:19.137 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.116+0000 7f7efeffd700 1 -- 172.21.15.92:0/3520473356 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f08017400 con 0x7f7f100ce3b0 2023-08-26T09:25:19.138 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.116+0000 7f7f14dd3700 1 -- 172.21.15.92:0/3520473356 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f100c74c0 con 0x7f7f100ce3b0 2023-08-26T09:25:19.138 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.117+0000 7f7f14dd3700 1 -- 172.21.15.92:0/3520473356 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f1014aab0 con 0x7f7f100ce3b0 2023-08-26T09:25:19.139 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.117+0000 7f7efeffd700 1 -- 172.21.15.92:0/3520473356 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7f080203b0 con 0x7f7f100ce3b0 2023-08-26T09:25:19.139 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.118+0000 7f7efeffd700 1 --2- 172.21.15.92:0/3520473356 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f7ef006a110 0x7f7ef006c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:19.139 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.118+0000 7f7f0e59c700 1 --2- 172.21.15.92:0/3520473356 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f7ef006a110 0x7f7ef006c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:19.139 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.118+0000 7f7efeffd700 1 -- 172.21.15.92:0/3520473356 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7f08088500 con 0x7f7f100ce3b0 2023-08-26T09:25:19.140 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.118+0000 7f7f0e59c700 1 --2- 172.21.15.92:0/3520473356 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f7ef006a110 0x7f7ef006c5d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7f04009b80 tx=0x7f7f04009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:19.140 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.122+0000 7f7efeffd700 1 -- 172.21.15.92:0/3520473356 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7f08053b50 con 0x7f7f100ce3b0 2023-08-26T09:25:19.370 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.365+0000 7f7f14dd3700 1 -- 172.21.15.92:0/3520473356 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f7f1004e660 con 0x7f7f100ce3b0 2023-08-26T09:25:19.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.368+0000 7f7efeffd700 1 -- 172.21.15.92:0/3520473356 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+169490 (secure 0 0 0) 0x7f7f08057170 con 0x7f7f100ce3b0 2023-08-26T09:25:19.375 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:25:19.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.371+0000 7f7f14dd3700 1 -- 172.21.15.92:0/3520473356 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f7ef006a110 msgr2=0x7f7ef006c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:19.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.371+0000 7f7f14dd3700 1 --2- 172.21.15.92:0/3520473356 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f7ef006a110 0x7f7ef006c5d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7f04009b80 tx=0x7f7f04009210 comp rx=0 tx=0).stop 2023-08-26T09:25:19.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.371+0000 7f7f14dd3700 1 -- 172.21.15.92:0/3520473356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f100ce3b0 msgr2=0x7f7f100ce830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:19.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.371+0000 7f7f14dd3700 1 --2- 172.21.15.92:0/3520473356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f100ce3b0 0x7f7f100ce830 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7f100ce380 tx=0x7f7f0800f3b0 comp rx=0 tx=0).stop 2023-08-26T09:25:19.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.371+0000 7f7f14dd3700 1 -- 172.21.15.92:0/3520473356 shutdown_connections 2023-08-26T09:25:19.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.371+0000 7f7f14dd3700 1 --2- 172.21.15.92:0/3520473356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f100ce3b0 0x7f7f100ce830 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:19.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.371+0000 7f7f14dd3700 1 --2- 172.21.15.92:0/3520473356 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7ef8003f80 0x7f7f100c6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:19.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.371+0000 7f7f14dd3700 1 --2- 172.21.15.92:0/3520473356 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f7ef006a110 0x7f7ef006c5d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:19.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.371+0000 7f7f14dd3700 1 --2- 172.21.15.92:0/3520473356 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7f10149c20 0x7f7f101490d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:19.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.371+0000 7f7f14dd3700 1 -- 172.21.15.92:0/3520473356 >> 172.21.15.92:0/3520473356 conn(0x7f7f100cfca0 msgr2=0x7f7f1014c800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:19.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.371+0000 7f7f14dd3700 1 -- 172.21.15.92:0/3520473356 shutdown_connections 2023-08-26T09:25:19.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.371+0000 7f7f14dd3700 1 -- 172.21.15.92:0/3520473356 wait complete. 2023-08-26T09:25:19.388 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":5,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1988454907},{"type":"v1","addr":"172.21.15.92:6833","nonce":1988454907}]},"active_addr":"172.21.15.92:6833/1988454907","active_change":"2023-08-26T09:25:00.921163+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4108,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.92:0","nonce":2522433177}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.92:0","nonce":904928047}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.92:0","nonce":1165724538}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.92:0","nonce":584351607}]}]} 2023-08-26T09:25:19.392 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-08-26T09:25:19.393 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-08-26T09:25:19.393 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-26T09:25:19.515 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.510+0000 7eff314bc700 1 Processor -- start 2023-08-26T09:25:19.516 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.510+0000 7eff314bc700 1 -- start start 2023-08-26T09:25:19.518 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.511+0000 7eff314bc700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7eff2c0b4ab0 0x7eff2c0b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:19.518 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.511+0000 7eff314bc700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7eff2c06a990 0x7eff2c06ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:19.518 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.511+0000 7eff314bc700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff2c06b360 con 0x7eff2c15d550 2023-08-26T09:25:19.518 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.511+0000 7eff314bc700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff2c0b5470 con 0x7eff2c0b4ab0 2023-08-26T09:25:19.518 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.511+0000 7eff314bc700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff2c0d10c0 con 0x7eff2c06a990 2023-08-26T09:25:19.519 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.511+0000 7eff2a7fc700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7eff2c0b4ab0 0x7eff2c0b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:19.519 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.511+0000 7eff2affd700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7eff2c15d550 0x7eff2c0b6440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:56510/0 (socket says 172.21.15.92:56510) 2023-08-26T09:25:19.519 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.511+0000 7eff2a7fc700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7eff2c0b4ab0 0x7eff2c0b4f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44498/0 (socket says 172.21.15.92:44498) 2023-08-26T09:25:19.519 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.511+0000 7eff2affd700 1 -- 172.21.15.92:0/2448209761 learned_addr learned my addr 172.21.15.92:0/2448209761 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:19.519 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.511+0000 7eff2b7fe700 1 --2- 172.21.15.92:0/2448209761 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7eff2c06a990 0x7eff2c06ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:19.520 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.511+0000 7eff2a7fc700 1 -- 172.21.15.92:0/2448209761 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7eff2c06a990 msgr2=0x7eff2c06ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:19.520 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.511+0000 7eff2a7fc700 1 --2- 172.21.15.92:0/2448209761 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7eff2c06a990 0x7eff2c06ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:19.520 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.511+0000 7eff2a7fc700 1 -- 172.21.15.92:0/2448209761 >> v1:172.21.15.92:6789/0 conn(0x7eff2c15d550 legacy=0x7eff2c0b6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:19.520 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.511+0000 7eff2a7fc700 1 -- 172.21.15.92:0/2448209761 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff2c0cdd70 con 0x7eff2c0b4ab0 2023-08-26T09:25:19.520 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.511+0000 7eff29ffb700 1 -- 172.21.15.92:0/2448209761 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3660908973 0 0) 0x7eff20001110 con 0x7eff2c15d550 2023-08-26T09:25:19.521 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.511+0000 7eff2a7fc700 1 --2- 172.21.15.92:0/2448209761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff2c0b4ab0 0x7eff2c0b4f30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7eff1c009840 tx=0x7eff1c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6ce5e54b1f03066 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:19.521 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.511+0000 7eff29ffb700 1 -- 172.21.15.92:0/2448209761 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1c011830 con 0x7eff2c0b4ab0 2023-08-26T09:25:19.521 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.511+0000 7eff29ffb700 1 -- 172.21.15.92:0/2448209761 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1c011990 con 0x7eff2c0b4ab0 2023-08-26T09:25:19.521 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.511+0000 7eff29ffb700 1 -- 172.21.15.92:0/2448209761 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1c011d20 con 0x7eff2c0b4ab0 2023-08-26T09:25:19.521 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.512+0000 7eff314bc700 1 -- 172.21.15.92:0/2448209761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff2c0b4ab0 msgr2=0x7eff2c0b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:19.522 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.512+0000 7eff314bc700 1 --2- 172.21.15.92:0/2448209761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff2c0b4ab0 0x7eff2c0b4f30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7eff1c009840 tx=0x7eff1c009b50 comp rx=0 tx=0).stop 2023-08-26T09:25:19.522 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.512+0000 7eff314bc700 1 -- 172.21.15.92:0/2448209761 shutdown_connections 2023-08-26T09:25:19.522 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.512+0000 7eff314bc700 1 --2- 172.21.15.92:0/2448209761 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7eff2c06a990 0x7eff2c06ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:19.522 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.512+0000 7eff314bc700 1 --2- 172.21.15.92:0/2448209761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff2c0b4ab0 0x7eff2c0b4f30 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:19.522 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.512+0000 7eff314bc700 1 -- 172.21.15.92:0/2448209761 >> 172.21.15.92:0/2448209761 conn(0x7eff2c0cfab0 msgr2=0x7eff2c0cfec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:19.522 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.512+0000 7eff314bc700 1 -- 172.21.15.92:0/2448209761 shutdown_connections 2023-08-26T09:25:19.523 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.512+0000 7eff314bc700 1 -- 172.21.15.92:0/2448209761 wait complete. 2023-08-26T09:25:19.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.514+0000 7eff314bc700 1 Processor -- start 2023-08-26T09:25:19.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.514+0000 7eff314bc700 1 -- start start 2023-08-26T09:25:19.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.515+0000 7eff314bc700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7eff2c06a990 0x7eff2c1f3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:19.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.515+0000 7eff314bc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff2c0b4ab0 0x7eff2c1f5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:19.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.515+0000 7eff314bc700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7eff2c15d550 0x7eff2c154040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:19.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.515+0000 7eff314bc700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2c157290 con 0x7eff2c0b4ab0 2023-08-26T09:25:19.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.515+0000 7eff314bc700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2c150780 con 0x7eff2c15d550 2023-08-26T09:25:19.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.515+0000 7eff314bc700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff2c156fb0 con 0x7eff2c06a990 2023-08-26T09:25:19.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.515+0000 7eff2a7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff2c0b4ab0 0x7eff2c1f5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:19.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.515+0000 7eff2a7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff2c0b4ab0 0x7eff2c1f5a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44504/0 (socket says 172.21.15.92:44504) 2023-08-26T09:25:19.528 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.515+0000 7eff2a7fc700 1 -- 172.21.15.92:0/1025788431 learned_addr learned my addr 172.21.15.92:0/1025788431 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:19.528 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.515+0000 7eff2affd700 1 --2- 172.21.15.92:0/1025788431 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7eff2c06a990 0x7eff2c1f3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:19.528 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.515+0000 7eff2b7fe700 1 --2- 172.21.15.92:0/1025788431 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7eff2c15d550 0x7eff2c154040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:19.528 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.515+0000 7eff2a7fc700 1 -- 172.21.15.92:0/1025788431 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7eff2c06a990 msgr2=0x7eff2c1f3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:19.528 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.515+0000 7eff2a7fc700 1 --2- 172.21.15.92:0/1025788431 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7eff2c06a990 0x7eff2c1f3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:19.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.515+0000 7eff2a7fc700 1 -- 172.21.15.92:0/1025788431 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7eff2c15d550 msgr2=0x7eff2c154040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:19.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.515+0000 7eff2a7fc700 1 --2- 172.21.15.92:0/1025788431 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7eff2c15d550 0x7eff2c154040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:19.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.515+0000 7eff2a7fc700 1 -- 172.21.15.92:0/1025788431 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1c0094a0 con 0x7eff2c0b4ab0 2023-08-26T09:25:19.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.515+0000 7eff2affd700 1 --2- 172.21.15.92:0/1025788431 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7eff2c06a990 0x7eff2c1f3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:25:19.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.515+0000 7eff2b7fe700 1 --2- 172.21.15.92:0/1025788431 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7eff2c15d550 0x7eff2c154040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:25:19.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.515+0000 7eff2a7fc700 1 --2- 172.21.15.92:0/1025788431 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff2c0b4ab0 0x7eff2c1f5a00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7eff1c0090b0 tx=0x7eff1c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:19.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.515+0000 7eff137fe700 1 -- 172.21.15.92:0/1025788431 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1c0038a0 con 0x7eff2c0b4ab0 2023-08-26T09:25:19.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.515+0000 7eff137fe700 1 -- 172.21.15.92:0/1025788431 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1c01f070 con 0x7eff2c0b4ab0 2023-08-26T09:25:19.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.515+0000 7eff314bc700 1 -- 172.21.15.92:0/1025788431 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff2c150130 con 0x7eff2c0b4ab0 2023-08-26T09:25:19.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.515+0000 7eff137fe700 1 -- 172.21.15.92:0/1025788431 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1c003c20 con 0x7eff2c0b4ab0 2023-08-26T09:25:19.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.515+0000 7eff314bc700 1 -- 172.21.15.92:0/1025788431 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff2c154580 con 0x7eff2c0b4ab0 2023-08-26T09:25:19.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.516+0000 7eff314bc700 1 -- 172.21.15.92:0/1025788431 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff2c1508f0 con 0x7eff2c0b4ab0 2023-08-26T09:25:19.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.517+0000 7eff137fe700 1 -- 172.21.15.92:0/1025788431 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7eff1c01a430 con 0x7eff2c0b4ab0 2023-08-26T09:25:19.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.517+0000 7eff137fe700 1 --2- 172.21.15.92:0/1025788431 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7eff1806a0e0 0x7eff1806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:19.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.517+0000 7eff137fe700 1 -- 172.21.15.92:0/1025788431 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7eff1c021070 con 0x7eff2c0b4ab0 2023-08-26T09:25:19.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.517+0000 7eff2affd700 1 --2- 172.21.15.92:0/1025788431 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7eff1806a0e0 0x7eff1806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:19.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.517+0000 7eff2affd700 1 --2- 172.21.15.92:0/1025788431 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7eff1806a0e0 0x7eff1806c5a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7eff20007fd0 tx=0x7eff20009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:19.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.521+0000 7eff137fe700 1 -- 172.21.15.92:0/1025788431 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7eff1c055710 con 0x7eff2c0b4ab0 2023-08-26T09:25:19.535 INFO:tasks.ceph.mds.a.smithi092.stderr:2023-08-26T09:25:19.530+0000 7f4bdb786700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-26T09:25:19.718 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.713+0000 7eff314bc700 1 -- 172.21.15.92:0/1025788431 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff2c04e660 con 0x7eff2c0b4ab0 2023-08-26T09:25:19.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.714+0000 7eff137fe700 1 -- 172.21.15.92:0/1025788431 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+18209 (secure 0 0 0) 0x7eff1c058d30 con 0x7eff2c0b4ab0 2023-08-26T09:25:19.720 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:25:19.720 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":20,"fsid":"254a2d31-bd41-4507-8326-1b205ac24377","created":"2023-08-26T09:24:55.352131+0000","modified":"2023-08-26T09:25:15.447635+0000","last_up_change":"2023-08-26T09:25:06.124496+0000","last_in_change":"2023-08-26T09:24:57.840725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-26T09:25:06.650431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-26T09:25:06.973382+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-26T09:25:11.584141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-26T09:25:12.814990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e9e7638-4459-4d8d-8e40-130bcf48df66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6819","nonce":382827192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6824","nonce":382827192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6831","nonce":382827192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6827","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6829","nonce":382827192}]},"public_addr":"172.21.15.92:6819/382827192","cluster_addr":"172.21.15.92:6824/382827192","heartbeat_back_addr":"172.21.15.92:6831/382827192","heartbeat_front_addr":"172.21.15.92:6829/382827192","state":["exists","up"]},{"osd":1,"uuid":"164e68c9-aedd-4df5-9b70-f4b1ec3bda13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6809","nonce":618773438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6811","nonce":618773438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6815","nonce":618773438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6813","nonce":618773438}]},"public_addr":"172.21.15.92:6809/618773438","cluster_addr":"172.21.15.92:6811/618773438","heartbeat_back_addr":"172.21.15.92:6815/618773438","heartbeat_front_addr":"172.21.15.92:6813/618773438","state":["exists","up"]},{"osd":2,"uuid":"8701dfee-629a-4d30-82e4-b8fac340303f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6818","nonce":3697397687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6821","nonce":3697397687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6828","nonce":3697397687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6823","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6825","nonce":3697397687}]},"public_addr":"172.21.15.92:6818/3697397687","cluster_addr":"172.21.15.92:6821/3697397687","heartbeat_back_addr":"172.21.15.92:6828/3697397687","heartbeat_front_addr":"172.21.15.92:6825/3697397687","state":["exists","up"]},{"osd":3,"uuid":"93bdc94d-dc07-495f-995a-a6ad072f0247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6801","nonce":3579846453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6803","nonce":3579846453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6807","nonce":3579846453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6805","nonce":3579846453}]},"public_addr":"172.21.15.92:6801/3579846453","cluster_addr":"172.21.15.92:6803/3579846453","heartbeat_back_addr":"172.21.15.92:6807/3579846453","heartbeat_front_addr":"172.21.15.92:6805/3579846453","state":["exists","up"]},{"osd":4,"uuid":"d9d0ea80-8481-46a7-9677-c338d32cf1d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6809","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6811","nonce":3228383424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6813","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6815","nonce":3228383424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6821","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6823","nonce":3228383424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6817","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6819","nonce":3228383424}]},"public_addr":"172.21.15.188:6811/3228383424","cluster_addr":"172.21.15.188:6815/3228383424","heartbeat_back_addr":"172.21.15.188:6823/3228383424","heartbeat_front_addr":"172.21.15.188:6819/3228383424","state":["exists","up"]},{"osd":5,"uuid":"38d03253-467a-456f-bd5e-5a46532a0b18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6801","nonce":1655821054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6803","nonce":1655821054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6807","nonce":1655821054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6805","nonce":1655821054}]},"public_addr":"172.21.15.188:6801/1655821054","cluster_addr":"172.21.15.188:6803/1655821054","heartbeat_back_addr":"172.21.15.188:6807/1655821054","heartbeat_front_addr":"172.21.15.188:6805/1655821054","state":["exists","up"]},{"osd":6,"uuid":"d61564b5-136f-42e5-a843-626c2017cc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6810","nonce":2069976891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6814","nonce":2069976891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6822","nonce":2069976891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6818","nonce":2069976891}]},"public_addr":"172.21.15.188:6810/2069976891","cluster_addr":"172.21.15.188:6814/2069976891","heartbeat_back_addr":"172.21.15.188:6822/2069976891","heartbeat_front_addr":"172.21.15.188:6818/2069976891","state":["exists","up"]},{"osd":7,"uuid":"fae2949e-0d62-42cd-ba72-08f516084b20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6825","nonce":1882888860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6827","nonce":1882888860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6831","nonce":1882888860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6829","nonce":1882888860}]},"public_addr":"172.21.15.188:6825/1882888860","cluster_addr":"172.21.15.188:6827/1882888860","heartbeat_back_addr":"172.21.15.188:6831/1882888860","heartbeat_front_addr":"172.21.15.188:6829/1882888860","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.038523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.063160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.000857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.975572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.023848+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.765194+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.081365+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:05.110745+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-26T09:25:19.721 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.716+0000 7eff314bc700 1 -- 172.21.15.92:0/1025788431 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7eff1806a0e0 msgr2=0x7eff1806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:19.722 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.716+0000 7eff314bc700 1 --2- 172.21.15.92:0/1025788431 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7eff1806a0e0 0x7eff1806c5a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7eff20007fd0 tx=0x7eff20009040 comp rx=0 tx=0).stop 2023-08-26T09:25:19.722 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.716+0000 7eff314bc700 1 -- 172.21.15.92:0/1025788431 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff2c0b4ab0 msgr2=0x7eff2c1f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:19.722 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.716+0000 7eff314bc700 1 --2- 172.21.15.92:0/1025788431 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff2c0b4ab0 0x7eff2c1f5a00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7eff1c0090b0 tx=0x7eff1c004750 comp rx=0 tx=0).stop 2023-08-26T09:25:19.722 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.716+0000 7eff314bc700 1 -- 172.21.15.92:0/1025788431 shutdown_connections 2023-08-26T09:25:19.722 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.716+0000 7eff314bc700 1 --2- 172.21.15.92:0/1025788431 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7eff1806a0e0 0x7eff1806c5a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:19.723 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.716+0000 7eff314bc700 1 --2- 172.21.15.92:0/1025788431 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7eff2c15d550 0x7eff2c154040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:19.723 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.716+0000 7eff314bc700 1 --2- 172.21.15.92:0/1025788431 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7eff2c06a990 0x7eff2c1f3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:19.723 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.716+0000 7eff314bc700 1 --2- 172.21.15.92:0/1025788431 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff2c0b4ab0 0x7eff2c1f5a00 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:19.723 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.716+0000 7eff314bc700 1 -- 172.21.15.92:0/1025788431 >> 172.21.15.92:0/1025788431 conn(0x7eff2c0cfab0 msgr2=0x7eff2c0cfe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:19.723 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.716+0000 7eff314bc700 1 -- 172.21.15.92:0/1025788431 shutdown_connections 2023-08-26T09:25:19.724 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.716+0000 7eff314bc700 1 -- 172.21.15.92:0/1025788431 wait complete. 2023-08-26T09:25:19.734 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-08-26T09:25:19.734 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-26T09:25:19.858 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.851+0000 7f091d9ee700 1 Processor -- start 2023-08-26T09:25:19.858 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.851+0000 7f091d9ee700 1 -- start start 2023-08-26T09:25:19.858 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.852+0000 7f091d9ee700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f091815d550 0x7f09180ce050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:19.859 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.852+0000 7f091d9ee700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09180b64b0 con 0x7f09180ce590 2023-08-26T09:25:19.859 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.852+0000 7f091d9ee700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09180d21e0 con 0x7f09180d1dd0 2023-08-26T09:25:19.859 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.852+0000 7f091d9ee700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09180cea40 con 0x7f091815d550 2023-08-26T09:25:19.859 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.852+0000 7f0916ffd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f091815d550 0x7f09180ce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:19.860 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.852+0000 7f09167fc700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f09180ce590 0x7f09180d16c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:56524/0 (socket says 172.21.15.92:56524) 2023-08-26T09:25:19.860 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.852+0000 7f0916ffd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f091815d550 0x7f09180ce050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44510/0 (socket says 172.21.15.92:44510) 2023-08-26T09:25:19.860 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.852+0000 7f09167fc700 1 -- 172.21.15.92:0/3509797223 learned_addr learned my addr 172.21.15.92:0/3509797223 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:19.860 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.852+0000 7f0916ffd700 1 -- 172.21.15.92:0/3509797223 >> v1:172.21.15.188:6789/0 conn(0x7f09180d1dd0 legacy=0x7f09180b71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:19.861 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.852+0000 7f0916ffd700 1 -- 172.21.15.92:0/3509797223 >> v1:172.21.15.92:6789/0 conn(0x7f09180ce590 legacy=0x7f09180d16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:19.861 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.852+0000 7f0916ffd700 1 -- 172.21.15.92:0/3509797223 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09180b6d30 con 0x7f091815d550 2023-08-26T09:25:19.861 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.852+0000 7f0915ffb700 1 -- 172.21.15.92:0/3509797223 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3189122201 0 0) 0x7f09180b64b0 con 0x7f09180ce590 2023-08-26T09:25:19.861 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.852+0000 7f0916ffd700 1 --2- 172.21.15.92:0/3509797223 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f091815d550 0x7f09180ce050 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0908009840 tx=0x7f0908009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10ae94f0a8ae71c8 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:19.861 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.852+0000 7f0915ffb700 1 -- 172.21.15.92:0/3509797223 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0908004230 con 0x7f091815d550 2023-08-26T09:25:19.862 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.852+0000 7f0915ffb700 1 -- 172.21.15.92:0/3509797223 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0908004390 con 0x7f091815d550 2023-08-26T09:25:19.862 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.852+0000 7f0915ffb700 1 -- 172.21.15.92:0/3509797223 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09080036a0 con 0x7f091815d550 2023-08-26T09:25:19.862 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.853+0000 7f091d9ee700 1 -- 172.21.15.92:0/3509797223 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f091815d550 msgr2=0x7f09180ce050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:19.862 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.853+0000 7f091d9ee700 1 --2- 172.21.15.92:0/3509797223 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f091815d550 0x7f09180ce050 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0908009840 tx=0x7f0908009b50 comp rx=0 tx=0).stop 2023-08-26T09:25:19.862 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.853+0000 7f091d9ee700 1 -- 172.21.15.92:0/3509797223 shutdown_connections 2023-08-26T09:25:19.863 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.853+0000 7f091d9ee700 1 --2- 172.21.15.92:0/3509797223 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f091815d550 0x7f09180ce050 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:19.863 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.853+0000 7f091d9ee700 1 -- 172.21.15.92:0/3509797223 >> 172.21.15.92:0/3509797223 conn(0x7f09180cfa90 msgr2=0x7f09180cfea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:19.863 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.853+0000 7f091d9ee700 1 -- 172.21.15.92:0/3509797223 shutdown_connections 2023-08-26T09:25:19.864 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.853+0000 7f091d9ee700 1 -- 172.21.15.92:0/3509797223 wait complete. 2023-08-26T09:25:19.866 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.854+0000 7f091d9ee700 1 Processor -- start 2023-08-26T09:25:19.867 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.854+0000 7f091d9ee700 1 -- start start 2023-08-26T09:25:19.867 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.855+0000 7f091d9ee700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f09180ce590 0x7f09180b4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:19.867 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.855+0000 7f091d9ee700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09180d1dd0 0x7f09180a9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:19.867 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.855+0000 7f091d9ee700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f091815d550 0x7f09180cbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:19.867 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.855+0000 7f091d9ee700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09181f3a80 con 0x7f09180d1dd0 2023-08-26T09:25:19.868 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.855+0000 7f091d9ee700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09181f2f00 con 0x7f09180ce590 2023-08-26T09:25:19.868 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.855+0000 7f091d9ee700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09181f31e0 con 0x7f091815d550 2023-08-26T09:25:19.868 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.855+0000 7f09167fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09180d1dd0 0x7f09180a9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:19.869 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.855+0000 7f09167fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09180d1dd0 0x7f09180a9970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44516/0 (socket says 172.21.15.92:44516) 2023-08-26T09:25:19.869 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.855+0000 7f09167fc700 1 -- 172.21.15.92:0/2651950394 learned_addr learned my addr 172.21.15.92:0/2651950394 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:19.869 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.855+0000 7f09177fe700 1 --2- 172.21.15.92:0/2651950394 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f091815d550 0x7f09180cbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:19.869 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.855+0000 7f0916ffd700 1 --2- 172.21.15.92:0/2651950394 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f09180ce590 0x7f09180b4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:19.869 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.855+0000 7f09167fc700 1 -- 172.21.15.92:0/2651950394 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f091815d550 msgr2=0x7f09180cbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:19.869 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.855+0000 7f09167fc700 1 --2- 172.21.15.92:0/2651950394 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f091815d550 0x7f09180cbfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:19.870 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.855+0000 7f09167fc700 1 -- 172.21.15.92:0/2651950394 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f09180ce590 msgr2=0x7f09180b4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:19.870 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.855+0000 7f09167fc700 1 --2- 172.21.15.92:0/2651950394 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f09180ce590 0x7f09180b4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:19.870 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.855+0000 7f09167fc700 1 -- 172.21.15.92:0/2651950394 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09080094a0 con 0x7f09180d1dd0 2023-08-26T09:25:19.870 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.855+0000 7f09167fc700 1 --2- 172.21.15.92:0/2651950394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09180d1dd0 0x7f09180a9970 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f090c0011e0 tx=0x7f090c00cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:19.871 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.856+0000 7f08fffff700 1 -- 172.21.15.92:0/2651950394 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c004c80 con 0x7f09180d1dd0 2023-08-26T09:25:19.871 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.856+0000 7f08fffff700 1 -- 172.21.15.92:0/2651950394 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090c004e00 con 0x7f09180d1dd0 2023-08-26T09:25:19.871 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.856+0000 7f091d9ee700 1 -- 172.21.15.92:0/2651950394 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09181f34c0 con 0x7f09180d1dd0 2023-08-26T09:25:19.871 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.856+0000 7f08fffff700 1 -- 172.21.15.92:0/2651950394 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c007310 con 0x7f09180d1dd0 2023-08-26T09:25:19.871 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.856+0000 7f091d9ee700 1 -- 172.21.15.92:0/2651950394 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09180a9eb0 con 0x7f09180d1dd0 2023-08-26T09:25:19.872 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.856+0000 7f091d9ee700 1 -- 172.21.15.92:0/2651950394 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f091804e660 con 0x7f09180d1dd0 2023-08-26T09:25:19.872 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.857+0000 7f08fffff700 1 -- 172.21.15.92:0/2651950394 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f090c007470 con 0x7f09180d1dd0 2023-08-26T09:25:19.872 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.857+0000 7f08fffff700 1 --2- 172.21.15.92:0/2651950394 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f090406a0e0 0x7f090406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:19.872 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.857+0000 7f08fffff700 1 -- 172.21.15.92:0/2651950394 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f090c088210 con 0x7f09180d1dd0 2023-08-26T09:25:19.872 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.857+0000 7f0916ffd700 1 --2- 172.21.15.92:0/2651950394 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f090406a0e0 0x7f090406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:19.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.858+0000 7f0916ffd700 1 --2- 172.21.15.92:0/2651950394 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f090406a0e0 0x7f090406c5a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f09080090b0 tx=0x7f0908008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:19.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:19.862+0000 7f08fffff700 1 -- 172.21.15.92:0/2651950394 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f090c053990 con 0x7f09180d1dd0 2023-08-26T09:25:20.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.054+0000 7f091d9ee700 1 -- 172.21.15.92:0/2651950394 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f091815aec0 con 0x7f09180d1dd0 2023-08-26T09:25:20.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.055+0000 7f08fffff700 1 -- 172.21.15.92:0/2651950394 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+18209 (secure 0 0 0) 0x7f090c056fb0 con 0x7f09180d1dd0 2023-08-26T09:25:20.061 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:25:20.061 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":20,"fsid":"254a2d31-bd41-4507-8326-1b205ac24377","created":"2023-08-26T09:24:55.352131+0000","modified":"2023-08-26T09:25:15.447635+0000","last_up_change":"2023-08-26T09:25:06.124496+0000","last_in_change":"2023-08-26T09:24:57.840725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-26T09:25:06.650431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-26T09:25:06.973382+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-26T09:25:11.584141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-26T09:25:12.814990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e9e7638-4459-4d8d-8e40-130bcf48df66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6819","nonce":382827192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6824","nonce":382827192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6831","nonce":382827192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6827","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6829","nonce":382827192}]},"public_addr":"172.21.15.92:6819/382827192","cluster_addr":"172.21.15.92:6824/382827192","heartbeat_back_addr":"172.21.15.92:6831/382827192","heartbeat_front_addr":"172.21.15.92:6829/382827192","state":["exists","up"]},{"osd":1,"uuid":"164e68c9-aedd-4df5-9b70-f4b1ec3bda13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6809","nonce":618773438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6811","nonce":618773438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6815","nonce":618773438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6813","nonce":618773438}]},"public_addr":"172.21.15.92:6809/618773438","cluster_addr":"172.21.15.92:6811/618773438","heartbeat_back_addr":"172.21.15.92:6815/618773438","heartbeat_front_addr":"172.21.15.92:6813/618773438","state":["exists","up"]},{"osd":2,"uuid":"8701dfee-629a-4d30-82e4-b8fac340303f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6818","nonce":3697397687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6821","nonce":3697397687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6828","nonce":3697397687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6823","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6825","nonce":3697397687}]},"public_addr":"172.21.15.92:6818/3697397687","cluster_addr":"172.21.15.92:6821/3697397687","heartbeat_back_addr":"172.21.15.92:6828/3697397687","heartbeat_front_addr":"172.21.15.92:6825/3697397687","state":["exists","up"]},{"osd":3,"uuid":"93bdc94d-dc07-495f-995a-a6ad072f0247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6801","nonce":3579846453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6803","nonce":3579846453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6807","nonce":3579846453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6805","nonce":3579846453}]},"public_addr":"172.21.15.92:6801/3579846453","cluster_addr":"172.21.15.92:6803/3579846453","heartbeat_back_addr":"172.21.15.92:6807/3579846453","heartbeat_front_addr":"172.21.15.92:6805/3579846453","state":["exists","up"]},{"osd":4,"uuid":"d9d0ea80-8481-46a7-9677-c338d32cf1d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6809","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6811","nonce":3228383424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6813","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6815","nonce":3228383424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6821","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6823","nonce":3228383424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6817","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6819","nonce":3228383424}]},"public_addr":"172.21.15.188:6811/3228383424","cluster_addr":"172.21.15.188:6815/3228383424","heartbeat_back_addr":"172.21.15.188:6823/3228383424","heartbeat_front_addr":"172.21.15.188:6819/3228383424","state":["exists","up"]},{"osd":5,"uuid":"38d03253-467a-456f-bd5e-5a46532a0b18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6801","nonce":1655821054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6803","nonce":1655821054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6807","nonce":1655821054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6805","nonce":1655821054}]},"public_addr":"172.21.15.188:6801/1655821054","cluster_addr":"172.21.15.188:6803/1655821054","heartbeat_back_addr":"172.21.15.188:6807/1655821054","heartbeat_front_addr":"172.21.15.188:6805/1655821054","state":["exists","up"]},{"osd":6,"uuid":"d61564b5-136f-42e5-a843-626c2017cc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6810","nonce":2069976891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6814","nonce":2069976891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6822","nonce":2069976891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6818","nonce":2069976891}]},"public_addr":"172.21.15.188:6810/2069976891","cluster_addr":"172.21.15.188:6814/2069976891","heartbeat_back_addr":"172.21.15.188:6822/2069976891","heartbeat_front_addr":"172.21.15.188:6818/2069976891","state":["exists","up"]},{"osd":7,"uuid":"fae2949e-0d62-42cd-ba72-08f516084b20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6825","nonce":1882888860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6827","nonce":1882888860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6831","nonce":1882888860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6829","nonce":1882888860}]},"public_addr":"172.21.15.188:6825/1882888860","cluster_addr":"172.21.15.188:6827/1882888860","heartbeat_back_addr":"172.21.15.188:6831/1882888860","heartbeat_front_addr":"172.21.15.188:6829/1882888860","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.038523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.063160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.000857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.975572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.023848+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.765194+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.081365+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:05.110745+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-26T09:25:20.063 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.057+0000 7f091d9ee700 1 -- 172.21.15.92:0/2651950394 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f090406a0e0 msgr2=0x7f090406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.063 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.057+0000 7f091d9ee700 1 --2- 172.21.15.92:0/2651950394 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f090406a0e0 0x7f090406c5a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f09080090b0 tx=0x7f0908008030 comp rx=0 tx=0).stop 2023-08-26T09:25:20.063 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.057+0000 7f091d9ee700 1 -- 172.21.15.92:0/2651950394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09180d1dd0 msgr2=0x7f09180a9970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.063 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.057+0000 7f091d9ee700 1 --2- 172.21.15.92:0/2651950394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09180d1dd0 0x7f09180a9970 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f090c0011e0 tx=0x7f090c00cae0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.064 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.058+0000 7f091d9ee700 1 -- 172.21.15.92:0/2651950394 shutdown_connections 2023-08-26T09:25:20.064 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.058+0000 7f091d9ee700 1 --2- 172.21.15.92:0/2651950394 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f090406a0e0 0x7f090406c5a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.064 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.058+0000 7f091d9ee700 1 --2- 172.21.15.92:0/2651950394 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f09180ce590 0x7f09180b4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.064 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.058+0000 7f091d9ee700 1 --2- 172.21.15.92:0/2651950394 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f091815d550 0x7f09180cbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.064 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.058+0000 7f091d9ee700 1 --2- 172.21.15.92:0/2651950394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09180d1dd0 0x7f09180a9970 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.065 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.058+0000 7f091d9ee700 1 -- 172.21.15.92:0/2651950394 >> 172.21.15.92:0/2651950394 conn(0x7f09180cfa90 msgr2=0x7f09180cfe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:20.065 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.058+0000 7f091d9ee700 1 -- 172.21.15.92:0/2651950394 shutdown_connections 2023-08-26T09:25:20.065 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.058+0000 7f091d9ee700 1 -- 172.21.15.92:0/2651950394 wait complete. 2023-08-26T09:25:20.077 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-08-26T09:25:20.078 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-08-26T09:25:20.078 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-08-26T09:25:20.079 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-08-26T09:25:20.079 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-08-26T09:25:20.080 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-08-26T09:25:20.080 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-08-26T09:25:20.081 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-08-26T09:25:20.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.278+0000 7f706c494700 1 Processor -- start 2023-08-26T09:25:20.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.278+0000 7f706c494700 1 -- start start 2023-08-26T09:25:20.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.280+0000 7f706c494700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f706413f8c0 0x7f70640b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.280+0000 7f706c494700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f706406c290 con 0x7f70640b3720 2023-08-26T09:25:20.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.280+0000 7f706c494700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f706406c570 con 0x7f706415d430 2023-08-26T09:25:20.286 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.280+0000 7f706c494700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f706406c850 con 0x7f706413f8c0 2023-08-26T09:25:20.286 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.280+0000 7f706a230700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f706413f8c0 0x7f70640b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.286 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.280+0000 7f706a230700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f706413f8c0 0x7f70640b31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44522/0 (socket says 172.21.15.92:44522) 2023-08-26T09:25:20.287 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.280+0000 7f706a230700 1 -- 172.21.15.92:0/1213496640 learned_addr learned my addr 172.21.15.92:0/1213496640 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:20.287 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.281+0000 7f706a230700 1 -- 172.21.15.92:0/1213496640 >> v1:172.21.15.188:6789/0 conn(0x7f706415d430 legacy=0x7f706406fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:20.287 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.281+0000 7f706a230700 1 -- 172.21.15.92:0/1213496640 >> v1:172.21.15.92:6789/0 conn(0x7f70640b3720 legacy=0x7f706415cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:20.287 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.281+0000 7f706a230700 1 -- 172.21.15.92:0/1213496640 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f706406cb30 con 0x7f706413f8c0 2023-08-26T09:25:20.288 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.281+0000 7f706a230700 1 --2- 172.21.15.92:0/1213496640 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f706413f8c0 0x7f70640b31e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f705c0092e0 tx=0x7f705c0095f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ac8d3bcc267ab3b server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.289 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.281+0000 7f4bcf2b2700 1 Processor -- start 2023-08-26T09:25:20.289 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.281+0000 7f4bcf2b2700 1 -- start start 2023-08-26T09:25:20.289 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.283+0000 7f4bcf2b2700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4bc815cd20 0x7f4bc815d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.289 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.283+0000 7f4bcf2b2700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4bc806fe20 0x7f4bc80702b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.289 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.283+0000 7f4bcf2b2700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bc815d6c0 con 0x7f4bc813f8c0 2023-08-26T09:25:20.290 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.283+0000 7f4bcf2b2700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bc806c290 con 0x7f4bc806fe20 2023-08-26T09:25:20.290 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.283+0000 7f4bcf2b2700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc806c570 con 0x7f4bc815cd20 2023-08-26T09:25:20.290 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.283+0000 7f4bcd84f700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4bc806fe20 0x7f4bc80702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.290 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.283+0000 7f4bcd84f700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4bc806fe20 0x7f4bc80702b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44532/0 (socket says 172.21.15.92:44532) 2023-08-26T09:25:20.290 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.283+0000 7f4bcd84f700 1 -- 172.21.15.92:0/3999197140 learned_addr learned my addr 172.21.15.92:0/3999197140 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:20.291 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.283+0000 7f4bcd04e700 1 --1- 172.21.15.92:0/3999197140 >> v1:172.21.15.92:6789/0 conn(0x7f4bc813f8c0 0x7f4bc80b31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:56542/0 (socket says 172.21.15.92:56542) 2023-08-26T09:25:20.291 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.283+0000 7f4bcd84f700 1 -- 172.21.15.92:0/3999197140 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4bc815cd20 msgr2=0x7f4bc815d180 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-26T09:25:20.291 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.283+0000 7f4bcd84f700 1 --2- 172.21.15.92:0/3999197140 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4bc815cd20 0x7f4bc815d180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.291 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.283+0000 7f4bcd84f700 1 -- 172.21.15.92:0/3999197140 >> v1:172.21.15.92:6789/0 conn(0x7f4bc813f8c0 legacy=0x7f4bc80b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.291 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.283+0000 7f4bcd84f700 1 -- 172.21.15.92:0/3999197140 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc806c850 con 0x7f4bc806fe20 2023-08-26T09:25:20.292 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.283+0000 7f4bcd84f700 1 --2- 172.21.15.92:0/3999197140 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4bc806fe20 0x7f4bc80702b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0009bd0 tx=0x7f4bc000b080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=755f07898e554ae2 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.292 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.284+0000 7f4bbffff700 1 -- 172.21.15.92:0/3999197140 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc00102f0 con 0x7f4bc806fe20 2023-08-26T09:25:20.292 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.284+0000 7f4bbffff700 1 -- 172.21.15.92:0/3999197140 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc0010450 con 0x7f4bc806fe20 2023-08-26T09:25:20.292 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.284+0000 7f4bbffff700 1 -- 172.21.15.92:0/3999197140 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc0014c90 con 0x7f4bc806fe20 2023-08-26T09:25:20.293 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.284+0000 7f706922e700 1 -- 172.21.15.92:0/1213496640 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705c004230 con 0x7f706413f8c0 2023-08-26T09:25:20.293 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.284+0000 7f706922e700 1 -- 172.21.15.92:0/1213496640 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f705c004390 con 0x7f706413f8c0 2023-08-26T09:25:20.293 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.284+0000 7f706922e700 1 -- 172.21.15.92:0/1213496640 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705c00f740 con 0x7f706413f8c0 2023-08-26T09:25:20.293 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.285+0000 7f706c494700 1 -- 172.21.15.92:0/1213496640 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f706413f8c0 msgr2=0x7f70640b31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.294 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.285+0000 7f706c494700 1 --2- 172.21.15.92:0/1213496640 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f706413f8c0 0x7f70640b31e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f705c0092e0 tx=0x7f705c0095f0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.294 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.286+0000 7f30b16a8700 1 Processor -- start 2023-08-26T09:25:20.295 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.286+0000 7f30b16a8700 1 -- start start 2023-08-26T09:25:20.295 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.287+0000 7f30b16a8700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f30ac06b450 0x7f30ac06de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.295 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.287+0000 7f30b16a8700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f30ac0ae590 0x7f30ac0cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.296 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.287+0000 7f30b16a8700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30ac159c70 con 0x7f30ac0cb640 2023-08-26T09:25:20.296 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.287+0000 7f30b16a8700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30ac0b0ef0 con 0x7f30ac06b450 2023-08-26T09:25:20.296 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.287+0000 7f30b16a8700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30ac0b11d0 con 0x7f30ac0ae590 2023-08-26T09:25:20.296 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.288+0000 7f30aaffd700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f30ac0cb640 0x7f30ac06ad40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:56548/0 (socket says 172.21.15.92:56548) 2023-08-26T09:25:20.296 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.288+0000 7f30aaffd700 1 -- 172.21.15.92:0/3064187312 learned_addr learned my addr 172.21.15.92:0/3064187312 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:20.297 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.288+0000 7f30aa7fc700 1 --2- 172.21.15.92:0/3064187312 >> v2:172.21.15.92:3300/0 conn(0x7f30ac06b450 0x7f30ac06de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.297 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.288+0000 7f30a9ffb700 1 -- 172.21.15.92:0/3064187312 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 999475466 0 0) 0x7f30ac159c70 con 0x7f30ac0cb640 2023-08-26T09:25:20.297 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.288+0000 7f30a9ffb700 1 -- 172.21.15.92:0/3064187312 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30940035b0 con 0x7f30ac0cb640 2023-08-26T09:25:20.297 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.289+0000 7f30a9ffb700 1 -- 172.21.15.92:0/3064187312 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2815450584 0 0) 0x7f30940035b0 con 0x7f30ac0cb640 2023-08-26T09:25:20.297 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.289+0000 7f30a9ffb700 1 -- 172.21.15.92:0/3064187312 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f30ac0ae590 msgr2=0x7f30ac0cbea0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-26T09:25:20.297 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.289+0000 7f30a9ffb700 1 --2- 172.21.15.92:0/3064187312 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f30ac0ae590 0x7f30ac0cbea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.298 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.289+0000 7f30a9ffb700 1 -- 172.21.15.92:0/3064187312 >> v2:172.21.15.92:3300/0 conn(0x7f30ac06b450 msgr2=0x7f30ac06de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:20.298 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.289+0000 7f30a9ffb700 1 --2- 172.21.15.92:0/3064187312 >> v2:172.21.15.92:3300/0 conn(0x7f30ac06b450 0x7f30ac06de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.298 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.289+0000 7f30a9ffb700 1 -- 172.21.15.92:0/3064187312 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30ac0b14b0 con 0x7f30ac0cb640 2023-08-26T09:25:20.298 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.289+0000 7f30a9ffb700 1 -- 172.21.15.92:0/3064187312 <== mon.0 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1019361464 0 0) 0x7f30a00017f0 con 0x7f30ac0cb640 2023-08-26T09:25:20.298 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.289+0000 7f30a9ffb700 1 -- 172.21.15.92:0/3064187312 >> v1:172.21.15.92:6789/0 conn(0x7f30ac0cb640 legacy=0x7f30ac06ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.299 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.289+0000 7f30a9ffb700 1 --2- 172.21.15.92:0/3064187312 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f30ac0ae590 0x7f3094003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.299 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.289+0000 7f30a9ffb700 1 --2- 172.21.15.92:0/3064187312 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3094004050 0x7f3094004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.299 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.289+0000 7f30a9ffb700 1 --2- 172.21.15.92:0/3064187312 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3094004d90 0x7f3094005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.299 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.289+0000 7f30a9ffb700 1 -- 172.21.15.92:0/3064187312 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ac0b0ef0 con 0x7f3094004d90 2023-08-26T09:25:20.299 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.289+0000 7f30a9ffb700 1 -- 172.21.15.92:0/3064187312 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ac0b11d0 con 0x7f3094004050 2023-08-26T09:25:20.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.289+0000 7f30a9ffb700 1 -- 172.21.15.92:0/3064187312 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3094005c20 con 0x7f30ac0ae590 2023-08-26T09:25:20.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.289+0000 7f30ab7fe700 1 --2- 172.21.15.92:0/3064187312 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3094004d90 0x7f3094005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.289+0000 7f30aaffd700 1 --2- 172.21.15.92:0/3064187312 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f30ac0ae590 0x7f3094003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.286+0000 7f5e037ed700 1 Processor -- start 2023-08-26T09:25:20.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.286+0000 7f5e037ed700 1 -- start start 2023-08-26T09:25:20.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.288+0000 7f5e037ed700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5dfc0b3890 0x7f5dfc06c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.288+0000 7f5e037ed700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dfc0b23e0 con 0x7f5dfc165930 2023-08-26T09:25:20.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.289+0000 7f30ab7fe700 1 -- 172.21.15.92:0/3064187312 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f30ac0ae590 msgr2=0x7f3094003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:20.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.289+0000 7f30ab7fe700 1 --2- 172.21.15.92:0/3064187312 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f30ac0ae590 0x7f3094003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.289+0000 7f30ab7fe700 1 -- 172.21.15.92:0/3064187312 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3094004050 msgr2=0x7f3094004850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-26T09:25:20.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.289+0000 7f30ab7fe700 1 --2- 172.21.15.92:0/3064187312 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3094004050 0x7f3094004850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.289+0000 7f30ab7fe700 1 -- 172.21.15.92:0/3064187312 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30ac0b14b0 con 0x7f3094004d90 2023-08-26T09:25:20.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.288+0000 7f5e037ed700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dfc06cea0 con 0x7f5dfc165550 2023-08-26T09:25:20.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.288+0000 7f5e037ed700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dfc0b26a0 con 0x7f5dfc0b3890 2023-08-26T09:25:20.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.288+0000 7f5e01589700 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f5dfc165550 0x7f5dfc06fe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.92:51664/0 (socket says 172.21.15.92:51664) 2023-08-26T09:25:20.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.288+0000 7f5e01589700 1 -- 172.21.15.92:0/1500207518 learned_addr learned my addr 172.21.15.92:0/1500207518 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:20.304 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.289+0000 7f30ab7fe700 1 --2- 172.21.15.92:0/3064187312 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3094004d90 0x7f3094005210 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f30a4009e30 tx=0x7f3094005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a9bc35ee6017a00 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.304 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.290+0000 7f5df3fff700 1 -- 172.21.15.92:0/1500207518 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1237150164 0 0) 0x7f5dfc0b23e0 con 0x7f5dfc165930 2023-08-26T09:25:20.305 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.290+0000 7f5df3fff700 1 -- 172.21.15.92:0/1500207518 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5de80035b0 con 0x7f5dfc165930 2023-08-26T09:25:20.305 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.290+0000 7f5df3fff700 1 -- 172.21.15.92:0/1500207518 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 452275153 0 0) 0x7f5dfc06cea0 con 0x7f5dfc165550 2023-08-26T09:25:20.305 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.290+0000 7f5df3fff700 1 -- 172.21.15.92:0/1500207518 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5dfc0b23e0 con 0x7f5dfc165550 2023-08-26T09:25:20.305 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.290+0000 7f5e01d8a700 1 --2- 172.21.15.92:0/1500207518 >> v2:172.21.15.92:3300/0 conn(0x7f5dfc0b3890 0x7f5dfc06c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.306 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.290+0000 7f5df3fff700 1 -- 172.21.15.92:0/1500207518 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2263262321 0 0) 0x7f5de80035b0 con 0x7f5dfc165930 2023-08-26T09:25:20.306 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.290+0000 7f5df3fff700 1 -- 172.21.15.92:0/1500207518 >> v2:172.21.15.92:3300/0 conn(0x7f5dfc0b3890 msgr2=0x7f5dfc06c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:20.306 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.290+0000 7f5df3fff700 1 --2- 172.21.15.92:0/1500207518 >> v2:172.21.15.92:3300/0 conn(0x7f5dfc0b3890 0x7f5dfc06c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.306 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.290+0000 7f5df3fff700 1 -- 172.21.15.92:0/1500207518 >> v1:172.21.15.188:6789/0 conn(0x7f5dfc165550 legacy=0x7f5dfc06fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.306 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.290+0000 7f5df3fff700 1 -- 172.21.15.92:0/1500207518 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dfc0b2980 con 0x7f5dfc165930 2023-08-26T09:25:20.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.290+0000 7f30a9ffb700 1 -- 172.21.15.92:0/3064187312 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a400baa0 con 0x7f3094004d90 2023-08-26T09:25:20.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.290+0000 7f5df3fff700 1 -- 172.21.15.92:0/1500207518 <== mon.0 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1019361464 0 0) 0x7f5df8001670 con 0x7f5dfc165930 2023-08-26T09:25:20.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.290+0000 7f5df3fff700 1 -- 172.21.15.92:0/1500207518 >> v1:172.21.15.92:6789/0 conn(0x7f5dfc165930 legacy=0x7f5dfc0b3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.290+0000 7f5df3fff700 1 --2- 172.21.15.92:0/1500207518 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5de8003be0 0x7f5de8003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.290+0000 7f5df3fff700 1 --2- 172.21.15.92:0/1500207518 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5de8004850 0x7f5de8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.290+0000 7f5df3fff700 1 --2- 172.21.15.92:0/1500207518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5de8005260 0x7f5de800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.290+0000 7f5df3fff700 1 -- 172.21.15.92:0/1500207518 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc0b26a0 con 0x7f5de8005260 2023-08-26T09:25:20.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.290+0000 7f5df3fff700 1 -- 172.21.15.92:0/1500207518 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de800c190 con 0x7f5de8003be0 2023-08-26T09:25:20.309 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.290+0000 7f5df3fff700 1 -- 172.21.15.92:0/1500207518 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de800c350 con 0x7f5de8004850 2023-08-26T09:25:20.309 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.290+0000 7f5e01d8a700 1 --2- 172.21.15.92:0/1500207518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5de8005260 0x7f5de800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.309 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.291+0000 7f706c494700 1 -- 172.21.15.92:0/1213496640 shutdown_connections 2023-08-26T09:25:20.309 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.291+0000 7f706c494700 1 --2- 172.21.15.92:0/1213496640 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f706413f8c0 0x7f70640b31e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.310 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.291+0000 7f706c494700 1 -- 172.21.15.92:0/1213496640 >> 172.21.15.92:0/1213496640 conn(0x7f70640b0880 msgr2=0x7f70640b0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:20.310 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.285+0000 7f4bcf2b2700 1 -- 172.21.15.92:0/3999197140 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4bc806fe20 msgr2=0x7f4bc80702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.310 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.285+0000 7f4bcf2b2700 1 --2- 172.21.15.92:0/3999197140 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4bc806fe20 0x7f4bc80702b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0009bd0 tx=0x7f4bc000b080 comp rx=0 tx=0).stop 2023-08-26T09:25:20.311 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.285+0000 7f4bcf2b2700 1 -- 172.21.15.92:0/3999197140 shutdown_connections 2023-08-26T09:25:20.311 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.285+0000 7f4bcf2b2700 1 --2- 172.21.15.92:0/3999197140 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4bc806fe20 0x7f4bc80702b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.311 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.285+0000 7f4bcf2b2700 1 --2- 172.21.15.92:0/3999197140 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4bc815cd20 0x7f4bc815d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.311 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.285+0000 7f4bcf2b2700 1 -- 172.21.15.92:0/3999197140 >> 172.21.15.92:0/3999197140 conn(0x7f4bc80b0880 msgr2=0x7f4bc80b0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:20.312 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.286+0000 7f4bcf2b2700 1 -- 172.21.15.92:0/3999197140 shutdown_connections 2023-08-26T09:25:20.312 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.286+0000 7f4bcf2b2700 1 -- 172.21.15.92:0/3999197140 wait complete. 2023-08-26T09:25:20.312 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.288+0000 7f4bcf2b2700 1 Processor -- start 2023-08-26T09:25:20.312 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.289+0000 7f4bcf2b2700 1 -- start start 2023-08-26T09:25:20.312 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.290+0000 7f4bcf2b2700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4bc806fe20 0x7f4bc80adfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.313 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.290+0000 7f4bcf2b2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4bc813f8c0 0x7f4bc80cc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.313 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.290+0000 7f4bcf2b2700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4bc815cd20 0x7f4bc80ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.313 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.290+0000 7f4bcf2b2700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc80ce230 con 0x7f4bc813f8c0 2023-08-26T09:25:20.313 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.290+0000 7f4bcf2b2700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc80cd190 con 0x7f4bc815cd20 2023-08-26T09:25:20.313 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.290+0000 7f4bcf2b2700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc80cd470 con 0x7f4bc806fe20 2023-08-26T09:25:20.313 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.290+0000 7f4bcd04e700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4bc806fe20 0x7f4bc80adfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.314 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.290+0000 7f4bcd04e700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4bc806fe20 0x7f4bc80adfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.92:43214/0 (socket says 172.21.15.92:43214) 2023-08-26T09:25:20.314 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.290+0000 7f4bcd04e700 1 -- 172.21.15.92:0/2757387346 learned_addr learned my addr 172.21.15.92:0/2757387346 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:20.314 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.290+0000 7f4bcd84f700 1 --2- 172.21.15.92:0/2757387346 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4bc815cd20 0x7f4bc80ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.314 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.290+0000 7f4bcc84d700 1 --2- 172.21.15.92:0/2757387346 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4bc813f8c0 0x7f4bc80cc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.291+0000 7f706c494700 1 -- 172.21.15.92:0/1213496640 shutdown_connections 2023-08-26T09:25:20.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.291+0000 7f5e01d8a700 1 -- 172.21.15.92:0/1500207518 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5de8004850 msgr2=0x7f5de8004cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-26T09:25:20.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.291+0000 7f5e01d8a700 1 --2- 172.21.15.92:0/1500207518 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5de8004850 0x7f5de8004cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.291+0000 7f5e01d8a700 1 -- 172.21.15.92:0/1500207518 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5de8003be0 msgr2=0x7f5de8003fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-26T09:25:20.316 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.291+0000 7f5e01d8a700 1 --2- 172.21.15.92:0/1500207518 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5de8003be0 0x7f5de8003fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.316 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.291+0000 7f5e01d8a700 1 -- 172.21.15.92:0/1500207518 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dfc0b2980 con 0x7f5de8005260 2023-08-26T09:25:20.316 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.291+0000 7f5e01d8a700 1 -- 172.21.15.92:0/1500207518 reap_dead start 2023-08-26T09:25:20.317 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.290+0000 7f30a9ffb700 1 -- 172.21.15.92:0/3064187312 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30a400bc00 con 0x7f3094004d90 2023-08-26T09:25:20.317 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.290+0000 7f30a9ffb700 1 -- 172.21.15.92:0/3064187312 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a4015420 con 0x7f3094004d90 2023-08-26T09:25:20.317 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.291+0000 7f30b16a8700 1 -- 172.21.15.92:0/3064187312 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3094004d90 msgr2=0x7f3094005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.317 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.291+0000 7f30b16a8700 1 --2- 172.21.15.92:0/3064187312 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3094004d90 0x7f3094005210 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f30a4009e30 tx=0x7f3094005880 comp rx=0 tx=0).stop 2023-08-26T09:25:20.317 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.291+0000 7f30ab7fe700 1 -- 172.21.15.92:0/3064187312 reap_dead start 2023-08-26T09:25:20.318 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.291+0000 7f30b16a8700 1 -- 172.21.15.92:0/3064187312 shutdown_connections 2023-08-26T09:25:20.318 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.291+0000 7f30b16a8700 1 -- 172.21.15.92:0/3064187312 >> 172.21.15.92:0/3064187312 conn(0x7f30ac0b23c0 msgr2=0x7f30ac0b27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:20.318 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.291+0000 7f4bcd84f700 1 -- 172.21.15.92:0/2757387346 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4bc806fe20 msgr2=0x7f4bc80adfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.318 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.291+0000 7f4bcd84f700 1 --2- 172.21.15.92:0/2757387346 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4bc806fe20 0x7f4bc80adfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.319 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.291+0000 7f4bcd84f700 1 -- 172.21.15.92:0/2757387346 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4bc813f8c0 msgr2=0x7f4bc80cc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.319 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.291+0000 7f4bcd84f700 1 --2- 172.21.15.92:0/2757387346 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4bc813f8c0 0x7f4bc80cc6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.319 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.291+0000 7f4bcd84f700 1 -- 172.21.15.92:0/2757387346 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc0009830 con 0x7f4bc815cd20 2023-08-26T09:25:20.319 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.292+0000 7f4bcd84f700 1 --2- 172.21.15.92:0/2757387346 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4bc815cd20 0x7f4bc80ceac0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4bc001a000 tx=0x7f4bc0004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.319 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.291+0000 7f706c494700 1 -- 172.21.15.92:0/1213496640 wait complete. 2023-08-26T09:25:20.320 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.292+0000 7f4bbdffb700 1 -- 172.21.15.92:0/2757387346 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc00095b0 con 0x7f4bc815cd20 2023-08-26T09:25:20.320 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.292+0000 7f4bcf2b2700 1 -- 172.21.15.92:0/2757387346 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bc80cd750 con 0x7f4bc815cd20 2023-08-26T09:25:20.320 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.292+0000 7f4bbdffb700 1 -- 172.21.15.92:0/2757387346 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc00092e0 con 0x7f4bc815cd20 2023-08-26T09:25:20.321 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.292+0000 7f4bbdffb700 1 -- 172.21.15.92:0/2757387346 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc00107c0 con 0x7f4bc815cd20 2023-08-26T09:25:20.321 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.292+0000 7f4bcf2b2700 1 -- 172.21.15.92:0/2757387346 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bc80cdd10 con 0x7f4bc815cd20 2023-08-26T09:25:20.321 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.293+0000 7f706c494700 1 Processor -- start 2023-08-26T09:25:20.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.292+0000 7f991d386700 1 Processor -- start 2023-08-26T09:25:20.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.293+0000 7f5e01d8a700 1 --2- 172.21.15.92:0/1500207518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5de8005260 0x7f5de800ba10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5df4009fa0 tx=0x7f5de8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=670055a2f1ecdc04 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.294+0000 7f5df3fff700 1 -- 172.21.15.92:0/1500207518 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df4007df0 con 0x7f5de8005260 2023-08-26T09:25:20.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.294+0000 7f5df3fff700 1 -- 172.21.15.92:0/1500207518 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df4003a20 con 0x7f5de8005260 2023-08-26T09:25:20.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.294+0000 7f5df3fff700 1 -- 172.21.15.92:0/1500207518 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df4003dd0 con 0x7f5de8005260 2023-08-26T09:25:20.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.293+0000 7f991d386700 1 -- start start 2023-08-26T09:25:20.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.294+0000 7f991d386700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f99180ce3e0 0x7f9918144bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.324 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.294+0000 7f991d386700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9918162af0 con 0x7f99180cf310 2023-08-26T09:25:20.324 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.294+0000 7f991d386700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99180ce7c0 con 0x7f99180b23b0 2023-08-26T09:25:20.324 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.294+0000 7f991d386700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9918144950 con 0x7f99180ce3e0 2023-08-26T09:25:20.324 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.294+0000 7f4bcf2b2700 1 -- 172.21.15.92:0/2757387346 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4bc806ce10 con 0x7f4bc815cd20 2023-08-26T09:25:20.325 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.293+0000 7f706c494700 1 -- start start 2023-08-26T09:25:20.325 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.294+0000 7f99177fe700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f99180cf310 0x7f99181653d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:56578/0 (socket says 172.21.15.92:56578) 2023-08-26T09:25:20.325 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.294+0000 7f99167fc700 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f99180b23b0 0x7f99180cec00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.92:51686/0 (socket says 172.21.15.92:51686) 2023-08-26T09:25:20.326 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.294+0000 7f99177fe700 1 -- 172.21.15.92:0/310845610 learned_addr learned my addr 172.21.15.92:0/310845610 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:20.326 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.294+0000 7f706c494700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f70640b3720 0x7f70641f7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.326 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.294+0000 7f706c494700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f706413f8c0 0x7f70640ce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.294+0000 7f9916ffd700 1 --2- 172.21.15.92:0/310845610 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f99180ce3e0 0x7f9918144bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.295+0000 7f9915ffb700 1 -- 172.21.15.92:0/310845610 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1859012040 0 0) 0x7f9918162af0 con 0x7f99180cf310 2023-08-26T09:25:20.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.295+0000 7f9915ffb700 1 -- 172.21.15.92:0/310845610 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99000035b0 con 0x7f99180cf310 2023-08-26T09:25:20.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.295+0000 7f9915ffb700 1 -- 172.21.15.92:0/310845610 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3966925367 0 0) 0x7f99180ce7c0 con 0x7f99180b23b0 2023-08-26T09:25:20.328 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.295+0000 7f5e037ed700 1 -- 172.21.15.92:0/1500207518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5de8005260 msgr2=0x7f5de800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.328 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.295+0000 7f5e037ed700 1 --2- 172.21.15.92:0/1500207518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5de8005260 0x7f5de800ba10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5df4009fa0 tx=0x7f5de8005880 comp rx=0 tx=0).stop 2023-08-26T09:25:20.329 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.294+0000 7f706c494700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f706415d430 0x7f70640aaa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.329 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.294+0000 7f706c494700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70640ac5b0 con 0x7f706415d430 2023-08-26T09:25:20.329 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.294+0000 7f706c494700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70640ac890 con 0x7f706413f8c0 2023-08-26T09:25:20.329 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.294+0000 7f706c494700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70640acb70 con 0x7f70640b3720 2023-08-26T09:25:20.329 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.295+0000 7f706a230700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f70640b3720 0x7f70641f7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.330 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.295+0000 7f706a230700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f70640b3720 0x7f70641f7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.92:43232/0 (socket says 172.21.15.92:43232) 2023-08-26T09:25:20.330 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.295+0000 7f706a230700 1 -- 172.21.15.92:0/655296531 learned_addr learned my addr 172.21.15.92:0/655296531 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:20.330 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.295+0000 7f7069a2f700 1 --2- 172.21.15.92:0/655296531 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f706413f8c0 0x7f70640ce0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.330 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.295+0000 7f9915ffb700 1 -- 172.21.15.92:0/310845610 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9918162af0 con 0x7f99180b23b0 2023-08-26T09:25:20.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.295+0000 7f1acb2ac700 1 Processor -- start 2023-08-26T09:25:20.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.295+0000 7f5e037ed700 1 -- 172.21.15.92:0/1500207518 shutdown_connections 2023-08-26T09:25:20.332 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.295+0000 7f5e037ed700 1 --2- 172.21.15.92:0/1500207518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5de8005260 0x7f5de800ba10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.332 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.295+0000 7f5e037ed700 1 -- 172.21.15.92:0/1500207518 >> 172.21.15.92:0/1500207518 conn(0x7f5dfc0b0880 msgr2=0x7f5dfc0b0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:20.332 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.295+0000 7f5e037ed700 1 -- 172.21.15.92:0/1500207518 shutdown_connections 2023-08-26T09:25:20.332 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.295+0000 7f4bbdffb700 1 -- 172.21.15.92:0/2757387346 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4bc0023070 con 0x7f4bc815cd20 2023-08-26T09:25:20.333 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.295+0000 7f30b16a8700 1 -- 172.21.15.92:0/3064187312 shutdown_connections 2023-08-26T09:25:20.333 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.295+0000 7f9916ffd700 1 -- 172.21.15.92:0/310845610 >> v1:172.21.15.188:6789/0 conn(0x7f99180b23b0 legacy=0x7f99180cec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.333 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.295+0000 7f9916ffd700 1 -- 172.21.15.92:0/310845610 >> v1:172.21.15.92:6789/0 conn(0x7f99180cf310 legacy=0x7f99181653d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.333 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.295+0000 7f9916ffd700 1 -- 172.21.15.92:0/310845610 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9918161ee0 con 0x7f99180ce3e0 2023-08-26T09:25:20.334 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.295+0000 7f5e037ed700 1 -- 172.21.15.92:0/1500207518 wait complete. 2023-08-26T09:25:20.334 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.295+0000 7f4bbdffb700 1 --2- 172.21.15.92:0/2757387346 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f4bac06a0e0 0x7f4bac06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.295+0000 7f7069a2f700 1 -- 172.21.15.92:0/655296531 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f70640b3720 msgr2=0x7f70641f7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.295+0000 7f7069a2f700 1 --2- 172.21.15.92:0/655296531 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f70640b3720 0x7f70641f7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.295+0000 7f7069a2f700 1 -- 172.21.15.92:0/655296531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f706415d430 msgr2=0x7f70640aaa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.295+0000 7f7069a2f700 1 --2- 172.21.15.92:0/655296531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f706415d430 0x7f70640aaa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.295+0000 7f7069a2f700 1 -- 172.21.15.92:0/655296531 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f705c009de0 con 0x7f706413f8c0 2023-08-26T09:25:20.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.295+0000 7f4bbdffb700 1 -- 172.21.15.92:0/2757387346 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4bc0088ef0 con 0x7f4bc815cd20 2023-08-26T09:25:20.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.295+0000 7f4bbdffb700 1 --2- 172.21.15.92:0/2757387346 >> [v2:172.21.15.92:6808/618773438,v1:172.21.15.92:6809/618773438] conn(0x7f4bac072920 0x7f4bac074d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.295+0000 7f4bbdffb700 1 -- 172.21.15.92:0/2757387346 --> [v2:172.21.15.92:6808/618773438,v1:172.21.15.92:6809/618773438] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4bac0753f0 con 0x7f4bac072920 2023-08-26T09:25:20.337 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.295+0000 7f4bbdffb700 1 -- 172.21.15.92:0/2757387346 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4bc00891b0 con 0x7f4bc815cd20 2023-08-26T09:25:20.337 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.296+0000 7f4bcd04e700 1 --2- 172.21.15.92:0/2757387346 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f4bac06a0e0 0x7f4bac06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.337 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.296+0000 7f4bcc84d700 1 --2- 172.21.15.92:0/2757387346 >> [v2:172.21.15.92:6808/618773438,v1:172.21.15.92:6809/618773438] conn(0x7f4bac072920 0x7f4bac074d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.337 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.296+0000 7f4bcc84d700 1 --2- 172.21.15.92:0/2757387346 >> [v2:172.21.15.92:6808/618773438,v1:172.21.15.92:6809/618773438] conn(0x7f4bac072920 0x7f4bac074d40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.337 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.297+0000 7f4bcd04e700 1 --2- 172.21.15.92:0/2757387346 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f4bac06a0e0 0x7f4bac06c5a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4bc4004e70 tx=0x7f4bc4001120 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.295+0000 7f1acb2ac700 1 -- start start 2023-08-26T09:25:20.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.296+0000 7f1acb2ac700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1ac415d1b0 0x7f1ac4070530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.296+0000 7f1acb2ac700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ac415d640 con 0x7f1ac415cd20 2023-08-26T09:25:20.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.296+0000 7f1acb2ac700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ac406c290 con 0x7f1ac413f8c0 2023-08-26T09:25:20.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.296+0000 7f1acb2ac700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac406c570 con 0x7f1ac415d1b0 2023-08-26T09:25:20.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.297+0000 7f1ac8847700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f1ac415cd20 0x7f1ac406fe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:56594/0 (socket says 172.21.15.92:56594) 2023-08-26T09:25:20.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.297+0000 7f1ac8847700 1 -- 172.21.15.92:0/2978087847 learned_addr learned my addr 172.21.15.92:0/2978087847 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:20.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.297+0000 7f5e037ed700 1 Processor -- start 2023-08-26T09:25:20.340 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.297+0000 7f1ac9849700 1 --2- 172.21.15.92:0/2978087847 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1ac415d1b0 0x7f1ac4070530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.340 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.297+0000 7f9916ffd700 1 --2- 172.21.15.92:0/310845610 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f99180ce3e0 0x7f9918144bd0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f990c009870 tx=0x7f990c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1efe00cb6fd4bec4 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.340 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.294+0000 7f586e58e700 1 Processor -- start 2023-08-26T09:25:20.341 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.295+0000 7f586e58e700 1 -- start start 2023-08-26T09:25:20.341 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.296+0000 7f586e58e700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f58680b3890 0x7f586806c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.341 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.297+0000 7f7069a2f700 1 --2- 172.21.15.92:0/655296531 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f706413f8c0 0x7f70640ce0a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f705400bdf0 tx=0x7f7054009f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.342 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.296+0000 7f586e58e700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58680b23e0 con 0x7f5868165550 2023-08-26T09:25:20.342 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.296+0000 7f586e58e700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f586806cea0 con 0x7f5868165930 2023-08-26T09:25:20.342 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.297+0000 7f586e58e700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58680b26a0 con 0x7f58680b3890 2023-08-26T09:25:20.342 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.297+0000 7f5867fff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f5868165550 0x7f586806fe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:56592/0 (socket says 172.21.15.92:56592) 2023-08-26T09:25:20.342 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.297+0000 7f5867fff700 1 -- 172.21.15.92:0/2919572128 learned_addr learned my addr 172.21.15.92:0/2919572128 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:20.343 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.297+0000 7f9915ffb700 1 -- 172.21.15.92:0/310845610 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990c011830 con 0x7f99180ce3e0 2023-08-26T09:25:20.343 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.297+0000 7f5e037ed700 1 -- start start 2023-08-26T09:25:20.343 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.298+0000 7f5e037ed700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5de8005260 0x7f5dfc0a9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.344 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.298+0000 7f5e037ed700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5dfc15e320 0x7f5dfc0ab430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.344 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.298+0000 7f5e037ed700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5dfc0ab970 0x7f5dfc070e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.344 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.298+0000 7f5e037ed700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc0aacc0 con 0x7f5dfc0ab970 2023-08-26T09:25:20.344 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.298+0000 7f5e037ed700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc15eac0 con 0x7f5dfc15e320 2023-08-26T09:25:20.344 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.298+0000 7f5e037ed700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc15eda0 con 0x7f5de8005260 2023-08-26T09:25:20.345 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.298+0000 7f5e01589700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5de8005260 0x7f5dfc0a9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.345 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.298+0000 7f5e01589700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5de8005260 0x7f5dfc0a9ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.92:43254/0 (socket says 172.21.15.92:43254) 2023-08-26T09:25:20.345 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.298+0000 7f5e01589700 1 -- 172.21.15.92:0/1425330594 learned_addr learned my addr 172.21.15.92:0/1425330594 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:20.345 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.298+0000 7f5e01d8a700 1 --2- 172.21.15.92:0/1425330594 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5dfc0ab970 0x7f5dfc070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.346 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.297+0000 7f586cb2b700 1 --2- 172.21.15.92:0/2919572128 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f58680b3890 0x7f586806c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.346 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.298+0000 7f586cb2b700 1 -- 172.21.15.92:0/2919572128 >> v1:172.21.15.188:6789/0 conn(0x7f5868165930 legacy=0x7f58680b3180 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-26T09:25:20.346 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.298+0000 7f586cb2b700 1 -- 172.21.15.92:0/2919572128 >> v1:172.21.15.92:6789/0 conn(0x7f5868165550 legacy=0x7f586806fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.346 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.298+0000 7f586cb2b700 1 -- 172.21.15.92:0/2919572128 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58680b2980 con 0x7f58680b3890 2023-08-26T09:25:20.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.298+0000 7f1abbfff700 1 -- 172.21.15.92:0/2978087847 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1227704227 0 0) 0x7f1ac406c290 con 0x7f1ac413f8c0 2023-08-26T09:25:20.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.298+0000 7f1abbfff700 1 -- 172.21.15.92:0/2978087847 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ab00035b0 con 0x7f1ac413f8c0 2023-08-26T09:25:20.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.298+0000 7f1ac9849700 1 -- 172.21.15.92:0/2978087847 >> v1:172.21.15.188:6789/0 conn(0x7f1ac413f8c0 legacy=0x7f1ac40b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.298+0000 7f1ac9849700 1 -- 172.21.15.92:0/2978087847 >> v1:172.21.15.92:6789/0 conn(0x7f1ac415cd20 legacy=0x7f1ac406fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.298+0000 7f1ac9849700 1 -- 172.21.15.92:0/2978087847 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac406c850 con 0x7f1ac415d1b0 2023-08-26T09:25:20.348 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.295+0000 7f30b16a8700 1 -- 172.21.15.92:0/3064187312 wait complete. 2023-08-26T09:25:20.348 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.297+0000 7f30b16a8700 1 Processor -- start 2023-08-26T09:25:20.348 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.298+0000 7f30b16a8700 1 -- start start 2023-08-26T09:25:20.348 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.298+0000 7f7062ffd700 1 -- 172.21.15.92:0/655296531 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705400cc90 con 0x7f706413f8c0 2023-08-26T09:25:20.349 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.298+0000 7f7062ffd700 1 -- 172.21.15.92:0/655296531 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f705400cdf0 con 0x7f706413f8c0 2023-08-26T09:25:20.349 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.298+0000 7f7062ffd700 1 -- 172.21.15.92:0/655296531 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7054014680 con 0x7f706413f8c0 2023-08-26T09:25:20.349 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.297+0000 7f9915ffb700 1 -- 172.21.15.92:0/310845610 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f990c011990 con 0x7f99180ce3e0 2023-08-26T09:25:20.349 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.297+0000 7f9915ffb700 1 -- 172.21.15.92:0/310845610 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990c011d00 con 0x7f99180ce3e0 2023-08-26T09:25:20.350 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.298+0000 7f991d386700 1 -- 172.21.15.92:0/310845610 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f99180ce3e0 msgr2=0x7f9918144bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.350 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.298+0000 7f991d386700 1 --2- 172.21.15.92:0/310845610 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f99180ce3e0 0x7f9918144bd0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f990c009870 tx=0x7f990c009b80 comp rx=0 tx=0).stop 2023-08-26T09:25:20.350 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.298+0000 7f5e00d88700 1 --2- 172.21.15.92:0/1425330594 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5dfc15e320 0x7f5dfc0ab430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.298+0000 7f586cb2b700 1 --2- 172.21.15.92:0/2919572128 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f58680b3890 0x7f586806c8c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f585c009870 tx=0x7f585c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d9b550e2b6e372 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.298+0000 7f991d386700 1 -- 172.21.15.92:0/310845610 shutdown_connections 2023-08-26T09:25:20.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.299+0000 7f991d386700 1 --2- 172.21.15.92:0/310845610 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f99180ce3e0 0x7f9918144bd0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.299+0000 7f991d386700 1 -- 172.21.15.92:0/310845610 >> 172.21.15.92:0/310845610 conn(0x7f991806a320 msgr2=0x7f991806a730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:20.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.299+0000 7f1ac9849700 1 --2- 172.21.15.92:0/2978087847 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1ac415d1b0 0x7f1ac4070530 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1abc009cb0 tx=0x7f1abc00b050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9211a6414162bb4 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.299+0000 7f5e01d8a700 1 -- 172.21.15.92:0/1425330594 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5de8005260 msgr2=0x7f5dfc0a9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.299+0000 7f5e01d8a700 1 --2- 172.21.15.92:0/1425330594 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5de8005260 0x7f5dfc0a9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.353 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.299+0000 7f5e01d8a700 1 -- 172.21.15.92:0/1425330594 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5dfc15e320 msgr2=0x7f5dfc0ab430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.353 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.299+0000 7f706c494700 1 -- 172.21.15.92:0/655296531 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70640ace50 con 0x7f706413f8c0 2023-08-26T09:25:20.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.299+0000 7f5e01d8a700 1 --2- 172.21.15.92:0/1425330594 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5dfc15e320 0x7f5dfc0ab430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.299+0000 7f5e01d8a700 1 -- 172.21.15.92:0/1425330594 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dfc15f080 con 0x7f5dfc0ab970 2023-08-26T09:25:20.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.299+0000 7f991d386700 1 -- 172.21.15.92:0/310845610 shutdown_connections 2023-08-26T09:25:20.355 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.299+0000 7f30b16a8700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3094004d90 0x7f30ac09cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.355 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.299+0000 7f30b16a8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30ac0c6ec0 0x7f30ac0c4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.355 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.299+0000 7f30b16a8700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f30ac156f40 0x7f30ac1573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.355 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.299+0000 7f30b16a8700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ac09d2e0 con 0x7f30ac0c6ec0 2023-08-26T09:25:20.355 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.299+0000 7f30b16a8700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ac0c7430 con 0x7f30ac156f40 2023-08-26T09:25:20.356 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.299+0000 7f30b16a8700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30ac0c7710 con 0x7f3094004d90 2023-08-26T09:25:20.356 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.299+0000 7f706c494700 1 -- 172.21.15.92:0/655296531 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70640ad410 con 0x7f706413f8c0 2023-08-26T09:25:20.356 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.300+0000 7f5e01d8a700 1 --2- 172.21.15.92:0/1425330594 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5dfc0ab970 0x7f5dfc070e70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc0cb060 tx=0x7f5df4004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.357 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.299+0000 7f706c494700 1 -- 172.21.15.92:0/655296531 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f706406d330 con 0x7f706413f8c0 2023-08-26T09:25:20.357 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.300+0000 7f5df1ffb700 1 -- 172.21.15.92:0/1425330594 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df4004430 con 0x7f5dfc0ab970 2023-08-26T09:25:20.358 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.300+0000 7f5df1ffb700 1 -- 172.21.15.92:0/1425330594 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df40045b0 con 0x7f5dfc0ab970 2023-08-26T09:25:20.358 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.300+0000 7f5e037ed700 1 -- 172.21.15.92:0/1425330594 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dfc0aaf10 con 0x7f5dfc0ab970 2023-08-26T09:25:20.358 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.300+0000 7f5df1ffb700 1 -- 172.21.15.92:0/1425330594 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df4004960 con 0x7f5dfc0ab970 2023-08-26T09:25:20.358 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.300+0000 7f30ab7fe700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f30ac156f40 0x7f30ac1573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.359 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.299+0000 7f1abbfff700 1 -- 172.21.15.92:0/2978087847 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc00bb20 con 0x7f1ac415d1b0 2023-08-26T09:25:20.359 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.299+0000 7f1abbfff700 1 -- 172.21.15.92:0/2978087847 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1abc00bc80 con 0x7f1ac415d1b0 2023-08-26T09:25:20.359 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.299+0000 7f1abbfff700 1 -- 172.21.15.92:0/2978087847 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc010480 con 0x7f1ac415d1b0 2023-08-26T09:25:20.359 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.300+0000 7f1acb2ac700 1 -- 172.21.15.92:0/2978087847 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1ac415d1b0 msgr2=0x7f1ac4070530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.360 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.300+0000 7f1acb2ac700 1 --2- 172.21.15.92:0/2978087847 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1ac415d1b0 0x7f1ac4070530 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1abc009cb0 tx=0x7f1abc00b050 comp rx=0 tx=0).stop 2023-08-26T09:25:20.360 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.300+0000 7f30aa7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30ac0c6ec0 0x7f30ac0c4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.361 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.300+0000 7f30ab7fe700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f30ac156f40 0x7f30ac1573d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.92:33408/0 (socket says 172.21.15.92:33408) 2023-08-26T09:25:20.361 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.300+0000 7f30aa7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30ac0c6ec0 0x7f30ac0c4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44598/0 (socket says 172.21.15.92:44598) 2023-08-26T09:25:20.361 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.300+0000 7f30ab7fe700 1 -- 172.21.15.92:0/1847814223 learned_addr learned my addr 172.21.15.92:0/1847814223 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:20.361 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.300+0000 7f30aaffd700 1 --2- 172.21.15.92:0/1847814223 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3094004d90 0x7f30ac09cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.362 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.300+0000 7f5e037ed700 1 -- 172.21.15.92:0/1425330594 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dfc0713b0 con 0x7f5dfc0ab970 2023-08-26T09:25:20.362 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.300+0000 7f4bbdffb700 1 -- 172.21.15.92:0/2757387346 <== osd.1 v2:172.21.15.92:6808/618773438 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f4bac0753f0 con 0x7f4bac072920 2023-08-26T09:25:20.362 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.300+0000 7f1acb2ac700 1 -- 172.21.15.92:0/2978087847 shutdown_connections 2023-08-26T09:25:20.363 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.300+0000 7f1acb2ac700 1 --2- 172.21.15.92:0/2978087847 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1ac415d1b0 0x7f1ac4070530 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.363 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.300+0000 7f1acb2ac700 1 -- 172.21.15.92:0/2978087847 >> 172.21.15.92:0/2978087847 conn(0x7f1ac40b0880 msgr2=0x7f1ac40b0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:20.363 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.301+0000 7f1acb2ac700 1 -- 172.21.15.92:0/2978087847 shutdown_connections 2023-08-26T09:25:20.363 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.300+0000 7f30aa7fc700 1 -- 172.21.15.92:0/1847814223 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3094004d90 msgr2=0x7f30ac09cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.364 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.300+0000 7f30aa7fc700 1 --2- 172.21.15.92:0/1847814223 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3094004d90 0x7f30ac09cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.364 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.300+0000 7f30aa7fc700 1 -- 172.21.15.92:0/1847814223 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f30ac156f40 msgr2=0x7f30ac1573d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.364 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.300+0000 7f30aa7fc700 1 --2- 172.21.15.92:0/1847814223 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f30ac156f40 0x7f30ac1573d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.364 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.300+0000 7f30aa7fc700 1 -- 172.21.15.92:0/1847814223 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30ac0c79f0 con 0x7f30ac0c6ec0 2023-08-26T09:25:20.364 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.301+0000 7f30aa7fc700 1 --2- 172.21.15.92:0/1847814223 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30ac0c6ec0 0x7f30ac0c4c50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f309c00e560 tx=0x7f309c00e870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.365 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.299+0000 7f991d386700 1 -- 172.21.15.92:0/310845610 wait complete. 2023-08-26T09:25:20.365 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.301+0000 7f991d386700 1 Processor -- start 2023-08-26T09:25:20.365 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.302+0000 7f5de77fe700 1 -- 172.21.15.92:0/1425330594 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5dd4000fc0 con 0x7f5dfc0ab970 2023-08-26T09:25:20.366 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.301+0000 7f991d386700 1 -- start start 2023-08-26T09:25:20.366 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.302+0000 7f991d386700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99180b23b0 0x7f99180adc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.366 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.302+0000 7f991d386700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f99180ce3e0 0x7f99181571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.366 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.302+0000 7f991d386700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f99180cf310 0x7f9918160880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.366 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.302+0000 7f991d386700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9918157c60 con 0x7f99180b23b0 2023-08-26T09:25:20.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.302+0000 7f991d386700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9918157f40 con 0x7f99180cf310 2023-08-26T09:25:20.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.302+0000 7f991d386700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9918158220 con 0x7f99180ce3e0 2023-08-26T09:25:20.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.301+0000 7f1acb2ac700 1 -- 172.21.15.92:0/2978087847 wait complete. 2023-08-26T09:25:20.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.302+0000 7f1acb2ac700 1 Processor -- start 2023-08-26T09:25:20.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.301+0000 7f30937fe700 1 -- 172.21.15.92:0/1847814223 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309c00c070 con 0x7f30ac0c6ec0 2023-08-26T09:25:20.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.302+0000 7f30937fe700 1 -- 172.21.15.92:0/1847814223 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f309c004020 con 0x7f30ac0c6ec0 2023-08-26T09:25:20.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.302+0000 7f30937fe700 1 -- 172.21.15.92:0/1847814223 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309c0043d0 con 0x7f30ac0c6ec0 2023-08-26T09:25:20.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.302+0000 7f30b16a8700 1 -- 172.21.15.92:0/1847814223 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30ac0c7cd0 con 0x7f30ac0c6ec0 2023-08-26T09:25:20.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.302+0000 7f30b16a8700 1 -- 172.21.15.92:0/1847814223 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30ac0c5190 con 0x7f30ac0c6ec0 2023-08-26T09:25:20.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.303+0000 7f9916ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99180b23b0 0x7f99180adc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.303+0000 7f9916ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99180b23b0 0x7f99180adc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44606/0 (socket says 172.21.15.92:44606) 2023-08-26T09:25:20.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.303+0000 7f9916ffd700 1 -- 172.21.15.92:0/1018105802 learned_addr learned my addr 172.21.15.92:0/1018105802 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:20.370 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.303+0000 7f1acb2ac700 1 -- start start 2023-08-26T09:25:20.370 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.303+0000 7f99177fe700 1 --2- 172.21.15.92:0/1018105802 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f99180cf310 0x7f9918160880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.371 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.303+0000 7f5866ffd700 1 -- 172.21.15.92:0/2919572128 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585c004230 con 0x7f58680b3890 2023-08-26T09:25:20.371 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.303+0000 7f5866ffd700 1 -- 172.21.15.92:0/2919572128 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f585c004390 con 0x7f58680b3890 2023-08-26T09:25:20.371 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.303+0000 7f5866ffd700 1 -- 172.21.15.92:0/2919572128 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585c0036a0 con 0x7f58680b3890 2023-08-26T09:25:20.371 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.304+0000 7f586e58e700 1 -- 172.21.15.92:0/2919572128 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f58680b3890 msgr2=0x7f586806c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.371 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.304+0000 7f586e58e700 1 --2- 172.21.15.92:0/2919572128 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f58680b3890 0x7f586806c8c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f585c009870 tx=0x7f585c009b80 comp rx=0 tx=0).stop 2023-08-26T09:25:20.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.304+0000 7f1acb2ac700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ac413f8c0 0x7f1ac4156c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.304+0000 7f1acb2ac700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1ac415cd20 0x7f1ac4152770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.304+0000 7f1acb2ac700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1ac415d1b0 0x7f1ac4151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.304+0000 7f1acb2ac700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac41519e0 con 0x7f1ac413f8c0 2023-08-26T09:25:20.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.304+0000 7f1acb2ac700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac41510d0 con 0x7f1ac415d1b0 2023-08-26T09:25:20.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.304+0000 7f1acb2ac700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac4152cb0 con 0x7f1ac415cd20 2023-08-26T09:25:20.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.304+0000 7f1ac8847700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1ac415cd20 0x7f1ac4152770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.304+0000 7f1ac9048700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ac413f8c0 0x7f1ac4156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.304+0000 7f1ac8847700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1ac415cd20 0x7f1ac4152770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.92:43276/0 (socket says 172.21.15.92:43276) 2023-08-26T09:25:20.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.304+0000 7f1ac8847700 1 -- 172.21.15.92:0/3487332820 learned_addr learned my addr 172.21.15.92:0/3487332820 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:20.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.304+0000 7f1ac9849700 1 --2- 172.21.15.92:0/3487332820 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1ac415d1b0 0x7f1ac4151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.303+0000 7f30b16a8700 1 -- 172.21.15.92:0/1847814223 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f308c000fc0 con 0x7f30ac0c6ec0 2023-08-26T09:25:20.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.304+0000 7f30937fe700 1 -- 172.21.15.92:0/1847814223 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f309c0036a0 con 0x7f30ac0c6ec0 2023-08-26T09:25:20.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.301+0000 7f7062ffd700 1 -- 172.21.15.92:0/655296531 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f70540147e0 con 0x7f706413f8c0 2023-08-26T09:25:20.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.302+0000 7f7062ffd700 1 --2- 172.21.15.92:0/655296531 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f705006a130 0x7f705006c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.302+0000 7f7062ffd700 1 -- 172.21.15.92:0/655296531 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7054088d70 con 0x7f706413f8c0 2023-08-26T09:25:20.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.302+0000 7f7062ffd700 1 --2- 172.21.15.92:0/655296531 >> [v2:172.21.15.188:6800/1655821054,v1:172.21.15.188:6801/1655821054] conn(0x7f70500729f0 0x7f7050074e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.302+0000 7f7062ffd700 1 -- 172.21.15.92:0/655296531 --> [v2:172.21.15.188:6800/1655821054,v1:172.21.15.188:6801/1655821054] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f70500754c0 con 0x7f70500729f0 2023-08-26T09:25:20.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.302+0000 7f7062ffd700 1 -- 172.21.15.92:0/655296531 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7054089210 con 0x7f706413f8c0 2023-08-26T09:25:20.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.302+0000 7f706aa31700 1 --2- 172.21.15.92:0/655296531 >> [v2:172.21.15.188:6800/1655821054,v1:172.21.15.188:6801/1655821054] conn(0x7f70500729f0 0x7f7050074e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.303+0000 7f706a230700 1 --2- 172.21.15.92:0/655296531 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f705006a130 0x7f705006c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.303+0000 7f706aa31700 1 --2- 172.21.15.92:0/655296531 >> [v2:172.21.15.188:6800/1655821054,v1:172.21.15.188:6801/1655821054] conn(0x7f70500729f0 0x7f7050074e10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.304+0000 7f706a230700 1 --2- 172.21.15.92:0/655296531 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f705006a130 0x7f705006c5f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f705c009630 tx=0x7f705c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.303+0000 7f9916ffd700 1 -- 172.21.15.92:0/1018105802 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f99180ce3e0 msgr2=0x7f99181571a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-26T09:25:20.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.303+0000 7f9916ffd700 1 --2- 172.21.15.92:0/1018105802 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f99180ce3e0 0x7f99181571a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.303+0000 7f9916ffd700 1 -- 172.21.15.92:0/1018105802 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f99180cf310 msgr2=0x7f9918160880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.303+0000 7f9916ffd700 1 --2- 172.21.15.92:0/1018105802 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f99180cf310 0x7f9918160880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.304+0000 7f9916ffd700 1 -- 172.21.15.92:0/1018105802 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f990c0094a0 con 0x7f99180b23b0 2023-08-26T09:25:20.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.304+0000 7f9916ffd700 1 --2- 172.21.15.92:0/1018105802 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99180b23b0 0x7f99180adc60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f990c0090b0 tx=0x7f990c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.304+0000 7f7062ffd700 1 -- 172.21.15.92:0/655296531 <== osd.5 v2:172.21.15.188:6800/1655821054 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f70500754c0 con 0x7f70500729f0 2023-08-26T09:25:20.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.304+0000 7f586e58e700 1 -- 172.21.15.92:0/2919572128 shutdown_connections 2023-08-26T09:25:20.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.304+0000 7f586e58e700 1 --2- 172.21.15.92:0/2919572128 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f58680b3890 0x7f586806c8c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.304+0000 7f586e58e700 1 -- 172.21.15.92:0/2919572128 >> 172.21.15.92:0/2919572128 conn(0x7f58680b0880 msgr2=0x7f58680b0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:20.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.304+0000 7f586e58e700 1 -- 172.21.15.92:0/2919572128 shutdown_connections 2023-08-26T09:25:20.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.304+0000 7f1ac9849700 1 -- 172.21.15.92:0/3487332820 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1ac415cd20 msgr2=0x7f1ac4152770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.304+0000 7f1ac9849700 1 --2- 172.21.15.92:0/3487332820 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1ac415cd20 0x7f1ac4152770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.304+0000 7f1ac9849700 1 -- 172.21.15.92:0/3487332820 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ac413f8c0 msgr2=0x7f1ac4156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.304+0000 7f1ac9849700 1 --2- 172.21.15.92:0/3487332820 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ac413f8c0 0x7f1ac4156c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.304+0000 7f1ac9849700 1 -- 172.21.15.92:0/3487332820 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1abc00d040 con 0x7f1ac415d1b0 2023-08-26T09:25:20.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.304+0000 7f1ac9048700 1 --2- 172.21.15.92:0/3487332820 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ac413f8c0 0x7f1ac4156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-26T09:25:20.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.305+0000 7f586e58e700 1 -- 172.21.15.92:0/2919572128 wait complete. 2023-08-26T09:25:20.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.304+0000 7f30937fe700 1 --2- 172.21.15.92:0/1847814223 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f309806a1b0 0x7f309806c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.304+0000 7f30937fe700 1 -- 172.21.15.92:0/1847814223 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f309c087d10 con 0x7f30ac0c6ec0 2023-08-26T09:25:20.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.305+0000 7f30937fe700 1 --2- 172.21.15.92:0/1847814223 >> [v2:172.21.15.188:6809/3228383424,v1:172.21.15.188:6811/3228383424] conn(0x7f30980729f0 0x7f3098074e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.305+0000 7f30937fe700 1 -- 172.21.15.92:0/1847814223 --> [v2:172.21.15.188:6809/3228383424,v1:172.21.15.188:6811/3228383424] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f30980754c0 con 0x7f30980729f0 2023-08-26T09:25:20.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.305+0000 7f1ac9849700 1 --2- 172.21.15.92:0/3487332820 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1ac415d1b0 0x7f1ac4151e00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1abc018000 tx=0x7f1abc004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.305+0000 7f98ff7fe700 1 -- 172.21.15.92:0/1018105802 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990c01a970 con 0x7f99180b23b0 2023-08-26T09:25:20.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.305+0000 7f98ff7fe700 1 -- 172.21.15.92:0/1018105802 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f990c01aad0 con 0x7f99180b23b0 2023-08-26T09:25:20.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.305+0000 7f991d386700 1 -- 172.21.15.92:0/1018105802 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9918137880 con 0x7f99180b23b0 2023-08-26T09:25:20.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.305+0000 7f991d386700 1 -- 172.21.15.92:0/1018105802 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9918161720 con 0x7f99180b23b0 2023-08-26T09:25:20.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.305+0000 7f98ff7fe700 1 -- 172.21.15.92:0/1018105802 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990c01ae60 con 0x7f99180b23b0 2023-08-26T09:25:20.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.305+0000 7f1ab9ffb700 1 -- 172.21.15.92:0/3487332820 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc01d040 con 0x7f1ac415d1b0 2023-08-26T09:25:20.385 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.305+0000 7f1ab9ffb700 1 -- 172.21.15.92:0/3487332820 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1abc004180 con 0x7f1ac415d1b0 2023-08-26T09:25:20.385 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.305+0000 7f1ab9ffb700 1 -- 172.21.15.92:0/3487332820 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc004550 con 0x7f1ac415d1b0 2023-08-26T09:25:20.385 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.305+0000 7f30ab7fe700 1 --2- 172.21.15.92:0/1847814223 >> [v2:172.21.15.188:6809/3228383424,v1:172.21.15.188:6811/3228383424] conn(0x7f30980729f0 0x7f3098074e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.386 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.306+0000 7f991d386700 1 -- 172.21.15.92:0/1018105802 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f98f8000fc0 con 0x7f99180b23b0 2023-08-26T09:25:20.386 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.306+0000 7f30aaffd700 1 --2- 172.21.15.92:0/1847814223 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f309806a1b0 0x7f309806c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.386 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.306+0000 7f5df1ffb700 1 -- 172.21.15.92:0/1425330594 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5df4020470 con 0x7f5dfc0ab970 2023-08-26T09:25:20.387 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.306+0000 7f586e58e700 1 Processor -- start 2023-08-26T09:25:20.387 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.307+0000 7f5df1ffb700 1 --2- 172.21.15.92:0/1425330594 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f5de006a0e0 0x7f5de006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.388 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.307+0000 7f5df1ffb700 1 -- 172.21.15.92:0/1425330594 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5df408a460 con 0x7f5dfc0ab970 2023-08-26T09:25:20.388 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.307+0000 7f5df1ffb700 1 --2- 172.21.15.92:0/1425330594 >> [v2:172.21.15.92:6817/382827192,v1:172.21.15.92:6819/382827192] conn(0x7f5de00727b0 0x7f5de0074bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.388 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.307+0000 7f5df1ffb700 1 -- 172.21.15.92:0/1425330594 --> [v2:172.21.15.92:6817/382827192,v1:172.21.15.92:6819/382827192] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5de0075280 con 0x7f5de00727b0 2023-08-26T09:25:20.388 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.307+0000 7f5df1ffb700 1 -- 172.21.15.92:0/1425330594 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5df408a8b0 con 0x7f5dfc0ab970 2023-08-26T09:25:20.389 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.307+0000 7f30aaffd700 1 --2- 172.21.15.92:0/1847814223 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f309806a1b0 0x7f309806c670 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f30a0001920 tx=0x7f30a0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.389 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.307+0000 7f30937fe700 1 -- 172.21.15.92:0/1847814223 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f309c053420 con 0x7f30ac0c6ec0 2023-08-26T09:25:20.389 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.307+0000 7f5e01589700 1 --2- 172.21.15.92:0/1425330594 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f5de006a0e0 0x7f5de006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.390 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.308+0000 7f5e01589700 1 --2- 172.21.15.92:0/1425330594 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f5de006a0e0 0x7f5de006c5a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5dec005910 tx=0x7f5dec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.391 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.308+0000 7f98ff7fe700 1 -- 172.21.15.92:0/1018105802 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f990c02d450 con 0x7f99180b23b0 2023-08-26T09:25:20.391 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.309+0000 7f98ff7fe700 1 --2- 172.21.15.92:0/1018105802 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f990406a130 0x7f990406c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.391 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.309+0000 7f99167fc700 1 --2- 172.21.15.92:0/1018105802 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f990406a130 0x7f990406c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.391 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.309+0000 7f98ff7fe700 1 -- 172.21.15.92:0/1018105802 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f990c089d80 con 0x7f99180b23b0 2023-08-26T09:25:20.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.309+0000 7f98ff7fe700 1 --2- 172.21.15.92:0/1018105802 >> [v2:172.21.15.188:6808/2069976891,v1:172.21.15.188:6810/2069976891] conn(0x7f99040729f0 0x7f9904074e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.309+0000 7f98ff7fe700 1 -- 172.21.15.92:0/1018105802 --> [v2:172.21.15.188:6808/2069976891,v1:172.21.15.188:6810/2069976891] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f99040754c0 con 0x7f99040729f0 2023-08-26T09:25:20.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.309+0000 7f98ff7fe700 1 -- 172.21.15.92:0/1018105802 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f990c08a220 con 0x7f99180b23b0 2023-08-26T09:25:20.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.309+0000 7f99167fc700 1 --2- 172.21.15.92:0/1018105802 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f990406a130 0x7f990406c5f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9908007fd0 tx=0x7f9908007940 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.309+0000 7f99177fe700 1 --2- 172.21.15.92:0/1018105802 >> [v2:172.21.15.188:6808/2069976891,v1:172.21.15.188:6810/2069976891] conn(0x7f99040729f0 0x7f9904074e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.310+0000 7f99177fe700 1 --2- 172.21.15.92:0/1018105802 >> [v2:172.21.15.188:6808/2069976891,v1:172.21.15.188:6810/2069976891] conn(0x7f99040729f0 0x7f9904074e10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.393 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.310+0000 7f98ff7fe700 1 -- 172.21.15.92:0/1018105802 <== osd.6 v2:172.21.15.188:6808/2069976891 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f99040754c0 con 0x7f99040729f0 2023-08-26T09:25:20.393 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.312+0000 7f5e00d88700 1 --2- 172.21.15.92:0/1425330594 >> [v2:172.21.15.92:6817/382827192,v1:172.21.15.92:6819/382827192] conn(0x7f5de00727b0 0x7f5de0074bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.313+0000 7fef7f59e700 1 Processor -- start 2023-08-26T09:25:20.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.313+0000 7fef7f59e700 1 -- start start 2023-08-26T09:25:20.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.314+0000 7f1acb2ac700 1 -- 172.21.15.92:0/3487332820 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ac4152f10 con 0x7f1ac415d1b0 2023-08-26T09:25:20.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.314+0000 7f1acb2ac700 1 -- 172.21.15.92:0/3487332820 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ac4151600 con 0x7f1ac415d1b0 2023-08-26T09:25:20.395 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.314+0000 7fef7f59e700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fef800ccf10 0x7fef800ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.396 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.314+0000 7fef7f59e700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fef800b1e30 0x7fef800b1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.396 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.314+0000 7fef7f59e700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef800ce670 con 0x7fef800d09c0 2023-08-26T09:25:20.396 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.314+0000 7fef7f59e700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef800b2660 con 0x7fef800b1e30 2023-08-26T09:25:20.396 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.314+0000 7fef7f59e700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef800cf180 con 0x7fef800ccf10 2023-08-26T09:25:20.396 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.314+0000 7fef7dd9b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fef800b1e30 0x7fef800b1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.397 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.314+0000 7fef7dd9b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fef800b1e30 0x7fef800b1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44632/0 (socket says 172.21.15.92:44632) 2023-08-26T09:25:20.397 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.314+0000 7fef7dd9b700 1 -- 172.21.15.92:0/2726157499 learned_addr learned my addr 172.21.15.92:0/2726157499 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:20.397 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.315+0000 7fef7e59c700 1 --2- 172.21.15.92:0/2726157499 >> v2:172.21.15.188:3300/0 conn(0x7fef800ccf10 0x7fef800ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.397 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.315+0000 7fef7d59a700 1 -- 172.21.15.92:0/2726157499 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2865389505 0 0) 0x7fef78001490 con 0x7fef800d09c0 2023-08-26T09:25:20.397 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.315+0000 7fef7d59a700 1 -- 172.21.15.92:0/2726157499 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef680035b0 con 0x7fef800d09c0 2023-08-26T09:25:20.398 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.315+0000 7f1acb2ac700 1 -- 172.21.15.92:0/3487332820 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1ac406ce10 con 0x7f1ac415d1b0 2023-08-26T09:25:20.398 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.315+0000 7fef7dd9b700 1 -- 172.21.15.92:0/2726157499 >> v2:172.21.15.188:3300/0 conn(0x7fef800ccf10 msgr2=0x7fef800ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:20.399 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.315+0000 7fef7dd9b700 1 --2- 172.21.15.92:0/2726157499 >> v2:172.21.15.188:3300/0 conn(0x7fef800ccf10 0x7fef800ce130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.399 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.315+0000 7fef7dd9b700 1 -- 172.21.15.92:0/2726157499 >> v1:172.21.15.92:6789/0 conn(0x7fef800d09c0 legacy=0x7fef800d0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.399 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.315+0000 7fef7dd9b700 1 -- 172.21.15.92:0/2726157499 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef800b2380 con 0x7fef800b1e30 2023-08-26T09:25:20.399 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.315+0000 7fef7e59c700 1 --2- 172.21.15.92:0/2726157499 >> v2:172.21.15.188:3300/0 conn(0x7fef800ccf10 0x7fef800ce130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-26T09:25:20.400 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.315+0000 7fef7dd9b700 1 --2- 172.21.15.92:0/2726157499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef800b1e30 0x7fef800b1290 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fef80071750 tx=0x7fef7400f330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfe23a053b18681b server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.400 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.315+0000 7fef7d59a700 1 -- 172.21.15.92:0/2726157499 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef74012070 con 0x7fef800b1e30 2023-08-26T09:25:20.400 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.315+0000 7fef7d59a700 1 -- 172.21.15.92:0/2726157499 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7400f910 con 0x7fef800b1e30 2023-08-26T09:25:20.400 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.315+0000 7fef7d59a700 1 -- 172.21.15.92:0/2726157499 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7400fc80 con 0x7fef800b1e30 2023-08-26T09:25:20.400 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.316+0000 7f586e58e700 1 -- start start 2023-08-26T09:25:20.401 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.316+0000 7fef7f59e700 1 -- 172.21.15.92:0/2726157499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef800b1e30 msgr2=0x7fef800b1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.401 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.316+0000 7fef7f59e700 1 --2- 172.21.15.92:0/2726157499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef800b1e30 0x7fef800b1290 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fef80071750 tx=0x7fef7400f330 comp rx=0 tx=0).stop 2023-08-26T09:25:20.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.316+0000 7fef7f59e700 1 -- 172.21.15.92:0/2726157499 shutdown_connections 2023-08-26T09:25:20.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.316+0000 7fef7f59e700 1 --2- 172.21.15.92:0/2726157499 >> v2:172.21.15.188:3300/0 conn(0x7fef800ccf10 0x7fef800ce130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.316+0000 7fef7f59e700 1 --2- 172.21.15.92:0/2726157499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef800b1e30 0x7fef800b1290 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.316+0000 7fef7f59e700 1 -- 172.21.15.92:0/2726157499 >> 172.21.15.92:0/2726157499 conn(0x7fef8006ad50 msgr2=0x7fef8009a040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:20.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.316+0000 7fef7f59e700 1 -- 172.21.15.92:0/2726157499 shutdown_connections 2023-08-26T09:25:20.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.316+0000 7fef7f59e700 1 -- 172.21.15.92:0/2726157499 wait complete. 2023-08-26T09:25:20.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.317+0000 7f586e58e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5868165550 0x7f5868149680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.317+0000 7f586e58e700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5868165930 0x7f5868149bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.317+0000 7f586e58e700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5868140c20 0x7f58681410d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.404 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.317+0000 7f586e58e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f586815a6e0 con 0x7f5868165550 2023-08-26T09:25:20.404 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.317+0000 7f586e58e700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5868141610 con 0x7f5868165930 2023-08-26T09:25:20.404 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.317+0000 7f586e58e700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f586815e180 con 0x7f5868140c20 2023-08-26T09:25:20.404 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.316+0000 7f30ab7fe700 1 --2- 172.21.15.92:0/1847814223 >> [v2:172.21.15.188:6809/3228383424,v1:172.21.15.188:6811/3228383424] conn(0x7f30980729f0 0x7f3098074e10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.405 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.317+0000 7f5867fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5868165550 0x7f5868149680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.317+0000 7f5867fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5868165550 0x7f5868149680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44636/0 (socket says 172.21.15.92:44636) 2023-08-26T09:25:20.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.317+0000 7f5867fff700 1 -- 172.21.15.92:0/295107745 learned_addr learned my addr 172.21.15.92:0/295107745 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:20.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.317+0000 7f58677fe700 1 --2- 172.21.15.92:0/295107745 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5868165930 0x7f5868149bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.317+0000 7f5867fff700 1 -- 172.21.15.92:0/295107745 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5868140c20 msgr2=0x7f58681410d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-26T09:25:20.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.317+0000 7f5867fff700 1 --2- 172.21.15.92:0/295107745 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5868140c20 0x7f58681410d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.407 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.317+0000 7f5867fff700 1 -- 172.21.15.92:0/295107745 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5868165930 msgr2=0x7f5868149bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.407 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.317+0000 7f5867fff700 1 --2- 172.21.15.92:0/295107745 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5868165930 0x7f5868149bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.407 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.317+0000 7f5867fff700 1 -- 172.21.15.92:0/295107745 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f585c0094a0 con 0x7f5868165550 2023-08-26T09:25:20.407 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.317+0000 7f5867fff700 1 --2- 172.21.15.92:0/295107745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5868165550 0x7f5868149680 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f586000cbd0 tx=0x7f586000cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.407 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.317+0000 7f5864ff9700 1 -- 172.21.15.92:0/295107745 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586000aac0 con 0x7f5868165550 2023-08-26T09:25:20.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.317+0000 7f5864ff9700 1 -- 172.21.15.92:0/295107745 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586000ac20 con 0x7f5868165550 2023-08-26T09:25:20.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.318+0000 7f586e58e700 1 -- 172.21.15.92:0/295107745 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5868159db0 con 0x7f5868165550 2023-08-26T09:25:20.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.318+0000 7f5864ff9700 1 -- 172.21.15.92:0/295107745 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5860012400 con 0x7f5868165550 2023-08-26T09:25:20.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.318+0000 7f586e58e700 1 -- 172.21.15.92:0/295107745 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f586815a370 con 0x7f5868165550 2023-08-26T09:25:20.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.318+0000 7f586e58e700 1 -- 172.21.15.92:0/295107745 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f58681660d0 con 0x7f5868165550 2023-08-26T09:25:20.409 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.319+0000 7f5864ff9700 1 -- 172.21.15.92:0/295107745 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f586001b3b0 con 0x7f5868165550 2023-08-26T09:25:20.409 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.319+0000 7f30937fe700 1 -- 172.21.15.92:0/1847814223 <== osd.4 v2:172.21.15.188:6809/3228383424 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f30980754c0 con 0x7f30980729f0 2023-08-26T09:25:20.409 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.319+0000 7fef7f59e700 1 Processor -- start 2023-08-26T09:25:20.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.319+0000 7fef7f59e700 1 -- start start 2023-08-26T09:25:20.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.320+0000 7f5864ff9700 1 --2- 172.21.15.92:0/295107745 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f585406a0e0 0x7f585406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.320+0000 7f5864ff9700 1 -- 172.21.15.92:0/295107745 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5860088190 con 0x7f5868165550 2023-08-26T09:25:20.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.320+0000 7f58677fe700 1 --2- 172.21.15.92:0/295107745 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f585406a0e0 0x7f585406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.411 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.320+0000 7f5864ff9700 1 --2- 172.21.15.92:0/295107745 >> [v2:172.21.15.92:6816/3697397687,v1:172.21.15.92:6818/3697397687] conn(0x7f5854072920 0x7f5854074d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.411 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.320+0000 7f5864ff9700 1 -- 172.21.15.92:0/295107745 --> [v2:172.21.15.92:6816/3697397687,v1:172.21.15.92:6818/3697397687] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f58540753f0 con 0x7f5854072920 2023-08-26T09:25:20.411 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.320+0000 7f5864ff9700 1 -- 172.21.15.92:0/295107745 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f586008a850 con 0x7f5868165550 2023-08-26T09:25:20.411 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.320+0000 7fef7f59e700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fef800b1e30 0x7fef801f6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.412 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.320+0000 7fef7f59e700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef800ccf10 0x7fef8015c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.412 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.320+0000 7fef7f59e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef800d09c0 0x7fef800aeab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.412 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.320+0000 7fef7f59e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef8015cca0 con 0x7fef800d09c0 2023-08-26T09:25:20.412 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.320+0000 7fef7f59e700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef8015cf80 con 0x7fef800ccf10 2023-08-26T09:25:20.412 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.320+0000 7fef7f59e700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef8015d260 con 0x7fef800b1e30 2023-08-26T09:25:20.413 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.321+0000 7f58677fe700 1 --2- 172.21.15.92:0/295107745 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f585406a0e0 0x7f585406c5a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5868148260 tx=0x7f58580090e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.414 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.321+0000 7fef7dd9b700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef800ccf10 0x7fef8015c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.414 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.321+0000 7fef7e59c700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fef800b1e30 0x7fef801f6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.414 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.321+0000 7fef7e59c700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fef800b1e30 0x7fef801f6500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.92:43310/0 (socket says 172.21.15.92:43310) 2023-08-26T09:25:20.415 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.321+0000 7fef7dd9b700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef800ccf10 0x7fef8015c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.92:33458/0 (socket says 172.21.15.92:33458) 2023-08-26T09:25:20.415 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.321+0000 7fef7e59c700 1 -- 172.21.15.92:0/1076297156 learned_addr learned my addr 172.21.15.92:0/1076297156 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:20.415 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.321+0000 7fef7e59c700 1 -- 172.21.15.92:0/1076297156 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef800ccf10 msgr2=0x7fef8015c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.415 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.321+0000 7fef7e59c700 1 --2- 172.21.15.92:0/1076297156 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef800ccf10 0x7fef8015c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.415 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.321+0000 7fef7e59c700 1 -- 172.21.15.92:0/1076297156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef800d09c0 msgr2=0x7fef800aeab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.416 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.321+0000 7fef7e59c700 1 --2- 172.21.15.92:0/1076297156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef800d09c0 0x7fef800aeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.416 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.321+0000 7fef7e59c700 1 -- 172.21.15.92:0/1076297156 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef700094a0 con 0x7fef800b1e30 2023-08-26T09:25:20.416 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.321+0000 7fef7dd9b700 1 --2- 172.21.15.92:0/1076297156 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef800ccf10 0x7fef8015c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-26T09:25:20.416 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.321+0000 7fef7e59c700 1 --2- 172.21.15.92:0/1076297156 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fef800b1e30 0x7fef801f6500 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fef7000ebe0 tx=0x7fef7000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.416 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.321+0000 7fef6effd700 1 -- 172.21.15.92:0/1076297156 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef70009800 con 0x7fef800b1e30 2023-08-26T09:25:20.417 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.321+0000 7fef6effd700 1 -- 172.21.15.92:0/1076297156 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7000c910 con 0x7fef800b1e30 2023-08-26T09:25:20.417 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.321+0000 7fef7f59e700 1 -- 172.21.15.92:0/1076297156 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef7400db30 con 0x7fef800b1e30 2023-08-26T09:25:20.417 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.322+0000 7f1ab9ffb700 1 -- 172.21.15.92:0/3487332820 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1abc0046b0 con 0x7f1ac415d1b0 2023-08-26T09:25:20.418 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.322+0000 7f1ab9ffb700 1 --2- 172.21.15.92:0/3487332820 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f1aa806a1b0 0x7f1aa806c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.418 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.322+0000 7f1ab9ffb700 1 -- 172.21.15.92:0/3487332820 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1abc089b10 con 0x7f1ac415d1b0 2023-08-26T09:25:20.418 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.322+0000 7f1ab9ffb700 1 --2- 172.21.15.92:0/3487332820 >> [v2:172.21.15.92:6800/3579846453,v1:172.21.15.92:6801/3579846453] conn(0x7f1aa8072a70 0x7f1aa8074e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.418 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.322+0000 7f1ab9ffb700 1 -- 172.21.15.92:0/3487332820 --> [v2:172.21.15.92:6800/3579846453,v1:172.21.15.92:6801/3579846453] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1aa8075540 con 0x7f1aa8072a70 2023-08-26T09:25:20.418 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.322+0000 7f1ab9ffb700 1 -- 172.21.15.92:0/3487332820 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1abc08e1c0 con 0x7f1ac415d1b0 2023-08-26T09:25:20.419 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.321+0000 7fef7f59e700 1 -- 172.21.15.92:0/1076297156 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef8015c990 con 0x7fef800b1e30 2023-08-26T09:25:20.419 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.322+0000 7fef7f59e700 1 -- 172.21.15.92:0/1076297156 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fef800b0a90 con 0x7fef800b1e30 2023-08-26T09:25:20.419 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.322+0000 7f1ac8847700 1 --2- 172.21.15.92:0/3487332820 >> [v2:172.21.15.92:6800/3579846453,v1:172.21.15.92:6801/3579846453] conn(0x7f1aa8072a70 0x7f1aa8074e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.420 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.323+0000 7fef6effd700 1 -- 172.21.15.92:0/1076297156 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7000cc80 con 0x7fef800b1e30 2023-08-26T09:25:20.420 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.323+0000 7f1ac8847700 1 --2- 172.21.15.92:0/3487332820 >> [v2:172.21.15.92:6800/3579846453,v1:172.21.15.92:6801/3579846453] conn(0x7f1aa8072a70 0x7f1aa8074e90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.420 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.324+0000 7f586cb2b700 1 --2- 172.21.15.92:0/295107745 >> [v2:172.21.15.92:6816/3697397687,v1:172.21.15.92:6818/3697397687] conn(0x7f5854072920 0x7f5854074d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.421 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.324+0000 7f1ab9ffb700 1 -- 172.21.15.92:0/3487332820 <== osd.3 v2:172.21.15.92:6800/3579846453 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f1aa8075540 con 0x7f1aa8072a70 2023-08-26T09:25:20.421 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.324+0000 7f586cb2b700 1 --2- 172.21.15.92:0/295107745 >> [v2:172.21.15.92:6816/3697397687,v1:172.21.15.92:6818/3697397687] conn(0x7f5854072920 0x7f5854074d40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.422 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.325+0000 7f5864ff9700 1 -- 172.21.15.92:0/295107745 <== osd.2 v2:172.21.15.92:6816/3697397687 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f58540753f0 con 0x7f5854072920 2023-08-26T09:25:20.422 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.327+0000 7f1ac9048700 1 --2- 172.21.15.92:0/3487332820 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f1aa806a1b0 0x7f1aa806c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.422 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.327+0000 7f1ac9048700 1 --2- 172.21.15.92:0/3487332820 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f1aa806a1b0 0x7f1aa806c670 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1ac413e9d0 tx=0x7f1ac0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.423 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.324+0000 7f5e00d88700 1 --2- 172.21.15.92:0/1425330594 >> [v2:172.21.15.92:6817/382827192,v1:172.21.15.92:6819/382827192] conn(0x7f5de00727b0 0x7f5de0074bd0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.423 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.325+0000 7f5df1ffb700 1 -- 172.21.15.92:0/1425330594 <== osd.0 v2:172.21.15.92:6817/382827192 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f5de0075280 con 0x7f5de00727b0 2023-08-26T09:25:20.423 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.328+0000 7f706c494700 1 -- 172.21.15.92:0/655296531 --> [v2:172.21.15.188:6800/1655821054,v1:172.21.15.188:6801/1655821054] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f706406ce10 con 0x7f70500729f0 2023-08-26T09:25:20.424 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.329+0000 7f7062ffd700 1 -- 172.21.15.92:0/655296531 <== osd.5 v2:172.21.15.188:6800/1655821054 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f70580011b0 con 0x7f70500729f0 2023-08-26T09:25:20.424 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.329+0000 7fef6effd700 1 -- 172.21.15.92:0/1076297156 <== mon.2 v2:172.21.15.188:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fef70013470 con 0x7fef800b1e30 2023-08-26T09:25:20.424 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.330+0000 7fef6effd700 1 --2- 172.21.15.92:0/1076297156 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fef6006a110 0x7fef6006c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.425 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.330+0000 7fef7dd9b700 1 --2- 172.21.15.92:0/1076297156 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fef6006a110 0x7fef6006c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.425 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.330+0000 7fef6effd700 1 -- 172.21.15.92:0/1076297156 <== mon.2 v2:172.21.15.188:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fef700886b0 con 0x7fef800b1e30 2023-08-26T09:25:20.425 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.330+0000 7fef6effd700 1 --2- 172.21.15.92:0/1076297156 >> [v2:172.21.15.188:6824/1882888860,v1:172.21.15.188:6825/1882888860] conn(0x7fef600728d0 0x7fef60074cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.425 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.330+0000 7fef6effd700 1 -- 172.21.15.92:0/1076297156 --> [v2:172.21.15.188:6824/1882888860,v1:172.21.15.188:6825/1882888860] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fef600753a0 con 0x7fef600728d0 2023-08-26T09:25:20.425 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.330+0000 7fef6effd700 1 -- 172.21.15.92:0/1076297156 <== mon.2 v2:172.21.15.188:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef70053da0 con 0x7fef800b1e30 2023-08-26T09:25:20.426 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.330+0000 7fef7dd9b700 1 --2- 172.21.15.92:0/1076297156 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fef6006a110 0x7fef6006c5d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fef74000c00 tx=0x7fef7400d000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.426 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.331+0000 7fef7ed9d700 1 --2- 172.21.15.92:0/1076297156 >> [v2:172.21.15.188:6824/1882888860,v1:172.21.15.188:6825/1882888860] conn(0x7fef600728d0 0x7fef60074cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.427 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.331+0000 7f4bcf2b2700 1 -- 172.21.15.92:0/2757387346 --> [v2:172.21.15.92:6808/618773438,v1:172.21.15.92:6809/618773438] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4bc806cb30 con 0x7f4bac072920 2023-08-26T09:25:20.427 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.331+0000 7fef7ed9d700 1 --2- 172.21.15.92:0/1076297156 >> [v2:172.21.15.188:6824/1882888860,v1:172.21.15.188:6825/1882888860] conn(0x7fef600728d0 0x7fef60074cf0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.427 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.332+0000 7f4bbdffb700 1 -- 172.21.15.92:0/2757387346 <== osd.1 v2:172.21.15.92:6808/618773438 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4bb8009680 con 0x7f4bac072920 2023-08-26T09:25:20.428 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.332+0000 7fef6effd700 1 -- 172.21.15.92:0/1076297156 <== osd.7 v2:172.21.15.188:6824/1882888860 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fef600753a0 con 0x7fef600728d0 2023-08-26T09:25:20.428 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.333+0000 7f706c494700 1 -- 172.21.15.92:0/655296531 >> [v2:172.21.15.188:6800/1655821054,v1:172.21.15.188:6801/1655821054] conn(0x7f70500729f0 msgr2=0x7f7050074e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.429 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.333+0000 7f706c494700 1 --2- 172.21.15.92:0/655296531 >> [v2:172.21.15.188:6800/1655821054,v1:172.21.15.188:6801/1655821054] conn(0x7f70500729f0 0x7f7050074e10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.429 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.333+0000 7f706c494700 1 -- 172.21.15.92:0/655296531 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f705006a130 msgr2=0x7f705006c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.429 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.333+0000 7f706c494700 1 --2- 172.21.15.92:0/655296531 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f705006a130 0x7f705006c5f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f705c009630 tx=0x7f705c008030 comp rx=0 tx=0).stop 2023-08-26T09:25:20.429 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.333+0000 7f706c494700 1 -- 172.21.15.92:0/655296531 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f706413f8c0 msgr2=0x7f70640ce0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.429 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.333+0000 7f706c494700 1 --2- 172.21.15.92:0/655296531 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f706413f8c0 0x7f70640ce0a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f705400bdf0 tx=0x7f7054009f70 comp rx=0 tx=0).stop 2023-08-26T09:25:20.430 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.333+0000 7f706aa31700 1 -- 172.21.15.92:0/655296531 reap_dead start 2023-08-26T09:25:20.430 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.334+0000 7f706c494700 1 -- 172.21.15.92:0/655296531 shutdown_connections 2023-08-26T09:25:20.430 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.334+0000 7f706c494700 1 -- 172.21.15.92:0/655296531 >> 172.21.15.92:0/655296531 conn(0x7f70640b0880 msgr2=0x7f70640b0090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:20.431 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.338+0000 7f706c494700 1 -- 172.21.15.92:0/655296531 shutdown_connections 2023-08-26T09:25:20.431 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.338+0000 7f706c494700 1 -- 172.21.15.92:0/655296531 wait complete. 2023-08-26T09:25:20.431 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.339+0000 7f991d386700 1 -- 172.21.15.92:0/1018105802 --> [v2:172.21.15.188:6808/2069976891,v1:172.21.15.188:6810/2069976891] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f98f8002d40 con 0x7f99040729f0 2023-08-26T09:25:20.432 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.343+0000 7f98ff7fe700 1 -- 172.21.15.92:0/1018105802 <== osd.6 v2:172.21.15.188:6808/2069976891 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f98f8002d40 con 0x7f99040729f0 2023-08-26T09:25:20.432 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.346+0000 7f4bcf2b2700 1 -- 172.21.15.92:0/2757387346 >> [v2:172.21.15.92:6808/618773438,v1:172.21.15.92:6809/618773438] conn(0x7f4bac072920 msgr2=0x7f4bac074d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.432 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.346+0000 7f4bcf2b2700 1 --2- 172.21.15.92:0/2757387346 >> [v2:172.21.15.92:6808/618773438,v1:172.21.15.92:6809/618773438] conn(0x7f4bac072920 0x7f4bac074d40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.433 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.349+0000 7f4bcf2b2700 1 -- 172.21.15.92:0/2757387346 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f4bac06a0e0 msgr2=0x7f4bac06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.433 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.349+0000 7f4bcf2b2700 1 --2- 172.21.15.92:0/2757387346 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f4bac06a0e0 0x7f4bac06c5a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4bc4004e70 tx=0x7f4bc4001120 comp rx=0 tx=0).stop 2023-08-26T09:25:20.433 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.349+0000 7f4bcf2b2700 1 -- 172.21.15.92:0/2757387346 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4bc815cd20 msgr2=0x7f4bc80ceac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.433 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.349+0000 7f4bcf2b2700 1 --2- 172.21.15.92:0/2757387346 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4bc815cd20 0x7f4bc80ceac0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4bc001a000 tx=0x7f4bc0004ad0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.433 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.349+0000 7f4bcd84f700 1 -- 172.21.15.92:0/2757387346 reap_dead start 2023-08-26T09:25:20.434 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.349+0000 7f4bcf2b2700 1 -- 172.21.15.92:0/2757387346 shutdown_connections 2023-08-26T09:25:20.434 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.349+0000 7f4bcf2b2700 1 -- 172.21.15.92:0/2757387346 >> 172.21.15.92:0/2757387346 conn(0x7f4bc80b0880 msgr2=0x7f4bc80ae6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:20.434 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.350+0000 7f991d386700 1 -- 172.21.15.92:0/1018105802 >> [v2:172.21.15.188:6808/2069976891,v1:172.21.15.188:6810/2069976891] conn(0x7f99040729f0 msgr2=0x7f9904074e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.435 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.350+0000 7f991d386700 1 --2- 172.21.15.92:0/1018105802 >> [v2:172.21.15.188:6808/2069976891,v1:172.21.15.188:6810/2069976891] conn(0x7f99040729f0 0x7f9904074e10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.435 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.350+0000 7f991d386700 1 -- 172.21.15.92:0/1018105802 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f990406a130 msgr2=0x7f990406c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.435 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.350+0000 7f991d386700 1 --2- 172.21.15.92:0/1018105802 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f990406a130 0x7f990406c5f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9908007fd0 tx=0x7f9908007940 comp rx=0 tx=0).stop 2023-08-26T09:25:20.435 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.350+0000 7f991d386700 1 -- 172.21.15.92:0/1018105802 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99180b23b0 msgr2=0x7f99180adc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.435 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.350+0000 7f991d386700 1 --2- 172.21.15.92:0/1018105802 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99180b23b0 0x7f99180adc60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f990c0090b0 tx=0x7f990c004750 comp rx=0 tx=0).stop 2023-08-26T09:25:20.436 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.350+0000 7f99177fe700 1 -- 172.21.15.92:0/1018105802 reap_dead start 2023-08-26T09:25:20.436 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.350+0000 7fef7f59e700 1 -- 172.21.15.92:0/1076297156 --> [v2:172.21.15.188:6824/1882888860,v1:172.21.15.188:6825/1882888860] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fef800b07b0 con 0x7fef600728d0 2023-08-26T09:25:20.436 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.350+0000 7f991d386700 1 -- 172.21.15.92:0/1018105802 shutdown_connections 2023-08-26T09:25:20.437 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.350+0000 7f991d386700 1 -- 172.21.15.92:0/1018105802 >> 172.21.15.92:0/1018105802 conn(0x7f991806a320 msgr2=0x7f9918071b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:20.437 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.350+0000 7f30b16a8700 1 -- 172.21.15.92:0/1847814223 --> [v2:172.21.15.188:6809/3228383424,v1:172.21.15.188:6811/3228383424] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f308c002d40 con 0x7f30980729f0 2023-08-26T09:25:20.437 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.350+0000 7fef6effd700 1 -- 172.21.15.92:0/1076297156 <== osd.7 v2:172.21.15.188:6824/1882888860 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fef78001c60 con 0x7fef600728d0 2023-08-26T09:25:20.438 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.351+0000 7f4bcf2b2700 1 -- 172.21.15.92:0/2757387346 shutdown_connections 2023-08-26T09:25:20.438 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.351+0000 7f4bcf2b2700 1 -- 172.21.15.92:0/2757387346 wait complete. 2023-08-26T09:25:20.439 INFO:teuthology.orchestra.run.smithi092.stdout:55834574854 2023-08-26T09:25:20.439 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-08-26T09:25:20.440 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.351+0000 7fef7f59e700 1 -- 172.21.15.92:0/1076297156 >> [v2:172.21.15.188:6824/1882888860,v1:172.21.15.188:6825/1882888860] conn(0x7fef600728d0 msgr2=0x7fef60074cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.441 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.351+0000 7fef7f59e700 1 --2- 172.21.15.92:0/1076297156 >> [v2:172.21.15.188:6824/1882888860,v1:172.21.15.188:6825/1882888860] conn(0x7fef600728d0 0x7fef60074cf0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.441 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.351+0000 7fef7f59e700 1 -- 172.21.15.92:0/1076297156 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fef6006a110 msgr2=0x7fef6006c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.441 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.351+0000 7fef7f59e700 1 --2- 172.21.15.92:0/1076297156 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fef6006a110 0x7fef6006c5d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fef74000c00 tx=0x7fef7400d000 comp rx=0 tx=0).stop 2023-08-26T09:25:20.441 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.351+0000 7fef7f59e700 1 -- 172.21.15.92:0/1076297156 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fef800b1e30 msgr2=0x7fef801f6500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.441 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.351+0000 7fef7f59e700 1 --2- 172.21.15.92:0/1076297156 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fef800b1e30 0x7fef801f6500 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fef7000ebe0 tx=0x7fef7000eef0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.442 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.351+0000 7fef7ed9d700 1 -- 172.21.15.92:0/1076297156 reap_dead start 2023-08-26T09:25:20.442 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.351+0000 7fef7f59e700 1 -- 172.21.15.92:0/1076297156 shutdown_connections 2023-08-26T09:25:20.442 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.351+0000 7fef7f59e700 1 -- 172.21.15.92:0/1076297156 >> 172.21.15.92:0/1076297156 conn(0x7fef8006ad50 msgr2=0x7fef8006f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:20.442 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.351+0000 7fef7f59e700 1 -- 172.21.15.92:0/1076297156 shutdown_connections 2023-08-26T09:25:20.442 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.351+0000 7fef7f59e700 1 -- 172.21.15.92:0/1076297156 wait complete. 2023-08-26T09:25:20.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.352+0000 7f991d386700 1 -- 172.21.15.92:0/1018105802 shutdown_connections 2023-08-26T09:25:20.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.354+0000 7f30937fe700 1 -- 172.21.15.92:0/1847814223 <== osd.4 v2:172.21.15.188:6809/3228383424 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f308c002d40 con 0x7f30980729f0 2023-08-26T09:25:20.444 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.354+0000 7f1acb2ac700 1 -- 172.21.15.92:0/3487332820 --> [v2:172.21.15.92:6800/3579846453,v1:172.21.15.92:6801/3579846453] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1ac406cb30 con 0x7f1aa8072a70 2023-08-26T09:25:20.444 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.355+0000 7f1ab9ffb700 1 -- 172.21.15.92:0/3487332820 <== osd.3 v2:172.21.15.92:6800/3579846453 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1ab400b6f0 con 0x7f1aa8072a70 2023-08-26T09:25:20.444 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.355+0000 7f1acb2ac700 1 -- 172.21.15.92:0/3487332820 >> [v2:172.21.15.92:6800/3579846453,v1:172.21.15.92:6801/3579846453] conn(0x7f1aa8072a70 msgr2=0x7f1aa8074e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.445 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.355+0000 7f1acb2ac700 1 --2- 172.21.15.92:0/3487332820 >> [v2:172.21.15.92:6800/3579846453,v1:172.21.15.92:6801/3579846453] conn(0x7f1aa8072a70 0x7f1aa8074e90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.445 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.355+0000 7f586e58e700 1 -- 172.21.15.92:0/295107745 --> [v2:172.21.15.92:6816/3697397687,v1:172.21.15.92:6818/3697397687] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f58680b2c60 con 0x7f5854072920 2023-08-26T09:25:20.446 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.356+0000 7f1acb2ac700 1 -- 172.21.15.92:0/3487332820 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f1aa806a1b0 msgr2=0x7f1aa806c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.446 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.356+0000 7f1acb2ac700 1 --2- 172.21.15.92:0/3487332820 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f1aa806a1b0 0x7f1aa806c670 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1ac413e9d0 tx=0x7f1ac0009040 comp rx=0 tx=0).stop 2023-08-26T09:25:20.446 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.356+0000 7f1acb2ac700 1 -- 172.21.15.92:0/3487332820 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1ac415d1b0 msgr2=0x7f1ac4151e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.446 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.356+0000 7f1acb2ac700 1 --2- 172.21.15.92:0/3487332820 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1ac415d1b0 0x7f1ac4151e00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1abc018000 tx=0x7f1abc004ad0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.446 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.356+0000 7f1ac9849700 1 -- 172.21.15.92:0/3487332820 reap_dead start 2023-08-26T09:25:20.447 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.356+0000 7f1acb2ac700 1 -- 172.21.15.92:0/3487332820 shutdown_connections 2023-08-26T09:25:20.447 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.356+0000 7f1acb2ac700 1 -- 172.21.15.92:0/3487332820 >> 172.21.15.92:0/3487332820 conn(0x7f1ac40b0880 msgr2=0x7f1ac40afa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:20.447 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.356+0000 7f5864ff9700 1 -- 172.21.15.92:0/295107745 <== osd.2 v2:172.21.15.92:6816/3697397687 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f585c004500 con 0x7f5854072920 2023-08-26T09:25:20.447 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.357+0000 7f991d386700 1 -- 172.21.15.92:0/1018105802 wait complete. 2023-08-26T09:25:20.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.357+0000 7f30b16a8700 1 -- 172.21.15.92:0/1847814223 >> [v2:172.21.15.188:6809/3228383424,v1:172.21.15.188:6811/3228383424] conn(0x7f30980729f0 msgr2=0x7f3098074e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.357+0000 7f30b16a8700 1 --2- 172.21.15.92:0/1847814223 >> [v2:172.21.15.188:6809/3228383424,v1:172.21.15.188:6811/3228383424] conn(0x7f30980729f0 0x7f3098074e10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.357+0000 7f30b16a8700 1 -- 172.21.15.92:0/1847814223 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f309806a1b0 msgr2=0x7f309806c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.357+0000 7f30b16a8700 1 --2- 172.21.15.92:0/1847814223 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f309806a1b0 0x7f309806c670 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f30a0001920 tx=0x7f30a0009040 comp rx=0 tx=0).stop 2023-08-26T09:25:20.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.357+0000 7f30b16a8700 1 -- 172.21.15.92:0/1847814223 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30ac0c6ec0 msgr2=0x7f30ac0c4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.357+0000 7f30b16a8700 1 --2- 172.21.15.92:0/1847814223 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30ac0c6ec0 0x7f30ac0c4c50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f309c00e560 tx=0x7f309c00e870 comp rx=0 tx=0).stop 2023-08-26T09:25:20.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.357+0000 7f30ab7fe700 1 -- 172.21.15.92:0/1847814223 reap_dead start 2023-08-26T09:25:20.450 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.357+0000 7f30b16a8700 1 -- 172.21.15.92:0/1847814223 shutdown_connections 2023-08-26T09:25:20.450 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.357+0000 7f30b16a8700 1 -- 172.21.15.92:0/1847814223 >> 172.21.15.92:0/1847814223 conn(0x7f30ac0b23c0 msgr2=0x7f30ac0ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:20.450 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.357+0000 7f30b16a8700 1 -- 172.21.15.92:0/1847814223 shutdown_connections 2023-08-26T09:25:20.450 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.357+0000 7f30b16a8700 1 -- 172.21.15.92:0/1847814223 wait complete. 2023-08-26T09:25:20.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.359+0000 7f586e58e700 1 -- 172.21.15.92:0/295107745 >> [v2:172.21.15.92:6816/3697397687,v1:172.21.15.92:6818/3697397687] conn(0x7f5854072920 msgr2=0x7f5854074d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.359+0000 7f586e58e700 1 --2- 172.21.15.92:0/295107745 >> [v2:172.21.15.92:6816/3697397687,v1:172.21.15.92:6818/3697397687] conn(0x7f5854072920 0x7f5854074d40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.359+0000 7f586e58e700 1 -- 172.21.15.92:0/295107745 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f585406a0e0 msgr2=0x7f585406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.359+0000 7f586e58e700 1 --2- 172.21.15.92:0/295107745 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f585406a0e0 0x7f585406c5a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5868148260 tx=0x7f58580090e0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.359+0000 7f586e58e700 1 -- 172.21.15.92:0/295107745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5868165550 msgr2=0x7f5868149680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.359+0000 7f586e58e700 1 --2- 172.21.15.92:0/295107745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5868165550 0x7f5868149680 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f586000cbd0 tx=0x7f586000cee0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.361+0000 7f1acb2ac700 1 -- 172.21.15.92:0/3487332820 shutdown_connections 2023-08-26T09:25:20.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.359+0000 7f5de77fe700 1 -- 172.21.15.92:0/1425330594 --> [v2:172.21.15.92:6817/382827192,v1:172.21.15.92:6819/382827192] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5dd4002d40 con 0x7f5de00727b0 2023-08-26T09:25:20.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.360+0000 7f5df1ffb700 1 -- 172.21.15.92:0/1425330594 <== osd.0 v2:172.21.15.92:6817/382827192 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5dd4002d40 con 0x7f5de00727b0 2023-08-26T09:25:20.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.360+0000 7f5de77fe700 1 -- 172.21.15.92:0/1425330594 >> [v2:172.21.15.92:6817/382827192,v1:172.21.15.92:6819/382827192] conn(0x7f5de00727b0 msgr2=0x7f5de0074bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.361+0000 7f5de77fe700 1 --2- 172.21.15.92:0/1425330594 >> [v2:172.21.15.92:6817/382827192,v1:172.21.15.92:6819/382827192] conn(0x7f5de00727b0 0x7f5de0074bd0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.361+0000 7f5de77fe700 1 -- 172.21.15.92:0/1425330594 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f5de006a0e0 msgr2=0x7f5de006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.361+0000 7f5de77fe700 1 --2- 172.21.15.92:0/1425330594 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f5de006a0e0 0x7f5de006c5a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5dec005910 tx=0x7f5dec009040 comp rx=0 tx=0).stop 2023-08-26T09:25:20.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.361+0000 7f5de77fe700 1 -- 172.21.15.92:0/1425330594 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5dfc0ab970 msgr2=0x7f5dfc070e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.361+0000 7f5de77fe700 1 --2- 172.21.15.92:0/1425330594 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5dfc0ab970 0x7f5dfc070e70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc0cb060 tx=0x7f5df4004b40 comp rx=0 tx=0).stop 2023-08-26T09:25:20.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.361+0000 7f5e01d8a700 1 -- 172.21.15.92:0/1425330594 reap_dead start 2023-08-26T09:25:20.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.361+0000 7f586cb2b700 1 -- 172.21.15.92:0/295107745 reap_dead start 2023-08-26T09:25:20.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.361+0000 7f586e58e700 1 -- 172.21.15.92:0/295107745 shutdown_connections 2023-08-26T09:25:20.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.361+0000 7f586e58e700 1 -- 172.21.15.92:0/295107745 >> 172.21.15.92:0/295107745 conn(0x7f58680b0880 msgr2=0x7f5868164730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:20.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.361+0000 7f586e58e700 1 -- 172.21.15.92:0/295107745 shutdown_connections 2023-08-26T09:25:20.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.361+0000 7f586e58e700 1 -- 172.21.15.92:0/295107745 wait complete. 2023-08-26T09:25:20.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.366+0000 7f1acb2ac700 1 -- 172.21.15.92:0/3487332820 wait complete. 2023-08-26T09:25:20.457 INFO:teuthology.orchestra.run.smithi092.stdout:55834574855 2023-08-26T09:25:20.457 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-08-26T09:25:20.458 INFO:teuthology.orchestra.run.smithi092.stdout:55834574854 2023-08-26T09:25:20.458 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-08-26T09:25:20.459 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.370+0000 7f5de77fe700 1 -- 172.21.15.92:0/1425330594 shutdown_connections 2023-08-26T09:25:20.459 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.370+0000 7f5de77fe700 1 -- 172.21.15.92:0/1425330594 >> 172.21.15.92:0/1425330594 conn(0x7f5dfc0b0880 msgr2=0x7f5dfc0af610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:20.459 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.372+0000 7f5de77fe700 1 -- 172.21.15.92:0/1425330594 shutdown_connections 2023-08-26T09:25:20.460 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.372+0000 7f5de77fe700 1 -- 172.21.15.92:0/1425330594 wait complete. 2023-08-26T09:25:20.460 INFO:teuthology.orchestra.run.smithi092.stdout:55834574856 2023-08-26T09:25:20.461 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-08-26T09:25:20.461 INFO:teuthology.orchestra.run.smithi092.stdout:55834574854 2023-08-26T09:25:20.462 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-08-26T09:25:20.463 INFO:teuthology.orchestra.run.smithi092.stdout:55834574855 2023-08-26T09:25:20.463 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-08-26T09:25:20.464 INFO:teuthology.orchestra.run.smithi092.stdout:55834574854 2023-08-26T09:25:20.464 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-08-26T09:25:20.465 INFO:teuthology.orchestra.run.smithi092.stdout:55834574854 2023-08-26T09:25:20.466 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-08-26T09:25:20.698 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.693+0000 7fcf02e94700 1 Processor -- start 2023-08-26T09:25:20.699 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.693+0000 7fcf02e94700 1 -- start start 2023-08-26T09:25:20.700 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.694+0000 7fcf02e94700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fcefc0ce3e0 0x7fcefc144bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.700 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.694+0000 7fcf02e94700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcefc162af0 con 0x7fcefc0cf310 2023-08-26T09:25:20.700 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.694+0000 7fcf02e94700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcefc0ce7c0 con 0x7fcefc0b23b0 2023-08-26T09:25:20.700 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.694+0000 7fcf02e94700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcefc144950 con 0x7fcefc0ce3e0 2023-08-26T09:25:20.701 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.695+0000 7fcf00c30700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fcefc0ce3e0 0x7fcefc144bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.701 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.695+0000 7fcf00c30700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fcefc0ce3e0 0x7fcefc144bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44660/0 (socket says 172.21.15.92:44660) 2023-08-26T09:25:20.701 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.695+0000 7fcf00c30700 1 -- 172.21.15.92:0/1413059339 learned_addr learned my addr 172.21.15.92:0/1413059339 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:20.702 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.695+0000 7fcf00c30700 1 -- 172.21.15.92:0/1413059339 >> v1:172.21.15.188:6789/0 conn(0x7fcefc0b23b0 legacy=0x7fcefc0cec00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-26T09:25:20.702 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.695+0000 7fcf00c30700 1 -- 172.21.15.92:0/1413059339 >> v1:172.21.15.92:6789/0 conn(0x7fcefc0cf310 legacy=0x7fcefc1653d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-26T09:25:20.702 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.695+0000 7fcf00c30700 1 -- 172.21.15.92:0/1413059339 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcefc161ee0 con 0x7fcefc0ce3e0 2023-08-26T09:25:20.702 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.695+0000 7fcf00c30700 1 --2- 172.21.15.92:0/1413059339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcefc0ce3e0 0x7fcefc144bd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcef00098f0 tx=0x7fcef0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8510f81c260cbd5 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.703 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.697+0000 7fcefb7fe700 1 -- 172.21.15.92:0/1413059339 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef0004230 con 0x7fcefc0ce3e0 2023-08-26T09:25:20.703 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.697+0000 7fcefb7fe700 1 -- 172.21.15.92:0/1413059339 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef0004390 con 0x7fcefc0ce3e0 2023-08-26T09:25:20.703 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.697+0000 7fcefb7fe700 1 -- 172.21.15.92:0/1413059339 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef00036a0 con 0x7fcefc0ce3e0 2023-08-26T09:25:20.703 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.698+0000 7fcf02e94700 1 -- 172.21.15.92:0/1413059339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcefc0ce3e0 msgr2=0x7fcefc144bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.704 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.698+0000 7fcf02e94700 1 --2- 172.21.15.92:0/1413059339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcefc0ce3e0 0x7fcefc144bd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcef00098f0 tx=0x7fcef0009c00 comp rx=0 tx=0).stop 2023-08-26T09:25:20.704 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.698+0000 7fcf02e94700 1 -- 172.21.15.92:0/1413059339 shutdown_connections 2023-08-26T09:25:20.704 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.698+0000 7fcf02e94700 1 --2- 172.21.15.92:0/1413059339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcefc0ce3e0 0x7fcefc144bd0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.698+0000 7fcf02e94700 1 -- 172.21.15.92:0/1413059339 >> 172.21.15.92:0/1413059339 conn(0x7fcefc06a320 msgr2=0x7fcefc06a730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:20.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.699+0000 7fcf02e94700 1 -- 172.21.15.92:0/1413059339 shutdown_connections 2023-08-26T09:25:20.706 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.700+0000 7fcf02e94700 1 -- 172.21.15.92:0/1413059339 wait complete. 2023-08-26T09:25:20.706 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.701+0000 7fcf02e94700 1 Processor -- start 2023-08-26T09:25:20.707 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.701+0000 7fcf02e94700 1 -- start start 2023-08-26T09:25:20.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.703+0000 7fcf02e94700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcefc0b23b0 0x7fcefc202d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.703+0000 7fcf02e94700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcefc0ce3e0 0x7fcefc0a84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.703+0000 7fcf02e94700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcefc0cf310 0x7fcefc15a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.703+0000 7fcf02e94700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcefc15f200 con 0x7fcefc0b23b0 2023-08-26T09:25:20.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.703+0000 7fcf02e94700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcefc160020 con 0x7fcefc0ce3e0 2023-08-26T09:25:20.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.703+0000 7fcf02e94700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcefc15f410 con 0x7fcefc0cf310 2023-08-26T09:25:20.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.703+0000 7fcf00c30700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcefc0b23b0 0x7fcefc202d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.703+0000 7fcf00c30700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcefc0b23b0 0x7fcefc202d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44664/0 (socket says 172.21.15.92:44664) 2023-08-26T09:25:20.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.703+0000 7fcf00c30700 1 -- 172.21.15.92:0/1844644893 learned_addr learned my addr 172.21.15.92:0/1844644893 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:20.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.704+0000 7fcefbfff700 1 --2- 172.21.15.92:0/1844644893 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcefc0ce3e0 0x7fcefc0a84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.704+0000 7fcf01431700 1 --2- 172.21.15.92:0/1844644893 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcefc0cf310 0x7fcefc15a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.704+0000 7fcf00c30700 1 -- 172.21.15.92:0/1844644893 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcefc0cf310 msgr2=0x7fcefc15a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.704+0000 7fcf00c30700 1 --2- 172.21.15.92:0/1844644893 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcefc0cf310 0x7fcefc15a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.704+0000 7fcf00c30700 1 -- 172.21.15.92:0/1844644893 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcefc0ce3e0 msgr2=0x7fcefc0a84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.704+0000 7fcf00c30700 1 --2- 172.21.15.92:0/1844644893 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcefc0ce3e0 0x7fcefc0a84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.704+0000 7fcf00c30700 1 -- 172.21.15.92:0/1844644893 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef0009550 con 0x7fcefc0b23b0 2023-08-26T09:25:20.712 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.704+0000 7fcf00c30700 1 --2- 172.21.15.92:0/1844644893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcefc0b23b0 0x7fcefc202d50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcef0009840 tx=0x7fcef0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.712 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.704+0000 7fcef97fa700 1 -- 172.21.15.92:0/1844644893 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef0011630 con 0x7fcefc0b23b0 2023-08-26T09:25:20.712 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.704+0000 7fcef97fa700 1 -- 172.21.15.92:0/1844644893 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef00117b0 con 0x7fcefc0b23b0 2023-08-26T09:25:20.712 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.704+0000 7fcef97fa700 1 -- 172.21.15.92:0/1844644893 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef0011b60 con 0x7fcefc0b23b0 2023-08-26T09:25:20.713 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.705+0000 7f3da403c700 1 Processor -- start 2023-08-26T09:25:20.713 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.705+0000 7fcf02e94700 1 -- 172.21.15.92:0/1844644893 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcefc15f6f0 con 0x7fcefc0b23b0 2023-08-26T09:25:20.713 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.706+0000 7fcf02e94700 1 -- 172.21.15.92:0/1844644893 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcefc15fcb0 con 0x7fcefc0b23b0 2023-08-26T09:25:20.714 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.706+0000 7f3da403c700 1 -- start start 2023-08-26T09:25:20.714 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.707+0000 7f3da403c700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f3d9c15cd20 0x7f3d9c15d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.714 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.707+0000 7f3da403c700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3d9c06fe20 0x7f3d9c0702b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.714 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.707+0000 7f3da403c700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d9c06c290 con 0x7f3d9c13f8c0 2023-08-26T09:25:20.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.707+0000 7f3da403c700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d9c15d6f0 con 0x7f3d9c15cd20 2023-08-26T09:25:20.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.708+0000 7f3da403c700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9c06c570 con 0x7f3d9c06fe20 2023-08-26T09:25:20.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.708+0000 7f3da1dd8700 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f3d9c13f8c0 0x7f3d9c0b31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.92:51794/0 (socket says 172.21.15.92:51794) 2023-08-26T09:25:20.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.708+0000 7f3da1dd8700 1 -- 172.21.15.92:0/3901983893 learned_addr learned my addr 172.21.15.92:0/3901983893 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:20.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.708+0000 7fcef97fa700 1 -- 172.21.15.92:0/1844644893 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcef0022070 con 0x7fcefc0b23b0 2023-08-26T09:25:20.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.708+0000 7fcf02e94700 1 -- 172.21.15.92:0/1844644893 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcefc04e660 con 0x7fcefc0b23b0 2023-08-26T09:25:20.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.708+0000 7fcef97fa700 1 --2- 172.21.15.92:0/1844644893 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fcee006a0e0 0x7fcee006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.717 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.708+0000 7fcef97fa700 1 -- 172.21.15.92:0/1844644893 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcef008a090 con 0x7fcefc0b23b0 2023-08-26T09:25:20.717 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.708+0000 7fcefbfff700 1 --2- 172.21.15.92:0/1844644893 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fcee006a0e0 0x7fcee006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.717 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.709+0000 7f4a27516700 1 Processor -- start 2023-08-26T09:25:20.718 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.709+0000 7fcefbfff700 1 --2- 172.21.15.92:0/1844644893 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fcee006a0e0 0x7fcee006c5a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcefc1445d0 tx=0x7fcee8009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.718 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.709+0000 7f4a27516700 1 -- start start 2023-08-26T09:25:20.718 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.709+0000 7f3da15d7700 1 --2- 172.21.15.92:0/3901983893 >> v2:172.21.15.188:3300/0 conn(0x7f3d9c15cd20 0x7f3d9c15d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.710+0000 7f5d5f51e700 1 Processor -- start 2023-08-26T09:25:20.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.710+0000 7fc05487e700 1 Processor -- start 2023-08-26T09:25:20.720 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.710+0000 7f3da0dd6700 1 -- 172.21.15.92:0/3901983893 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4136522088 0 0) 0x7f3d9c06c290 con 0x7f3d9c13f8c0 2023-08-26T09:25:20.720 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.710+0000 7f3da0dd6700 1 -- 172.21.15.92:0/3901983893 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d880035b0 con 0x7f3d9c13f8c0 2023-08-26T09:25:20.720 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.710+0000 7f3da15d7700 1 -- 172.21.15.92:0/3901983893 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3d9c06fe20 msgr2=0x7f3d9c0702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:20.720 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.710+0000 7f3da25d9700 1 --2- 172.21.15.92:0/3901983893 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3d9c06fe20 0x7f3d9c0702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.721 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.710+0000 7f3da15d7700 1 --2- 172.21.15.92:0/3901983893 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3d9c06fe20 0x7f3d9c0702b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.721 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.710+0000 7f3da15d7700 1 -- 172.21.15.92:0/3901983893 >> v1:172.21.15.188:6789/0 conn(0x7f3d9c13f8c0 legacy=0x7f3d9c0b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.721 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.710+0000 7f3da15d7700 1 -- 172.21.15.92:0/3901983893 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d9c06c850 con 0x7f3d9c15cd20 2023-08-26T09:25:20.721 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.710+0000 7f3da25d9700 1 --2- 172.21.15.92:0/3901983893 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3d9c06fe20 0x7f3d9c0702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:25:20.722 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.710+0000 7f5d5f51e700 1 -- start start 2023-08-26T09:25:20.722 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.710+0000 7fc05487e700 1 -- start start 2023-08-26T09:25:20.722 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.711+0000 7fd7dc56c700 1 Processor -- start 2023-08-26T09:25:20.723 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.711+0000 7fd7dc56c700 1 -- start start 2023-08-26T09:25:20.723 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.711+0000 7f5d5f51e700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f5d5813f8c0 0x7f5d580b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.724 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.712+0000 7f3da15d7700 1 --2- 172.21.15.92:0/3901983893 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3d9c15cd20 0x7f3d9c15d1b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3d98008840 tx=0x7f3d9800d330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c58cab2596410477 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.724 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.710+0000 7f4a27516700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a200cd460 0x7f4a200cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.724 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.710+0000 7f4a27516700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f4a2006cd10 0x7f4a200cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.724 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.710+0000 7f4a27516700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4a200cdd80 0x7f4a200704e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.725 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.710+0000 7f4a27516700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a2006db50 con 0x7f4a200cdd80 2023-08-26T09:25:20.725 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.710+0000 7f4a27516700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a2006d2b0 con 0x7f4a2006cd10 2023-08-26T09:25:20.725 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.710+0000 7f4a27516700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2006d590 con 0x7f4a200cd460 2023-08-26T09:25:20.725 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.710+0000 7f4a252b2700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a200cd460 0x7f4a200cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.725 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.711+0000 7f4a252b2700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a200cd460 0x7f4a200cb8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.92:43342/0 (socket says 172.21.15.92:43342) 2023-08-26T09:25:20.726 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.711+0000 7f4a252b2700 1 -- 172.21.15.92:0/2024024462 learned_addr learned my addr 172.21.15.92:0/2024024462 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:20.726 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.711+0000 7f4a25ab3700 1 --2- 172.21.15.92:0/2024024462 >> v2:172.21.15.92:3300/0 conn(0x7f4a200cdd80 0x7f4a200704e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.726 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.711+0000 7f4a24ab1700 1 --2- 172.21.15.92:0/2024024462 >> v2:172.21.15.188:3300/0 conn(0x7f4a2006cd10 0x7f4a200cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.726 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.711+0000 7f4a252b2700 1 -- 172.21.15.92:0/2024024462 >> v2:172.21.15.188:3300/0 conn(0x7f4a2006cd10 msgr2=0x7f4a200cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:20.726 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.711+0000 7f4a252b2700 1 --2- 172.21.15.92:0/2024024462 >> v2:172.21.15.188:3300/0 conn(0x7f4a2006cd10 0x7f4a200cd840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.726 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.711+0000 7f4a252b2700 1 -- 172.21.15.92:0/2024024462 >> v2:172.21.15.92:3300/0 conn(0x7f4a200cdd80 msgr2=0x7f4a200704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:20.727 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.711+0000 7f4a252b2700 1 --2- 172.21.15.92:0/2024024462 >> v2:172.21.15.92:3300/0 conn(0x7f4a200cdd80 0x7f4a200704e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.727 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.711+0000 7f4a252b2700 1 -- 172.21.15.92:0/2024024462 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a2006d870 con 0x7f4a200cd460 2023-08-26T09:25:20.727 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.711+0000 7f4a252b2700 1 --2- 172.21.15.92:0/2024024462 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a200cd460 0x7f4a200cb8b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4a200cfd70 tx=0x7f4a1c009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=937f9c426fdb9590 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.727 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.711+0000 7f4a17fff700 1 -- 172.21.15.92:0/2024024462 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1c011830 con 0x7f4a200cd460 2023-08-26T09:25:20.727 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.711+0000 7f4a17fff700 1 -- 172.21.15.92:0/2024024462 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1c011990 con 0x7f4a200cd460 2023-08-26T09:25:20.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.711+0000 7f4a17fff700 1 -- 172.21.15.92:0/2024024462 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1c011d20 con 0x7f4a200cd460 2023-08-26T09:25:20.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.712+0000 7f4a27516700 1 -- 172.21.15.92:0/2024024462 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a200cd460 msgr2=0x7f4a200cb8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.712+0000 7f4a27516700 1 --2- 172.21.15.92:0/2024024462 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a200cd460 0x7f4a200cb8b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4a200cfd70 tx=0x7f4a1c009bd0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.711+0000 7f5d5f51e700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5d580b3720 0x7f5d5815cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.711+0000 7f5d5f51e700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5d5815d260 0x7f5d58159700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.711+0000 7f5d5f51e700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d5815d710 con 0x7f5d5815d260 2023-08-26T09:25:20.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.711+0000 7f5d5f51e700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d5806c290 con 0x7f5d5813f8c0 2023-08-26T09:25:20.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.711+0000 7f5d5f51e700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5806c570 con 0x7f5d580b3720 2023-08-26T09:25:20.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.712+0000 7f5d5cab9700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5d580b3720 0x7f5d5815cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.712+0000 7f5d5cab9700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5d580b3720 0x7f5d5815cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.92:43350/0 (socket says 172.21.15.92:43350) 2023-08-26T09:25:20.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.712+0000 7f5d5cab9700 1 -- 172.21.15.92:0/2993088076 learned_addr learned my addr 172.21.15.92:0/2993088076 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:20.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.712+0000 7f5d5d2ba700 1 --2- 172.21.15.92:0/2993088076 >> v2:172.21.15.188:3300/0 conn(0x7f5d5813f8c0 0x7f5d580b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.712+0000 7f5d5dabb700 1 --2- 172.21.15.92:0/2993088076 >> v2:172.21.15.92:3300/0 conn(0x7f5d5815d260 0x7f5d58159700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.712+0000 7f5d5cab9700 1 -- 172.21.15.92:0/2993088076 >> v2:172.21.15.188:3300/0 conn(0x7f5d5813f8c0 msgr2=0x7f5d580b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:20.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.712+0000 7f5d5cab9700 1 --2- 172.21.15.92:0/2993088076 >> v2:172.21.15.188:3300/0 conn(0x7f5d5813f8c0 0x7f5d580b31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.731 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.712+0000 7f5d5cab9700 1 -- 172.21.15.92:0/2993088076 >> v2:172.21.15.92:3300/0 conn(0x7f5d5815d260 msgr2=0x7f5d58159700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:20.731 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.712+0000 7f5d5cab9700 1 --2- 172.21.15.92:0/2993088076 >> v2:172.21.15.92:3300/0 conn(0x7f5d5815d260 0x7f5d58159700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.731 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.712+0000 7f5d5cab9700 1 -- 172.21.15.92:0/2993088076 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d5806c850 con 0x7f5d580b3720 2023-08-26T09:25:20.731 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.712+0000 7fc05487e700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc05006cf50 0x7fc05006d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.732 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.712+0000 7fc05487e700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc0500d08f0 0x7fc0500cf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.732 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.712+0000 7fc05487e700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc050165c90 con 0x7fc0500cf820 2023-08-26T09:25:20.732 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.712+0000 7fc05487e700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc05006d870 con 0x7fc0500d08f0 2023-08-26T09:25:20.732 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.712+0000 7fc05487e700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc050165f30 con 0x7fc05006cf50 2023-08-26T09:25:20.732 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.712+0000 7fc04e59c700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc05006cf50 0x7fc05006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.712+0000 7fc04e59c700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc05006cf50 0x7fc05006d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.92:43354/0 (socket says 172.21.15.92:43354) 2023-08-26T09:25:20.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.712+0000 7fc04e59c700 1 -- 172.21.15.92:0/4272767850 learned_addr learned my addr 172.21.15.92:0/4272767850 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:20.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.712+0000 7f5d5cab9700 1 --2- 172.21.15.92:0/2993088076 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5d580b3720 0x7f5d5815cd20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5d58072790 tx=0x7f5d48009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31e760cbd36b1575 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.712+0000 7fd7dc56c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fd7d4071de0 0x7fd7d4159680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.713+0000 7fd7dc56c700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd7d40b2690 0x7fd7d40b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.713+0000 7fd7dc56c700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7d406c2c0 con 0x7fd7d40b1e10 2023-08-26T09:25:20.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.713+0000 7fd7dc56c700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7d40cf380 con 0x7fd7d4071de0 2023-08-26T09:25:20.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.713+0000 7fd7dc56c700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7d40b2fe0 con 0x7fd7d40b2690 2023-08-26T09:25:20.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.713+0000 7fd7da308700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fd7d4071de0 0x7fd7d4159680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.713+0000 7fd7da308700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fd7d4071de0 0x7fd7d4159680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44694/0 (socket says 172.21.15.92:44694) 2023-08-26T09:25:20.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.713+0000 7fd7da308700 1 -- 172.21.15.92:0/773587120 learned_addr learned my addr 172.21.15.92:0/773587120 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:20.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.713+0000 7f5d4ffff700 1 -- 172.21.15.92:0/2993088076 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4800d940 con 0x7f5d580b3720 2023-08-26T09:25:20.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.713+0000 7f5d4ffff700 1 -- 172.21.15.92:0/2993088076 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4800c070 con 0x7f5d580b3720 2023-08-26T09:25:20.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.713+0000 7f5d4ffff700 1 -- 172.21.15.92:0/2993088076 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4800dcc0 con 0x7f5d580b3720 2023-08-26T09:25:20.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.712+0000 7fc04dd9b700 1 --2- 172.21.15.92:0/4272767850 >> v2:172.21.15.92:3300/0 conn(0x7fc0500d08f0 0x7fc0500cf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.713+0000 7fc04e59c700 1 -- 172.21.15.92:0/4272767850 >> v2:172.21.15.92:3300/0 conn(0x7fc0500d08f0 msgr2=0x7fc0500cf2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:20.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.713+0000 7fc04e59c700 1 --2- 172.21.15.92:0/4272767850 >> v2:172.21.15.92:3300/0 conn(0x7fc0500d08f0 0x7fc0500cf2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.713+0000 7fc04e59c700 1 -- 172.21.15.92:0/4272767850 >> v1:172.21.15.92:6789/0 conn(0x7fc0500cf820 legacy=0x7fc050161840 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-26T09:25:20.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.713+0000 7fc04e59c700 1 -- 172.21.15.92:0/4272767850 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc05006e860 con 0x7fc05006cf50 2023-08-26T09:25:20.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.713+0000 7fd7dab09700 1 --2- 172.21.15.92:0/773587120 >> v2:172.21.15.188:3300/0 conn(0x7fd7d40b2690 0x7fd7d40b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.713+0000 7fc04e59c700 1 --2- 172.21.15.92:0/4272767850 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc05006cf50 0x7fc05006d330 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc048009e50 tx=0x7fc04800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=448e2e7912e2a6e5 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.713+0000 7f4a27516700 1 -- 172.21.15.92:0/2024024462 shutdown_connections 2023-08-26T09:25:20.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.713+0000 7f4a27516700 1 --2- 172.21.15.92:0/2024024462 >> v2:172.21.15.92:3300/0 conn(0x7f4a200cdd80 0x7f4a200704e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.713+0000 7fd7dab09700 1 -- 172.21.15.92:0/773587120 >> v2:172.21.15.92:3300/0 conn(0x7fd7d4071de0 msgr2=0x7fd7d4159680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:20.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.713+0000 7fd7dab09700 1 --2- 172.21.15.92:0/773587120 >> v2:172.21.15.92:3300/0 conn(0x7fd7d4071de0 0x7fd7d4159680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.713+0000 7fd7dab09700 1 -- 172.21.15.92:0/773587120 >> v1:172.21.15.188:6789/0 conn(0x7fd7d40b1e10 legacy=0x7fd7d40cec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.713+0000 7fd7dab09700 1 -- 172.21.15.92:0/773587120 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d4071930 con 0x7fd7d40b2690 2023-08-26T09:25:20.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.713+0000 7f4a27516700 1 --2- 172.21.15.92:0/2024024462 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a200cd460 0x7f4a200cb8b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.713+0000 7f4a27516700 1 --2- 172.21.15.92:0/2024024462 >> v2:172.21.15.188:3300/0 conn(0x7f4a2006cd10 0x7f4a200cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.713+0000 7f4a27516700 1 -- 172.21.15.92:0/2024024462 >> 172.21.15.92:0/2024024462 conn(0x7f4a200b0880 msgr2=0x7f4a200b0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:20.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.713+0000 7f4a27516700 1 -- 172.21.15.92:0/2024024462 shutdown_connections 2023-08-26T09:25:20.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.713+0000 7f3da0dd6700 1 -- 172.21.15.92:0/3901983893 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d98010070 con 0x7f3d9c15cd20 2023-08-26T09:25:20.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.713+0000 7f3da0dd6700 1 -- 172.21.15.92:0/3901983893 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d9800d910 con 0x7f3d9c15cd20 2023-08-26T09:25:20.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.713+0000 7f3da0dd6700 1 -- 172.21.15.92:0/3901983893 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9800dca0 con 0x7f3d9c15cd20 2023-08-26T09:25:20.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.713+0000 7fd7dab09700 1 --2- 172.21.15.92:0/773587120 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd7d40b2690 0x7fd7d40b2aa0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd7d40b1da0 tx=0x7fd7cc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26336504578ce9a3 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.713+0000 7effb06de700 1 Processor -- start 2023-08-26T09:25:20.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.714+0000 7effb06de700 1 -- start start 2023-08-26T09:25:20.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.714+0000 7fd7d9306700 1 -- 172.21.15.92:0/773587120 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc00e070 con 0x7fd7d40b2690 2023-08-26T09:25:20.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.714+0000 7fd7d9306700 1 -- 172.21.15.92:0/773587120 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7cc00bb20 con 0x7fd7d40b2690 2023-08-26T09:25:20.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.714+0000 7fd7d9306700 1 -- 172.21.15.92:0/773587120 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc012430 con 0x7fd7d40b2690 2023-08-26T09:25:20.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.714+0000 7f5d5f51e700 1 -- 172.21.15.92:0/2993088076 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5d580b3720 msgr2=0x7f5d5815cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.714+0000 7f5d5f51e700 1 --2- 172.21.15.92:0/2993088076 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5d580b3720 0x7f5d5815cd20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5d58072790 tx=0x7f5d48009bd0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.714+0000 7f3da403c700 1 -- 172.21.15.92:0/3901983893 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3d9c15cd20 msgr2=0x7f3d9c15d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.714+0000 7f3da403c700 1 --2- 172.21.15.92:0/3901983893 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3d9c15cd20 0x7f3d9c15d1b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3d98008840 tx=0x7f3d9800d330 comp rx=0 tx=0).stop 2023-08-26T09:25:20.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.715+0000 7f5d5f51e700 1 -- 172.21.15.92:0/2993088076 shutdown_connections 2023-08-26T09:25:20.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.715+0000 7f5d5f51e700 1 --2- 172.21.15.92:0/2993088076 >> v2:172.21.15.188:3300/0 conn(0x7f5d5813f8c0 0x7f5d580b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.715+0000 7f5d5f51e700 1 --2- 172.21.15.92:0/2993088076 >> v2:172.21.15.92:3300/0 conn(0x7f5d5815d260 0x7f5d58159700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.746 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.715+0000 7f5d5f51e700 1 --2- 172.21.15.92:0/2993088076 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5d580b3720 0x7f5d5815cd20 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.746 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.715+0000 7f5d5f51e700 1 -- 172.21.15.92:0/2993088076 >> 172.21.15.92:0/2993088076 conn(0x7f5d580b0880 msgr2=0x7f5d580b0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:20.746 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.714+0000 7fd7dc56c700 1 -- 172.21.15.92:0/773587120 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd7d40b2690 msgr2=0x7fd7d40b2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.746 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.715+0000 7fd7dc56c700 1 --2- 172.21.15.92:0/773587120 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd7d40b2690 0x7fd7d40b2aa0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd7d40b1da0 tx=0x7fd7cc00b330 comp rx=0 tx=0).stop 2023-08-26T09:25:20.747 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.715+0000 7fc04d59a700 1 -- 172.21.15.92:0/4272767850 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04800e070 con 0x7fc05006cf50 2023-08-26T09:25:20.747 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.715+0000 7fc04d59a700 1 -- 172.21.15.92:0/4272767850 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc048003a20 con 0x7fc05006cf50 2023-08-26T09:25:20.747 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.715+0000 7fc04d59a700 1 -- 172.21.15.92:0/4272767850 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc048003dd0 con 0x7fc05006cf50 2023-08-26T09:25:20.748 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.716+0000 7fcef97fa700 1 -- 172.21.15.92:0/1844644893 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fcef00bc990 con 0x7fcefc0b23b0 2023-08-26T09:25:20.748 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.716+0000 7fd7dc56c700 1 -- 172.21.15.92:0/773587120 shutdown_connections 2023-08-26T09:25:20.748 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.716+0000 7fd7dc56c700 1 --2- 172.21.15.92:0/773587120 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd7d40b2690 0x7fd7d40b2aa0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.748 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.716+0000 7fd7dc56c700 1 --2- 172.21.15.92:0/773587120 >> v2:172.21.15.92:3300/0 conn(0x7fd7d4071de0 0x7fd7d4159680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.749 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.716+0000 7fd7dc56c700 1 -- 172.21.15.92:0/773587120 >> 172.21.15.92:0/773587120 conn(0x7fd7d406a320 msgr2=0x7fd7d406a730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:20.749 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.716+0000 7fd7dc56c700 1 -- 172.21.15.92:0/773587120 shutdown_connections 2023-08-26T09:25:20.749 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.714+0000 7f4a27516700 1 -- 172.21.15.92:0/2024024462 wait complete. 2023-08-26T09:25:20.749 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.716+0000 7f4a27516700 1 Processor -- start 2023-08-26T09:25:20.749 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.716+0000 7f4a27516700 1 -- start start 2023-08-26T09:25:20.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.715+0000 7f5d5f51e700 1 -- 172.21.15.92:0/2993088076 shutdown_connections 2023-08-26T09:25:20.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.715+0000 7f5d5f51e700 1 -- 172.21.15.92:0/2993088076 wait complete. 2023-08-26T09:25:20.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.715+0000 7effb06de700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7effa806d570 0x7effa815d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.715+0000 7effb06de700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7effa815d710 0x7effa8070a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.715+0000 7effb06de700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effa8154110 con 0x7effa8153d30 2023-08-26T09:25:20.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.715+0000 7effb06de700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effa815dba0 con 0x7effa806d570 2023-08-26T09:25:20.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.715+0000 7effb06de700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effa80b4100 con 0x7effa815d710 2023-08-26T09:25:20.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.715+0000 7effaec7b700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7effa815d710 0x7effa8070a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.716+0000 7effaec7b700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7effa815d710 0x7effa8070a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.92:33512/0 (socket says 172.21.15.92:33512) 2023-08-26T09:25:20.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.716+0000 7effaec7b700 1 -- 172.21.15.92:0/297224108 learned_addr learned my addr 172.21.15.92:0/297224108 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:20.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.716+0000 7fc05487e700 1 -- 172.21.15.92:0/4272767850 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc05006cf50 msgr2=0x7fc05006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.716+0000 7fc05487e700 1 --2- 172.21.15.92:0/4272767850 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc05006cf50 0x7fc05006d330 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc048009e50 tx=0x7fc04800b330 comp rx=0 tx=0).stop 2023-08-26T09:25:20.753 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.716+0000 7fd7dc56c700 1 -- 172.21.15.92:0/773587120 wait complete. 2023-08-26T09:25:20.753 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.716+0000 7effaec7b700 1 -- 172.21.15.92:0/297224108 >> v2:172.21.15.92:3300/0 conn(0x7effa806d570 msgr2=0x7effa815d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:20.753 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.716+0000 7effaec7b700 1 --2- 172.21.15.92:0/297224108 >> v2:172.21.15.92:3300/0 conn(0x7effa806d570 0x7effa815d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.754 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.716+0000 7effaec7b700 1 -- 172.21.15.92:0/297224108 >> v1:172.21.15.188:6789/0 conn(0x7effa8153d30 legacy=0x7effa80b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.754 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.716+0000 7effaec7b700 1 -- 172.21.15.92:0/297224108 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa80b34f0 con 0x7effa815d710 2023-08-26T09:25:20.754 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.716+0000 7effaec7b700 1 --2- 172.21.15.92:0/297224108 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7effa815d710 0x7effa8070a20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7effa80b2320 tx=0x7effa000c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7aa09ddfa3733f0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.754 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.716+0000 7fc05487e700 1 -- 172.21.15.92:0/4272767850 shutdown_connections 2023-08-26T09:25:20.755 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.716+0000 7fc05487e700 1 --2- 172.21.15.92:0/4272767850 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc05006cf50 0x7fc05006d330 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.755 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.716+0000 7fc05487e700 1 --2- 172.21.15.92:0/4272767850 >> v2:172.21.15.92:3300/0 conn(0x7fc0500d08f0 0x7fc0500cf2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.755 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.716+0000 7fc05487e700 1 -- 172.21.15.92:0/4272767850 >> 172.21.15.92:0/4272767850 conn(0x7fc0500cfd40 msgr2=0x7fc0500d0150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:20.755 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.717+0000 7f5d5f51e700 1 Processor -- start 2023-08-26T09:25:20.756 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.717+0000 7f5d5f51e700 1 -- start start 2023-08-26T09:25:20.756 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.717+0000 7effad478700 1 -- 172.21.15.92:0/297224108 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa0009e60 con 0x7effa815d710 2023-08-26T09:25:20.757 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.717+0000 7f4a27516700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4a2006cd10 0x7f4a20141ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.757 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.717+0000 7f4a27516700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a200cd460 0x7f4a2013bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.757 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.717+0000 7f4a27516700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4a200cdd80 0x7f4a2013aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.757 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.717+0000 7f4a27516700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2013c500 con 0x7f4a2006cd10 2023-08-26T09:25:20.758 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.717+0000 7f4a27516700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a201421b0 con 0x7f4a200cdd80 2023-08-26T09:25:20.758 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.717+0000 7f4a27516700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a20142490 con 0x7f4a200cd460 2023-08-26T09:25:20.758 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.717+0000 7f4a24ab1700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a200cd460 0x7f4a2013bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.758 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.717+0000 7f4a24ab1700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a200cd460 0x7f4a2013bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.92:43372/0 (socket says 172.21.15.92:43372) 2023-08-26T09:25:20.758 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.717+0000 7f4a24ab1700 1 -- 172.21.15.92:0/395320753 learned_addr learned my addr 172.21.15.92:0/395320753 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:20.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.717+0000 7f4a25ab3700 1 --2- 172.21.15.92:0/395320753 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4a200cdd80 0x7f4a2013aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.717+0000 7f3da403c700 1 -- 172.21.15.92:0/3901983893 shutdown_connections 2023-08-26T09:25:20.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.717+0000 7f3da403c700 1 --2- 172.21.15.92:0/3901983893 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3d9c06fe20 0x7f3d9c0702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.717+0000 7f3da403c700 1 --2- 172.21.15.92:0/3901983893 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3d9c15cd20 0x7f3d9c15d1b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.760 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.717+0000 7f3da403c700 1 -- 172.21.15.92:0/3901983893 >> 172.21.15.92:0/3901983893 conn(0x7f3d9c0b0880 msgr2=0x7f3d9c0b0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:20.760 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.717+0000 7effad478700 1 -- 172.21.15.92:0/297224108 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa000cad0 con 0x7effa815d710 2023-08-26T09:25:20.760 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.717+0000 7effad478700 1 -- 172.21.15.92:0/297224108 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa000ce80 con 0x7effa815d710 2023-08-26T09:25:20.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.718+0000 7fd7dc56c700 1 Processor -- start 2023-08-26T09:25:20.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.718+0000 7f3da403c700 1 -- 172.21.15.92:0/3901983893 shutdown_connections 2023-08-26T09:25:20.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.718+0000 7f4a24ab1700 1 -- 172.21.15.92:0/395320753 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4a200cdd80 msgr2=0x7f4a2013aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.762 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.718+0000 7f4a24ab1700 1 --2- 172.21.15.92:0/395320753 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4a200cdd80 0x7f4a2013aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.762 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.718+0000 7f4a24ab1700 1 -- 172.21.15.92:0/395320753 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4a2006cd10 msgr2=0x7f4a20141ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.762 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.718+0000 7f4a24ab1700 1 --2- 172.21.15.92:0/395320753 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4a2006cd10 0x7f4a20141ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.762 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.718+0000 7f4a24ab1700 1 -- 172.21.15.92:0/395320753 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a1c009550 con 0x7f4a200cd460 2023-08-26T09:25:20.763 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.718+0000 7effb06de700 1 -- 172.21.15.92:0/297224108 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7effa815d710 msgr2=0x7effa8070a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.763 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.718+0000 7effb06de700 1 --2- 172.21.15.92:0/297224108 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7effa815d710 0x7effa8070a20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7effa80b2320 tx=0x7effa000c440 comp rx=0 tx=0).stop 2023-08-26T09:25:20.764 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.718+0000 7f5d5f51e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d580b3720 0x7f5d5815bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.764 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.718+0000 7f5d5f51e700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5d5813f8c0 0x7f5d580ad640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.764 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.718+0000 7f5d5f51e700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5d5815d260 0x7f5d580adb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.764 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.718+0000 7f5d5f51e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d580a8880 con 0x7f5d580b3720 2023-08-26T09:25:20.764 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.718+0000 7f5d5f51e700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d580ce360 con 0x7f5d5815d260 2023-08-26T09:25:20.765 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.718+0000 7f5d5f51e700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d580ce640 con 0x7f5d5813f8c0 2023-08-26T09:25:20.765 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.718+0000 7fc05487e700 1 -- 172.21.15.92:0/4272767850 shutdown_connections 2023-08-26T09:25:20.766 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.718+0000 7f5d5d2ba700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d580b3720 0x7f5d5815bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.766 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.718+0000 7f5d5d2ba700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d580b3720 0x7f5d5815bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44712/0 (socket says 172.21.15.92:44712) 2023-08-26T09:25:20.766 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.718+0000 7f5d5d2ba700 1 -- 172.21.15.92:0/1529939422 learned_addr learned my addr 172.21.15.92:0/1529939422 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:20.766 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.718+0000 7f5d5dabb700 1 --2- 172.21.15.92:0/1529939422 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5d5815d260 0x7f5d580adb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.766 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.718+0000 7f5d5cab9700 1 --2- 172.21.15.92:0/1529939422 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5d5813f8c0 0x7f5d580ad640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.767 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.719+0000 7f5d5d2ba700 1 -- 172.21.15.92:0/1529939422 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5d5813f8c0 msgr2=0x7f5d580ad640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.767 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.719+0000 7f5d5d2ba700 1 --2- 172.21.15.92:0/1529939422 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5d5813f8c0 0x7f5d580ad640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.767 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.719+0000 7f5d5d2ba700 1 -- 172.21.15.92:0/1529939422 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5d5815d260 msgr2=0x7f5d580adb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.767 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.719+0000 7f5d5d2ba700 1 --2- 172.21.15.92:0/1529939422 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5d5815d260 0x7f5d580adb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.767 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.719+0000 7f5d5d2ba700 1 -- 172.21.15.92:0/1529939422 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d48009550 con 0x7f5d580b3720 2023-08-26T09:25:20.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.719+0000 7effb06de700 1 -- 172.21.15.92:0/297224108 shutdown_connections 2023-08-26T09:25:20.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.719+0000 7effb06de700 1 --2- 172.21.15.92:0/297224108 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7effa815d710 0x7effa8070a20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.719+0000 7effb06de700 1 --2- 172.21.15.92:0/297224108 >> v2:172.21.15.92:3300/0 conn(0x7effa806d570 0x7effa815d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.719+0000 7effb06de700 1 -- 172.21.15.92:0/297224108 >> 172.21.15.92:0/297224108 conn(0x7effa80b0880 msgr2=0x7effa80b0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:20.769 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.719+0000 7fc05487e700 1 -- 172.21.15.92:0/4272767850 wait complete. 2023-08-26T09:25:20.769 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.719+0000 7f5d5d2ba700 1 --2- 172.21.15.92:0/1529939422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d580b3720 0x7f5d5815bee0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5d5400da30 tx=0x7f5d5400ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.769 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.719+0000 7effb06de700 1 -- 172.21.15.92:0/297224108 shutdown_connections 2023-08-26T09:25:20.770 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.718+0000 7fd7dc56c700 1 -- start start 2023-08-26T09:25:20.770 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.719+0000 7fd7dc56c700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd7d4071de0 0x7fd7d4150530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.770 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.719+0000 7fd7dc56c700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd7d40b1e10 0x7fd7d415c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.770 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.719+0000 7fd7dc56c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7d40b2690 0x7fd7d40cca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.771 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.719+0000 7fd7dc56c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d414e210 con 0x7fd7d40b2690 2023-08-26T09:25:20.771 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.719+0000 7fd7dc56c700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d41597b0 con 0x7fd7d40b1e10 2023-08-26T09:25:20.771 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.719+0000 7fd7dc56c700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d4159a90 con 0x7fd7d4071de0 2023-08-26T09:25:20.771 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.719+0000 7fd7d9b07700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd7d40b1e10 0x7fd7d415c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.771 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.719+0000 7fd7da308700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd7d4071de0 0x7fd7d4150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.772 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.719+0000 7fd7dab09700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7d40b2690 0x7fd7d40cca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.772 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.719+0000 7fd7dab09700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7d40b2690 0x7fd7d40cca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44722/0 (socket says 172.21.15.92:44722) 2023-08-26T09:25:20.772 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.719+0000 7fd7dab09700 1 -- 172.21.15.92:0/3692486473 learned_addr learned my addr 172.21.15.92:0/3692486473 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:20.772 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.720+0000 7fd7da308700 1 -- 172.21.15.92:0/3692486473 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd7d40b1e10 msgr2=0x7fd7d415c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.772 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.720+0000 7fd7da308700 1 --2- 172.21.15.92:0/3692486473 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd7d40b1e10 0x7fd7d415c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.773 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.720+0000 7fd7da308700 1 -- 172.21.15.92:0/3692486473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7d40b2690 msgr2=0x7fd7d40cca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.773 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.720+0000 7fd7da308700 1 --2- 172.21.15.92:0/3692486473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7d40b2690 0x7fd7d40cca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.773 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.720+0000 7fd7da308700 1 -- 172.21.15.92:0/3692486473 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7cc009a70 con 0x7fd7d4071de0 2023-08-26T09:25:20.773 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.718+0000 7f3da403c700 1 -- 172.21.15.92:0/3901983893 wait complete. 2023-08-26T09:25:20.773 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.720+0000 7f3da403c700 1 Processor -- start 2023-08-26T09:25:20.774 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.720+0000 7f3da403c700 1 -- start start 2023-08-26T09:25:20.774 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.721+0000 7f3da403c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d9c06fe20 0x7f3d9c13c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.774 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.721+0000 7f3da403c700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3d9c13f8c0 0x7f3d9c1f4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.774 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.721+0000 7f3da403c700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3d9c15cd20 0x7f3d9c13a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.774 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.721+0000 7f3da403c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9c1f4b80 con 0x7f3d9c06fe20 2023-08-26T09:25:20.775 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.721+0000 7f3da403c700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9c13cd10 con 0x7f3d9c15cd20 2023-08-26T09:25:20.775 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.721+0000 7f3da403c700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9c1f5690 con 0x7f3d9c13f8c0 2023-08-26T09:25:20.775 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.719+0000 7f4a24ab1700 1 --2- 172.21.15.92:0/395320753 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a200cd460 0x7f4a2013bfc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800ce70 tx=0x7f4a1800a570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.776 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.719+0000 7f5d4dffb700 1 -- 172.21.15.92:0/1529939422 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5400f040 con 0x7f5d580b3720 2023-08-26T09:25:20.776 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.719+0000 7f5d4dffb700 1 -- 172.21.15.92:0/1529939422 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d5400b940 con 0x7f5d580b3720 2023-08-26T09:25:20.776 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.719+0000 7f5d4dffb700 1 -- 172.21.15.92:0/1529939422 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5400a1c0 con 0x7f5d580b3720 2023-08-26T09:25:20.776 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.719+0000 7f5d5f51e700 1 -- 172.21.15.92:0/1529939422 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d580ce920 con 0x7f5d580b3720 2023-08-26T09:25:20.776 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.719+0000 7f5d5f51e700 1 -- 172.21.15.92:0/1529939422 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d580ceee0 con 0x7f5d580b3720 2023-08-26T09:25:20.777 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.719+0000 7effb06de700 1 -- 172.21.15.92:0/297224108 wait complete. 2023-08-26T09:25:20.777 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.721+0000 7effb06de700 1 Processor -- start 2023-08-26T09:25:20.777 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.721+0000 7fc05487e700 1 Processor -- start 2023-08-26T09:25:20.777 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.721+0000 7fc05487e700 1 -- start start 2023-08-26T09:25:20.778 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.721+0000 7f3da1dd8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d9c06fe20 0x7f3d9c13c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.778 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.721+0000 7f3da1dd8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d9c06fe20 0x7f3d9c13c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44724/0 (socket says 172.21.15.92:44724) 2023-08-26T09:25:20.778 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.721+0000 7f3da1dd8700 1 -- 172.21.15.92:0/2344237278 learned_addr learned my addr 172.21.15.92:0/2344237278 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:20.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.720+0000 7f4a15ffb700 1 -- 172.21.15.92:0/395320753 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a18003a20 con 0x7f4a200cd460 2023-08-26T09:25:20.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.720+0000 7f4a15ffb700 1 -- 172.21.15.92:0/395320753 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a18003b80 con 0x7f4a200cd460 2023-08-26T09:25:20.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.720+0000 7f4a15ffb700 1 -- 172.21.15.92:0/395320753 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a18004020 con 0x7f4a200cd460 2023-08-26T09:25:20.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.720+0000 7f4a27516700 1 -- 172.21.15.92:0/395320753 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a20142770 con 0x7f4a200cd460 2023-08-26T09:25:20.780 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.720+0000 7f4a27516700 1 -- 172.21.15.92:0/395320753 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a20142d30 con 0x7f4a200cd460 2023-08-26T09:25:20.780 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.722+0000 7f3da1dd8700 1 -- 172.21.15.92:0/2344237278 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3d9c13f8c0 msgr2=0x7f3d9c1f4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.780 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.722+0000 7f3da1dd8700 1 --2- 172.21.15.92:0/2344237278 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3d9c13f8c0 0x7f3d9c1f4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.780 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.722+0000 7f3da1dd8700 1 -- 172.21.15.92:0/2344237278 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3d9c15cd20 msgr2=0x7f3d9c13a3e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-26T09:25:20.781 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.722+0000 7f3da1dd8700 1 --2- 172.21.15.92:0/2344237278 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3d9c15cd20 0x7f3d9c13a3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.781 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.722+0000 7f3da1dd8700 1 -- 172.21.15.92:0/2344237278 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d98008520 con 0x7f3d9c06fe20 2023-08-26T09:25:20.781 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.722+0000 7fc05487e700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc05006cf50 0x7fc050158ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.781 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.722+0000 7fc05487e700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc0500cf820 0x7fc0500b2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.722+0000 7fc05487e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0500d08f0 0x7fc0501584f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.722+0000 7fc05487e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0500b4330 con 0x7fc0500d08f0 2023-08-26T09:25:20.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.722+0000 7fc05487e700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0501595a0 con 0x7fc05006cf50 2023-08-26T09:25:20.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.722+0000 7fc05487e700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0500b36b0 con 0x7fc0500cf820 2023-08-26T09:25:20.783 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.722+0000 7f3da1dd8700 1 --2- 172.21.15.92:0/2344237278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d9c06fe20 0x7f3d9c13c730 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c00c700 tx=0x7f3d8c00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.783 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.722+0000 7f4a27516700 1 -- 172.21.15.92:0/395320753 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a000052f0 con 0x7f4a200cd460 2023-08-26T09:25:20.783 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.722+0000 7fc04dd9b700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc0500cf820 0x7fc0500b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.784 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.722+0000 7fc04dd9b700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc0500cf820 0x7fc0500b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.92:43396/0 (socket says 172.21.15.92:43396) 2023-08-26T09:25:20.784 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.722+0000 7fc04dd9b700 1 -- 172.21.15.92:0/4187017877 learned_addr learned my addr 172.21.15.92:0/4187017877 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:20.784 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.722+0000 7fc04ed9d700 1 --2- 172.21.15.92:0/4187017877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0500d08f0 0x7fc0501584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.784 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.722+0000 7f5d5f51e700 1 -- 172.21.15.92:0/1529939422 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d580cf0d0 con 0x7f5d580b3720 2023-08-26T09:25:20.785 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.723+0000 7fc04e59c700 1 --2- 172.21.15.92:0/4187017877 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc05006cf50 0x7fc050158ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.785 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.723+0000 7fc04ed9d700 1 -- 172.21.15.92:0/4187017877 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc0500cf820 msgr2=0x7fc0500b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.785 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.723+0000 7fc04ed9d700 1 --2- 172.21.15.92:0/4187017877 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc0500cf820 0x7fc0500b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.723+0000 7fc04ed9d700 1 -- 172.21.15.92:0/4187017877 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc05006cf50 msgr2=0x7fc050158ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.723+0000 7fc04ed9d700 1 --2- 172.21.15.92:0/4187017877 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc05006cf50 0x7fc050158ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.723+0000 7fc04ed9d700 1 -- 172.21.15.92:0/4187017877 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc048009b30 con 0x7fc0500d08f0 2023-08-26T09:25:20.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.721+0000 7effb06de700 1 -- start start 2023-08-26T09:25:20.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.722+0000 7effb06de700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7effa806d570 0x7effa8152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.722+0000 7effb06de700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effa8153d30 0x7effa81f3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.722+0000 7effb06de700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7effa815d710 0x7effa81f3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.722+0000 7effb06de700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa814f8e0 con 0x7effa8153d30 2023-08-26T09:25:20.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.722+0000 7effb06de700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa8150240 con 0x7effa815d710 2023-08-26T09:25:20.788 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.722+0000 7effb06de700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa81f4290 con 0x7effa806d570 2023-08-26T09:25:20.788 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.723+0000 7effae47a700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7effa806d570 0x7effa8152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.788 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.723+0000 7effae47a700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7effa806d570 0x7effa8152720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.92:43402/0 (socket says 172.21.15.92:43402) 2023-08-26T09:25:20.788 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.723+0000 7effae47a700 1 -- 172.21.15.92:0/2911642996 learned_addr learned my addr 172.21.15.92:0/2911642996 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:20.788 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.723+0000 7effaec7b700 1 --2- 172.21.15.92:0/2911642996 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7effa815d710 0x7effa81f3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.789 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.723+0000 7fc04ed9d700 1 --2- 172.21.15.92:0/4187017877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0500d08f0 0x7fc0501584f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc04400b3f0 tx=0x7fc04400b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.789 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.723+0000 7f5d4dffb700 1 -- 172.21.15.92:0/1529939422 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5d5400bcf0 con 0x7f5d580b3720 2023-08-26T09:25:20.790 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.723+0000 7effaec7b700 1 -- 172.21.15.92:0/2911642996 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7effa806d570 msgr2=0x7effa8152720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.790 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.723+0000 7effaec7b700 1 --2- 172.21.15.92:0/2911642996 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7effa806d570 0x7effa8152720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.790 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.723+0000 7effaec7b700 1 -- 172.21.15.92:0/2911642996 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effa8153d30 msgr2=0x7effa81f3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.790 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.723+0000 7effaec7b700 1 --2- 172.21.15.92:0/2911642996 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effa8153d30 0x7effa81f3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.790 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.723+0000 7effaec7b700 1 -- 172.21.15.92:0/2911642996 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa000d040 con 0x7effa815d710 2023-08-26T09:25:20.791 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.724+0000 7effaec7b700 1 --2- 172.21.15.92:0/2911642996 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7effa815d710 0x7effa81f3b80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7effa80b1ec0 tx=0x7effa0004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.791 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.724+0000 7f5d4dffb700 1 --2- 172.21.15.92:0/1529939422 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f5d3c06a1e0 0x7f5d3c06c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.791 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.724+0000 7f5d4dffb700 1 -- 172.21.15.92:0/1529939422 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5d54088000 con 0x7f5d580b3720 2023-08-26T09:25:20.792 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.724+0000 7eff9effd700 1 -- 172.21.15.92:0/2911642996 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa0004250 con 0x7effa815d710 2023-08-26T09:25:20.792 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.723+0000 7fc03effd700 1 -- 172.21.15.92:0/4187017877 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc044011830 con 0x7fc0500d08f0 2023-08-26T09:25:20.792 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.723+0000 7fc03effd700 1 -- 172.21.15.92:0/4187017877 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc044011990 con 0x7fc0500d08f0 2023-08-26T09:25:20.793 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.723+0000 7fc03effd700 1 -- 172.21.15.92:0/4187017877 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc044011d20 con 0x7fc0500d08f0 2023-08-26T09:25:20.793 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.723+0000 7fd7da308700 1 --2- 172.21.15.92:0/3692486473 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd7d4071de0 0x7fd7d4150530 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd7d000ed70 tx=0x7fd7d000d630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.793 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.724+0000 7f5d5cab9700 1 --2- 172.21.15.92:0/1529939422 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f5d3c06a1e0 0x7f5d3c06c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.794 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.725+0000 7f5d5cab9700 1 --2- 172.21.15.92:0/1529939422 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f5d3c06a1e0 0x7f5d3c06c6a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5d48009c10 tx=0x7f5d48008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.794 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.724+0000 7effb06de700 1 -- 172.21.15.92:0/2911642996 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effa81f4570 con 0x7effa815d710 2023-08-26T09:25:20.794 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.724+0000 7effb06de700 1 -- 172.21.15.92:0/2911642996 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effa8152c60 con 0x7effa815d710 2023-08-26T09:25:20.795 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.724+0000 7f3d927fc700 1 -- 172.21.15.92:0/2344237278 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c005d70 con 0x7f3d9c06fe20 2023-08-26T09:25:20.795 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.724+0000 7f3d927fc700 1 -- 172.21.15.92:0/2344237278 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d8c0070d0 con 0x7f3d9c06fe20 2023-08-26T09:25:20.795 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.724+0000 7f3d927fc700 1 -- 172.21.15.92:0/2344237278 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c007440 con 0x7f3d9c06fe20 2023-08-26T09:25:20.795 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.724+0000 7f3da403c700 1 -- 172.21.15.92:0/2344237278 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d9c1f5930 con 0x7f3d9c06fe20 2023-08-26T09:25:20.795 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.724+0000 7f3da403c700 1 -- 172.21.15.92:0/2344237278 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d9c200530 con 0x7f3d9c06fe20 2023-08-26T09:25:20.796 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.726+0000 7f3da403c700 1 -- 172.21.15.92:0/2344237278 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d840052f0 con 0x7f3d9c06fe20 2023-08-26T09:25:20.796 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.725+0000 7f4a15ffb700 1 -- 172.21.15.92:0/395320753 <== mon.2 v2:172.21.15.188:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4a18004180 con 0x7f4a200cd460 2023-08-26T09:25:20.796 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.725+0000 7f4a15ffb700 1 --2- 172.21.15.92:0/395320753 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f4a0406a1b0 0x7f4a0406c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.796 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.725+0000 7f4a15ffb700 1 -- 172.21.15.92:0/395320753 <== mon.2 v2:172.21.15.188:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4a18012070 con 0x7f4a200cd460 2023-08-26T09:25:20.797 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.726+0000 7f4a252b2700 1 --2- 172.21.15.92:0/395320753 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f4a0406a1b0 0x7f4a0406c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.797 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.725+0000 7eff9effd700 1 -- 172.21.15.92:0/2911642996 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa00043b0 con 0x7effa815d710 2023-08-26T09:25:20.797 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.725+0000 7eff9effd700 1 -- 172.21.15.92:0/2911642996 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa0004740 con 0x7effa815d710 2023-08-26T09:25:20.797 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.726+0000 7fc05487e700 1 -- 172.21.15.92:0/4187017877 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0500b3990 con 0x7fc0500d08f0 2023-08-26T09:25:20.798 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.726+0000 7fc05487e700 1 -- 172.21.15.92:0/4187017877 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0500b3f50 con 0x7fc0500d08f0 2023-08-26T09:25:20.798 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.726+0000 7effb06de700 1 -- 172.21.15.92:0/2911642996 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff900052f0 con 0x7effa815d710 2023-08-26T09:25:20.798 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.726+0000 7f4a252b2700 1 --2- 172.21.15.92:0/395320753 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f4a0406a1b0 0x7f4a0406c670 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4a200cb340 tx=0x7f4a1c010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.799 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.727+0000 7eff9effd700 1 -- 172.21.15.92:0/2911642996 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7effa0020070 con 0x7effa815d710 2023-08-26T09:25:20.799 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.727+0000 7fc05487e700 1 -- 172.21.15.92:0/4187017877 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0500b4470 con 0x7fc0500d08f0 2023-08-26T09:25:20.800 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.727+0000 7eff9effd700 1 --2- 172.21.15.92:0/2911642996 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7eff8c06a0e0 0x7eff8c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.800 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.728+0000 7effae47a700 1 --2- 172.21.15.92:0/2911642996 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7eff8c06a0e0 0x7eff8c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.800 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.728+0000 7eff9effd700 1 -- 172.21.15.92:0/2911642996 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7effa0089a40 con 0x7effa815d710 2023-08-26T09:25:20.800 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.728+0000 7effae47a700 1 --2- 172.21.15.92:0/2911642996 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7eff8c06a0e0 0x7eff8c06c5a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7effa40018d0 tx=0x7effa4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.801 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.728+0000 7fd7c6ffd700 1 -- 172.21.15.92:0/3692486473 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d000dd90 con 0x7fd7d4071de0 2023-08-26T09:25:20.801 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.728+0000 7fd7c6ffd700 1 -- 172.21.15.92:0/3692486473 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d0010440 con 0x7fd7d4071de0 2023-08-26T09:25:20.802 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.728+0000 7fd7dc56c700 1 -- 172.21.15.92:0/3692486473 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7d4159d70 con 0x7fd7d4071de0 2023-08-26T09:25:20.802 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.728+0000 7fd7c6ffd700 1 -- 172.21.15.92:0/3692486473 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d00107d0 con 0x7fd7d4071de0 2023-08-26T09:25:20.802 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.728+0000 7fd7dc56c700 1 -- 172.21.15.92:0/3692486473 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7d414de30 con 0x7fd7d4071de0 2023-08-26T09:25:20.802 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.729+0000 7f320c760700 1 Processor -- start 2023-08-26T09:25:20.803 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.729+0000 7f320c760700 1 -- start start 2023-08-26T09:25:20.803 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.729+0000 7fd7dc56c700 1 -- 172.21.15.92:0/3692486473 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7d4159fb0 con 0x7fd7d4071de0 2023-08-26T09:25:20.803 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.730+0000 7f4a15ffb700 1 -- 172.21.15.92:0/395320753 <== mon.2 v2:172.21.15.188:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4a18054920 con 0x7f4a200cd460 2023-08-26T09:25:20.804 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.730+0000 7f320c760700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f320415b120 0x7f32040724b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.804 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.730+0000 7f320c760700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f32040cc540 0x7f32040cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.805 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.730+0000 7f320c760700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32040b1e30 con 0x7f3204066020 2023-08-26T09:25:20.805 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.730+0000 7f320c760700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3204066480 con 0x7f32040cc540 2023-08-26T09:25:20.805 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.730+0000 7f320c760700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32040b1070 con 0x7f320415b120 2023-08-26T09:25:20.805 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.730+0000 7f320a4fc700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f320415b120 0x7f32040724b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.805 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.730+0000 7f320a4fc700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f320415b120 0x7f32040724b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.92:43412/0 (socket says 172.21.15.92:43412) 2023-08-26T09:25:20.806 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.730+0000 7f320a4fc700 1 -- 172.21.15.92:0/324677028 learned_addr learned my addr 172.21.15.92:0/324677028 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:20.806 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.730+0000 7fd7c6ffd700 1 -- 172.21.15.92:0/3692486473 <== mon.2 v2:172.21.15.188:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd7d0010930 con 0x7fd7d4071de0 2023-08-26T09:25:20.807 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.731+0000 7f320a4fc700 1 -- 172.21.15.92:0/324677028 >> v2:172.21.15.92:3300/0 conn(0x7f32040cc540 msgr2=0x7f32040cd7a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-26T09:25:20.807 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.731+0000 7f320a4fc700 1 --2- 172.21.15.92:0/324677028 >> v2:172.21.15.92:3300/0 conn(0x7f32040cc540 0x7f32040cd7a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.807 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.731+0000 7f320a4fc700 1 -- 172.21.15.92:0/324677028 >> v1:172.21.15.92:6789/0 conn(0x7f3204066020 legacy=0x7f32040cbe30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-26T09:25:20.807 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.731+0000 7f320a4fc700 1 -- 172.21.15.92:0/324677028 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32040b1350 con 0x7f320415b120 2023-08-26T09:25:20.808 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.731+0000 7fd7c6ffd700 1 --2- 172.21.15.92:0/3692486473 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fd7b806a0e0 0x7fd7b806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.808 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.731+0000 7fd7c6ffd700 1 -- 172.21.15.92:0/3692486473 <== mon.2 v2:172.21.15.188:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd7d0088ae0 con 0x7fd7d4071de0 2023-08-26T09:25:20.808 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.731+0000 7fd7d9b07700 1 --2- 172.21.15.92:0/3692486473 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fd7b806a0e0 0x7fd7b806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.809 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.731+0000 7f320a4fc700 1 --2- 172.21.15.92:0/324677028 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f320415b120 0x7f32040724b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f31f4006fd0 tx=0x7f31f4009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8d455e37557ff39 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.809 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.731+0000 7fd7d9b07700 1 --2- 172.21.15.92:0/3692486473 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fd7b806a0e0 0x7fd7b806c5a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd7d40cd650 tx=0x7fd7c8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.809 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.731+0000 7f5d4dffb700 1 -- 172.21.15.92:0/1529939422 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5d540ba990 con 0x7f5d580b3720 2023-08-26T09:25:20.810 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.732+0000 7f3d927fc700 1 -- 172.21.15.92:0/2344237278 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3d8c0075a0 con 0x7f3d9c06fe20 2023-08-26T09:25:20.810 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.733+0000 7f3d927fc700 1 --2- 172.21.15.92:0/2344237278 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f3d8806a5b0 0x7f3d8806ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.810 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.733+0000 7f3d927fc700 1 -- 172.21.15.92:0/2344237278 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3d8c087de0 con 0x7f3d9c06fe20 2023-08-26T09:25:20.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.733+0000 7f3da15d7700 1 --2- 172.21.15.92:0/2344237278 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f3d8806a5b0 0x7f3d8806ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.733+0000 7eff9effd700 1 -- 172.21.15.92:0/2911642996 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7effa008be60 con 0x7effa815d710 2023-08-26T09:25:20.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.734+0000 7f3da15d7700 1 --2- 172.21.15.92:0/2344237278 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f3d8806a5b0 0x7f3d8806ca70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c0719a0 tx=0x7f3d98014000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.735+0000 7f32094fa700 1 -- 172.21.15.92:0/324677028 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f4005e30 con 0x7f320415b120 2023-08-26T09:25:20.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.735+0000 7f32094fa700 1 -- 172.21.15.92:0/324677028 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f4006030 con 0x7f320415b120 2023-08-26T09:25:20.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.735+0000 7f32094fa700 1 -- 172.21.15.92:0/324677028 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f40063e0 con 0x7f320415b120 2023-08-26T09:25:20.813 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.738+0000 7fd7c6ffd700 1 -- 172.21.15.92:0/3692486473 <== mon.2 v2:172.21.15.188:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd7d4159fb0 con 0x7fd7d4071de0 2023-08-26T09:25:20.813 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.741+0000 7fc03effd700 1 -- 172.21.15.92:0/4187017877 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc04401a400 con 0x7fc0500d08f0 2023-08-26T09:25:20.813 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.742+0000 7fc03effd700 1 --2- 172.21.15.92:0/4187017877 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fc03006a130 0x7fc03006c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.814 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.742+0000 7fc03effd700 1 -- 172.21.15.92:0/4187017877 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc0440888d0 con 0x7fc0500d08f0 2023-08-26T09:25:20.814 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.746+0000 7f320c760700 1 -- 172.21.15.92:0/324677028 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f320415b120 msgr2=0x7f32040724b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.814 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.746+0000 7f320c760700 1 --2- 172.21.15.92:0/324677028 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f320415b120 0x7f32040724b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f31f4006fd0 tx=0x7f31f4009bd0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.814 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.747+0000 7fc04e59c700 1 --2- 172.21.15.92:0/4187017877 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fc03006a130 0x7fc03006c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.815 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.747+0000 7f320c760700 1 -- 172.21.15.92:0/324677028 shutdown_connections 2023-08-26T09:25:20.815 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.747+0000 7f320c760700 1 --2- 172.21.15.92:0/324677028 >> v2:172.21.15.92:3300/0 conn(0x7f32040cc540 0x7f32040cd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.815 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.747+0000 7f320c760700 1 --2- 172.21.15.92:0/324677028 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f320415b120 0x7f32040724b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.816 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.747+0000 7f320c760700 1 -- 172.21.15.92:0/324677028 >> 172.21.15.92:0/324677028 conn(0x7f32040b23c0 msgr2=0x7f32040b27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:20.816 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.747+0000 7fc04e59c700 1 --2- 172.21.15.92:0/4187017877 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fc03006a130 0x7fc03006c5f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc0501fa8a0 tx=0x7fc048009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.816 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.750+0000 7f320c760700 1 -- 172.21.15.92:0/324677028 shutdown_connections 2023-08-26T09:25:20.817 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.751+0000 7f3d927fc700 1 -- 172.21.15.92:0/2344237278 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3d8c0536f0 con 0x7f3d9c06fe20 2023-08-26T09:25:20.817 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.751+0000 7f320c760700 1 -- 172.21.15.92:0/324677028 wait complete. 2023-08-26T09:25:20.817 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.751+0000 7fc03effd700 1 -- 172.21.15.92:0/4187017877 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc0440540e0 con 0x7fc0500d08f0 2023-08-26T09:25:20.819 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.753+0000 7f320c760700 1 Processor -- start 2023-08-26T09:25:20.819 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.753+0000 7f320c760700 1 -- start start 2023-08-26T09:25:20.819 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.754+0000 7f320c760700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3204066020 0x7f32041f6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.754+0000 7f320c760700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f32040cc540 0x7f320415d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.754+0000 7f320c760700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f320415b120 0x7f320415daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.754+0000 7f320c760700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f320415e030 con 0x7f3204066020 2023-08-26T09:25:20.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.754+0000 7f320c760700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3204159920 con 0x7f320415b120 2023-08-26T09:25:20.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.754+0000 7f320c760700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32041f7020 con 0x7f32040cc540 2023-08-26T09:25:20.821 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.754+0000 7f320a4fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3204066020 0x7f32041f6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.821 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.754+0000 7f320a4fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3204066020 0x7f32041f6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44756/0 (socket says 172.21.15.92:44756) 2023-08-26T09:25:20.821 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.754+0000 7f320a4fc700 1 -- 172.21.15.92:0/3951488424 learned_addr learned my addr 172.21.15.92:0/3951488424 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:20.821 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.755+0000 7f320a4fc700 1 -- 172.21.15.92:0/3951488424 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f32040cc540 msgr2=0x7f320415d5b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-26T09:25:20.821 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.755+0000 7f320a4fc700 1 --2- 172.21.15.92:0/3951488424 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f32040cc540 0x7f320415d5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.822 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.755+0000 7f320a4fc700 1 -- 172.21.15.92:0/3951488424 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f320415b120 msgr2=0x7f320415daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:20.822 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.755+0000 7f320a4fc700 1 --2- 172.21.15.92:0/3951488424 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f320415b120 0x7f320415daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:20.822 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.755+0000 7f320a4fc700 1 -- 172.21.15.92:0/3951488424 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f4009500 con 0x7f3204066020 2023-08-26T09:25:20.822 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.755+0000 7f320a4fc700 1 --2- 172.21.15.92:0/3951488424 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3204066020 0x7f32041f6ae0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f31f4009c10 tx=0x7f31f4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:20.822 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.755+0000 7f31faffd700 1 -- 172.21.15.92:0/3951488424 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f4025430 con 0x7f3204066020 2023-08-26T09:25:20.822 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.756+0000 7f31faffd700 1 -- 172.21.15.92:0/3951488424 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f4020070 con 0x7f3204066020 2023-08-26T09:25:20.823 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.756+0000 7f31faffd700 1 -- 172.21.15.92:0/3951488424 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f40257d0 con 0x7f3204066020 2023-08-26T09:25:20.823 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.756+0000 7f320c760700 1 -- 172.21.15.92:0/3951488424 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32040c6b50 con 0x7f3204066020 2023-08-26T09:25:20.823 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.756+0000 7f320c760700 1 -- 172.21.15.92:0/3951488424 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32040c7110 con 0x7f3204066020 2023-08-26T09:25:20.823 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.758+0000 7f31faffd700 1 -- 172.21.15.92:0/3951488424 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f31f4022030 con 0x7f3204066020 2023-08-26T09:25:20.823 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.758+0000 7f31faffd700 1 --2- 172.21.15.92:0/3951488424 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f31f006a290 0x7f31f006c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:20.824 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.759+0000 7f31faffd700 1 -- 172.21.15.92:0/3951488424 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f31f4089490 con 0x7f3204066020 2023-08-26T09:25:20.824 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.759+0000 7f3209cfb700 1 --2- 172.21.15.92:0/3951488424 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f31f006a290 0x7f31f006c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:20.824 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.759+0000 7f320c760700 1 -- 172.21.15.92:0/3951488424 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31ec0052f0 con 0x7f3204066020 2023-08-26T09:25:20.824 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.769+0000 7f31faffd700 1 -- 172.21.15.92:0/3951488424 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f31f408e060 con 0x7f3204066020 2023-08-26T09:25:20.824 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:20.769+0000 7f3209cfb700 1 --2- 172.21.15.92:0/3951488424 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f31f006a290 0x7f31f006c750 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3200006fd0 tx=0x7f3200006bc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:21.112 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.106+0000 7fcf02e94700 1 -- 172.21.15.92:0/1844644893 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fcefc04e660 con 0x7fcefc0b23b0 2023-08-26T09:25:21.123 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.118+0000 7fcef97fa700 1 -- 172.21.15.92:0/1844644893 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcef002a090 con 0x7fcefc0b23b0 2023-08-26T09:25:21.125 INFO:teuthology.orchestra.run.smithi092.stdout:55834574853 2023-08-26T09:25:21.125 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.119+0000 7f4a27516700 1 -- 172.21.15.92:0/395320753 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f4a00005870 con 0x7f4a200cd460 2023-08-26T09:25:21.126 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.121+0000 7f4a15ffb700 1 -- 172.21.15.92:0/395320753 <== mon.2 v2:172.21.15.188:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4a18057f40 con 0x7f4a200cd460 2023-08-26T09:25:21.127 INFO:teuthology.orchestra.run.smithi092.stdout:55834574853 2023-08-26T09:25:21.127 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.123+0000 7fcf02e94700 1 -- 172.21.15.92:0/1844644893 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fcee006a0e0 msgr2=0x7fcee006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:21.128 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.123+0000 7fcf02e94700 1 --2- 172.21.15.92:0/1844644893 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fcee006a0e0 0x7fcee006c5a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcefc1445d0 tx=0x7fcee8009190 comp rx=0 tx=0).stop 2023-08-26T09:25:21.128 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.123+0000 7fcf02e94700 1 -- 172.21.15.92:0/1844644893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcefc0b23b0 msgr2=0x7fcefc202d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:21.128 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.123+0000 7fcf02e94700 1 --2- 172.21.15.92:0/1844644893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcefc0b23b0 0x7fcefc202d50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcef0009840 tx=0x7fcef0004750 comp rx=0 tx=0).stop 2023-08-26T09:25:21.129 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.123+0000 7fcf02e94700 1 -- 172.21.15.92:0/1844644893 shutdown_connections 2023-08-26T09:25:21.129 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.123+0000 7fcf02e94700 1 --2- 172.21.15.92:0/1844644893 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcefc0cf310 0x7fcefc15a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:21.129 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.123+0000 7fcf02e94700 1 --2- 172.21.15.92:0/1844644893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcefc0b23b0 0x7fcefc202d50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:21.130 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.123+0000 7fcf02e94700 1 --2- 172.21.15.92:0/1844644893 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fcee006a0e0 0x7fcee006c5a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:21.130 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.123+0000 7fcf02e94700 1 --2- 172.21.15.92:0/1844644893 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcefc0ce3e0 0x7fcefc0a84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:21.130 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.123+0000 7fcf02e94700 1 -- 172.21.15.92:0/1844644893 >> 172.21.15.92:0/1844644893 conn(0x7fcefc06a320 msgr2=0x7fcefc163e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:21.130 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.124+0000 7fcf02e94700 1 -- 172.21.15.92:0/1844644893 shutdown_connections 2023-08-26T09:25:21.130 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.124+0000 7fcf02e94700 1 -- 172.21.15.92:0/1844644893 wait complete. 2023-08-26T09:25:21.131 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.124+0000 7f5d5f51e700 1 -- 172.21.15.92:0/1529939422 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5d5804e660 con 0x7f5d580b3720 2023-08-26T09:25:21.131 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.125+0000 7f5d4dffb700 1 -- 172.21.15.92:0/1529939422 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5d5401c070 con 0x7f5d580b3720 2023-08-26T09:25:21.133 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.126+0000 7f4a27516700 1 -- 172.21.15.92:0/395320753 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f4a0406a1b0 msgr2=0x7f4a0406c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:21.134 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.126+0000 7f4a27516700 1 --2- 172.21.15.92:0/395320753 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f4a0406a1b0 0x7f4a0406c670 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4a200cb340 tx=0x7f4a1c010000 comp rx=0 tx=0).stop 2023-08-26T09:25:21.134 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.126+0000 7f4a27516700 1 -- 172.21.15.92:0/395320753 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a200cd460 msgr2=0x7f4a2013bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:21.134 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.126+0000 7f4a27516700 1 --2- 172.21.15.92:0/395320753 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a200cd460 0x7f4a2013bfc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800ce70 tx=0x7f4a1800a570 comp rx=0 tx=0).stop 2023-08-26T09:25:21.134 INFO:teuthology.orchestra.run.smithi092.stdout:55834574854 2023-08-26T09:25:21.135 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.130+0000 7f5d5f51e700 1 -- 172.21.15.92:0/1529939422 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f5d3c06a1e0 msgr2=0x7f5d3c06c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:21.135 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.130+0000 7f5d5f51e700 1 --2- 172.21.15.92:0/1529939422 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f5d3c06a1e0 0x7f5d3c06c6a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5d48009c10 tx=0x7f5d48008030 comp rx=0 tx=0).stop 2023-08-26T09:25:21.135 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.130+0000 7f5d5f51e700 1 -- 172.21.15.92:0/1529939422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d580b3720 msgr2=0x7f5d5815bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:21.136 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.130+0000 7f5d5f51e700 1 --2- 172.21.15.92:0/1529939422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d580b3720 0x7f5d5815bee0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5d5400da30 tx=0x7f5d5400ddf0 comp rx=0 tx=0).stop 2023-08-26T09:25:21.136 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.132+0000 7f5d5f51e700 1 -- 172.21.15.92:0/1529939422 shutdown_connections 2023-08-26T09:25:21.137 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.132+0000 7f5d5f51e700 1 --2- 172.21.15.92:0/1529939422 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f5d3c06a1e0 0x7f5d3c06c6a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:21.137 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.132+0000 7f5d5f51e700 1 --2- 172.21.15.92:0/1529939422 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5d5815d260 0x7f5d580adb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:21.137 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.132+0000 7f5d5f51e700 1 --2- 172.21.15.92:0/1529939422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d580b3720 0x7f5d5815bee0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:21.137 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.132+0000 7f5d5f51e700 1 --2- 172.21.15.92:0/1529939422 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5d5813f8c0 0x7f5d580ad640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:21.138 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.132+0000 7f5d5f51e700 1 -- 172.21.15.92:0/1529939422 >> 172.21.15.92:0/1529939422 conn(0x7f5d580b0880 msgr2=0x7f5d58156930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:21.139 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.134+0000 7f4a27516700 1 -- 172.21.15.92:0/395320753 shutdown_connections 2023-08-26T09:25:21.139 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.134+0000 7f4a27516700 1 --2- 172.21.15.92:0/395320753 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f4a0406a1b0 0x7f4a0406c670 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:21.139 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.134+0000 7f4a27516700 1 --2- 172.21.15.92:0/395320753 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4a200cdd80 0x7f4a2013aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:21.140 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.134+0000 7f4a27516700 1 --2- 172.21.15.92:0/395320753 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4a2006cd10 0x7f4a20141ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:21.140 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.134+0000 7f4a27516700 1 --2- 172.21.15.92:0/395320753 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a200cd460 0x7f4a2013bfc0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:21.140 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.134+0000 7f4a27516700 1 -- 172.21.15.92:0/395320753 >> 172.21.15.92:0/395320753 conn(0x7f4a200b0880 msgr2=0x7f4a2006dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:21.141 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.134+0000 7f5d5f51e700 1 -- 172.21.15.92:0/1529939422 shutdown_connections 2023-08-26T09:25:21.141 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.134+0000 7f5d5f51e700 1 -- 172.21.15.92:0/1529939422 wait complete. 2023-08-26T09:25:21.144 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.139+0000 7f4a27516700 1 -- 172.21.15.92:0/395320753 shutdown_connections 2023-08-26T09:25:21.144 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.139+0000 7f4a27516700 1 -- 172.21.15.92:0/395320753 wait complete. 2023-08-26T09:25:21.148 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2023-08-26T09:25:21.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.143+0000 7effb06de700 1 -- 172.21.15.92:0/2911642996 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7eff90005870 con 0x7effa815d710 2023-08-26T09:25:21.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.144+0000 7eff9effd700 1 -- 172.21.15.92:0/2911642996 <== mon.1 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7effa0055140 con 0x7effa815d710 2023-08-26T09:25:21.150 INFO:teuthology.orchestra.run.smithi092.stdout:55834574853 2023-08-26T09:25:21.151 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.145+0000 7fc05487e700 1 -- 172.21.15.92:0/4187017877 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc0500b4470 con 0x7fc0500d08f0 2023-08-26T09:25:21.151 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.146+0000 7fc03effd700 1 -- 172.21.15.92:0/4187017877 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc0500b4470 con 0x7fc0500d08f0 2023-08-26T09:25:21.151 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.146+0000 7fd7dc56c700 1 -- 172.21.15.92:0/3692486473 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fd7d4159bd0 con 0x7fd7d4071de0 2023-08-26T09:25:21.152 INFO:teuthology.orchestra.run.smithi092.stdout:55834574853 2023-08-26T09:25:21.152 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.146+0000 7fd7c6ffd700 1 -- 172.21.15.92:0/3692486473 <== mon.2 v2:172.21.15.188:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd7d4159bd0 con 0x7fd7d4071de0 2023-08-26T09:25:21.153 INFO:teuthology.orchestra.run.smithi092.stdout:55834574854 2023-08-26T09:25:21.153 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.147+0000 7effb06de700 1 -- 172.21.15.92:0/2911642996 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7eff8c06a0e0 msgr2=0x7eff8c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:21.153 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.147+0000 7effb06de700 1 --2- 172.21.15.92:0/2911642996 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7eff8c06a0e0 0x7eff8c06c5a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7effa40018d0 tx=0x7effa4009040 comp rx=0 tx=0).stop 2023-08-26T09:25:21.154 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.147+0000 7effb06de700 1 -- 172.21.15.92:0/2911642996 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7effa815d710 msgr2=0x7effa81f3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:21.154 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.147+0000 7effb06de700 1 --2- 172.21.15.92:0/2911642996 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7effa815d710 0x7effa81f3b80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7effa80b1ec0 tx=0x7effa0004b40 comp rx=0 tx=0).stop 2023-08-26T09:25:21.154 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.148+0000 7effb06de700 1 -- 172.21.15.92:0/2911642996 shutdown_connections 2023-08-26T09:25:21.154 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.148+0000 7effb06de700 1 --2- 172.21.15.92:0/2911642996 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7eff8c06a0e0 0x7eff8c06c5a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:21.154 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.148+0000 7effb06de700 1 --2- 172.21.15.92:0/2911642996 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7effa815d710 0x7effa81f3b80 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:21.155 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.148+0000 7effb06de700 1 --2- 172.21.15.92:0/2911642996 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7effa806d570 0x7effa8152720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:21.155 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.148+0000 7effb06de700 1 --2- 172.21.15.92:0/2911642996 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effa8153d30 0x7effa81f3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:21.155 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.148+0000 7effb06de700 1 -- 172.21.15.92:0/2911642996 >> 172.21.15.92:0/2911642996 conn(0x7effa80b0880 msgr2=0x7effa806fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:21.155 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.148+0000 7effb06de700 1 -- 172.21.15.92:0/2911642996 shutdown_connections 2023-08-26T09:25:21.155 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.148+0000 7effb06de700 1 -- 172.21.15.92:0/2911642996 wait complete. 2023-08-26T09:25:21.156 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.149+0000 7fc05487e700 1 -- 172.21.15.92:0/4187017877 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fc03006a130 msgr2=0x7fc03006c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:21.156 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.149+0000 7fc05487e700 1 --2- 172.21.15.92:0/4187017877 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fc03006a130 0x7fc03006c5f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc0501fa8a0 tx=0x7fc048009000 comp rx=0 tx=0).stop 2023-08-26T09:25:21.156 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.149+0000 7fc05487e700 1 -- 172.21.15.92:0/4187017877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0500d08f0 msgr2=0x7fc0501584f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:21.157 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.149+0000 7fc05487e700 1 --2- 172.21.15.92:0/4187017877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0500d08f0 0x7fc0501584f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc04400b3f0 tx=0x7fc04400b7b0 comp rx=0 tx=0).stop 2023-08-26T09:25:21.157 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.150+0000 7fd7dc56c700 1 -- 172.21.15.92:0/3692486473 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fd7b806a0e0 msgr2=0x7fd7b806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:21.158 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.150+0000 7fd7dc56c700 1 --2- 172.21.15.92:0/3692486473 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fd7b806a0e0 0x7fd7b806c5a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd7d40cd650 tx=0x7fd7c8009040 comp rx=0 tx=0).stop 2023-08-26T09:25:21.158 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.150+0000 7fd7dc56c700 1 -- 172.21.15.92:0/3692486473 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd7d4071de0 msgr2=0x7fd7d4150530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:21.158 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.150+0000 7fd7dc56c700 1 --2- 172.21.15.92:0/3692486473 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd7d4071de0 0x7fd7d4150530 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd7d000ed70 tx=0x7fd7d000d630 comp rx=0 tx=0).stop 2023-08-26T09:25:21.158 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.151+0000 7fd7dc56c700 1 -- 172.21.15.92:0/3692486473 shutdown_connections 2023-08-26T09:25:21.158 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.151+0000 7fd7dc56c700 1 --2- 172.21.15.92:0/3692486473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7d40b2690 0x7fd7d40cca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:21.159 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.151+0000 7fd7dc56c700 1 --2- 172.21.15.92:0/3692486473 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd7d4071de0 0x7fd7d4150530 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:21.159 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.151+0000 7fd7dc56c700 1 --2- 172.21.15.92:0/3692486473 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fd7b806a0e0 0x7fd7b806c5a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:21.159 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.151+0000 7fd7dc56c700 1 --2- 172.21.15.92:0/3692486473 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd7d40b1e10 0x7fd7d415c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:21.159 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.151+0000 7fd7dc56c700 1 -- 172.21.15.92:0/3692486473 >> 172.21.15.92:0/3692486473 conn(0x7fd7d406a320 msgr2=0x7fd7d406a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:21.159 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.151+0000 7fd7dc56c700 1 -- 172.21.15.92:0/3692486473 shutdown_connections 2023-08-26T09:25:21.160 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.151+0000 7fd7dc56c700 1 -- 172.21.15.92:0/3692486473 wait complete. 2023-08-26T09:25:21.161 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.3 2023-08-26T09:25:21.167 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.162+0000 7fc05487e700 1 -- 172.21.15.92:0/4187017877 shutdown_connections 2023-08-26T09:25:21.167 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.162+0000 7fc05487e700 1 --2- 172.21.15.92:0/4187017877 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fc03006a130 0x7fc03006c5f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:21.167 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.162+0000 7fc05487e700 1 --2- 172.21.15.92:0/4187017877 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc05006cf50 0x7fc050158ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:21.167 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.162+0000 7fc05487e700 1 --2- 172.21.15.92:0/4187017877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0500d08f0 0x7fc0501584f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:21.168 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.162+0000 7fc05487e700 1 --2- 172.21.15.92:0/4187017877 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc0500cf820 0x7fc0500b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:21.168 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.162+0000 7fc05487e700 1 -- 172.21.15.92:0/4187017877 >> 172.21.15.92:0/4187017877 conn(0x7fc0500cfd40 msgr2=0x7fc0500c70d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:21.168 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.162+0000 7fc05487e700 1 -- 172.21.15.92:0/4187017877 shutdown_connections 2023-08-26T09:25:21.168 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.162+0000 7fc05487e700 1 -- 172.21.15.92:0/4187017877 wait complete. 2023-08-26T09:25:21.169 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2023-08-26T09:25:21.170 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.164+0000 7f320c760700 1 -- 172.21.15.92:0/3951488424 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f31ec005870 con 0x7f3204066020 2023-08-26T09:25:21.170 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.164+0000 7f3da403c700 1 -- 172.21.15.92:0/2344237278 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3d84005870 con 0x7f3d9c06fe20 2023-08-26T09:25:21.170 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.164+0000 7f31faffd700 1 -- 172.21.15.92:0/3951488424 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f31f4054c00 con 0x7f3204066020 2023-08-26T09:25:21.171 INFO:teuthology.orchestra.run.smithi092.stdout:55834574855 2023-08-26T09:25:21.172 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2023-08-26T09:25:21.173 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.165+0000 7f3d927fc700 1 -- 172.21.15.92:0/2344237278 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3d8c017020 con 0x7f3d9c06fe20 2023-08-26T09:25:21.173 INFO:teuthology.orchestra.run.smithi092.stdout:55834574853 2023-08-26T09:25:21.174 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.7 2023-08-26T09:25:21.175 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.167+0000 7f320c760700 1 -- 172.21.15.92:0/3951488424 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f31f006a290 msgr2=0x7f31f006c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:21.175 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.167+0000 7f320c760700 1 --2- 172.21.15.92:0/3951488424 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f31f006a290 0x7f31f006c750 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3200006fd0 tx=0x7f3200006bc0 comp rx=0 tx=0).stop 2023-08-26T09:25:21.176 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.167+0000 7f320c760700 1 -- 172.21.15.92:0/3951488424 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3204066020 msgr2=0x7f32041f6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:21.176 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.167+0000 7f320c760700 1 --2- 172.21.15.92:0/3951488424 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3204066020 0x7f32041f6ae0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f31f4009c10 tx=0x7f31f4004750 comp rx=0 tx=0).stop 2023-08-26T09:25:21.176 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.167+0000 7f320c760700 1 -- 172.21.15.92:0/3951488424 shutdown_connections 2023-08-26T09:25:21.176 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.167+0000 7f320c760700 1 --2- 172.21.15.92:0/3951488424 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f31f006a290 0x7f31f006c750 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:21.177 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.167+0000 7f320c760700 1 --2- 172.21.15.92:0/3951488424 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f320415b120 0x7f320415daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:21.177 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.167+0000 7f320c760700 1 --2- 172.21.15.92:0/3951488424 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3204066020 0x7f32041f6ae0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:21.177 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.167+0000 7f320c760700 1 --2- 172.21.15.92:0/3951488424 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f32040cc540 0x7f320415d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:21.177 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.167+0000 7f320c760700 1 -- 172.21.15.92:0/3951488424 >> 172.21.15.92:0/3951488424 conn(0x7f32040b23c0 msgr2=0x7f32040c9a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:21.178 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.167+0000 7f3da403c700 1 -- 172.21.15.92:0/2344237278 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f3d8806a5b0 msgr2=0x7f3d8806ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:21.178 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.167+0000 7f3da403c700 1 --2- 172.21.15.92:0/2344237278 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f3d8806a5b0 0x7f3d8806ca70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c0719a0 tx=0x7f3d98014000 comp rx=0 tx=0).stop 2023-08-26T09:25:21.178 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.168+0000 7f3da403c700 1 -- 172.21.15.92:0/2344237278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d9c06fe20 msgr2=0x7f3d9c13c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:21.178 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.168+0000 7f3da403c700 1 --2- 172.21.15.92:0/2344237278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d9c06fe20 0x7f3d9c13c730 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c00c700 tx=0x7f3d8c00cac0 comp rx=0 tx=0).stop 2023-08-26T09:25:21.179 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.168+0000 7f320c760700 1 -- 172.21.15.92:0/3951488424 shutdown_connections 2023-08-26T09:25:21.179 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.168+0000 7f3da403c700 1 -- 172.21.15.92:0/2344237278 shutdown_connections 2023-08-26T09:25:21.179 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.168+0000 7f3da403c700 1 --2- 172.21.15.92:0/2344237278 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f3d8806a5b0 0x7f3d8806ca70 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:21.180 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.168+0000 7f3da403c700 1 --2- 172.21.15.92:0/2344237278 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3d9c15cd20 0x7f3d9c13a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:21.180 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.168+0000 7f3da403c700 1 --2- 172.21.15.92:0/2344237278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d9c06fe20 0x7f3d9c13c730 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:21.180 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.168+0000 7f320c760700 1 -- 172.21.15.92:0/3951488424 wait complete. 2023-08-26T09:25:21.181 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.168+0000 7f3da403c700 1 --2- 172.21.15.92:0/2344237278 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3d9c13f8c0 0x7f3d9c1f4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:21.181 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.168+0000 7f3da403c700 1 -- 172.21.15.92:0/2344237278 >> 172.21.15.92:0/2344237278 conn(0x7f3d9c0b0880 msgr2=0x7f3d9c158690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:21.181 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.168+0000 7f3da403c700 1 -- 172.21.15.92:0/2344237278 shutdown_connections 2023-08-26T09:25:21.181 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:21.168+0000 7f3da403c700 1 -- 172.21.15.92:0/2344237278 wait complete. 2023-08-26T09:25:21.183 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2023-08-26T09:25:21.188 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.4 2023-08-26T09:25:21.189 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2023-08-26T09:25:22.150 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-08-26T09:25:22.162 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-08-26T09:25:22.171 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-08-26T09:25:22.174 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-08-26T09:25:22.175 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-08-26T09:25:22.184 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-08-26T09:25:22.189 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-08-26T09:25:22.190 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-08-26T09:25:22.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.326+0000 7fa44cef5700 1 Processor -- start 2023-08-26T09:25:22.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.326+0000 7fa44cef5700 1 -- start start 2023-08-26T09:25:22.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.328+0000 7fa44cef5700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa4480b1370 0x7fa4480b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:22.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.328+0000 7fa44cef5700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa44806c290 con 0x7fa4480b3720 2023-08-26T09:25:22.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.328+0000 7fa44cef5700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa44806c570 con 0x7fa44815d430 2023-08-26T09:25:22.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.328+0000 7fa44cef5700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa44806c850 con 0x7fa4480b1370 2023-08-26T09:25:22.340 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.329+0000 7fa445d9b700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fa4480b3720 0x7fa44815cd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:56778/0 (socket says 172.21.15.92:56778) 2023-08-26T09:25:22.340 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.329+0000 7fa445d9b700 1 -- 172.21.15.92:0/3897490573 learned_addr learned my addr 172.21.15.92:0/3897490573 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:22.340 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.330+0000 7fa44659c700 1 --2- 172.21.15.92:0/3897490573 >> v2:172.21.15.92:3300/0 conn(0x7fa4480b1370 0x7fa4480b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:22.340 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.330+0000 7fa44659c700 1 -- 172.21.15.92:0/3897490573 >> v1:172.21.15.188:6789/0 conn(0x7fa44815d430 legacy=0x7fa44806fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:22.340 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.330+0000 7fa44659c700 1 -- 172.21.15.92:0/3897490573 >> v1:172.21.15.92:6789/0 conn(0x7fa4480b3720 legacy=0x7fa44815cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:22.340 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.330+0000 7fa44659c700 1 -- 172.21.15.92:0/3897490573 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa44806cb30 con 0x7fa4480b1370 2023-08-26T09:25:22.341 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.331+0000 7fa44659c700 1 --2- 172.21.15.92:0/3897490573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4480b1370 0x7fa4480b31e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa43c009840 tx=0x7fa43c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63152c96f9f1d687 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:22.341 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.331+0000 7fa44559a700 1 -- 172.21.15.92:0/3897490573 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43c004230 con 0x7fa4480b1370 2023-08-26T09:25:22.341 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.331+0000 7fa44559a700 1 -- 172.21.15.92:0/3897490573 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43c004390 con 0x7fa4480b1370 2023-08-26T09:25:22.341 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.331+0000 7fa44559a700 1 -- 172.21.15.92:0/3897490573 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43c0036a0 con 0x7fa4480b1370 2023-08-26T09:25:22.341 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.332+0000 7fa44cef5700 1 -- 172.21.15.92:0/3897490573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4480b1370 msgr2=0x7fa4480b31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:22.342 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.332+0000 7fa44cef5700 1 --2- 172.21.15.92:0/3897490573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4480b1370 0x7fa4480b31e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa43c009840 tx=0x7fa43c009b50 comp rx=0 tx=0).stop 2023-08-26T09:25:22.342 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.333+0000 7fa44cef5700 1 -- 172.21.15.92:0/3897490573 shutdown_connections 2023-08-26T09:25:22.342 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.333+0000 7fa44cef5700 1 --2- 172.21.15.92:0/3897490573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4480b1370 0x7fa4480b31e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.342 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.333+0000 7fa44cef5700 1 -- 172.21.15.92:0/3897490573 >> 172.21.15.92:0/3897490573 conn(0x7fa4480b0880 msgr2=0x7fa4480b0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:22.343 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.333+0000 7fa44cef5700 1 -- 172.21.15.92:0/3897490573 shutdown_connections 2023-08-26T09:25:22.343 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.333+0000 7fa44cef5700 1 -- 172.21.15.92:0/3897490573 wait complete. 2023-08-26T09:25:22.343 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.335+0000 7fa44cef5700 1 Processor -- start 2023-08-26T09:25:22.343 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.335+0000 7fa44cef5700 1 -- start start 2023-08-26T09:25:22.344 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.336+0000 7fa44cef5700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4480b1370 0x7fa4480ced90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:22.344 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.336+0000 7fa44cef5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4480b3720 0x7fa448158110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:22.344 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.338+0000 7fa445d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4480b3720 0x7fa448158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:22.344 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.338+0000 7fa445d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4480b3720 0x7fa448158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44772/0 (socket says 172.21.15.92:44772) 2023-08-26T09:25:22.345 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.338+0000 7fa44cef5700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa44815d430 0x7fa448158650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:22.345 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.338+0000 7fa44cef5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4481697c0 con 0x7fa4480b3720 2023-08-26T09:25:22.345 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.338+0000 7fa44cef5700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4480a8880 con 0x7fa4480b1370 2023-08-26T09:25:22.346 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.338+0000 7fa44cef5700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4480a8b60 con 0x7fa44815d430 2023-08-26T09:25:22.346 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.338+0000 7fa445d9b700 1 -- 172.21.15.92:0/1926193425 learned_addr learned my addr 172.21.15.92:0/1926193425 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:22.346 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.339+0000 7fa445d9b700 1 -- 172.21.15.92:0/1926193425 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa44815d430 msgr2=0x7fa448158650 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-26T09:25:22.346 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.339+0000 7fa445d9b700 1 --2- 172.21.15.92:0/1926193425 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa44815d430 0x7fa448158650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.346 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.339+0000 7fa445d9b700 1 -- 172.21.15.92:0/1926193425 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4480b1370 msgr2=0x7fa4480ced90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-26T09:25:22.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.339+0000 7fa445d9b700 1 --2- 172.21.15.92:0/1926193425 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4480b1370 0x7fa4480ced90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.339+0000 7fa445d9b700 1 -- 172.21.15.92:0/1926193425 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa43c0094a0 con 0x7fa4480b3720 2023-08-26T09:25:22.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.339+0000 7fa445d9b700 1 --2- 172.21.15.92:0/1926193425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4480b3720 0x7fa448158110 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa440002050 tx=0x7fa44000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:22.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.340+0000 7fa436ffd700 1 -- 172.21.15.92:0/1926193425 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44000ae00 con 0x7fa4480b3720 2023-08-26T09:25:22.348 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.340+0000 7fa436ffd700 1 -- 172.21.15.92:0/1926193425 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4400070d0 con 0x7fa4480b3720 2023-08-26T09:25:22.348 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.340+0000 7fa436ffd700 1 -- 172.21.15.92:0/1926193425 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa440007480 con 0x7fa4480b3720 2023-08-26T09:25:22.349 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.340+0000 7fa44cef5700 1 -- 172.21.15.92:0/1926193425 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4480a8e40 con 0x7fa4480b3720 2023-08-26T09:25:22.349 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.340+0000 7fa44cef5700 1 -- 172.21.15.92:0/1926193425 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4480a9400 con 0x7fa4480b3720 2023-08-26T09:25:22.350 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.344+0000 7fa436ffd700 1 -- 172.21.15.92:0/1926193425 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa4400075e0 con 0x7fa4480b3720 2023-08-26T09:25:22.350 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.345+0000 7fa436ffd700 1 --2- 172.21.15.92:0/1926193425 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa42806a180 0x7fa42806c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:22.350 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.345+0000 7fa436ffd700 1 -- 172.21.15.92:0/1926193425 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa440088710 con 0x7fa4480b3720 2023-08-26T09:25:22.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.346+0000 7fa44cef5700 1 -- 172.21.15.92:0/1926193425 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa42c0052f0 con 0x7fa4480b3720 2023-08-26T09:25:22.357 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.353+0000 7fa44659c700 1 --2- 172.21.15.92:0/1926193425 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa42806a180 0x7fa42806c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:22.358 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.353+0000 7fa44659c700 1 --2- 172.21.15.92:0/1926193425 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa42806a180 0x7fa42806c640 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa43c009b90 tx=0x7fa43c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:22.360 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.355+0000 7fa436ffd700 1 -- 172.21.15.92:0/1926193425 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa440053e70 con 0x7fa4480b3720 2023-08-26T09:25:22.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.398+0000 7f440f668700 1 Processor -- start 2023-08-26T09:25:22.405 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.398+0000 7f440f668700 1 -- start start 2023-08-26T09:25:22.405 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.400+0000 7f440f668700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4408161910 0x7f440806d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:22.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.400+0000 7f440f668700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f44080c2b20 0x7f4408165d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:22.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.400+0000 7f440f668700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44081658a0 con 0x7f440806a320 2023-08-26T09:25:22.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.400+0000 7f440f668700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44080c35a0 con 0x7f44080c2b20 2023-08-26T09:25:22.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.400+0000 7f440f668700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44080c2fe0 con 0x7f4408161910 2023-08-26T09:25:22.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.401+0000 7f440d404700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4408161910 0x7f440806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:22.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.401+0000 7f440dc05700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f440806a320 0x7f4408070ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:56794/0 (socket says 172.21.15.92:56794) 2023-08-26T09:25:22.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.401+0000 7f440dc05700 1 -- 172.21.15.92:0/2509478017 learned_addr learned my addr 172.21.15.92:0/2509478017 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:22.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.401+0000 7f440cc03700 1 --2- 172.21.15.92:0/2509478017 >> v2:172.21.15.92:3300/0 conn(0x7f44080c2b20 0x7f4408165d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:22.409 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.402+0000 7f43fffff700 1 -- 172.21.15.92:0/2509478017 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3496847894 0 0) 0x7f44081658a0 con 0x7f440806a320 2023-08-26T09:25:22.409 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.402+0000 7f43fffff700 1 -- 172.21.15.92:0/2509478017 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43f40035b0 con 0x7f440806a320 2023-08-26T09:25:22.409 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.402+0000 7f43fffff700 1 -- 172.21.15.92:0/2509478017 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4070579215 0 0) 0x7f43f40035b0 con 0x7f440806a320 2023-08-26T09:25:22.409 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.402+0000 7f43fffff700 1 -- 172.21.15.92:0/2509478017 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4408161910 msgr2=0x7f440806d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:22.409 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.402+0000 7f43fffff700 1 --2- 172.21.15.92:0/2509478017 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4408161910 0x7f440806d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.402+0000 7f43fffff700 1 -- 172.21.15.92:0/2509478017 >> v2:172.21.15.92:3300/0 conn(0x7f44080c2b20 msgr2=0x7f4408165d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:22.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.402+0000 7f43fffff700 1 --2- 172.21.15.92:0/2509478017 >> v2:172.21.15.92:3300/0 conn(0x7f44080c2b20 0x7f4408165d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.402+0000 7f43fffff700 1 -- 172.21.15.92:0/2509478017 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44080c32c0 con 0x7f440806a320 2023-08-26T09:25:22.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.402+0000 7f43fffff700 1 -- 172.21.15.92:0/2509478017 <== mon.0 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1019361464 0 0) 0x7f44000019f0 con 0x7f440806a320 2023-08-26T09:25:22.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.402+0000 7f440cc03700 1 --2- 172.21.15.92:0/2509478017 >> v2:172.21.15.92:3300/0 conn(0x7f44080c2b20 0x7f4408165d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-26T09:25:22.411 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.402+0000 7f43fffff700 1 -- 172.21.15.92:0/2509478017 >> v1:172.21.15.92:6789/0 conn(0x7f440806a320 legacy=0x7f4408070ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:22.411 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.402+0000 7f43fffff700 1 --2- 172.21.15.92:0/2509478017 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f43f4003a00 0x7f43f4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:22.411 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.402+0000 7f43fffff700 1 --2- 172.21.15.92:0/2509478017 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43f40043f0 0x7f43f40048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:22.411 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.402+0000 7f43fffff700 1 --2- 172.21.15.92:0/2509478017 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f43f40050d0 0x7f43f400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:22.411 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.402+0000 7f43fffff700 1 -- 172.21.15.92:0/2509478017 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44080c35a0 con 0x7f43f40043f0 2023-08-26T09:25:22.411 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.402+0000 7f43fffff700 1 -- 172.21.15.92:0/2509478017 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44080c2fe0 con 0x7f43f40050d0 2023-08-26T09:25:22.412 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.402+0000 7f43fffff700 1 -- 172.21.15.92:0/2509478017 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43f400c060 con 0x7f43f4003a00 2023-08-26T09:25:22.412 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.403+0000 7f440dc05700 1 --2- 172.21.15.92:0/2509478017 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f43f40050d0 0x7f43f400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:22.412 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.403+0000 7f440cc03700 1 --2- 172.21.15.92:0/2509478017 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43f40043f0 0x7f43f40048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:22.412 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.403+0000 7f440d404700 1 --2- 172.21.15.92:0/2509478017 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f43f4003a00 0x7f43f4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:22.412 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.403+0000 7f440cc03700 1 -- 172.21.15.92:0/2509478017 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f43f4003a00 msgr2=0x7f43f4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:22.413 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.403+0000 7f440cc03700 1 --2- 172.21.15.92:0/2509478017 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f43f4003a00 0x7f43f4003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.413 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.403+0000 7f440cc03700 1 -- 172.21.15.92:0/2509478017 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f43f40050d0 msgr2=0x7f43f400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:22.413 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.403+0000 7f440cc03700 1 --2- 172.21.15.92:0/2509478017 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f43f40050d0 0x7f43f400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.413 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.403+0000 7f440cc03700 1 -- 172.21.15.92:0/2509478017 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44080c32c0 con 0x7f43f40043f0 2023-08-26T09:25:22.414 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.403+0000 7f440cc03700 1 --2- 172.21.15.92:0/2509478017 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43f40043f0 0x7f43f40048d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4404009d30 tx=0x7f43f4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2b524b15a26344f server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:22.414 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.403+0000 7f43fffff700 1 -- 172.21.15.92:0/2509478017 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4404009e80 con 0x7f43f40043f0 2023-08-26T09:25:22.415 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.403+0000 7f43fffff700 1 -- 172.21.15.92:0/2509478017 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f440400e9a0 con 0x7f43f40043f0 2023-08-26T09:25:22.415 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.403+0000 7f43fffff700 1 -- 172.21.15.92:0/2509478017 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440400ed30 con 0x7f43f40043f0 2023-08-26T09:25:22.415 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.404+0000 7f440f668700 1 -- 172.21.15.92:0/2509478017 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43f40043f0 msgr2=0x7f43f40048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:22.415 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.404+0000 7f440f668700 1 --2- 172.21.15.92:0/2509478017 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43f40043f0 0x7f43f40048d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4404009d30 tx=0x7f43f4005880 comp rx=0 tx=0).stop 2023-08-26T09:25:22.415 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.404+0000 7f440dc05700 1 -- 172.21.15.92:0/2509478017 reap_dead start 2023-08-26T09:25:22.416 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.405+0000 7f7d3ac4b700 1 Processor -- start 2023-08-26T09:25:22.416 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.406+0000 7fe2209a4700 1 Processor -- start 2023-08-26T09:25:22.417 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.406+0000 7f7d3ac4b700 1 -- start start 2023-08-26T09:25:22.417 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.406+0000 7f440f668700 1 -- 172.21.15.92:0/2509478017 shutdown_connections 2023-08-26T09:25:22.417 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.406+0000 7f440f668700 1 -- 172.21.15.92:0/2509478017 >> 172.21.15.92:0/2509478017 conn(0x7f44080cc790 msgr2=0x7f44080ccb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:22.418 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.407+0000 7fe2209a4700 1 -- start start 2023-08-26T09:25:22.418 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.408+0000 7fe2209a4700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe21c0ae590 0x7fe21c06de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:22.418 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.408+0000 7fe2209a4700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe21c159c70 con 0x7fe21c0cb640 2023-08-26T09:25:22.418 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.408+0000 7fe2209a4700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe21c0b0ef0 con 0x7fe21c06b450 2023-08-26T09:25:22.418 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.408+0000 7fe2209a4700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe21c0b11d0 con 0x7fe21c0ae590 2023-08-26T09:25:22.419 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.408+0000 7f7d3ac4b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f7d340cad90 0x7f7d341405d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:22.419 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.408+0000 7f7d3ac4b700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f7d340cb170 0x7f7d3406beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:22.419 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.408+0000 7fe21a59c700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fe21c0cb640 0x7fe21c06ad40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:56804/0 (socket says 172.21.15.92:56804) 2023-08-26T09:25:22.420 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.408+0000 7fe21a59c700 1 -- 172.21.15.92:0/376958426 learned_addr learned my addr 172.21.15.92:0/376958426 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:22.420 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.408+0000 7f7d3ac4b700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d3406c820 con 0x7f7d3406c3f0 2023-08-26T09:25:22.420 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.408+0000 7f7d3ac4b700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d3413e590 con 0x7f7d340cad90 2023-08-26T09:25:22.420 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.408+0000 7f7d3ac4b700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d34140e70 con 0x7f7d340cb170 2023-08-26T09:25:22.421 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.408+0000 7fe21ad9d700 1 --2- 172.21.15.92:0/376958426 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe21c0ae590 0x7fe21c06de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:22.421 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.408+0000 7f7d389e7700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f7d340cad90 0x7f7d341405d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:22.421 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.408+0000 7f7d389e7700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f7d340cad90 0x7f7d341405d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44796/0 (socket says 172.21.15.92:44796) 2023-08-26T09:25:22.422 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.408+0000 7f7d389e7700 1 -- 172.21.15.92:0/164728707 learned_addr learned my addr 172.21.15.92:0/164728707 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:22.422 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.409+0000 7fe21959a700 1 -- 172.21.15.92:0/376958426 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 221253772 0 0) 0x7fe21c159c70 con 0x7fe21c0cb640 2023-08-26T09:25:22.422 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.409+0000 7f7d389e7700 1 -- 172.21.15.92:0/164728707 >> v2:172.21.15.188:3300/0 conn(0x7f7d340cb170 msgr2=0x7f7d3406beb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-26T09:25:22.423 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.409+0000 7f7d389e7700 1 --2- 172.21.15.92:0/164728707 >> v2:172.21.15.188:3300/0 conn(0x7f7d340cb170 0x7f7d3406beb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.423 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.409+0000 7f7d389e7700 1 -- 172.21.15.92:0/164728707 >> v1:172.21.15.188:6789/0 conn(0x7f7d3406c3f0 legacy=0x7f7d3415eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:22.423 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.409+0000 7f7d389e7700 1 -- 172.21.15.92:0/164728707 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d34141150 con 0x7f7d340cad90 2023-08-26T09:25:22.423 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.409+0000 7f440f668700 1 -- 172.21.15.92:0/2509478017 shutdown_connections 2023-08-26T09:25:22.424 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.409+0000 7f7d389e7700 1 --2- 172.21.15.92:0/164728707 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d340cad90 0x7f7d341405d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7d340cc000 tx=0x7f7d2c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40fef9034321cd22 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:22.424 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.409+0000 7f98afe28700 1 Processor -- start 2023-08-26T09:25:22.425 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.409+0000 7f7d337fe700 1 -- 172.21.15.92:0/164728707 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c00e070 con 0x7f7d340cad90 2023-08-26T09:25:22.425 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.409+0000 7f7d337fe700 1 -- 172.21.15.92:0/164728707 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d2c003a20 con 0x7f7d340cad90 2023-08-26T09:25:22.425 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.409+0000 7f7d337fe700 1 -- 172.21.15.92:0/164728707 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c003dd0 con 0x7f7d340cad90 2023-08-26T09:25:22.426 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.409+0000 7fe21ad9d700 1 -- 172.21.15.92:0/376958426 >> v1:172.21.15.188:6789/0 conn(0x7fe21c06b450 legacy=0x7fe21c0cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:22.426 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.410+0000 7fe21ad9d700 1 -- 172.21.15.92:0/376958426 >> v1:172.21.15.92:6789/0 conn(0x7fe21c0cb640 legacy=0x7fe21c06ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:22.426 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.410+0000 7fe21ad9d700 1 -- 172.21.15.92:0/376958426 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe21c0b14b0 con 0x7fe21c0ae590 2023-08-26T09:25:22.426 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.410+0000 7fe21ad9d700 1 --2- 172.21.15.92:0/376958426 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe21c0ae590 0x7fe21c06de40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe214009c30 tx=0x7fe214009f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69a95ce8358419e server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:22.427 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.411+0000 7f278b19b700 1 Processor -- start 2023-08-26T09:25:22.427 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.411+0000 7f7d3ac4b700 1 -- 172.21.15.92:0/164728707 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d340cad90 msgr2=0x7f7d341405d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:22.427 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.411+0000 7f7d3ac4b700 1 --2- 172.21.15.92:0/164728707 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d340cad90 0x7f7d341405d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7d340cc000 tx=0x7f7d2c00b330 comp rx=0 tx=0).stop 2023-08-26T09:25:22.428 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.409+0000 7f98afe28700 1 -- start start 2023-08-26T09:25:22.428 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.411+0000 7f98afe28700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f98a815d1b0 0x7f98a8070530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:22.429 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.411+0000 7f98afe28700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98a806c290 con 0x7f98a815cd20 2023-08-26T09:25:22.429 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.411+0000 7f98afe28700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98a806c570 con 0x7f98a813f8c0 2023-08-26T09:25:22.429 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.411+0000 7f98afe28700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98a806c850 con 0x7f98a815d1b0 2023-08-26T09:25:22.429 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.411+0000 7f98adbc4700 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f98a813f8c0 0x7f98a80b31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.92:51926/0 (socket says 172.21.15.92:51926) 2023-08-26T09:25:22.429 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.411+0000 7f98adbc4700 1 -- 172.21.15.92:0/3831058032 learned_addr learned my addr 172.21.15.92:0/3831058032 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:22.430 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.411+0000 7f278b19b700 1 -- start start 2023-08-26T09:25:22.430 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.409+0000 7f440f668700 1 -- 172.21.15.92:0/2509478017 wait complete. 2023-08-26T09:25:22.430 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.411+0000 7f440f668700 1 Processor -- start 2023-08-26T09:25:22.431 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.411+0000 7f98acbc2700 1 -- 172.21.15.92:0/3831058032 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 216360018 0 0) 0x7f98a806c570 con 0x7f98a813f8c0 2023-08-26T09:25:22.431 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.411+0000 7f98acbc2700 1 -- 172.21.15.92:0/3831058032 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98940035b0 con 0x7f98a813f8c0 2023-08-26T09:25:22.431 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.411+0000 7f7d3ac4b700 1 -- 172.21.15.92:0/164728707 shutdown_connections 2023-08-26T09:25:22.432 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.411+0000 7f7d3ac4b700 1 --2- 172.21.15.92:0/164728707 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d340cad90 0x7f7d341405d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.432 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.411+0000 7f7d3ac4b700 1 --2- 172.21.15.92:0/164728707 >> v2:172.21.15.188:3300/0 conn(0x7f7d340cb170 0x7f7d3406beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.432 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.412+0000 7f7d3ac4b700 1 -- 172.21.15.92:0/164728707 >> 172.21.15.92:0/164728707 conn(0x7f7d3406a320 msgr2=0x7f7d3406a730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:22.433 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.412+0000 7f98acbc2700 1 -- 172.21.15.92:0/3831058032 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3495508210 0 0) 0x7f98940035b0 con 0x7f98a813f8c0 2023-08-26T09:25:22.433 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.412+0000 7f98ae3c5700 1 --2- 172.21.15.92:0/3831058032 >> v2:172.21.15.92:3300/0 conn(0x7f98a815d1b0 0x7f98a8070530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:22.433 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.412+0000 7f98acbc2700 1 -- 172.21.15.92:0/3831058032 >> v2:172.21.15.92:3300/0 conn(0x7f98a815d1b0 msgr2=0x7f98a8070530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:22.433 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.412+0000 7f98acbc2700 1 --2- 172.21.15.92:0/3831058032 >> v2:172.21.15.92:3300/0 conn(0x7f98a815d1b0 0x7f98a8070530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.433 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.412+0000 7f98acbc2700 1 -- 172.21.15.92:0/3831058032 >> v1:172.21.15.92:6789/0 conn(0x7f98a815cd20 legacy=0x7f98a806fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:22.434 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.412+0000 7f98acbc2700 1 -- 172.21.15.92:0/3831058032 --> v1:172.21.15.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a806cb30 con 0x7f98a813f8c0 2023-08-26T09:25:22.434 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.412+0000 7f98acbc2700 1 -- 172.21.15.92:0/3831058032 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1019361464 0 0) 0x7f98a40016b0 con 0x7f98a813f8c0 2023-08-26T09:25:22.434 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.412+0000 7f98acbc2700 1 -- 172.21.15.92:0/3831058032 >> v1:172.21.15.188:6789/0 conn(0x7f98a813f8c0 legacy=0x7f98a80b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:22.434 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.412+0000 7f98acbc2700 1 --2- 172.21.15.92:0/3831058032 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9894003a50 0x7f9894003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:22.434 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.412+0000 7f98acbc2700 1 --2- 172.21.15.92:0/3831058032 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9894004850 0x7f9894004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:22.434 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.412+0000 7f98acbc2700 1 --2- 172.21.15.92:0/3831058032 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9894005330 0x7f9894014220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:22.435 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.412+0000 7f98acbc2700 1 -- 172.21.15.92:0/3831058032 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a806c850 con 0x7f9894005330 2023-08-26T09:25:22.435 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.412+0000 7f98acbc2700 1 -- 172.21.15.92:0/3831058032 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9894014a90 con 0x7f9894004850 2023-08-26T09:25:22.435 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.412+0000 7f98acbc2700 1 -- 172.21.15.92:0/3831058032 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9894014c50 con 0x7f9894003a50 2023-08-26T09:25:22.435 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.412+0000 7f98ae3c5700 1 --2- 172.21.15.92:0/3831058032 >> v2:172.21.15.92:3300/0 conn(0x7f98a815d1b0 0x7f98a8070530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:25:22.435 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.412+0000 7f98adbc4700 1 --2- 172.21.15.92:0/3831058032 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9894003a50 0x7f9894003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:22.436 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.413+0000 7f98ae3c5700 1 --2- 172.21.15.92:0/3831058032 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9894005330 0x7f9894014220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:22.436 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.413+0000 7f98adbc4700 1 -- 172.21.15.92:0/3831058032 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9894004850 msgr2=0x7f9894004cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-26T09:25:22.436 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.413+0000 7f98adbc4700 1 --2- 172.21.15.92:0/3831058032 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9894004850 0x7f9894004cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.436 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.413+0000 7f98adbc4700 1 -- 172.21.15.92:0/3831058032 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9894005330 msgr2=0x7f9894014220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:22.436 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.413+0000 7f98adbc4700 1 --2- 172.21.15.92:0/3831058032 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9894005330 0x7f9894014220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.437 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.413+0000 7f98adbc4700 1 -- 172.21.15.92:0/3831058032 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98940035b0 con 0x7f9894003a50 2023-08-26T09:25:22.437 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.412+0000 7f440f668700 1 -- start start 2023-08-26T09:25:22.437 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.413+0000 7f440f668700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43f40043f0 0x7f44080c44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:22.437 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.413+0000 7f440f668700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44080c6050 0x7f440814e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:22.438 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.413+0000 7f440f668700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f440814eb10 0x7f440815d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:22.438 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.413+0000 7f440f668700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f440814efc0 con 0x7f43f40043f0 2023-08-26T09:25:22.438 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.413+0000 7f440f668700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44080b28b0 con 0x7f440814eb10 2023-08-26T09:25:22.438 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.413+0000 7f440f668700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44080c5510 con 0x7f44080c6050 2023-08-26T09:25:22.438 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.413+0000 7f440cc03700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44080c6050 0x7f440814e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:22.439 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.413+0000 7f440cc03700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44080c6050 0x7f440814e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.92:43484/0 (socket says 172.21.15.92:43484) 2023-08-26T09:25:22.439 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.413+0000 7f440cc03700 1 -- 172.21.15.92:0/140504332 learned_addr learned my addr 172.21.15.92:0/140504332 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:22.439 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.413+0000 7f440dc05700 1 --2- 172.21.15.92:0/140504332 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f440814eb10 0x7f440815d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:22.439 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.412+0000 7f7d3ac4b700 1 -- 172.21.15.92:0/164728707 shutdown_connections 2023-08-26T09:25:22.439 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.412+0000 7f7d3ac4b700 1 -- 172.21.15.92:0/164728707 wait complete. 2023-08-26T09:25:22.440 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.412+0000 7fe21959a700 1 -- 172.21.15.92:0/376958426 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe214003c20 con 0x7fe21c0ae590 2023-08-26T09:25:22.440 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.412+0000 7fe21959a700 1 -- 172.21.15.92:0/376958426 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe214003d80 con 0x7fe21c0ae590 2023-08-26T09:25:22.440 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.412+0000 7fe21959a700 1 -- 172.21.15.92:0/376958426 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21400bb60 con 0x7fe21c0ae590 2023-08-26T09:25:22.440 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.413+0000 7fe2209a4700 1 -- 172.21.15.92:0/376958426 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe21c0ae590 msgr2=0x7fe21c06de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:22.441 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.413+0000 7fe2209a4700 1 --2- 172.21.15.92:0/376958426 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe21c0ae590 0x7fe21c06de40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe214009c30 tx=0x7fe214009f40 comp rx=0 tx=0).stop 2023-08-26T09:25:22.441 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.413+0000 7fe2209a4700 1 -- 172.21.15.92:0/376958426 shutdown_connections 2023-08-26T09:25:22.441 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.413+0000 7fe2209a4700 1 --2- 172.21.15.92:0/376958426 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe21c0ae590 0x7fe21c06de40 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.441 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.413+0000 7fe2209a4700 1 -- 172.21.15.92:0/376958426 >> 172.21.15.92:0/376958426 conn(0x7fe21c0b23c0 msgr2=0x7fe21c0b27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:22.441 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.413+0000 7fe2209a4700 1 -- 172.21.15.92:0/376958426 shutdown_connections 2023-08-26T09:25:22.442 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.413+0000 7fe2209a4700 1 -- 172.21.15.92:0/376958426 wait complete. 2023-08-26T09:25:22.442 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.412+0000 7f278b19b700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f2784144bd0 0x7f27840cec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:22.442 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.412+0000 7f278b19b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f27840cf140 0x7f27841653d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:22.442 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.412+0000 7f278b19b700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2784145050 con 0x7f27840ce3e0 2023-08-26T09:25:22.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.412+0000 7f278b19b700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2784144950 con 0x7f27840cf140 2023-08-26T09:25:22.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.412+0000 7f278b19b700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27840cf5b0 con 0x7f2784144bd0 2023-08-26T09:25:22.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.412+0000 7f2789738700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f27840cf140 0x7f27841653d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:22.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.412+0000 7f2789738700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f27840cf140 0x7f27841653d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44812/0 (socket says 172.21.15.92:44812) 2023-08-26T09:25:22.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.412+0000 7f2788f37700 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f27840ce3e0 0x7f27840b23b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.92:51934/0 (socket says 172.21.15.92:51934) 2023-08-26T09:25:22.444 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.412+0000 7f2789738700 1 -- 172.21.15.92:0/4071083076 learned_addr learned my addr 172.21.15.92:0/4071083076 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:22.444 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.413+0000 7f27837fe700 1 -- 172.21.15.92:0/4071083076 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3481050676 0 0) 0x7f2774001110 con 0x7f27840ce3e0 2023-08-26T09:25:22.444 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.413+0000 7f27837fe700 1 -- 172.21.15.92:0/4071083076 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f276c0035b0 con 0x7f27840ce3e0 2023-08-26T09:25:22.444 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.413+0000 7f2789738700 1 -- 172.21.15.92:0/4071083076 >> v2:172.21.15.188:3300/0 conn(0x7f2784144bd0 msgr2=0x7f27840cec00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-26T09:25:22.444 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.413+0000 7f2789738700 1 --2- 172.21.15.92:0/4071083076 >> v2:172.21.15.188:3300/0 conn(0x7f2784144bd0 0x7f27840cec00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.445 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.413+0000 7f2789738700 1 -- 172.21.15.92:0/4071083076 >> v1:172.21.15.188:6789/0 conn(0x7f27840ce3e0 legacy=0x7f27840b23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:22.445 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.413+0000 7f2789738700 1 -- 172.21.15.92:0/4071083076 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2784162af0 con 0x7f27840cf140 2023-08-26T09:25:22.445 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.413+0000 7f98ae3c5700 1 -- 172.21.15.92:0/3831058032 reap_dead start 2023-08-26T09:25:22.445 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.414+0000 7f440cc03700 1 -- 172.21.15.92:0/140504332 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f440814eb10 msgr2=0x7f440815d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:22.446 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.414+0000 7f440cc03700 1 --2- 172.21.15.92:0/140504332 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f440814eb10 0x7f440815d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.446 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.414+0000 7f440cc03700 1 -- 172.21.15.92:0/140504332 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43f40043f0 msgr2=0x7f44080c44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:22.446 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.414+0000 7f440cc03700 1 --2- 172.21.15.92:0/140504332 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43f40043f0 0x7f44080c44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.446 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.414+0000 7f440cc03700 1 -- 172.21.15.92:0/140504332 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44080c64d0 con 0x7f44080c6050 2023-08-26T09:25:22.447 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.414+0000 7f98adbc4700 1 --2- 172.21.15.92:0/3831058032 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9894003a50 0x7f9894003e50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f98a4001eb0 tx=0x7f9894005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fcc90e3ff46cb3ee server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:22.447 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.414+0000 7f440cc03700 1 --2- 172.21.15.92:0/140504332 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44080c6050 0x7f440814e5d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4404016000 tx=0x7f44040047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:22.447 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.414+0000 7f2789738700 1 --2- 172.21.15.92:0/4071083076 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27840cf140 0x7f27841653d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f27840ae7c0 tx=0x7f277c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab0287a0ba25127f server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:22.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.414+0000 7f7d3ac4b700 1 Processor -- start 2023-08-26T09:25:22.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.414+0000 7f7d3ac4b700 1 -- start start 2023-08-26T09:25:22.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.415+0000 7fe2209a4700 1 Processor -- start 2023-08-26T09:25:22.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.414+0000 7f98acbc2700 1 -- 172.21.15.92:0/3831058032 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a400cd20 con 0x7f9894003a50 2023-08-26T09:25:22.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.414+0000 7f98acbc2700 1 -- 172.21.15.92:0/3831058032 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a400ce80 con 0x7f9894003a50 2023-08-26T09:25:22.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.414+0000 7f98acbc2700 1 -- 172.21.15.92:0/3831058032 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a4005ba0 con 0x7f9894003a50 2023-08-26T09:25:22.450 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.415+0000 7f98afe28700 1 -- 172.21.15.92:0/3831058032 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9894003a50 msgr2=0x7f9894003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:22.450 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.415+0000 7f98afe28700 1 --2- 172.21.15.92:0/3831058032 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9894003a50 0x7f9894003e50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f98a4001eb0 tx=0x7f9894005880 comp rx=0 tx=0).stop 2023-08-26T09:25:22.450 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.415+0000 7f98afe28700 1 -- 172.21.15.92:0/3831058032 shutdown_connections 2023-08-26T09:25:22.450 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.416+0000 7f98afe28700 1 --2- 172.21.15.92:0/3831058032 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9894003a50 0x7f9894003e50 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.450 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.416+0000 7f98afe28700 1 -- 172.21.15.92:0/3831058032 >> 172.21.15.92:0/3831058032 conn(0x7f98a80b0880 msgr2=0x7f98a80b0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:22.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.415+0000 7f43fdffb700 1 -- 172.21.15.92:0/140504332 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4404006e60 con 0x7f44080c6050 2023-08-26T09:25:22.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.415+0000 7f43fdffb700 1 -- 172.21.15.92:0/140504332 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44040038b0 con 0x7f44080c6050 2023-08-26T09:25:22.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.415+0000 7f43fdffb700 1 -- 172.21.15.92:0/140504332 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4404003c60 con 0x7f44080c6050 2023-08-26T09:25:22.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.416+0000 7f440f668700 1 -- 172.21.15.92:0/140504332 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44080c57b0 con 0x7f44080c6050 2023-08-26T09:25:22.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.416+0000 7f440f668700 1 -- 172.21.15.92:0/140504332 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44080c6780 con 0x7f44080c6050 2023-08-26T09:25:22.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.416+0000 7f7d3ac4b700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7d3406c3f0 0x7f7d341f9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:22.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.416+0000 7f7d3ac4b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d340cad90 0x7f7d340b1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:22.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.416+0000 7f7d3ac4b700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7d340cb170 0x7f7d34152ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:22.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.416+0000 7f7d3ac4b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d34152a40 con 0x7f7d340cad90 2023-08-26T09:25:22.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.416+0000 7f7d3ac4b700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d340b2950 con 0x7f7d3406c3f0 2023-08-26T09:25:22.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.416+0000 7f7d3ac4b700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d340b2390 con 0x7f7d340cb170 2023-08-26T09:25:22.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.416+0000 7f7d391e8700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7d340cb170 0x7f7d34152ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:22.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.416+0000 7f7d391e8700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7d340cb170 0x7f7d34152ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.92:43490/0 (socket says 172.21.15.92:43490) 2023-08-26T09:25:22.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.416+0000 7f7d391e8700 1 -- 172.21.15.92:0/3361027633 learned_addr learned my addr 172.21.15.92:0/3361027633 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:22.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.415+0000 7fe2209a4700 1 -- start start 2023-08-26T09:25:22.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.416+0000 7f7d389e7700 1 --2- 172.21.15.92:0/3361027633 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7d3406c3f0 0x7f7d341f9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:22.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.417+0000 7f352e92d700 1 Processor -- start 2023-08-26T09:25:22.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.416+0000 7fe2209a4700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe21c06b450 0x7fe21c098ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:22.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.417+0000 7fe2209a4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe21c0ae590 0x7fe21c0c8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:22.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.417+0000 7fe2209a4700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe21c0cb640 0x7fe21c0cf470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:22.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.417+0000 7fe2209a4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe21c0c74a0 con 0x7fe21c0ae590 2023-08-26T09:25:22.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.417+0000 7fe2209a4700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe21c0c8b70 con 0x7fe21c06b450 2023-08-26T09:25:22.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.417+0000 7fe2209a4700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe21c0c6890 con 0x7fe21c0cb640 2023-08-26T09:25:22.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.417+0000 7f7d389e7700 1 -- 172.21.15.92:0/3361027633 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7d340cb170 msgr2=0x7f7d34152ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:22.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.417+0000 7f7d389e7700 1 --2- 172.21.15.92:0/3361027633 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7d340cb170 0x7f7d34152ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.417+0000 7f7d389e7700 1 -- 172.21.15.92:0/3361027633 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d340cad90 msgr2=0x7f7d340b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:22.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.417+0000 7f7d389e7700 1 --2- 172.21.15.92:0/3361027633 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d340cad90 0x7f7d340b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.417+0000 7f7d389e7700 1 -- 172.21.15.92:0/3361027633 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d2c009b30 con 0x7f7d3406c3f0 2023-08-26T09:25:22.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.417+0000 7f352e92d700 1 -- start start 2023-08-26T09:25:22.459 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.417+0000 7fe219d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe21c0ae590 0x7fe21c0c8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:22.459 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.417+0000 7fe219d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe21c0ae590 0x7fe21c0c8630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44832/0 (socket says 172.21.15.92:44832) 2023-08-26T09:25:22.459 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.417+0000 7fe219d9b700 1 -- 172.21.15.92:0/3050826829 learned_addr learned my addr 172.21.15.92:0/3050826829 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:22.460 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.417+0000 7fe21a59c700 1 --2- 172.21.15.92:0/3050826829 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe21c06b450 0x7fe21c098ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:22.460 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.417+0000 7fe21ad9d700 1 --2- 172.21.15.92:0/3050826829 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe21c0cb640 0x7fe21c0cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:22.460 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.418+0000 7fe219d9b700 1 -- 172.21.15.92:0/3050826829 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe21c0cb640 msgr2=0x7fe21c0cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:22.460 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.418+0000 7fe219d9b700 1 --2- 172.21.15.92:0/3050826829 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe21c0cb640 0x7fe21c0cf470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.460 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.418+0000 7fe219d9b700 1 -- 172.21.15.92:0/3050826829 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe21c06b450 msgr2=0x7fe21c098ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:22.460 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.418+0000 7fe219d9b700 1 --2- 172.21.15.92:0/3050826829 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe21c06b450 0x7fe21c098ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.461 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.418+0000 7fe219d9b700 1 -- 172.21.15.92:0/3050826829 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe21400d040 con 0x7fe21c0ae590 2023-08-26T09:25:22.461 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.416+0000 7f27837fe700 1 -- 172.21.15.92:0/4071083076 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277c00e070 con 0x7f27840cf140 2023-08-26T09:25:22.461 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.417+0000 7f27837fe700 1 -- 172.21.15.92:0/4071083076 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f277c00b8d0 con 0x7f27840cf140 2023-08-26T09:25:22.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.417+0000 7f27837fe700 1 -- 172.21.15.92:0/4071083076 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277c00bc80 con 0x7f27840cf140 2023-08-26T09:25:22.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.418+0000 7f278b19b700 1 -- 172.21.15.92:0/4071083076 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27840cf140 msgr2=0x7f27841653d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:22.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.418+0000 7f278b19b700 1 --2- 172.21.15.92:0/4071083076 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27840cf140 0x7f27841653d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f27840ae7c0 tx=0x7f277c00b330 comp rx=0 tx=0).stop 2023-08-26T09:25:22.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.418+0000 7f278b19b700 1 -- 172.21.15.92:0/4071083076 shutdown_connections 2023-08-26T09:25:22.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.418+0000 7f278b19b700 1 --2- 172.21.15.92:0/4071083076 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27840cf140 0x7f27841653d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.463 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.418+0000 7f278b19b700 1 --2- 172.21.15.92:0/4071083076 >> v2:172.21.15.188:3300/0 conn(0x7f2784144bd0 0x7f27840cec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.463 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.418+0000 7f278b19b700 1 -- 172.21.15.92:0/4071083076 >> 172.21.15.92:0/4071083076 conn(0x7f278406a320 msgr2=0x7f278406a730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:22.463 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.418+0000 7f7d389e7700 1 --2- 172.21.15.92:0/3361027633 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7d3406c3f0 0x7f7d341f9c60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c014000 tx=0x7f7d2c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:22.463 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.418+0000 7f278b19b700 1 -- 172.21.15.92:0/4071083076 shutdown_connections 2023-08-26T09:25:22.464 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.418+0000 7f352e92d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f3528160ef0 0x7f35280d1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:22.464 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.418+0000 7f352e92d700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f35280ce830 0x7f35280b2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:22.464 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.418+0000 7f352e92d700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35280cf130 con 0x7f3528161b40 2023-08-26T09:25:22.464 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.418+0000 7f352e92d700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35280d2180 con 0x7f3528160ef0 2023-08-26T09:25:22.465 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.418+0000 7f98afe28700 1 -- 172.21.15.92:0/3831058032 shutdown_connections 2023-08-26T09:25:22.465 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.418+0000 7f352e92d700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35280d0e80 con 0x7f35280ce830 2023-08-26T09:25:22.466 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.418+0000 7f43fdffb700 1 -- 172.21.15.92:0/140504332 <== mon.2 v2:172.21.15.188:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4404013470 con 0x7f44080c6050 2023-08-26T09:25:22.466 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.419+0000 7f43fdffb700 1 --2- 172.21.15.92:0/140504332 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f43ec06a1b0 0x7f43ec06c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:22.466 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.419+0000 7f43fdffb700 1 -- 172.21.15.92:0/140504332 <== mon.2 v2:172.21.15.188:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f44040899e0 con 0x7f44080c6050 2023-08-26T09:25:22.466 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.420+0000 7f440d404700 1 --2- 172.21.15.92:0/140504332 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f43ec06a1b0 0x7f43ec06c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:22.467 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.418+0000 7f7d317fa700 1 -- 172.21.15.92:0/3361027633 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c004500 con 0x7f7d3406c3f0 2023-08-26T09:25:22.467 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.418+0000 7f7d317fa700 1 -- 172.21.15.92:0/3361027633 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d2c004660 con 0x7f7d3406c3f0 2023-08-26T09:25:22.467 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.418+0000 7f7d317fa700 1 -- 172.21.15.92:0/3361027633 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c012430 con 0x7f7d3406c3f0 2023-08-26T09:25:22.467 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.418+0000 7f7d3ac4b700 1 -- 172.21.15.92:0/3361027633 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d340b2670 con 0x7f7d3406c3f0 2023-08-26T09:25:22.467 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.418+0000 7f7d3ac4b700 1 -- 172.21.15.92:0/3361027633 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d341fa1a0 con 0x7f7d3406c3f0 2023-08-26T09:25:22.468 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.420+0000 7f7d3ac4b700 1 -- 172.21.15.92:0/3361027633 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d140052f0 con 0x7f7d3406c3f0 2023-08-26T09:25:22.468 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.420+0000 7fe219d9b700 1 --2- 172.21.15.92:0/3050826829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe21c0ae590 0x7fe21c0c8630 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe21000c650 tx=0x7fe21000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:22.468 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.418+0000 7f278b19b700 1 -- 172.21.15.92:0/4071083076 wait complete. 2023-08-26T09:25:22.469 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.420+0000 7f278b19b700 1 Processor -- start 2023-08-26T09:25:22.469 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.418+0000 7f352ceca700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f35280ce830 0x7f35280b2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:22.469 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.418+0000 7f352ceca700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f35280ce830 0x7f35280b2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.92:33646/0 (socket says 172.21.15.92:33646) 2023-08-26T09:25:22.469 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.418+0000 7f352ceca700 1 -- 172.21.15.92:0/626902559 learned_addr learned my addr 172.21.15.92:0/626902559 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:22.470 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.420+0000 7f352ceca700 1 -- 172.21.15.92:0/626902559 >> v2:172.21.15.92:3300/0 conn(0x7f3528160ef0 msgr2=0x7f35280d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:22.470 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.420+0000 7f352ceca700 1 --2- 172.21.15.92:0/626902559 >> v2:172.21.15.92:3300/0 conn(0x7f3528160ef0 0x7f35280d1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.470 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.420+0000 7f352ceca700 1 -- 172.21.15.92:0/626902559 >> v1:172.21.15.188:6789/0 conn(0x7f3528161b40 legacy=0x7f35281612d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:22.470 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.420+0000 7f352ceca700 1 -- 172.21.15.92:0/626902559 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35280d1160 con 0x7f35280ce830 2023-08-26T09:25:22.471 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.418+0000 7f98afe28700 1 -- 172.21.15.92:0/3831058032 wait complete. 2023-08-26T09:25:22.471 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.420+0000 7f98afe28700 1 Processor -- start 2023-08-26T09:25:22.471 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.420+0000 7f440f668700 1 -- 172.21.15.92:0/140504332 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44080c5510 con 0x7f44080c6050 2023-08-26T09:25:22.471 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.420+0000 7f440d404700 1 --2- 172.21.15.92:0/140504332 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f43ec06a1b0 0x7f43ec06c670 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f43f8006fd0 tx=0x7f43f8006e40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:22.472 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.420+0000 7fe20affd700 1 -- 172.21.15.92:0/3050826829 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe210005480 con 0x7fe21c0ae590 2023-08-26T09:25:22.472 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.420+0000 7fe20affd700 1 -- 172.21.15.92:0/3050826829 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe210003680 con 0x7fe21c0ae590 2023-08-26T09:25:22.472 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.421+0000 7fe2209a4700 1 -- 172.21.15.92:0/3050826829 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe21c0c6b70 con 0x7fe21c0ae590 2023-08-26T09:25:22.472 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.421+0000 7fe2209a4700 1 -- 172.21.15.92:0/3050826829 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe21c0c7130 con 0x7fe21c0ae590 2023-08-26T09:25:22.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.420+0000 7f278b19b700 1 -- start start 2023-08-26T09:25:22.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.421+0000 7f278b19b700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f27840ce3e0 0x7f278412fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:22.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.421+0000 7f278b19b700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f27840cf140 0x7f27841fec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:22.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.421+0000 7f278b19b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2784144bd0 0x7f2784154520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:22.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.421+0000 7f278b19b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2784144460 con 0x7f2784144bd0 2023-08-26T09:25:22.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.421+0000 7f278b19b700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2784155a70 con 0x7f27840ce3e0 2023-08-26T09:25:22.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.421+0000 7f278b19b700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2784157440 con 0x7f27840cf140 2023-08-26T09:25:22.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.420+0000 7f352ceca700 1 --2- 172.21.15.92:0/626902559 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f35280ce830 0x7f35280b2ae0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f352808c9b0 tx=0x7f352000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba79323f6bc1d152 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:22.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.420+0000 7f3526ffd700 1 -- 172.21.15.92:0/626902559 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352000e070 con 0x7f35280ce830 2023-08-26T09:25:22.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.420+0000 7f3526ffd700 1 -- 172.21.15.92:0/626902559 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3520003a20 con 0x7f35280ce830 2023-08-26T09:25:22.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.420+0000 7f3526ffd700 1 -- 172.21.15.92:0/626902559 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3520003dd0 con 0x7f35280ce830 2023-08-26T09:25:22.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.421+0000 7f352e92d700 1 -- 172.21.15.92:0/626902559 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f35280ce830 msgr2=0x7f35280b2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:22.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.421+0000 7f352e92d700 1 --2- 172.21.15.92:0/626902559 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f35280ce830 0x7f35280b2ae0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f352808c9b0 tx=0x7f352000b330 comp rx=0 tx=0).stop 2023-08-26T09:25:22.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.422+0000 7f352e92d700 1 -- 172.21.15.92:0/626902559 shutdown_connections 2023-08-26T09:25:22.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.422+0000 7f352e92d700 1 --2- 172.21.15.92:0/626902559 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f35280ce830 0x7f35280b2ae0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.422+0000 7f352e92d700 1 --2- 172.21.15.92:0/626902559 >> v2:172.21.15.92:3300/0 conn(0x7f3528160ef0 0x7f35280d1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.422+0000 7f352e92d700 1 -- 172.21.15.92:0/626902559 >> 172.21.15.92:0/626902559 conn(0x7f35280d3180 msgr2=0x7f35280d3590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:22.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.422+0000 7f7d317fa700 1 -- 172.21.15.92:0/3361027633 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7d2c012590 con 0x7f7d3406c3f0 2023-08-26T09:25:22.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.422+0000 7f2788f37700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f27840ce3e0 0x7f278412fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:22.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.422+0000 7f2788f37700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f27840ce3e0 0x7f278412fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.92:33658/0 (socket says 172.21.15.92:33658) 2023-08-26T09:25:22.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.422+0000 7f2788f37700 1 -- 172.21.15.92:0/3264855804 learned_addr learned my addr 172.21.15.92:0/3264855804 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:22.478 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.422+0000 7f2783fff700 1 --2- 172.21.15.92:0/3264855804 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f27840cf140 0x7f27841fec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:22.478 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.422+0000 7f7d317fa700 1 --2- 172.21.15.92:0/3361027633 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f7d2006a130 0x7f7d2006c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:22.478 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.422+0000 7f2788f37700 1 -- 172.21.15.92:0/3264855804 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f27840cf140 msgr2=0x7f27841fec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:22.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.422+0000 7f2788f37700 1 --2- 172.21.15.92:0/3264855804 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f27840cf140 0x7f27841fec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.422+0000 7f2788f37700 1 -- 172.21.15.92:0/3264855804 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2784144bd0 msgr2=0x7f2784154520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:22.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.422+0000 7f2788f37700 1 --2- 172.21.15.92:0/3264855804 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2784144bd0 0x7f2784154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.422+0000 7f2788f37700 1 -- 172.21.15.92:0/3264855804 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f277c009b30 con 0x7f27840ce3e0 2023-08-26T09:25:22.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.422+0000 7f7d317fa700 1 -- 172.21.15.92:0/3361027633 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7d2c08a020 con 0x7f7d3406c3f0 2023-08-26T09:25:22.480 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.422+0000 7f2788f37700 1 --2- 172.21.15.92:0/3264855804 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f27840ce3e0 0x7f278412fed0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2774007fd0 tx=0x7f277400c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:22.480 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.422+0000 7fe20affd700 1 -- 172.21.15.92:0/3050826829 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe210003a10 con 0x7fe21c0ae590 2023-08-26T09:25:22.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.423+0000 7f7d33fff700 1 --2- 172.21.15.92:0/3361027633 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f7d2006a130 0x7f7d2006c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:22.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.423+0000 7fe20affd700 1 -- 172.21.15.92:0/3050826829 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe210003bb0 con 0x7fe21c0ae590 2023-08-26T09:25:22.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.423+0000 7f7d33fff700 1 --2- 172.21.15.92:0/3361027633 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f7d2006a130 0x7f7d2006c5f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7d240096d0 tx=0x7f7d24006c30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:22.482 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.423+0000 7fe20affd700 1 --2- 172.21.15.92:0/3050826829 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fe1fc06a130 0x7fe1fc06c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:22.482 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.423+0000 7fe21a59c700 1 --2- 172.21.15.92:0/3050826829 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fe1fc06a130 0x7fe1fc06c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:22.483 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.424+0000 7fe21a59c700 1 --2- 172.21.15.92:0/3050826829 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fe1fc06a130 0x7fe1fc06c5f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe20c0010e0 tx=0x7fe20c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:22.483 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.424+0000 7fe2209a4700 1 -- 172.21.15.92:0/3050826829 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2000052f0 con 0x7fe21c0ae590 2023-08-26T09:25:22.483 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.425+0000 7f98afe28700 1 -- start start 2023-08-26T09:25:22.484 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.425+0000 7fe20affd700 1 -- 172.21.15.92:0/3050826829 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe2100574f0 con 0x7fe21c0ae590 2023-08-26T09:25:22.484 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.425+0000 7f27817fa700 1 -- 172.21.15.92:0/3264855804 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2774005cb0 con 0x7f27840ce3e0 2023-08-26T09:25:22.484 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.426+0000 7f27817fa700 1 -- 172.21.15.92:0/3264855804 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2774005e10 con 0x7f27840ce3e0 2023-08-26T09:25:22.484 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.426+0000 7f27817fa700 1 -- 172.21.15.92:0/3264855804 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27740072f0 con 0x7f27840ce3e0 2023-08-26T09:25:22.485 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.426+0000 7f43fdffb700 1 -- 172.21.15.92:0/140504332 <== mon.2 v2:172.21.15.188:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4404055140 con 0x7f44080c6050 2023-08-26T09:25:22.486 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.426+0000 7f98afe28700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9894003a50 0x7f98a80cf510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:22.486 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.426+0000 7f98afe28700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f98a81ff6b0 0x7f98a813b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:22.486 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.426+0000 7f98afe28700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f98a81ffb30 0x7f98a813bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:22.486 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.426+0000 7f98afe28700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a80cfa50 con 0x7f9894003a50 2023-08-26T09:25:22.486 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.426+0000 7f98afe28700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a813a570 con 0x7f98a81ff6b0 2023-08-26T09:25:22.487 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.426+0000 7f98afe28700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98a8139960 con 0x7f98a81ffb30 2023-08-26T09:25:22.487 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.426+0000 7f98adbc4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9894003a50 0x7f98a80cf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:22.487 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.426+0000 7f98adbc4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9894003a50 0x7f98a80cf510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44856/0 (socket says 172.21.15.92:44856) 2023-08-26T09:25:22.487 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.426+0000 7f98adbc4700 1 -- 172.21.15.92:0/3376676099 learned_addr learned my addr 172.21.15.92:0/3376676099 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:22.487 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.426+0000 7f98ad3c3700 1 --2- 172.21.15.92:0/3376676099 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f98a81ff6b0 0x7f98a813b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:22.488 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.426+0000 7f98ae3c5700 1 --2- 172.21.15.92:0/3376676099 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f98a81ffb30 0x7f98a813bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:22.488 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.426+0000 7f98adbc4700 1 -- 172.21.15.92:0/3376676099 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f98a81ffb30 msgr2=0x7f98a813bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:22.488 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.426+0000 7f98adbc4700 1 --2- 172.21.15.92:0/3376676099 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f98a81ffb30 0x7f98a813bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.488 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.426+0000 7f98adbc4700 1 -- 172.21.15.92:0/3376676099 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f98a81ff6b0 msgr2=0x7f98a813b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:22.488 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.426+0000 7f98adbc4700 1 --2- 172.21.15.92:0/3376676099 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f98a81ff6b0 0x7f98a813b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.489 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.426+0000 7f98adbc4700 1 -- 172.21.15.92:0/3376676099 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a8139c40 con 0x7f9894003a50 2023-08-26T09:25:22.489 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.426+0000 7f352e92d700 1 -- 172.21.15.92:0/626902559 shutdown_connections 2023-08-26T09:25:22.489 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.426+0000 7f98adbc4700 1 --2- 172.21.15.92:0/3376676099 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9894003a50 0x7f98a80cf510 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f98a400c7d0 tx=0x7f98a4001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:22.490 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.426+0000 7f278b19b700 1 -- 172.21.15.92:0/3264855804 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2784157720 con 0x7f27840ce3e0 2023-08-26T09:25:22.490 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.427+0000 7f352e92d700 1 -- 172.21.15.92:0/626902559 wait complete. 2023-08-26T09:25:22.491 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.427+0000 7f7d317fa700 1 -- 172.21.15.92:0/3361027633 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7d2c055880 con 0x7f7d3406c3f0 2023-08-26T09:25:22.491 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.427+0000 7f278b19b700 1 -- 172.21.15.92:0/3264855804 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2784155d50 con 0x7f27840ce3e0 2023-08-26T09:25:22.491 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.428+0000 7f278b19b700 1 -- 172.21.15.92:0/3264855804 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27841572a0 con 0x7f27840ce3e0 2023-08-26T09:25:22.492 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.428+0000 7f352e92d700 1 Processor -- start 2023-08-26T09:25:22.493 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.429+0000 7f352e92d700 1 -- start start 2023-08-26T09:25:22.493 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.430+0000 7f352e92d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f35280ce830 0x7f35280b0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:22.493 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.430+0000 7f352e92d700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3528160ef0 0x7f35280cb570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:22.493 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.430+0000 7f352e92d700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3528161b40 0x7f352815c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:22.493 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.430+0000 7f352e92d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35281f7cf0 con 0x7f35280ce830 2023-08-26T09:25:22.493 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.430+0000 7f352e92d700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35281fa2f0 con 0x7f3528160ef0 2023-08-26T09:25:22.494 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.430+0000 7f352e92d700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35281fa5d0 con 0x7f3528161b40 2023-08-26T09:25:22.494 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.430+0000 7f3527fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f35280ce830 0x7f35280b0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:22.494 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.430+0000 7f3527fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f35280ce830 0x7f35280b0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44862/0 (socket says 172.21.15.92:44862) 2023-08-26T09:25:22.494 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.430+0000 7f3527fff700 1 -- 172.21.15.92:0/2203979872 learned_addr learned my addr 172.21.15.92:0/2203979872 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:22.494 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.431+0000 7f3527fff700 1 -- 172.21.15.92:0/2203979872 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3528161b40 msgr2=0x7f352815c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:22.495 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.431+0000 7f3527fff700 1 --2- 172.21.15.92:0/2203979872 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3528161b40 0x7f352815c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.495 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.431+0000 7f3527fff700 1 -- 172.21.15.92:0/2203979872 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3528160ef0 msgr2=0x7f35280cb570 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-26T09:25:22.495 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.431+0000 7f3527fff700 1 --2- 172.21.15.92:0/2203979872 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3528160ef0 0x7f35280cb570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.495 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.431+0000 7f3527fff700 1 -- 172.21.15.92:0/2203979872 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3520009b30 con 0x7f35280ce830 2023-08-26T09:25:22.495 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.431+0000 7f3527fff700 1 --2- 172.21.15.92:0/2203979872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f35280ce830 0x7f35280b0fc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f351800b480 tx=0x7f351800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:22.496 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.431+0000 7f27817fa700 1 -- 172.21.15.92:0/3264855804 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2774007450 con 0x7f27840ce3e0 2023-08-26T09:25:22.496 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.432+0000 7f27817fa700 1 --2- 172.21.15.92:0/3264855804 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f277006a0e0 0x7f277006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:22.496 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.432+0000 7f27817fa700 1 -- 172.21.15.92:0/3264855804 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2774087a70 con 0x7f27840ce3e0 2023-08-26T09:25:22.497 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.432+0000 7f2783fff700 1 --2- 172.21.15.92:0/3264855804 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f277006a0e0 0x7f277006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:22.497 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.433+0000 7f2783fff700 1 --2- 172.21.15.92:0/3264855804 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f277006a0e0 0x7f277006c5a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2784202960 tx=0x7f27780090e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:22.497 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.433+0000 7f989e7fc700 1 -- 172.21.15.92:0/3376676099 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a40072d0 con 0x7f9894003a50 2023-08-26T09:25:22.497 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.433+0000 7f27817fa700 1 -- 172.21.15.92:0/3264855804 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2774053240 con 0x7f27840ce3e0 2023-08-26T09:25:22.498 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.433+0000 7f989e7fc700 1 -- 172.21.15.92:0/3376676099 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a4007430 con 0x7f9894003a50 2023-08-26T09:25:22.498 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.433+0000 7f989e7fc700 1 -- 172.21.15.92:0/3376676099 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a40077c0 con 0x7f9894003a50 2023-08-26T09:25:22.498 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.433+0000 7f98afe28700 1 -- 172.21.15.92:0/3376676099 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98a8139f20 con 0x7f9894003a50 2023-08-26T09:25:22.499 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.433+0000 7f98afe28700 1 -- 172.21.15.92:0/3376676099 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98a813aa00 con 0x7f9894003a50 2023-08-26T09:25:22.499 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.435+0000 7f98afe28700 1 -- 172.21.15.92:0/3376676099 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98900052f0 con 0x7f9894003a50 2023-08-26T09:25:22.499 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.436+0000 7f989e7fc700 1 -- 172.21.15.92:0/3376676099 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f98a401e430 con 0x7f9894003a50 2023-08-26T09:25:22.499 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.436+0000 7f989e7fc700 1 --2- 172.21.15.92:0/3376676099 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f988c06a160 0x7f988c06c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:22.499 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.436+0000 7f989e7fc700 1 -- 172.21.15.92:0/3376676099 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f98a4089bf0 con 0x7f9894003a50 2023-08-26T09:25:22.499 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.437+0000 7f98ad3c3700 1 --2- 172.21.15.92:0/3376676099 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f988c06a160 0x7f988c06c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:22.500 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.437+0000 7f98ad3c3700 1 --2- 172.21.15.92:0/3376676099 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f988c06a160 0x7f988c06c620 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f98a81f2ae0 tx=0x7f9898009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:22.500 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.431+0000 7f5c78124700 1 Processor -- start 2023-08-26T09:25:22.500 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.431+0000 7f5c78124700 1 -- start start 2023-08-26T09:25:22.500 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.432+0000 7f5c78124700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f5c70164440 0x7f5c7006c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:22.501 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.432+0000 7f5c78124700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5c7016e0c0 0x7f5c70173d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:22.501 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.432+0000 7f5c78124700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c70071200 con 0x7f5c7006c070 2023-08-26T09:25:22.501 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.432+0000 7f5c78124700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c70164820 con 0x7f5c70164440 2023-08-26T09:25:22.501 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.432+0000 7f5c78124700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c700708d0 con 0x7f5c7016e0c0 2023-08-26T09:25:22.501 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.432+0000 7f5c75ec0700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f5c70164440 0x7f5c7006c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:22.502 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.432+0000 7f5c75ec0700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f5c70164440 0x7f5c7006c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.92:33678/0 (socket says 172.21.15.92:33678) 2023-08-26T09:25:22.502 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.433+0000 7f5c75ec0700 1 -- 172.21.15.92:0/1208283868 learned_addr learned my addr 172.21.15.92:0/1208283868 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:22.502 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.434+0000 7f5c75ec0700 1 -- 172.21.15.92:0/1208283868 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5c7016e0c0 msgr2=0x7f5c70173d40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-26T09:25:22.502 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.434+0000 7f5c75ec0700 1 --2- 172.21.15.92:0/1208283868 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5c7016e0c0 0x7f5c70173d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.502 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.434+0000 7f5c75ec0700 1 -- 172.21.15.92:0/1208283868 >> v1:172.21.15.188:6789/0 conn(0x7f5c7006c070 legacy=0x7f5c7016d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:22.503 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.434+0000 7f5c75ec0700 1 -- 172.21.15.92:0/1208283868 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c70070bb0 con 0x7f5c70164440 2023-08-26T09:25:22.503 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.435+0000 7f5c75ec0700 1 --2- 172.21.15.92:0/1208283868 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5c70164440 0x7f5c7006c8c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c0078e0 tx=0x7f5c6c007bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66836636df4b20a6 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:22.503 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.439+0000 7f5c74ebe700 1 -- 172.21.15.92:0/1208283868 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6c012890 con 0x7f5c70164440 2023-08-26T09:25:22.503 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.439+0000 7f5c74ebe700 1 -- 172.21.15.92:0/1208283868 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c6c0129f0 con 0x7f5c70164440 2023-08-26T09:25:22.503 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.439+0000 7f5c74ebe700 1 -- 172.21.15.92:0/1208283868 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6c012d80 con 0x7f5c70164440 2023-08-26T09:25:22.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.440+0000 7f5c78124700 1 -- 172.21.15.92:0/1208283868 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5c70164440 msgr2=0x7f5c7006c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:22.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.440+0000 7f5c78124700 1 --2- 172.21.15.92:0/1208283868 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5c70164440 0x7f5c7006c8c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c0078e0 tx=0x7f5c6c007bf0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.440+0000 7f5c78124700 1 -- 172.21.15.92:0/1208283868 shutdown_connections 2023-08-26T09:25:22.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.440+0000 7f5c78124700 1 --2- 172.21.15.92:0/1208283868 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5c7016e0c0 0x7f5c70173d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.440+0000 7f5c78124700 1 --2- 172.21.15.92:0/1208283868 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5c70164440 0x7f5c7006c8c0 secure :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c0078e0 tx=0x7f5c6c007bf0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.440+0000 7f5c78124700 1 -- 172.21.15.92:0/1208283868 >> 172.21.15.92:0/1208283868 conn(0x7f5c700b0880 msgr2=0x7f5c700b0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:22.505 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.441+0000 7f5c78124700 1 -- 172.21.15.92:0/1208283868 shutdown_connections 2023-08-26T09:25:22.505 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.441+0000 7f5c78124700 1 -- 172.21.15.92:0/1208283868 wait complete. 2023-08-26T09:25:22.505 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.443+0000 7f5c78124700 1 Processor -- start 2023-08-26T09:25:22.505 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.437+0000 7fe20affd700 1 -- 172.21.15.92:0/3050826829 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe210017020 con 0x7fe21c0ae590 2023-08-26T09:25:22.506 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.433+0000 7f3524ff9700 1 -- 172.21.15.92:0/2203979872 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3518005a00 con 0x7f35280ce830 2023-08-26T09:25:22.506 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.433+0000 7f3524ff9700 1 -- 172.21.15.92:0/2203979872 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3518005b60 con 0x7f35280ce830 2023-08-26T09:25:22.506 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.433+0000 7f3524ff9700 1 -- 172.21.15.92:0/2203979872 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35180116f0 con 0x7f35280ce830 2023-08-26T09:25:22.506 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.434+0000 7f352e92d700 1 -- 172.21.15.92:0/2203979872 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35281fa8b0 con 0x7f35280ce830 2023-08-26T09:25:22.507 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.434+0000 7f352e92d700 1 -- 172.21.15.92:0/2203979872 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35281fae70 con 0x7f35280ce830 2023-08-26T09:25:22.507 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.435+0000 7f352e92d700 1 -- 172.21.15.92:0/2203979872 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f352804e660 con 0x7f35280ce830 2023-08-26T09:25:22.507 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.437+0000 7f3524ff9700 1 -- 172.21.15.92:0/2203979872 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3518011850 con 0x7f35280ce830 2023-08-26T09:25:22.507 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.438+0000 7f3524ff9700 1 --2- 172.21.15.92:0/2203979872 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f351406a1b0 0x7f351406c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:22.507 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.438+0000 7f3524ff9700 1 -- 172.21.15.92:0/2203979872 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3518088a70 con 0x7f35280ce830 2023-08-26T09:25:22.508 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.438+0000 7f35277fe700 1 --2- 172.21.15.92:0/2203979872 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f351406a1b0 0x7f351406c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:22.508 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.438+0000 7f35277fe700 1 --2- 172.21.15.92:0/2203979872 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f351406a1b0 0x7f351406c670 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f35280c9720 tx=0x7f351c006be0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:22.509 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.443+0000 7f5c78124700 1 -- start start 2023-08-26T09:25:22.509 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.444+0000 7f5c78124700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c7006c070 0x7f5c70168c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:22.509 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.444+0000 7f5c78124700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5c7016e0c0 0x7f5c70208c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:22.509 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.444+0000 7f5c78124700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5c701f4490 0x7f5c70165e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:22.510 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.444+0000 7f5c78124700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c70164db0 con 0x7f5c7006c070 2023-08-26T09:25:22.510 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.444+0000 7f5c78124700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c70165090 con 0x7f5c7016e0c0 2023-08-26T09:25:22.510 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.444+0000 7f5c78124700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c70165370 con 0x7f5c701f4490 2023-08-26T09:25:22.510 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.444+0000 7f5c766c1700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5c701f4490 0x7f5c70165e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:22.510 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.444+0000 7f5c766c1700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5c701f4490 0x7f5c70165e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.92:43544/0 (socket says 172.21.15.92:43544) 2023-08-26T09:25:22.511 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.444+0000 7f5c756bf700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5c7016e0c0 0x7f5c70208c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:22.511 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.444+0000 7f5c766c1700 1 -- 172.21.15.92:0/105486901 learned_addr learned my addr 172.21.15.92:0/105486901 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:22.511 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.445+0000 7f5c756bf700 1 -- 172.21.15.92:0/105486901 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5c701f4490 msgr2=0x7f5c70165e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:22.511 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.445+0000 7f5c756bf700 1 --2- 172.21.15.92:0/105486901 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5c701f4490 0x7f5c70165e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.511 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.445+0000 7f5c756bf700 1 -- 172.21.15.92:0/105486901 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c7006c070 msgr2=0x7f5c70168c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:22.511 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.445+0000 7f5c756bf700 1 --2- 172.21.15.92:0/105486901 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c7006c070 0x7f5c70168c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.512 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.445+0000 7f5c756bf700 1 -- 172.21.15.92:0/105486901 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c6c0075c0 con 0x7f5c7016e0c0 2023-08-26T09:25:22.512 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.445+0000 7f5c756bf700 1 --2- 172.21.15.92:0/105486901 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5c7016e0c0 0x7f5c70208c00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5c60000f60 tx=0x7f5c6000c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:22.512 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.445+0000 7f5c667fc700 1 -- 172.21.15.92:0/105486901 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c600052d0 con 0x7f5c7016e0c0 2023-08-26T09:25:22.512 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.445+0000 7f5c667fc700 1 -- 172.21.15.92:0/105486901 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c60005430 con 0x7f5c7016e0c0 2023-08-26T09:25:22.512 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.445+0000 7f5c667fc700 1 -- 172.21.15.92:0/105486901 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c600038c0 con 0x7f5c7016e0c0 2023-08-26T09:25:22.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.445+0000 7f5c78124700 1 -- 172.21.15.92:0/105486901 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c70165650 con 0x7f5c7016e0c0 2023-08-26T09:25:22.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.445+0000 7f5c78124700 1 -- 172.21.15.92:0/105486901 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c70169160 con 0x7f5c7016e0c0 2023-08-26T09:25:22.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.447+0000 7f5c667fc700 1 -- 172.21.15.92:0/105486901 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5c60003a20 con 0x7f5c7016e0c0 2023-08-26T09:25:22.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.448+0000 7f5c667fc700 1 --2- 172.21.15.92:0/105486901 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f5c5c06a270 0x7f5c5c06c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:22.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.448+0000 7f5c667fc700 1 -- 172.21.15.92:0/105486901 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5c60087900 con 0x7f5c7016e0c0 2023-08-26T09:25:22.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.448+0000 7f5c75ec0700 1 --2- 172.21.15.92:0/105486901 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f5c5c06a270 0x7f5c5c06c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:22.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.449+0000 7f3524ff9700 1 -- 172.21.15.92:0/2203979872 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3518054140 con 0x7f35280ce830 2023-08-26T09:25:22.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.449+0000 7f5c78124700 1 -- 172.21.15.92:0/105486901 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c580052f0 con 0x7f5c7016e0c0 2023-08-26T09:25:22.515 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.449+0000 7f5c75ec0700 1 --2- 172.21.15.92:0/105486901 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f5c5c06a270 0x7f5c5c06c730 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5c700cfd40 tx=0x7f5c6c011000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:22.515 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.454+0000 7f5c667fc700 1 -- 172.21.15.92:0/105486901 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5c60053080 con 0x7f5c7016e0c0 2023-08-26T09:25:22.515 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.460+0000 7f989e7fc700 1 -- 172.21.15.92:0/3376676099 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f98a4055370 con 0x7f9894003a50 2023-08-26T09:25:22.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.762+0000 7fa44cef5700 1 -- 172.21.15.92:0/1926193425 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fa42c0055a0 con 0x7fa4480b3720 2023-08-26T09:25:22.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.763+0000 7fa436ffd700 1 -- 172.21.15.92:0/1926193425 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa440018030 con 0x7fa4480b3720 2023-08-26T09:25:22.771 INFO:teuthology.orchestra.run.smithi092.stdout:55834574854 2023-08-26T09:25:22.771 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.766+0000 7fa44cef5700 1 -- 172.21.15.92:0/1926193425 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa42806a180 msgr2=0x7fa42806c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:22.771 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.766+0000 7fa44cef5700 1 --2- 172.21.15.92:0/1926193425 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa42806a180 0x7fa42806c640 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa43c009b90 tx=0x7fa43c008030 comp rx=0 tx=0).stop 2023-08-26T09:25:22.772 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.766+0000 7fa44cef5700 1 -- 172.21.15.92:0/1926193425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4480b3720 msgr2=0x7fa448158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:22.772 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.766+0000 7fa44cef5700 1 --2- 172.21.15.92:0/1926193425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4480b3720 0x7fa448158110 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa440002050 tx=0x7fa44000a340 comp rx=0 tx=0).stop 2023-08-26T09:25:22.773 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.767+0000 7fa44cef5700 1 -- 172.21.15.92:0/1926193425 shutdown_connections 2023-08-26T09:25:22.773 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.767+0000 7fa44cef5700 1 --2- 172.21.15.92:0/1926193425 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa42806a180 0x7fa42806c640 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.773 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.767+0000 7fa44cef5700 1 --2- 172.21.15.92:0/1926193425 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4480b1370 0x7fa4480ced90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.773 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.767+0000 7fa44cef5700 1 --2- 172.21.15.92:0/1926193425 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa44815d430 0x7fa448158650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.774 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.767+0000 7fa44cef5700 1 --2- 172.21.15.92:0/1926193425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4480b3720 0x7fa448158110 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.774 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.767+0000 7fa44cef5700 1 -- 172.21.15.92:0/1926193425 >> 172.21.15.92:0/1926193425 conn(0x7fa4480b0880 msgr2=0x7fa4480b00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:22.774 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.767+0000 7fa44cef5700 1 -- 172.21.15.92:0/1926193425 shutdown_connections 2023-08-26T09:25:22.774 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.767+0000 7fa44cef5700 1 -- 172.21.15.92:0/1926193425 wait complete. 2023-08-26T09:25:22.791 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2023-08-26T09:25:22.791 DEBUG:teuthology.parallel:result is None 2023-08-26T09:25:22.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.815+0000 7f278b19b700 1 -- 172.21.15.92:0/3264855804 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f2784145050 con 0x7f27840ce3e0 2023-08-26T09:25:22.821 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.817+0000 7f27817fa700 1 -- 172.21.15.92:0/3264855804 <== mon.1 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2784145050 con 0x7f27840ce3e0 2023-08-26T09:25:22.824 INFO:teuthology.orchestra.run.smithi092.stdout:55834574856 2023-08-26T09:25:22.829 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.824+0000 7f278b19b700 1 -- 172.21.15.92:0/3264855804 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f277006a0e0 msgr2=0x7f277006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:22.829 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.824+0000 7f278b19b700 1 --2- 172.21.15.92:0/3264855804 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f277006a0e0 0x7f277006c5a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2784202960 tx=0x7f27780090e0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.829 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.824+0000 7f278b19b700 1 -- 172.21.15.92:0/3264855804 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f27840ce3e0 msgr2=0x7f278412fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:22.829 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.824+0000 7f278b19b700 1 --2- 172.21.15.92:0/3264855804 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f27840ce3e0 0x7f278412fed0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2774007fd0 tx=0x7f277400c9e0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.830 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.824+0000 7f278b19b700 1 -- 172.21.15.92:0/3264855804 shutdown_connections 2023-08-26T09:25:22.830 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.824+0000 7f278b19b700 1 --2- 172.21.15.92:0/3264855804 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f277006a0e0 0x7f277006c5a0 secure :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2784202960 tx=0x7f27780090e0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.830 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.824+0000 7f278b19b700 1 --2- 172.21.15.92:0/3264855804 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f27840ce3e0 0x7f278412fed0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.830 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.824+0000 7f278b19b700 1 --2- 172.21.15.92:0/3264855804 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2784144bd0 0x7f2784154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.830 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.824+0000 7f278b19b700 1 --2- 172.21.15.92:0/3264855804 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f27840cf140 0x7f27841fec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.831 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.824+0000 7f278b19b700 1 -- 172.21.15.92:0/3264855804 >> 172.21.15.92:0/3264855804 conn(0x7f278406a320 msgr2=0x7f2784163a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:22.831 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.824+0000 7f278b19b700 1 -- 172.21.15.92:0/3264855804 shutdown_connections 2023-08-26T09:25:22.831 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.824+0000 7f278b19b700 1 -- 172.21.15.92:0/3264855804 wait complete. 2023-08-26T09:25:22.832 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.824+0000 7f440f668700 1 -- 172.21.15.92:0/140504332 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f4408165500 con 0x7f44080c6050 2023-08-26T09:25:22.832 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.827+0000 7f7d3ac4b700 1 -- 172.21.15.92:0/3361027633 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f7d14005870 con 0x7f7d3406c3f0 2023-08-26T09:25:22.833 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.827+0000 7f43fdffb700 1 -- 172.21.15.92:0/140504332 <== mon.2 v2:172.21.15.188:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4404017020 con 0x7f44080c6050 2023-08-26T09:25:22.833 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.827+0000 7f7d317fa700 1 -- 172.21.15.92:0/3361027633 <== mon.1 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7d2c058ea0 con 0x7f7d3406c3f0 2023-08-26T09:25:22.833 INFO:teuthology.orchestra.run.smithi092.stdout:55834574855 2023-08-26T09:25:22.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.829+0000 7f7d3ac4b700 1 -- 172.21.15.92:0/3361027633 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f7d2006a130 msgr2=0x7f7d2006c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:22.838 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.829+0000 7f7d3ac4b700 1 --2- 172.21.15.92:0/3361027633 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f7d2006a130 0x7f7d2006c5f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7d240096d0 tx=0x7f7d24006c30 comp rx=0 tx=0).stop 2023-08-26T09:25:22.838 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.829+0000 7f7d3ac4b700 1 -- 172.21.15.92:0/3361027633 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7d3406c3f0 msgr2=0x7f7d341f9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:22.838 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.829+0000 7f7d3ac4b700 1 --2- 172.21.15.92:0/3361027633 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7d3406c3f0 0x7f7d341f9c60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c014000 tx=0x7f7d2c004ad0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.838 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.830+0000 7f7d3ac4b700 1 -- 172.21.15.92:0/3361027633 shutdown_connections 2023-08-26T09:25:22.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.830+0000 7f7d3ac4b700 1 --2- 172.21.15.92:0/3361027633 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f7d2006a130 0x7f7d2006c5f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.830+0000 7f7d3ac4b700 1 --2- 172.21.15.92:0/3361027633 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7d3406c3f0 0x7f7d341f9c60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.830+0000 7f7d3ac4b700 1 --2- 172.21.15.92:0/3361027633 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7d340cb170 0x7f7d34152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.830+0000 7f7d3ac4b700 1 --2- 172.21.15.92:0/3361027633 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d340cad90 0x7f7d340b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.830+0000 7f7d3ac4b700 1 -- 172.21.15.92:0/3361027633 >> 172.21.15.92:0/3361027633 conn(0x7f7d3406a320 msgr2=0x7f7d340ae7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:22.840 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.830+0000 7f7d3ac4b700 1 -- 172.21.15.92:0/3361027633 shutdown_connections 2023-08-26T09:25:22.840 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.830+0000 7f7d3ac4b700 1 -- 172.21.15.92:0/3361027633 wait complete. 2023-08-26T09:25:22.840 INFO:teuthology.orchestra.run.smithi092.stdout:55834574854 2023-08-26T09:25:22.846 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.841+0000 7f440f668700 1 -- 172.21.15.92:0/140504332 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f43ec06a1b0 msgr2=0x7f43ec06c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:22.846 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.841+0000 7f440f668700 1 --2- 172.21.15.92:0/140504332 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f43ec06a1b0 0x7f43ec06c670 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f43f8006fd0 tx=0x7f43f8006e40 comp rx=0 tx=0).stop 2023-08-26T09:25:22.846 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.841+0000 7f440f668700 1 -- 172.21.15.92:0/140504332 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44080c6050 msgr2=0x7f440814e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:22.847 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.841+0000 7f440f668700 1 --2- 172.21.15.92:0/140504332 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44080c6050 0x7f440814e5d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4404016000 tx=0x7f44040047c0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.847 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.841+0000 7f440f668700 1 -- 172.21.15.92:0/140504332 shutdown_connections 2023-08-26T09:25:22.847 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.841+0000 7f440f668700 1 --2- 172.21.15.92:0/140504332 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f43ec06a1b0 0x7f43ec06c670 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.847 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.841+0000 7f440f668700 1 --2- 172.21.15.92:0/140504332 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f440814eb10 0x7f440815d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.848 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.841+0000 7f440f668700 1 --2- 172.21.15.92:0/140504332 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43f40043f0 0x7f44080c44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.848 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.841+0000 7f440f668700 1 --2- 172.21.15.92:0/140504332 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44080c6050 0x7f440814e5d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.848 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.841+0000 7f440f668700 1 -- 172.21.15.92:0/140504332 >> 172.21.15.92:0/140504332 conn(0x7f44080cc790 msgr2=0x7f4408161e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:22.848 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.841+0000 7f440f668700 1 -- 172.21.15.92:0/140504332 shutdown_connections 2023-08-26T09:25:22.849 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.841+0000 7f440f668700 1 -- 172.21.15.92:0/140504332 wait complete. 2023-08-26T09:25:22.850 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2023-08-26T09:25:22.851 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.844+0000 7fe2209a4700 1 -- 172.21.15.92:0/3050826829 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe2000055a0 con 0x7fe21c0ae590 2023-08-26T09:25:22.852 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.844+0000 7fe20affd700 1 -- 172.21.15.92:0/3050826829 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe2100531a0 con 0x7fe21c0ae590 2023-08-26T09:25:22.852 DEBUG:teuthology.parallel:result is None 2023-08-26T09:25:22.853 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.4 2023-08-26T09:25:22.853 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.847+0000 7f352e92d700 1 -- 172.21.15.92:0/2203979872 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f35280b28c0 con 0x7f35280ce830 2023-08-26T09:25:22.854 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.847+0000 7f3524ff9700 1 -- 172.21.15.92:0/2203979872 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3518057760 con 0x7f35280ce830 2023-08-26T09:25:22.854 DEBUG:teuthology.parallel:result is None 2023-08-26T09:25:22.854 INFO:teuthology.orchestra.run.smithi092.stdout:55834574854 2023-08-26T09:25:22.855 INFO:teuthology.orchestra.run.smithi092.stdout:55834574854 2023-08-26T09:25:22.855 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.850+0000 7f352e92d700 1 -- 172.21.15.92:0/2203979872 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f351406a1b0 msgr2=0x7f351406c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:22.855 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.850+0000 7f352e92d700 1 --2- 172.21.15.92:0/2203979872 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f351406a1b0 0x7f351406c670 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f35280c9720 tx=0x7f351c006be0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.856 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.850+0000 7f352e92d700 1 -- 172.21.15.92:0/2203979872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f35280ce830 msgr2=0x7f35280b0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:22.856 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.850+0000 7f352e92d700 1 --2- 172.21.15.92:0/2203979872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f35280ce830 0x7f35280b0fc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f351800b480 tx=0x7f351800b840 comp rx=0 tx=0).stop 2023-08-26T09:25:22.856 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.850+0000 7fe2209a4700 1 -- 172.21.15.92:0/3050826829 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fe1fc06a130 msgr2=0x7fe1fc06c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:22.856 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.850+0000 7fe2209a4700 1 --2- 172.21.15.92:0/3050826829 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fe1fc06a130 0x7fe1fc06c5f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe20c0010e0 tx=0x7fe20c009040 comp rx=0 tx=0).stop 2023-08-26T09:25:22.857 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.850+0000 7fe2209a4700 1 -- 172.21.15.92:0/3050826829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe21c0ae590 msgr2=0x7fe21c0c8630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:22.857 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.851+0000 7f352e92d700 1 -- 172.21.15.92:0/2203979872 shutdown_connections 2023-08-26T09:25:22.857 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.851+0000 7f352e92d700 1 --2- 172.21.15.92:0/2203979872 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3528161b40 0x7f352815c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.858 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.850+0000 7fe2209a4700 1 --2- 172.21.15.92:0/3050826829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe21c0ae590 0x7fe21c0c8630 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe21000c650 tx=0x7fe21000ca10 comp rx=0 tx=0).stop 2023-08-26T09:25:22.858 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.851+0000 7fe2209a4700 1 -- 172.21.15.92:0/3050826829 shutdown_connections 2023-08-26T09:25:22.858 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.851+0000 7fe2209a4700 1 --2- 172.21.15.92:0/3050826829 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fe1fc06a130 0x7fe1fc06c5f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.858 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.851+0000 7fe2209a4700 1 --2- 172.21.15.92:0/3050826829 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe21c06b450 0x7fe21c098ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.859 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.851+0000 7f352e92d700 1 --2- 172.21.15.92:0/2203979872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f35280ce830 0x7f35280b0fc0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.859 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.851+0000 7f352e92d700 1 --2- 172.21.15.92:0/2203979872 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f351406a1b0 0x7f351406c670 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.859 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.851+0000 7f352e92d700 1 --2- 172.21.15.92:0/2203979872 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3528160ef0 0x7f35280cb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.859 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.851+0000 7f352e92d700 1 -- 172.21.15.92:0/2203979872 >> 172.21.15.92:0/2203979872 conn(0x7f35280d3180 msgr2=0x7f35280b2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:22.860 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.851+0000 7fe2209a4700 1 --2- 172.21.15.92:0/3050826829 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe21c0cb640 0x7fe21c0cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.860 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.851+0000 7fe2209a4700 1 --2- 172.21.15.92:0/3050826829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe21c0ae590 0x7fe21c0c8630 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.861 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.851+0000 7fe2209a4700 1 -- 172.21.15.92:0/3050826829 >> 172.21.15.92:0/3050826829 conn(0x7fe21c0b23c0 msgr2=0x7fe21c0ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:22.861 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.851+0000 7f352e92d700 1 -- 172.21.15.92:0/2203979872 shutdown_connections 2023-08-26T09:25:22.861 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.851+0000 7fe2209a4700 1 -- 172.21.15.92:0/3050826829 shutdown_connections 2023-08-26T09:25:22.862 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.851+0000 7f352e92d700 1 -- 172.21.15.92:0/2203979872 wait complete. 2023-08-26T09:25:22.862 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.851+0000 7fe2209a4700 1 -- 172.21.15.92:0/3050826829 wait complete. 2023-08-26T09:25:22.863 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.856+0000 7f5c78124700 1 -- 172.21.15.92:0/105486901 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5c58005870 con 0x7f5c7016e0c0 2023-08-26T09:25:22.863 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.857+0000 7f5c667fc700 1 -- 172.21.15.92:0/105486901 <== mon.1 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5c60017030 con 0x7f5c7016e0c0 2023-08-26T09:25:22.863 INFO:teuthology.orchestra.run.smithi092.stdout:55834574854 2023-08-26T09:25:22.866 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.860+0000 7f5c78124700 1 -- 172.21.15.92:0/105486901 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f5c5c06a270 msgr2=0x7f5c5c06c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:22.866 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.860+0000 7f5c78124700 1 --2- 172.21.15.92:0/105486901 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f5c5c06a270 0x7f5c5c06c730 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5c700cfd40 tx=0x7f5c6c011000 comp rx=0 tx=0).stop 2023-08-26T09:25:22.866 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.860+0000 7f5c78124700 1 -- 172.21.15.92:0/105486901 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5c7016e0c0 msgr2=0x7f5c70208c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:22.866 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.860+0000 7f5c78124700 1 --2- 172.21.15.92:0/105486901 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5c7016e0c0 0x7f5c70208c00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5c60000f60 tx=0x7f5c6000c7e0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.866 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.860+0000 7f5c78124700 1 -- 172.21.15.92:0/105486901 shutdown_connections 2023-08-26T09:25:22.867 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.861+0000 7f5c78124700 1 --2- 172.21.15.92:0/105486901 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5c701f4490 0x7f5c70165e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.867 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.861+0000 7f5c78124700 1 --2- 172.21.15.92:0/105486901 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c7006c070 0x7f5c70168c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.867 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.861+0000 7f5c78124700 1 --2- 172.21.15.92:0/105486901 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f5c5c06a270 0x7f5c5c06c730 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.867 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.861+0000 7f5c78124700 1 --2- 172.21.15.92:0/105486901 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5c7016e0c0 0x7f5c70208c00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.868 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.861+0000 7f5c78124700 1 -- 172.21.15.92:0/105486901 >> 172.21.15.92:0/105486901 conn(0x7f5c700b0880 msgr2=0x7f5c700b2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:22.868 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.861+0000 7f5c78124700 1 -- 172.21.15.92:0/105486901 shutdown_connections 2023-08-26T09:25:22.868 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.861+0000 7f5c78124700 1 -- 172.21.15.92:0/105486901 wait complete. 2023-08-26T09:25:22.870 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2023-08-26T09:25:22.871 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.865+0000 7f98afe28700 1 -- 172.21.15.92:0/3376676099 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9890005870 con 0x7f9894003a50 2023-08-26T09:25:22.871 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.865+0000 7f989e7fc700 1 -- 172.21.15.92:0/3376676099 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f98a4017020 con 0x7f9894003a50 2023-08-26T09:25:22.872 DEBUG:teuthology.parallel:result is None 2023-08-26T09:25:22.872 INFO:teuthology.orchestra.run.smithi092.stdout:55834574855 2023-08-26T09:25:22.873 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2023-08-26T09:25:22.874 DEBUG:teuthology.parallel:result is None 2023-08-26T09:25:22.874 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.867+0000 7f98afe28700 1 -- 172.21.15.92:0/3376676099 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f988c06a160 msgr2=0x7f988c06c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:22.875 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.867+0000 7f98afe28700 1 --2- 172.21.15.92:0/3376676099 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f988c06a160 0x7f988c06c620 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f98a81f2ae0 tx=0x7f9898009040 comp rx=0 tx=0).stop 2023-08-26T09:25:22.875 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.867+0000 7f98afe28700 1 -- 172.21.15.92:0/3376676099 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9894003a50 msgr2=0x7f98a80cf510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:22.875 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.867+0000 7f98afe28700 1 --2- 172.21.15.92:0/3376676099 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9894003a50 0x7f98a80cf510 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f98a400c7d0 tx=0x7f98a4001970 comp rx=0 tx=0).stop 2023-08-26T09:25:22.875 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.867+0000 7f98afe28700 1 -- 172.21.15.92:0/3376676099 shutdown_connections 2023-08-26T09:25:22.876 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.867+0000 7f98afe28700 1 --2- 172.21.15.92:0/3376676099 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f98a81ffb30 0x7f98a813bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.876 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.867+0000 7f98afe28700 1 --2- 172.21.15.92:0/3376676099 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9894003a50 0x7f98a80cf510 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.876 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.867+0000 7f98afe28700 1 --2- 172.21.15.92:0/3376676099 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f988c06a160 0x7f988c06c620 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.876 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.867+0000 7f98afe28700 1 --2- 172.21.15.92:0/3376676099 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f98a81ff6b0 0x7f98a813b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:22.877 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.867+0000 7f98afe28700 1 -- 172.21.15.92:0/3376676099 >> 172.21.15.92:0/3376676099 conn(0x7f98a80b0880 msgr2=0x7f98a80affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:22.877 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.868+0000 7f98afe28700 1 -- 172.21.15.92:0/3376676099 shutdown_connections 2023-08-26T09:25:22.877 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:22.868+0000 7f98afe28700 1 -- 172.21.15.92:0/3376676099 wait complete. 2023-08-26T09:25:22.878 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2023-08-26T09:25:22.878 DEBUG:teuthology.parallel:result is None 2023-08-26T09:25:22.883 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2023-08-26T09:25:22.884 DEBUG:teuthology.parallel:result is None 2023-08-26T09:25:22.886 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2023-08-26T09:25:22.886 DEBUG:teuthology.parallel:result is None 2023-08-26T09:25:22.886 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-08-26T09:25:22.887 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-26T09:25:23.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.042+0000 7f6e322ab700 1 Processor -- start 2023-08-26T09:25:23.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.042+0000 7f6e322ab700 1 -- start start 2023-08-26T09:25:23.050 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.043+0000 7f6e322ab700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6e2c15a090 0x7f6e2c0cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:23.050 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.043+0000 7f6e322ab700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e2c0cf7e0 con 0x7f6e2c06f4e0 2023-08-26T09:25:23.050 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.043+0000 7f6e322ab700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e2c0caec0 con 0x7f6e2c0cb8e0 2023-08-26T09:25:23.050 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.043+0000 7f6e322ab700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2c0cb160 con 0x7f6e2c15a090 2023-08-26T09:25:23.051 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.043+0000 7f6e2b7fe700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f6e2c06f4e0 0x7f6e2c0cd900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:56900/0 (socket says 172.21.15.92:56900) 2023-08-26T09:25:23.051 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.043+0000 7f6e2b7fe700 1 -- 172.21.15.92:0/1118438915 learned_addr learned my addr 172.21.15.92:0/1118438915 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:23.051 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.043+0000 7f6e2bfff700 1 --2- 172.21.15.92:0/1118438915 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6e2c15a090 0x7f6e2c0cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:23.051 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.043+0000 7f6e2affd700 1 -- 172.21.15.92:0/1118438915 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4014563561 0 0) 0x7f6e2c0cf7e0 con 0x7f6e2c06f4e0 2023-08-26T09:25:23.051 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.043+0000 7f6e2affd700 1 -- 172.21.15.92:0/1118438915 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e140035b0 con 0x7f6e2c06f4e0 2023-08-26T09:25:23.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.043+0000 7f6e2affd700 1 -- 172.21.15.92:0/1118438915 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 18645401 0 0) 0x7f6e2c0caec0 con 0x7f6e2c0cb8e0 2023-08-26T09:25:23.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.043+0000 7f6e2affd700 1 -- 172.21.15.92:0/1118438915 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e2c0cf7e0 con 0x7f6e2c0cb8e0 2023-08-26T09:25:23.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.043+0000 7f6e2affd700 1 -- 172.21.15.92:0/1118438915 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3243075069 0 0) 0x7f6e140035b0 con 0x7f6e2c06f4e0 2023-08-26T09:25:23.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.043+0000 7f6e2bfff700 1 -- 172.21.15.92:0/1118438915 >> v1:172.21.15.188:6789/0 conn(0x7f6e2c0cb8e0 legacy=0x7f6e2c06e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:23.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.043+0000 7f6e2bfff700 1 -- 172.21.15.92:0/1118438915 >> v1:172.21.15.92:6789/0 conn(0x7f6e2c06f4e0 legacy=0x7f6e2c0cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:23.053 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.043+0000 7f6e2bfff700 1 -- 172.21.15.92:0/1118438915 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e2c0cb440 con 0x7f6e2c15a090 2023-08-26T09:25:23.053 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.044+0000 7f6e2bfff700 1 --2- 172.21.15.92:0/1118438915 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6e2c15a090 0x7f6e2c0cd2d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c009870 tx=0x7f6e1c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5838d3da95109d6 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:23.053 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.044+0000 7f6e2affd700 1 -- 172.21.15.92:0/1118438915 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e200015f0 con 0x7f6e2c15a090 2023-08-26T09:25:23.053 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.044+0000 7f6e2affd700 1 -- 172.21.15.92:0/1118438915 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e1c004030 con 0x7f6e2c15a090 2023-08-26T09:25:23.053 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.044+0000 7f6e2affd700 1 -- 172.21.15.92:0/1118438915 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c0043c0 con 0x7f6e2c15a090 2023-08-26T09:25:23.054 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.044+0000 7f6e322ab700 1 -- 172.21.15.92:0/1118438915 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6e2c15a090 msgr2=0x7f6e2c0cd2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:23.054 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.044+0000 7f6e322ab700 1 --2- 172.21.15.92:0/1118438915 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6e2c15a090 0x7f6e2c0cd2d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c009870 tx=0x7f6e1c009b80 comp rx=0 tx=0).stop 2023-08-26T09:25:23.054 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.044+0000 7f6e322ab700 1 -- 172.21.15.92:0/1118438915 shutdown_connections 2023-08-26T09:25:23.054 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.044+0000 7f6e322ab700 1 --2- 172.21.15.92:0/1118438915 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6e2c15a090 0x7f6e2c0cd2d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:23.056 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.044+0000 7f6e322ab700 1 -- 172.21.15.92:0/1118438915 >> 172.21.15.92:0/1118438915 conn(0x7f6e2c0cc7b0 msgr2=0x7f6e2c0ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:23.056 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.044+0000 7f6e322ab700 1 -- 172.21.15.92:0/1118438915 shutdown_connections 2023-08-26T09:25:23.056 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.044+0000 7f6e322ab700 1 -- 172.21.15.92:0/1118438915 wait complete. 2023-08-26T09:25:23.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.046+0000 7f6e322ab700 1 Processor -- start 2023-08-26T09:25:23.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.046+0000 7f6e322ab700 1 -- start start 2023-08-26T09:25:23.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.046+0000 7f6e322ab700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6e2c06f4e0 0x7f6e2c15c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:23.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.046+0000 7f6e322ab700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e2c0cb8e0 0x7f6e2c14e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:23.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.046+0000 7f6e322ab700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6e2c15a090 0x7f6e2c0c90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:23.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.046+0000 7f6e322ab700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2c15bc20 con 0x7f6e2c0cb8e0 2023-08-26T09:25:23.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.046+0000 7f6e322ab700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2c15afa0 con 0x7f6e2c06f4e0 2023-08-26T09:25:23.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.046+0000 7f6e322ab700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2c15b280 con 0x7f6e2c15a090 2023-08-26T09:25:23.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.047+0000 7f6e2b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e2c0cb8e0 0x7f6e2c14e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:23.061 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.047+0000 7f6e2b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e2c0cb8e0 0x7f6e2c14e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44892/0 (socket says 172.21.15.92:44892) 2023-08-26T09:25:23.061 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.047+0000 7f6e2b7fe700 1 -- 172.21.15.92:0/2460079693 learned_addr learned my addr 172.21.15.92:0/2460079693 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:23.061 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.047+0000 7f6e2bfff700 1 --2- 172.21.15.92:0/2460079693 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6e2c06f4e0 0x7f6e2c15c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:23.061 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.047+0000 7f6e30848700 1 --2- 172.21.15.92:0/2460079693 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6e2c15a090 0x7f6e2c0c90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:23.061 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.047+0000 7f6e2b7fe700 1 -- 172.21.15.92:0/2460079693 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6e2c15a090 msgr2=0x7f6e2c0c90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:23.062 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.047+0000 7f6e2b7fe700 1 --2- 172.21.15.92:0/2460079693 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6e2c15a090 0x7f6e2c0c90f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:23.062 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.047+0000 7f6e2b7fe700 1 -- 172.21.15.92:0/2460079693 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6e2c06f4e0 msgr2=0x7f6e2c15c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:23.062 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.047+0000 7f6e2b7fe700 1 --2- 172.21.15.92:0/2460079693 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6e2c06f4e0 0x7f6e2c15c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:23.062 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.047+0000 7f6e2b7fe700 1 -- 172.21.15.92:0/2460079693 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e1c0094a0 con 0x7f6e2c0cb8e0 2023-08-26T09:25:23.062 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.047+0000 7f6e2b7fe700 1 --2- 172.21.15.92:0/2460079693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e2c0cb8e0 0x7f6e2c14e390 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6e2000c700 tx=0x7f6e2000cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:23.063 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.047+0000 7f6e28ff9700 1 -- 172.21.15.92:0/2460079693 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e20004c80 con 0x7f6e2c0cb8e0 2023-08-26T09:25:23.063 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.047+0000 7f6e28ff9700 1 -- 172.21.15.92:0/2460079693 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e20004e00 con 0x7f6e2c0cb8e0 2023-08-26T09:25:23.063 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.047+0000 7f6e322ab700 1 -- 172.21.15.92:0/2460079693 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e2c15b560 con 0x7f6e2c0cb8e0 2023-08-26T09:25:23.064 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.047+0000 7f6e28ff9700 1 -- 172.21.15.92:0/2460079693 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e20007310 con 0x7f6e2c0cb8e0 2023-08-26T09:25:23.064 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.047+0000 7f6e322ab700 1 -- 172.21.15.92:0/2460079693 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e2c14e8d0 con 0x7f6e2c0cb8e0 2023-08-26T09:25:23.064 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.048+0000 7f6e322ab700 1 -- 172.21.15.92:0/2460079693 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e2c15bd60 con 0x7f6e2c0cb8e0 2023-08-26T09:25:23.064 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.048+0000 7f6e28ff9700 1 -- 172.21.15.92:0/2460079693 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6e20007470 con 0x7f6e2c0cb8e0 2023-08-26T09:25:23.064 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.049+0000 7f6e28ff9700 1 --2- 172.21.15.92:0/2460079693 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f6e1806a0e0 0x7f6e1806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:23.065 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.049+0000 7f6e28ff9700 1 -- 172.21.15.92:0/2460079693 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6e20088300 con 0x7f6e2c0cb8e0 2023-08-26T09:25:23.065 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.049+0000 7f6e2bfff700 1 --2- 172.21.15.92:0/2460079693 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f6e1806a0e0 0x7f6e1806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:23.065 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.049+0000 7f6e2bfff700 1 --2- 172.21.15.92:0/2460079693 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f6e1806a0e0 0x7f6e1806c5a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c000c00 tx=0x7f6e1c013040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:23.065 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.053+0000 7f6e28ff9700 1 -- 172.21.15.92:0/2460079693 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f6e2c15bd60 con 0x7f6e2c0cb8e0 2023-08-26T09:25:23.247 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.242+0000 7f6e322ab700 1 -- 172.21.15.92:0/2460079693 --> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6e2c15a470 con 0x7f6e1806a0e0 2023-08-26T09:25:23.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.249+0000 7f6e28ff9700 1 -- 172.21.15.92:0/2460079693 <== mgr.4107 v2:172.21.15.92:6832/1988454907 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286849 (secure 0 0 0) 0x7f6e1c004570 con 0x7f6e1806a0e0 2023-08-26T09:25:23.258 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:25:23.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.252+0000 7f6e322ab700 1 -- 172.21.15.92:0/2460079693 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f6e1806a0e0 msgr2=0x7f6e1806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:23.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.252+0000 7f6e322ab700 1 --2- 172.21.15.92:0/2460079693 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f6e1806a0e0 0x7f6e1806c5a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c000c00 tx=0x7f6e1c013040 comp rx=0 tx=0).stop 2023-08-26T09:25:23.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.252+0000 7f6e322ab700 1 -- 172.21.15.92:0/2460079693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e2c0cb8e0 msgr2=0x7f6e2c14e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:23.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.252+0000 7f6e322ab700 1 --2- 172.21.15.92:0/2460079693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e2c0cb8e0 0x7f6e2c14e390 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6e2000c700 tx=0x7f6e2000cac0 comp rx=0 tx=0).stop 2023-08-26T09:25:23.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.253+0000 7f6e322ab700 1 -- 172.21.15.92:0/2460079693 shutdown_connections 2023-08-26T09:25:23.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.253+0000 7f6e322ab700 1 --2- 172.21.15.92:0/2460079693 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f6e1806a0e0 0x7f6e1806c5a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:23.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.253+0000 7f6e322ab700 1 --2- 172.21.15.92:0/2460079693 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6e2c06f4e0 0x7f6e2c15c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:23.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.253+0000 7f6e322ab700 1 --2- 172.21.15.92:0/2460079693 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6e2c15a090 0x7f6e2c0c90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:23.262 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.253+0000 7f6e322ab700 1 --2- 172.21.15.92:0/2460079693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e2c0cb8e0 0x7f6e2c14e390 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:23.262 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.253+0000 7f6e322ab700 1 -- 172.21.15.92:0/2460079693 >> 172.21.15.92:0/2460079693 conn(0x7f6e2c0cc7b0 msgr2=0x7f6e2c0c52a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:23.262 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.253+0000 7f6e322ab700 1 -- 172.21.15.92:0/2460079693 shutdown_connections 2023-08-26T09:25:23.262 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.253+0000 7f6e322ab700 1 -- 172.21.15.92:0/2460079693 wait complete. 2023-08-26T09:25:23.263 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2023-08-26T09:25:23.270 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-08-26T09:25:22.940028+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219032,"kb_used_data":2816,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755688,"statfs":{"total":773094113280,"available":772869824512,"internally_reserved":0,"allocated":2883584,"data_stored":1778258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.487379"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912486+0000","last_change":"2023-08-26T09:25:14.464286+0000","last_active":"2023-08-26T09:25:15.912486+0000","last_peered":"2023-08-26T09:25:15.912486+0000","last_clean":"2023-08-26T09:25:15.912486+0000","last_became_active":"2023-08-26T09:25:14.463990+0000","last_became_peered":"2023-08-26T09:25:14.463990+0000","last_unstale":"2023-08-26T09:25:15.912486+0000","last_undegraded":"2023-08-26T09:25:15.912486+0000","last_fullsized":"2023-08-26T09:25:15.912486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T10:28:24.469066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912986+0000","last_change":"2023-08-26T09:25:14.478324+0000","last_active":"2023-08-26T09:25:15.912986+0000","last_peered":"2023-08-26T09:25:15.912986+0000","last_clean":"2023-08-26T09:25:15.912986+0000","last_became_active":"2023-08-26T09:25:14.477999+0000","last_became_peered":"2023-08-26T09:25:14.477999+0000","last_unstale":"2023-08-26T09:25:15.912986+0000","last_undegraded":"2023-08-26T09:25:15.912986+0000","last_fullsized":"2023-08-26T09:25:15.912986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:40:12.427554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456847+0000","last_change":"2023-08-26T09:25:14.480250+0000","last_active":"2023-08-26T09:25:15.456847+0000","last_peered":"2023-08-26T09:25:15.456847+0000","last_clean":"2023-08-26T09:25:15.456847+0000","last_became_active":"2023-08-26T09:25:14.478388+0000","last_became_peered":"2023-08-26T09:25:14.478388+0000","last_unstale":"2023-08-26T09:25:15.456847+0000","last_undegraded":"2023-08-26T09:25:15.456847+0000","last_fullsized":"2023-08-26T09:25:15.456847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:47:09.883784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914035+0000","last_change":"2023-08-26T09:25:14.465651+0000","last_active":"2023-08-26T09:25:15.914035+0000","last_peered":"2023-08-26T09:25:15.914035+0000","last_clean":"2023-08-26T09:25:15.914035+0000","last_became_active":"2023-08-26T09:25:14.465256+0000","last_became_peered":"2023-08-26T09:25:14.465256+0000","last_unstale":"2023-08-26T09:25:15.914035+0000","last_undegraded":"2023-08-26T09:25:15.914035+0000","last_fullsized":"2023-08-26T09:25:15.914035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T12:36:01.054979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912897+0000","last_change":"2023-08-26T09:25:14.464842+0000","last_active":"2023-08-26T09:25:15.912897+0000","last_peered":"2023-08-26T09:25:15.912897+0000","last_clean":"2023-08-26T09:25:15.912897+0000","last_became_active":"2023-08-26T09:25:14.464583+0000","last_became_peered":"2023-08-26T09:25:14.464583+0000","last_unstale":"2023-08-26T09:25:15.912897+0000","last_undegraded":"2023-08-26T09:25:15.912897+0000","last_fullsized":"2023-08-26T09:25:15.912897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:40:12.427554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456323+0000","last_change":"2023-08-26T09:25:14.477270+0000","last_active":"2023-08-26T09:25:15.456323+0000","last_peered":"2023-08-26T09:25:15.456323+0000","last_clean":"2023-08-26T09:25:15.456323+0000","last_became_active":"2023-08-26T09:25:14.476947+0000","last_became_peered":"2023-08-26T09:25:14.476947+0000","last_unstale":"2023-08-26T09:25:15.456323+0000","last_undegraded":"2023-08-26T09:25:15.456323+0000","last_fullsized":"2023-08-26T09:25:15.456323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:57:39.300454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914251+0000","last_change":"2023-08-26T09:25:14.481184+0000","last_active":"2023-08-26T09:25:15.914251+0000","last_peered":"2023-08-26T09:25:15.914251+0000","last_clean":"2023-08-26T09:25:15.914251+0000","last_became_active":"2023-08-26T09:25:14.480546+0000","last_became_peered":"2023-08-26T09:25:14.480546+0000","last_unstale":"2023-08-26T09:25:15.914251+0000","last_undegraded":"2023-08-26T09:25:15.914251+0000","last_fullsized":"2023-08-26T09:25:15.914251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T12:08:55.397933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912826+0000","last_change":"2023-08-26T09:25:14.476072+0000","last_active":"2023-08-26T09:25:15.912826+0000","last_peered":"2023-08-26T09:25:15.912826+0000","last_clean":"2023-08-26T09:25:15.912826+0000","last_became_active":"2023-08-26T09:25:14.475757+0000","last_became_peered":"2023-08-26T09:25:14.475757+0000","last_unstale":"2023-08-26T09:25:15.912826+0000","last_undegraded":"2023-08-26T09:25:15.912826+0000","last_fullsized":"2023-08-26T09:25:15.912826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:35:42.200335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912764+0000","last_change":"2023-08-26T09:25:14.465769+0000","last_active":"2023-08-26T09:25:15.912764+0000","last_peered":"2023-08-26T09:25:15.912764+0000","last_clean":"2023-08-26T09:25:15.912764+0000","last_became_active":"2023-08-26T09:25:14.465320+0000","last_became_peered":"2023-08-26T09:25:14.465320+0000","last_unstale":"2023-08-26T09:25:15.912764+0000","last_undegraded":"2023-08-26T09:25:15.912764+0000","last_fullsized":"2023-08-26T09:25:15.912764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:35:42.200335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.913305+0000","last_change":"2023-08-26T09:25:14.474303+0000","last_active":"2023-08-26T09:25:15.913305+0000","last_peered":"2023-08-26T09:25:15.913305+0000","last_clean":"2023-08-26T09:25:15.913305+0000","last_became_active":"2023-08-26T09:25:14.474007+0000","last_became_peered":"2023-08-26T09:25:14.474007+0000","last_unstale":"2023-08-26T09:25:15.913305+0000","last_undegraded":"2023-08-26T09:25:15.913305+0000","last_fullsized":"2023-08-26T09:25:15.913305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:08:30.313992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456892+0000","last_change":"2023-08-26T09:25:14.481555+0000","last_active":"2023-08-26T09:25:15.456892+0000","last_peered":"2023-08-26T09:25:15.456892+0000","last_clean":"2023-08-26T09:25:15.456892+0000","last_became_active":"2023-08-26T09:25:14.481266+0000","last_became_peered":"2023-08-26T09:25:14.481266+0000","last_unstale":"2023-08-26T09:25:15.456892+0000","last_undegraded":"2023-08-26T09:25:15.456892+0000","last_fullsized":"2023-08-26T09:25:15.456892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T16:56:24.503758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912603+0000","last_change":"2023-08-26T09:25:14.483240+0000","last_active":"2023-08-26T09:25:15.912603+0000","last_peered":"2023-08-26T09:25:15.912603+0000","last_clean":"2023-08-26T09:25:15.912603+0000","last_became_active":"2023-08-26T09:25:14.482944+0000","last_became_peered":"2023-08-26T09:25:14.482944+0000","last_unstale":"2023-08-26T09:25:15.912603+0000","last_undegraded":"2023-08-26T09:25:15.912603+0000","last_fullsized":"2023-08-26T09:25:15.912603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T19:09:52.055178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912575+0000","last_change":"2023-08-26T09:25:14.467043+0000","last_active":"2023-08-26T09:25:15.912575+0000","last_peered":"2023-08-26T09:25:15.912575+0000","last_clean":"2023-08-26T09:25:15.912575+0000","last_became_active":"2023-08-26T09:25:14.466612+0000","last_became_peered":"2023-08-26T09:25:14.466612+0000","last_unstale":"2023-08-26T09:25:15.912575+0000","last_undegraded":"2023-08-26T09:25:15.912575+0000","last_fullsized":"2023-08-26T09:25:15.912575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T13:47:16.562890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.913110+0000","last_change":"2023-08-26T09:25:14.475578+0000","last_active":"2023-08-26T09:25:15.913110+0000","last_peered":"2023-08-26T09:25:15.913110+0000","last_clean":"2023-08-26T09:25:15.913110+0000","last_became_active":"2023-08-26T09:25:14.475270+0000","last_became_peered":"2023-08-26T09:25:14.475270+0000","last_unstale":"2023-08-26T09:25:15.913110+0000","last_undegraded":"2023-08-26T09:25:15.913110+0000","last_fullsized":"2023-08-26T09:25:15.913110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:39:35.210853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914404+0000","last_change":"2023-08-26T09:25:14.481338+0000","last_active":"2023-08-26T09:25:15.914404+0000","last_peered":"2023-08-26T09:25:15.914404+0000","last_clean":"2023-08-26T09:25:15.914404+0000","last_became_active":"2023-08-26T09:25:14.480937+0000","last_became_peered":"2023-08-26T09:25:14.480937+0000","last_unstale":"2023-08-26T09:25:15.914404+0000","last_undegraded":"2023-08-26T09:25:15.914404+0000","last_fullsized":"2023-08-26T09:25:15.914404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T10:30:08.408755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456272+0000","last_change":"2023-08-26T09:25:14.478860+0000","last_active":"2023-08-26T09:25:15.456272+0000","last_peered":"2023-08-26T09:25:15.456272+0000","last_clean":"2023-08-26T09:25:15.456272+0000","last_became_active":"2023-08-26T09:25:14.475252+0000","last_became_peered":"2023-08-26T09:25:14.475252+0000","last_unstale":"2023-08-26T09:25:15.456272+0000","last_undegraded":"2023-08-26T09:25:15.456272+0000","last_fullsized":"2023-08-26T09:25:15.456272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:08:30.313992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912833+0000","last_change":"2023-08-26T09:25:14.465951+0000","last_active":"2023-08-26T09:25:15.912833+0000","last_peered":"2023-08-26T09:25:15.912833+0000","last_clean":"2023-08-26T09:25:15.912833+0000","last_became_active":"2023-08-26T09:25:14.465336+0000","last_became_peered":"2023-08-26T09:25:14.465336+0000","last_unstale":"2023-08-26T09:25:15.912833+0000","last_undegraded":"2023-08-26T09:25:15.912833+0000","last_fullsized":"2023-08-26T09:25:15.912833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T17:36:47.712402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.457012+0000","last_change":"2023-08-26T09:25:14.480642+0000","last_active":"2023-08-26T09:25:15.457012+0000","last_peered":"2023-08-26T09:25:15.457012+0000","last_clean":"2023-08-26T09:25:15.457012+0000","last_became_active":"2023-08-26T09:25:14.477065+0000","last_became_peered":"2023-08-26T09:25:14.477065+0000","last_unstale":"2023-08-26T09:25:15.457012+0000","last_undegraded":"2023-08-26T09:25:15.457012+0000","last_fullsized":"2023-08-26T09:25:15.457012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T16:55:45.411292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912654+0000","last_change":"2023-08-26T09:25:14.473064+0000","last_active":"2023-08-26T09:25:15.912654+0000","last_peered":"2023-08-26T09:25:15.912654+0000","last_clean":"2023-08-26T09:25:15.912654+0000","last_became_active":"2023-08-26T09:25:14.472726+0000","last_became_peered":"2023-08-26T09:25:14.472726+0000","last_unstale":"2023-08-26T09:25:15.912654+0000","last_undegraded":"2023-08-26T09:25:15.912654+0000","last_fullsized":"2023-08-26T09:25:15.912654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T14:27:21.893277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456821+0000","last_change":"2023-08-26T09:25:14.477899+0000","last_active":"2023-08-26T09:25:15.456821+0000","last_peered":"2023-08-26T09:25:15.456821+0000","last_clean":"2023-08-26T09:25:15.456821+0000","last_became_active":"2023-08-26T09:25:14.477646+0000","last_became_peered":"2023-08-26T09:25:14.477646+0000","last_unstale":"2023-08-26T09:25:15.456821+0000","last_undegraded":"2023-08-26T09:25:15.456821+0000","last_fullsized":"2023-08-26T09:25:15.456821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T21:16:03.436585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914892+0000","last_change":"2023-08-26T09:25:14.474723+0000","last_active":"2023-08-26T09:25:15.914892+0000","last_peered":"2023-08-26T09:25:15.914892+0000","last_clean":"2023-08-26T09:25:15.914892+0000","last_became_active":"2023-08-26T09:25:14.474265+0000","last_became_peered":"2023-08-26T09:25:14.474265+0000","last_unstale":"2023-08-26T09:25:15.914892+0000","last_undegraded":"2023-08-26T09:25:15.914892+0000","last_fullsized":"2023-08-26T09:25:15.914892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:50:25.845586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912833+0000","last_change":"2023-08-26T09:25:14.480019+0000","last_active":"2023-08-26T09:25:15.912833+0000","last_peered":"2023-08-26T09:25:15.912833+0000","last_clean":"2023-08-26T09:25:15.912833+0000","last_became_active":"2023-08-26T09:25:14.479765+0000","last_became_peered":"2023-08-26T09:25:14.479765+0000","last_unstale":"2023-08-26T09:25:15.912833+0000","last_undegraded":"2023-08-26T09:25:15.912833+0000","last_fullsized":"2023-08-26T09:25:15.912833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:53:08.855565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.450667+0000","last_change":"2023-08-26T09:25:14.467611+0000","last_active":"2023-08-26T09:25:15.450667+0000","last_peered":"2023-08-26T09:25:15.450667+0000","last_clean":"2023-08-26T09:25:15.450667+0000","last_became_active":"2023-08-26T09:25:14.467315+0000","last_became_peered":"2023-08-26T09:25:14.467315+0000","last_unstale":"2023-08-26T09:25:15.450667+0000","last_undegraded":"2023-08-26T09:25:15.450667+0000","last_fullsized":"2023-08-26T09:25:15.450667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T20:25:04.985842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914297+0000","last_change":"2023-08-26T09:25:14.474950+0000","last_active":"2023-08-26T09:25:15.914297+0000","last_peered":"2023-08-26T09:25:15.914297+0000","last_clean":"2023-08-26T09:25:15.914297+0000","last_became_active":"2023-08-26T09:25:14.474642+0000","last_became_peered":"2023-08-26T09:25:14.474642+0000","last_unstale":"2023-08-26T09:25:15.914297+0000","last_undegraded":"2023-08-26T09:25:15.914297+0000","last_fullsized":"2023-08-26T09:25:15.914297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T19:36:33.198355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.455614+0000","last_change":"2023-08-26T09:25:14.477808+0000","last_active":"2023-08-26T09:25:15.455614+0000","last_peered":"2023-08-26T09:25:15.455614+0000","last_clean":"2023-08-26T09:25:15.455614+0000","last_became_active":"2023-08-26T09:25:14.477502+0000","last_became_peered":"2023-08-26T09:25:14.477502+0000","last_unstale":"2023-08-26T09:25:15.455614+0000","last_undegraded":"2023-08-26T09:25:15.455614+0000","last_fullsized":"2023-08-26T09:25:15.455614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:40:12.427554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.455764+0000","last_change":"2023-08-26T09:25:14.478759+0000","last_active":"2023-08-26T09:25:15.455764+0000","last_peered":"2023-08-26T09:25:15.455764+0000","last_clean":"2023-08-26T09:25:15.455764+0000","last_became_active":"2023-08-26T09:25:14.478540+0000","last_became_peered":"2023-08-26T09:25:14.478540+0000","last_unstale":"2023-08-26T09:25:15.455764+0000","last_undegraded":"2023-08-26T09:25:15.455764+0000","last_fullsized":"2023-08-26T09:25:15.455764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T13:55:45.487107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.913386+0000","last_change":"2023-08-26T09:25:14.479900+0000","last_active":"2023-08-26T09:25:15.913386+0000","last_peered":"2023-08-26T09:25:15.913386+0000","last_clean":"2023-08-26T09:25:15.913386+0000","last_became_active":"2023-08-26T09:25:14.479407+0000","last_became_peered":"2023-08-26T09:25:14.479407+0000","last_unstale":"2023-08-26T09:25:15.913386+0000","last_undegraded":"2023-08-26T09:25:15.913386+0000","last_fullsized":"2023-08-26T09:25:15.913386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:41:19.138754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456515+0000","last_change":"2023-08-26T09:25:13.467208+0000","last_active":"2023-08-26T09:25:15.456515+0000","last_peered":"2023-08-26T09:25:15.456515+0000","last_clean":"2023-08-26T09:25:15.456515+0000","last_became_active":"2023-08-26T09:25:13.466920+0000","last_became_peered":"2023-08-26T09:25:13.466920+0000","last_unstale":"2023-08-26T09:25:15.456515+0000","last_undegraded":"2023-08-26T09:25:15.456515+0000","last_fullsized":"2023-08-26T09:25:15.456515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T13:12:05.420158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.450851+0000","last_change":"2023-08-26T09:25:14.474437+0000","last_active":"2023-08-26T09:25:15.450851+0000","last_peered":"2023-08-26T09:25:15.450851+0000","last_clean":"2023-08-26T09:25:15.450851+0000","last_became_active":"2023-08-26T09:25:14.474159+0000","last_became_peered":"2023-08-26T09:25:14.474159+0000","last_unstale":"2023-08-26T09:25:15.450851+0000","last_undegraded":"2023-08-26T09:25:15.450851+0000","last_fullsized":"2023-08-26T09:25:15.450851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T19:36:33.198355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.455463+0000","last_change":"2023-08-26T09:25:13.473039+0000","last_active":"2023-08-26T09:25:15.455463+0000","last_peered":"2023-08-26T09:25:15.455463+0000","last_clean":"2023-08-26T09:25:15.455463+0000","last_became_active":"2023-08-26T09:25:13.472691+0000","last_became_peered":"2023-08-26T09:25:13.472691+0000","last_unstale":"2023-08-26T09:25:15.455463+0000","last_undegraded":"2023-08-26T09:25:15.455463+0000","last_fullsized":"2023-08-26T09:25:15.455463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T17:36:46.707048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.913417+0000","last_change":"2023-08-26T09:25:14.476192+0000","last_active":"2023-08-26T09:25:15.913417+0000","last_peered":"2023-08-26T09:25:15.913417+0000","last_clean":"2023-08-26T09:25:15.913417+0000","last_became_active":"2023-08-26T09:25:14.475936+0000","last_became_peered":"2023-08-26T09:25:14.475936+0000","last_unstale":"2023-08-26T09:25:15.913417+0000","last_undegraded":"2023-08-26T09:25:15.913417+0000","last_fullsized":"2023-08-26T09:25:15.913417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:08:05.287372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.451045+0000","last_change":"2023-08-26T09:25:13.464715+0000","last_active":"2023-08-26T09:25:15.451045+0000","last_peered":"2023-08-26T09:25:15.451045+0000","last_clean":"2023-08-26T09:25:15.451045+0000","last_became_active":"2023-08-26T09:25:13.462699+0000","last_became_peered":"2023-08-26T09:25:13.462699+0000","last_unstale":"2023-08-26T09:25:15.451045+0000","last_undegraded":"2023-08-26T09:25:15.451045+0000","last_fullsized":"2023-08-26T09:25:15.451045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T17:21:10.806672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914232+0000","last_change":"2023-08-26T09:25:14.468187+0000","last_active":"2023-08-26T09:25:15.914232+0000","last_peered":"2023-08-26T09:25:15.914232+0000","last_clean":"2023-08-26T09:25:15.914232+0000","last_became_active":"2023-08-26T09:25:14.467908+0000","last_became_peered":"2023-08-26T09:25:14.467908+0000","last_unstale":"2023-08-26T09:25:15.914232+0000","last_undegraded":"2023-08-26T09:25:15.914232+0000","last_fullsized":"2023-08-26T09:25:15.914232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:35:42.200335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912929+0000","last_change":"2023-08-26T09:25:13.465714+0000","last_active":"2023-08-26T09:25:15.912929+0000","last_peered":"2023-08-26T09:25:15.912929+0000","last_clean":"2023-08-26T09:25:15.912929+0000","last_became_active":"2023-08-26T09:25:13.465457+0000","last_became_peered":"2023-08-26T09:25:13.465457+0000","last_unstale":"2023-08-26T09:25:15.912929+0000","last_undegraded":"2023-08-26T09:25:15.912929+0000","last_fullsized":"2023-08-26T09:25:15.912929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T16:12:41.071106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.450927+0000","last_change":"2023-08-26T09:25:14.480898+0000","last_active":"2023-08-26T09:25:15.450927+0000","last_peered":"2023-08-26T09:25:15.450927+0000","last_clean":"2023-08-26T09:25:15.450927+0000","last_became_active":"2023-08-26T09:25:14.480599+0000","last_became_peered":"2023-08-26T09:25:14.480599+0000","last_unstale":"2023-08-26T09:25:15.450927+0000","last_undegraded":"2023-08-26T09:25:15.450927+0000","last_fullsized":"2023-08-26T09:25:15.450927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T10:30:08.408755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.913038+0000","last_change":"2023-08-26T09:25:13.465637+0000","last_active":"2023-08-26T09:25:15.913038+0000","last_peered":"2023-08-26T09:25:15.913038+0000","last_clean":"2023-08-26T09:25:15.913038+0000","last_became_active":"2023-08-26T09:25:13.465347+0000","last_became_peered":"2023-08-26T09:25:13.465347+0000","last_unstale":"2023-08-26T09:25:15.913038+0000","last_undegraded":"2023-08-26T09:25:15.913038+0000","last_fullsized":"2023-08-26T09:25:15.913038+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T16:12:41.071106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.450800+0000","last_change":"2023-08-26T09:25:14.481625+0000","last_active":"2023-08-26T09:25:15.450800+0000","last_peered":"2023-08-26T09:25:15.450800+0000","last_clean":"2023-08-26T09:25:15.450800+0000","last_became_active":"2023-08-26T09:25:14.481225+0000","last_became_peered":"2023-08-26T09:25:14.481225+0000","last_unstale":"2023-08-26T09:25:15.450800+0000","last_undegraded":"2023-08-26T09:25:15.450800+0000","last_fullsized":"2023-08-26T09:25:15.450800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:57:39.300454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914883+0000","last_change":"2023-08-26T09:25:13.472891+0000","last_active":"2023-08-26T09:25:15.914883+0000","last_peered":"2023-08-26T09:25:15.914883+0000","last_clean":"2023-08-26T09:25:15.914883+0000","last_became_active":"2023-08-26T09:25:13.472559+0000","last_became_peered":"2023-08-26T09:25:13.472559+0000","last_unstale":"2023-08-26T09:25:15.914883+0000","last_undegraded":"2023-08-26T09:25:15.914883+0000","last_fullsized":"2023-08-26T09:25:15.914883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:47:08.878431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.455409+0000","last_change":"2023-08-26T09:25:14.477752+0000","last_active":"2023-08-26T09:25:15.455409+0000","last_peered":"2023-08-26T09:25:15.455409+0000","last_clean":"2023-08-26T09:25:15.455409+0000","last_became_active":"2023-08-26T09:25:14.477352+0000","last_became_peered":"2023-08-26T09:25:14.477352+0000","last_unstale":"2023-08-26T09:25:15.455409+0000","last_undegraded":"2023-08-26T09:25:15.455409+0000","last_fullsized":"2023-08-26T09:25:15.455409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:35:42.200335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456948+0000","last_change":"2023-08-26T09:25:13.463758+0000","last_active":"2023-08-26T09:25:15.456948+0000","last_peered":"2023-08-26T09:25:15.456948+0000","last_clean":"2023-08-26T09:25:15.456948+0000","last_became_active":"2023-08-26T09:25:13.462510+0000","last_became_peered":"2023-08-26T09:25:13.462510+0000","last_unstale":"2023-08-26T09:25:15.456948+0000","last_undegraded":"2023-08-26T09:25:15.456948+0000","last_fullsized":"2023-08-26T09:25:15.456948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T17:28:48.518473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456875+0000","last_change":"2023-08-26T09:25:14.471833+0000","last_active":"2023-08-26T09:25:15.456875+0000","last_peered":"2023-08-26T09:25:15.456875+0000","last_clean":"2023-08-26T09:25:15.456875+0000","last_became_active":"2023-08-26T09:25:14.471529+0000","last_became_peered":"2023-08-26T09:25:14.471529+0000","last_unstale":"2023-08-26T09:25:15.456875+0000","last_undegraded":"2023-08-26T09:25:15.456875+0000","last_fullsized":"2023-08-26T09:25:15.456875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:50:25.845586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914699+0000","last_change":"2023-08-26T09:25:13.467178+0000","last_active":"2023-08-26T09:25:15.914699+0000","last_peered":"2023-08-26T09:25:15.914699+0000","last_clean":"2023-08-26T09:25:15.914699+0000","last_became_active":"2023-08-26T09:25:13.466871+0000","last_became_peered":"2023-08-26T09:25:13.466871+0000","last_unstale":"2023-08-26T09:25:15.914699+0000","last_undegraded":"2023-08-26T09:25:15.914699+0000","last_fullsized":"2023-08-26T09:25:15.914699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T20:38:25.405572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.451584+0000","last_change":"2023-08-26T09:25:14.474363+0000","last_active":"2023-08-26T09:25:15.451584+0000","last_peered":"2023-08-26T09:25:15.451584+0000","last_clean":"2023-08-26T09:25:15.451584+0000","last_became_active":"2023-08-26T09:25:14.473676+0000","last_became_peered":"2023-08-26T09:25:14.473676+0000","last_unstale":"2023-08-26T09:25:15.451584+0000","last_undegraded":"2023-08-26T09:25:15.451584+0000","last_fullsized":"2023-08-26T09:25:15.451584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:32:16.860545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912984+0000","last_change":"2023-08-26T09:25:13.465320+0000","last_active":"2023-08-26T09:25:15.912984+0000","last_peered":"2023-08-26T09:25:15.912984+0000","last_clean":"2023-08-26T09:25:15.912984+0000","last_became_active":"2023-08-26T09:25:13.465025+0000","last_became_peered":"2023-08-26T09:25:13.465025+0000","last_unstale":"2023-08-26T09:25:15.912984+0000","last_undegraded":"2023-08-26T09:25:15.912984+0000","last_fullsized":"2023-08-26T09:25:15.912984+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:39:34.205499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.913337+0000","last_change":"2023-08-26T09:25:14.479704+0000","last_active":"2023-08-26T09:25:15.913337+0000","last_peered":"2023-08-26T09:25:15.913337+0000","last_clean":"2023-08-26T09:25:15.913337+0000","last_became_active":"2023-08-26T09:25:14.479039+0000","last_became_peered":"2023-08-26T09:25:14.479039+0000","last_unstale":"2023-08-26T09:25:15.913337+0000","last_undegraded":"2023-08-26T09:25:15.913337+0000","last_fullsized":"2023-08-26T09:25:15.913337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:57:39.300454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914313+0000","last_change":"2023-08-26T09:25:13.465191+0000","last_active":"2023-08-26T09:25:15.914313+0000","last_peered":"2023-08-26T09:25:15.914313+0000","last_clean":"2023-08-26T09:25:15.914313+0000","last_became_active":"2023-08-26T09:25:13.464895+0000","last_became_peered":"2023-08-26T09:25:13.464895+0000","last_unstale":"2023-08-26T09:25:15.914313+0000","last_undegraded":"2023-08-26T09:25:15.914313+0000","last_fullsized":"2023-08-26T09:25:15.914313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:08:04.282019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.913110+0000","last_change":"2023-08-26T09:25:14.461784+0000","last_active":"2023-08-26T09:25:15.913110+0000","last_peered":"2023-08-26T09:25:15.913110+0000","last_clean":"2023-08-26T09:25:15.913110+0000","last_became_active":"2023-08-26T09:25:14.461510+0000","last_became_peered":"2023-08-26T09:25:14.461510+0000","last_unstale":"2023-08-26T09:25:15.913110+0000","last_undegraded":"2023-08-26T09:25:15.913110+0000","last_fullsized":"2023-08-26T09:25:15.913110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:57:39.300454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.913708+0000","last_change":"2023-08-26T09:25:13.459408+0000","last_active":"2023-08-26T09:25:15.913708+0000","last_peered":"2023-08-26T09:25:15.913708+0000","last_clean":"2023-08-26T09:25:15.913708+0000","last_became_active":"2023-08-26T09:25:13.459125+0000","last_became_peered":"2023-08-26T09:25:13.459125+0000","last_unstale":"2023-08-26T09:25:15.913708+0000","last_undegraded":"2023-08-26T09:25:15.913708+0000","last_fullsized":"2023-08-26T09:25:15.913708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:20:02.388922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.451246+0000","last_change":"2023-08-26T09:25:14.479451+0000","last_active":"2023-08-26T09:25:15.451246+0000","last_peered":"2023-08-26T09:25:15.451246+0000","last_clean":"2023-08-26T09:25:15.451246+0000","last_became_active":"2023-08-26T09:25:14.479170+0000","last_became_peered":"2023-08-26T09:25:14.479170+0000","last_unstale":"2023-08-26T09:25:15.451246+0000","last_undegraded":"2023-08-26T09:25:15.451246+0000","last_fullsized":"2023-08-26T09:25:15.451246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:47:09.883784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914856+0000","last_change":"2023-08-26T09:25:13.466893+0000","last_active":"2023-08-26T09:25:15.914856+0000","last_peered":"2023-08-26T09:25:15.914856+0000","last_clean":"2023-08-26T09:25:15.914856+0000","last_became_active":"2023-08-26T09:25:13.466554+0000","last_became_peered":"2023-08-26T09:25:13.466554+0000","last_unstale":"2023-08-26T09:25:15.914856+0000","last_undegraded":"2023-08-26T09:25:15.914856+0000","last_fullsized":"2023-08-26T09:25:15.914856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T21:16:02.431231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912867+0000","last_change":"2023-08-26T09:25:14.479478+0000","last_active":"2023-08-26T09:25:15.912867+0000","last_peered":"2023-08-26T09:25:15.912867+0000","last_clean":"2023-08-26T09:25:15.912867+0000","last_became_active":"2023-08-26T09:25:14.479194+0000","last_became_peered":"2023-08-26T09:25:14.479194+0000","last_unstale":"2023-08-26T09:25:15.912867+0000","last_undegraded":"2023-08-26T09:25:15.912867+0000","last_fullsized":"2023-08-26T09:25:15.912867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T17:36:47.712402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914741+0000","last_change":"2023-08-26T09:25:13.465149+0000","last_active":"2023-08-26T09:25:15.914741+0000","last_peered":"2023-08-26T09:25:15.914741+0000","last_clean":"2023-08-26T09:25:15.914741+0000","last_became_active":"2023-08-26T09:25:13.464867+0000","last_became_peered":"2023-08-26T09:25:13.464867+0000","last_unstale":"2023-08-26T09:25:15.914741+0000","last_undegraded":"2023-08-26T09:25:15.914741+0000","last_fullsized":"2023-08-26T09:25:15.914741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:32:15.855191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456388+0000","last_change":"2023-08-26T09:25:14.482569+0000","last_active":"2023-08-26T09:25:15.456388+0000","last_peered":"2023-08-26T09:25:15.456388+0000","last_clean":"2023-08-26T09:25:15.456388+0000","last_became_active":"2023-08-26T09:25:14.482335+0000","last_became_peered":"2023-08-26T09:25:14.482335+0000","last_unstale":"2023-08-26T09:25:15.456388+0000","last_undegraded":"2023-08-26T09:25:15.456388+0000","last_fullsized":"2023-08-26T09:25:15.456388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T12:08:55.397933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914864+0000","last_change":"2023-08-26T09:25:13.465796+0000","last_active":"2023-08-26T09:25:15.914864+0000","last_peered":"2023-08-26T09:25:15.914864+0000","last_clean":"2023-08-26T09:25:15.914864+0000","last_became_active":"2023-08-26T09:25:13.465506+0000","last_became_peered":"2023-08-26T09:25:13.465506+0000","last_unstale":"2023-08-26T09:25:15.914864+0000","last_undegraded":"2023-08-26T09:25:15.914864+0000","last_fullsized":"2023-08-26T09:25:15.914864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:34:55.483540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914351+0000","last_change":"2023-08-26T09:25:14.478582+0000","last_active":"2023-08-26T09:25:15.914351+0000","last_peered":"2023-08-26T09:25:15.914351+0000","last_clean":"2023-08-26T09:25:15.914351+0000","last_became_active":"2023-08-26T09:25:14.478305+0000","last_became_peered":"2023-08-26T09:25:14.478305+0000","last_unstale":"2023-08-26T09:25:15.914351+0000","last_undegraded":"2023-08-26T09:25:15.914351+0000","last_fullsized":"2023-08-26T09:25:15.914351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:53:08.855565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.913249+0000","last_change":"2023-08-26T09:25:13.472805+0000","last_active":"2023-08-26T09:25:15.913249+0000","last_peered":"2023-08-26T09:25:15.913249+0000","last_clean":"2023-08-26T09:25:15.913249+0000","last_became_active":"2023-08-26T09:25:13.472533+0000","last_became_peered":"2023-08-26T09:25:13.472533+0000","last_unstale":"2023-08-26T09:25:15.913249+0000","last_undegraded":"2023-08-26T09:25:15.913249+0000","last_fullsized":"2023-08-26T09:25:15.913249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T13:55:44.481753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.913084+0000","last_change":"2023-08-26T09:25:14.475468+0000","last_active":"2023-08-26T09:25:15.913084+0000","last_peered":"2023-08-26T09:25:15.913084+0000","last_clean":"2023-08-26T09:25:15.913084+0000","last_became_active":"2023-08-26T09:25:14.475180+0000","last_became_peered":"2023-08-26T09:25:14.475180+0000","last_unstale":"2023-08-26T09:25:15.913084+0000","last_undegraded":"2023-08-26T09:25:15.913084+0000","last_fullsized":"2023-08-26T09:25:15.913084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:08:30.313992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.451147+0000","last_change":"2023-08-26T09:25:13.462794+0000","last_active":"2023-08-26T09:25:15.451147+0000","last_peered":"2023-08-26T09:25:15.451147+0000","last_clean":"2023-08-26T09:25:15.451147+0000","last_became_active":"2023-08-26T09:25:13.462517+0000","last_became_peered":"2023-08-26T09:25:13.462517+0000","last_unstale":"2023-08-26T09:25:15.451147+0000","last_undegraded":"2023-08-26T09:25:15.451147+0000","last_fullsized":"2023-08-26T09:25:15.451147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T21:16:02.431231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456794+0000","last_change":"2023-08-26T09:25:14.476660+0000","last_active":"2023-08-26T09:25:15.456794+0000","last_peered":"2023-08-26T09:25:15.456794+0000","last_clean":"2023-08-26T09:25:15.456794+0000","last_became_active":"2023-08-26T09:25:14.476382+0000","last_became_peered":"2023-08-26T09:25:14.476382+0000","last_unstale":"2023-08-26T09:25:15.456794+0000","last_undegraded":"2023-08-26T09:25:15.456794+0000","last_fullsized":"2023-08-26T09:25:15.456794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:34:56.488893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914383+0000","last_change":"2023-08-26T09:25:13.461050+0000","last_active":"2023-08-26T09:25:15.914383+0000","last_peered":"2023-08-26T09:25:15.914383+0000","last_clean":"2023-08-26T09:25:15.914383+0000","last_became_active":"2023-08-26T09:25:13.460752+0000","last_became_peered":"2023-08-26T09:25:13.460752+0000","last_unstale":"2023-08-26T09:25:15.914383+0000","last_undegraded":"2023-08-26T09:25:15.914383+0000","last_fullsized":"2023-08-26T09:25:15.914383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:40:11.422201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.457068+0000","last_change":"2023-08-26T09:25:14.475179+0000","last_active":"2023-08-26T09:25:15.457068+0000","last_peered":"2023-08-26T09:25:15.457068+0000","last_clean":"2023-08-26T09:25:15.457068+0000","last_became_active":"2023-08-26T09:25:14.474740+0000","last_became_peered":"2023-08-26T09:25:14.474740+0000","last_unstale":"2023-08-26T09:25:15.457068+0000","last_undegraded":"2023-08-26T09:25:15.457068+0000","last_fullsized":"2023-08-26T09:25:15.457068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:43:46.388415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456598+0000","last_change":"2023-08-26T09:25:13.460000+0000","last_active":"2023-08-26T09:25:15.456598+0000","last_peered":"2023-08-26T09:25:15.456598+0000","last_clean":"2023-08-26T09:25:15.456598+0000","last_became_active":"2023-08-26T09:25:13.459242+0000","last_became_peered":"2023-08-26T09:25:13.459242+0000","last_unstale":"2023-08-26T09:25:15.456598+0000","last_undegraded":"2023-08-26T09:25:15.456598+0000","last_fullsized":"2023-08-26T09:25:15.456598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T10:30:07.403402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.457088+0000","last_change":"2023-08-26T09:25:14.476877+0000","last_active":"2023-08-26T09:25:15.457088+0000","last_peered":"2023-08-26T09:25:15.457088+0000","last_clean":"2023-08-26T09:25:15.457088+0000","last_became_active":"2023-08-26T09:25:14.475838+0000","last_became_peered":"2023-08-26T09:25:14.475838+0000","last_unstale":"2023-08-26T09:25:15.457088+0000","last_undegraded":"2023-08-26T09:25:15.457088+0000","last_fullsized":"2023-08-26T09:25:15.457088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:11:33.355206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.450670+0000","last_change":"2023-08-26T09:25:13.462482+0000","last_active":"2023-08-26T09:25:15.450670+0000","last_peered":"2023-08-26T09:25:15.450670+0000","last_clean":"2023-08-26T09:25:15.450670+0000","last_became_active":"2023-08-26T09:25:13.461712+0000","last_became_peered":"2023-08-26T09:25:13.461712+0000","last_unstale":"2023-08-26T09:25:15.450670+0000","last_undegraded":"2023-08-26T09:25:15.450670+0000","last_fullsized":"2023-08-26T09:25:15.450670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T13:55:44.481753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.455779+0000","last_change":"2023-08-26T09:25:14.477795+0000","last_active":"2023-08-26T09:25:15.455779+0000","last_peered":"2023-08-26T09:25:15.455779+0000","last_clean":"2023-08-26T09:25:15.455779+0000","last_became_active":"2023-08-26T09:25:14.477279+0000","last_became_peered":"2023-08-26T09:25:14.477279+0000","last_unstale":"2023-08-26T09:25:15.455779+0000","last_undegraded":"2023-08-26T09:25:15.455779+0000","last_fullsized":"2023-08-26T09:25:15.455779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:08:30.313992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.451120+0000","last_change":"2023-08-26T09:25:13.464458+0000","last_active":"2023-08-26T09:25:15.451120+0000","last_peered":"2023-08-26T09:25:15.451120+0000","last_clean":"2023-08-26T09:25:15.451120+0000","last_became_active":"2023-08-26T09:25:13.464108+0000","last_became_peered":"2023-08-26T09:25:13.464108+0000","last_unstale":"2023-08-26T09:25:15.451120+0000","last_undegraded":"2023-08-26T09:25:15.451120+0000","last_fullsized":"2023-08-26T09:25:15.451120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:34:55.483540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456941+0000","last_change":"2023-08-26T09:25:08.404814+0000","last_active":"2023-08-26T09:25:15.456941+0000","last_peered":"2023-08-26T09:25:15.456941+0000","last_clean":"2023-08-26T09:25:15.456941+0000","last_became_active":"2023-08-26T09:25:08.404465+0000","last_became_peered":"2023-08-26T09:25:08.404465+0000","last_unstale":"2023-08-26T09:25:15.456941+0000","last_undegraded":"2023-08-26T09:25:15.456941+0000","last_fullsized":"2023-08-26T09:25:15.456941+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T17:16:37.346278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.451541+0000","last_change":"2023-08-26T09:25:14.481693+0000","last_active":"2023-08-26T09:25:15.451541+0000","last_peered":"2023-08-26T09:25:15.451541+0000","last_clean":"2023-08-26T09:25:15.451541+0000","last_became_active":"2023-08-26T09:25:14.481214+0000","last_became_peered":"2023-08-26T09:25:14.481214+0000","last_unstale":"2023-08-26T09:25:15.451541+0000","last_undegraded":"2023-08-26T09:25:15.451541+0000","last_fullsized":"2023-08-26T09:25:15.451541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:41:19.138754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.450798+0000","last_change":"2023-08-26T09:25:08.405372+0000","last_active":"2023-08-26T09:25:15.450798+0000","last_peered":"2023-08-26T09:25:15.450798+0000","last_clean":"2023-08-26T09:25:15.450798+0000","last_became_active":"2023-08-26T09:25:08.404984+0000","last_became_peered":"2023-08-26T09:25:08.404984+0000","last_unstale":"2023-08-26T09:25:15.450798+0000","last_undegraded":"2023-08-26T09:25:15.450798+0000","last_fullsized":"2023-08-26T09:25:15.450798+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T12:08:49.341773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:17.117778+0000","last_change":"2023-08-26T09:25:13.462159+0000","last_active":"2023-08-26T09:25:17.117778+0000","last_peered":"2023-08-26T09:25:17.117778+0000","last_clean":"2023-08-26T09:25:17.117778+0000","last_became_active":"2023-08-26T09:25:13.461876+0000","last_became_peered":"2023-08-26T09:25:13.461876+0000","last_unstale":"2023-08-26T09:25:17.117778+0000","last_undegraded":"2023-08-26T09:25:17.117778+0000","last_fullsized":"2023-08-26T09:25:17.117778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T19:36:32.193002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456480+0000","last_change":"2023-08-26T09:25:14.472318+0000","last_active":"2023-08-26T09:25:15.456480+0000","last_peered":"2023-08-26T09:25:15.456480+0000","last_clean":"2023-08-26T09:25:15.456480+0000","last_became_active":"2023-08-26T09:25:14.472047+0000","last_became_peered":"2023-08-26T09:25:14.472047+0000","last_unstale":"2023-08-26T09:25:15.456480+0000","last_undegraded":"2023-08-26T09:25:15.456480+0000","last_fullsized":"2023-08-26T09:25:15.456480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:08:05.287372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.455460+0000","last_change":"2023-08-26T09:25:08.410050+0000","last_active":"2023-08-26T09:25:15.455460+0000","last_peered":"2023-08-26T09:25:15.455460+0000","last_clean":"2023-08-26T09:25:15.455460+0000","last_became_active":"2023-08-26T09:25:08.409798+0000","last_became_peered":"2023-08-26T09:25:08.409798+0000","last_unstale":"2023-08-26T09:25:15.455460+0000","last_undegraded":"2023-08-26T09:25:15.455460+0000","last_fullsized":"2023-08-26T09:25:15.455460+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:53:02.799405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":169,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914315+0000","last_change":"2023-08-26T09:25:08.409089+0000","last_active":"2023-08-26T09:25:15.914315+0000","last_peered":"2023-08-26T09:25:15.914315+0000","last_clean":"2023-08-26T09:25:15.914315+0000","last_became_active":"2023-08-26T09:25:08.408185+0000","last_became_peered":"2023-08-26T09:25:08.408185+0000","last_unstale":"2023-08-26T09:25:15.914315+0000","last_undegraded":"2023-08-26T09:25:15.914315+0000","last_fullsized":"2023-08-26T09:25:15.914315+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T13:12:00.369352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912672+0000","last_change":"2023-08-26T09:25:13.460120+0000","last_active":"2023-08-26T09:25:15.912672+0000","last_peered":"2023-08-26T09:25:15.912672+0000","last_clean":"2023-08-26T09:25:15.912672+0000","last_became_active":"2023-08-26T09:25:13.459827+0000","last_became_peered":"2023-08-26T09:25:13.459827+0000","last_unstale":"2023-08-26T09:25:15.912672+0000","last_undegraded":"2023-08-26T09:25:15.912672+0000","last_fullsized":"2023-08-26T09:25:15.912672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T12:36:00.049625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.913234+0000","last_change":"2023-08-26T09:25:14.480583+0000","last_active":"2023-08-26T09:25:15.913234+0000","last_peered":"2023-08-26T09:25:15.913234+0000","last_clean":"2023-08-26T09:25:15.913234+0000","last_became_active":"2023-08-26T09:25:14.480314+0000","last_became_peered":"2023-08-26T09:25:14.480314+0000","last_unstale":"2023-08-26T09:25:15.913234+0000","last_undegraded":"2023-08-26T09:25:15.913234+0000","last_fullsized":"2023-08-26T09:25:15.913234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T12:08:55.397933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914494+0000","last_change":"2023-08-26T09:25:08.448979+0000","last_active":"2023-08-26T09:25:15.914494+0000","last_peered":"2023-08-26T09:25:15.914494+0000","last_clean":"2023-08-26T09:25:15.914494+0000","last_became_active":"2023-08-26T09:25:08.448706+0000","last_became_peered":"2023-08-26T09:25:08.448706+0000","last_unstale":"2023-08-26T09:25:15.914494+0000","last_undegraded":"2023-08-26T09:25:15.914494+0000","last_fullsized":"2023-08-26T09:25:15.914494+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T17:21:05.755866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.455347+0000","last_change":"2023-08-26T09:25:13.466718+0000","last_active":"2023-08-26T09:25:15.455347+0000","last_peered":"2023-08-26T09:25:15.455347+0000","last_clean":"2023-08-26T09:25:15.455347+0000","last_became_active":"2023-08-26T09:25:13.466411+0000","last_became_peered":"2023-08-26T09:25:13.466411+0000","last_unstale":"2023-08-26T09:25:15.455347+0000","last_undegraded":"2023-08-26T09:25:15.455347+0000","last_fullsized":"2023-08-26T09:25:15.455347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T12:36:00.049625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.455738+0000","last_change":"2023-08-26T09:25:14.477603+0000","last_active":"2023-08-26T09:25:15.455738+0000","last_peered":"2023-08-26T09:25:15.455738+0000","last_clean":"2023-08-26T09:25:15.455738+0000","last_became_active":"2023-08-26T09:25:14.476929+0000","last_became_peered":"2023-08-26T09:25:14.476929+0000","last_unstale":"2023-08-26T09:25:15.455738+0000","last_undegraded":"2023-08-26T09:25:15.455738+0000","last_fullsized":"2023-08-26T09:25:15.455738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:41:19.138754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914092+0000","last_change":"2023-08-26T09:25:08.448601+0000","last_active":"2023-08-26T09:25:15.914092+0000","last_peered":"2023-08-26T09:25:15.914092+0000","last_clean":"2023-08-26T09:25:15.914092+0000","last_became_active":"2023-08-26T09:25:08.448275+0000","last_became_peered":"2023-08-26T09:25:08.448275+0000","last_unstale":"2023-08-26T09:25:15.914092+0000","last_undegraded":"2023-08-26T09:25:15.914092+0000","last_fullsized":"2023-08-26T09:25:15.914092+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:57:33.244294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.450893+0000","last_change":"2023-08-26T09:25:13.464379+0000","last_active":"2023-08-26T09:25:15.450893+0000","last_peered":"2023-08-26T09:25:15.450893+0000","last_clean":"2023-08-26T09:25:15.450893+0000","last_became_active":"2023-08-26T09:25:13.463777+0000","last_became_peered":"2023-08-26T09:25:13.463777+0000","last_unstale":"2023-08-26T09:25:15.450893+0000","last_undegraded":"2023-08-26T09:25:15.450893+0000","last_fullsized":"2023-08-26T09:25:15.450893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T13:12:05.420158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914233+0000","last_change":"2023-08-26T09:25:14.479040+0000","last_active":"2023-08-26T09:25:15.914233+0000","last_peered":"2023-08-26T09:25:15.914233+0000","last_clean":"2023-08-26T09:25:15.914233+0000","last_became_active":"2023-08-26T09:25:14.478759+0000","last_became_peered":"2023-08-26T09:25:14.478759+0000","last_unstale":"2023-08-26T09:25:15.914233+0000","last_undegraded":"2023-08-26T09:25:15.914233+0000","last_fullsized":"2023-08-26T09:25:15.914233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T17:36:47.712402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912847+0000","last_change":"2023-08-26T09:25:08.449014+0000","last_active":"2023-08-26T09:25:15.912847+0000","last_peered":"2023-08-26T09:25:15.912847+0000","last_clean":"2023-08-26T09:25:15.912847+0000","last_became_active":"2023-08-26T09:25:08.448671+0000","last_became_peered":"2023-08-26T09:25:08.448671+0000","last_unstale":"2023-08-26T09:25:15.912847+0000","last_undegraded":"2023-08-26T09:25:15.912847+0000","last_fullsized":"2023-08-26T09:25:15.912847+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:53:02.799405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456678+0000","last_change":"2023-08-26T09:25:13.460870+0000","last_active":"2023-08-26T09:25:15.456678+0000","last_peered":"2023-08-26T09:25:15.456678+0000","last_clean":"2023-08-26T09:25:15.456678+0000","last_became_active":"2023-08-26T09:25:13.460491+0000","last_became_peered":"2023-08-26T09:25:13.460491+0000","last_unstale":"2023-08-26T09:25:15.456678+0000","last_undegraded":"2023-08-26T09:25:15.456678+0000","last_fullsized":"2023-08-26T09:25:15.456678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T20:38:25.405572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.455773+0000","last_change":"2023-08-26T09:25:14.477148+0000","last_active":"2023-08-26T09:25:15.455773+0000","last_peered":"2023-08-26T09:25:15.455773+0000","last_clean":"2023-08-26T09:25:15.455773+0000","last_became_active":"2023-08-26T09:25:14.476854+0000","last_became_peered":"2023-08-26T09:25:14.476854+0000","last_unstale":"2023-08-26T09:25:15.455773+0000","last_undegraded":"2023-08-26T09:25:15.455773+0000","last_fullsized":"2023-08-26T09:25:15.455773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:57:39.300454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.913808+0000","last_change":"2023-08-26T09:25:08.449159+0000","last_active":"2023-08-26T09:25:15.913808+0000","last_peered":"2023-08-26T09:25:15.913808+0000","last_clean":"2023-08-26T09:25:15.913808+0000","last_became_active":"2023-08-26T09:25:08.448870+0000","last_became_peered":"2023-08-26T09:25:08.448870+0000","last_unstale":"2023-08-26T09:25:15.913808+0000","last_undegraded":"2023-08-26T09:25:15.913808+0000","last_fullsized":"2023-08-26T09:25:15.913808+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T19:52:03.570007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.455740+0000","last_change":"2023-08-26T09:25:13.466685+0000","last_active":"2023-08-26T09:25:15.455740+0000","last_peered":"2023-08-26T09:25:15.455740+0000","last_clean":"2023-08-26T09:25:15.455740+0000","last_became_active":"2023-08-26T09:25:13.465771+0000","last_became_peered":"2023-08-26T09:25:13.465771+0000","last_unstale":"2023-08-26T09:25:15.455740+0000","last_undegraded":"2023-08-26T09:25:15.455740+0000","last_fullsized":"2023-08-26T09:25:15.455740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T20:25:03.980488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912999+0000","last_change":"2023-08-26T09:25:14.470265+0000","last_active":"2023-08-26T09:25:15.912999+0000","last_peered":"2023-08-26T09:25:15.912999+0000","last_clean":"2023-08-26T09:25:15.912999+0000","last_became_active":"2023-08-26T09:25:14.469955+0000","last_became_peered":"2023-08-26T09:25:14.469955+0000","last_unstale":"2023-08-26T09:25:15.912999+0000","last_undegraded":"2023-08-26T09:25:15.912999+0000","last_fullsized":"2023-08-26T09:25:15.912999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T20:25:04.985842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914470+0000","last_change":"2023-08-26T09:25:08.403552+0000","last_active":"2023-08-26T09:25:15.914470+0000","last_peered":"2023-08-26T09:25:15.914470+0000","last_clean":"2023-08-26T09:25:15.914470+0000","last_became_active":"2023-08-26T09:25:08.403261+0000","last_became_peered":"2023-08-26T09:25:08.403261+0000","last_unstale":"2023-08-26T09:25:15.914470+0000","last_undegraded":"2023-08-26T09:25:15.914470+0000","last_fullsized":"2023-08-26T09:25:15.914470+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T16:12:36.020300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.913475+0000","last_change":"2023-08-26T09:25:13.472922+0000","last_active":"2023-08-26T09:25:15.913475+0000","last_peered":"2023-08-26T09:25:15.913475+0000","last_clean":"2023-08-26T09:25:15.913475+0000","last_became_active":"2023-08-26T09:25:13.472617+0000","last_became_peered":"2023-08-26T09:25:13.472617+0000","last_unstale":"2023-08-26T09:25:15.913475+0000","last_undegraded":"2023-08-26T09:25:15.913475+0000","last_fullsized":"2023-08-26T09:25:15.913475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T12:08:54.392580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.455804+0000","last_change":"2023-08-26T09:25:14.478564+0000","last_active":"2023-08-26T09:25:15.455804+0000","last_peered":"2023-08-26T09:25:15.455804+0000","last_clean":"2023-08-26T09:25:15.455804+0000","last_became_active":"2023-08-26T09:25:14.476929+0000","last_became_peered":"2023-08-26T09:25:14.476929+0000","last_unstale":"2023-08-26T09:25:15.455804+0000","last_undegraded":"2023-08-26T09:25:15.455804+0000","last_fullsized":"2023-08-26T09:25:15.455804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T16:12:42.076460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.913060+0000","last_change":"2023-08-26T09:25:13.461920+0000","last_active":"2023-08-26T09:25:15.913060+0000","last_peered":"2023-08-26T09:25:15.913060+0000","last_clean":"2023-08-26T09:25:15.913060+0000","last_became_active":"2023-08-26T09:25:13.459797+0000","last_became_peered":"2023-08-26T09:25:13.459797+0000","last_unstale":"2023-08-26T09:25:15.913060+0000","last_undegraded":"2023-08-26T09:25:15.913060+0000","last_fullsized":"2023-08-26T09:25:15.913060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T13:55:44.481753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912637+0000","last_change":"2023-08-26T09:25:14.478962+0000","last_active":"2023-08-26T09:25:15.912637+0000","last_peered":"2023-08-26T09:25:15.912637+0000","last_clean":"2023-08-26T09:25:15.912637+0000","last_became_active":"2023-08-26T09:25:14.478697+0000","last_became_peered":"2023-08-26T09:25:14.478697+0000","last_unstale":"2023-08-26T09:25:15.912637+0000","last_undegraded":"2023-08-26T09:25:15.912637+0000","last_fullsized":"2023-08-26T09:25:15.912637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T16:51:33.426902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.913245+0000","last_change":"2023-08-26T09:25:13.462877+0000","last_active":"2023-08-26T09:25:15.913245+0000","last_peered":"2023-08-26T09:25:15.913245+0000","last_clean":"2023-08-26T09:25:15.913245+0000","last_became_active":"2023-08-26T09:25:13.462284+0000","last_became_peered":"2023-08-26T09:25:13.462284+0000","last_unstale":"2023-08-26T09:25:15.913245+0000","last_undegraded":"2023-08-26T09:25:15.913245+0000","last_fullsized":"2023-08-26T09:25:15.913245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T20:25:03.980488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456631+0000","last_change":"2023-08-26T09:25:14.474944+0000","last_active":"2023-08-26T09:25:15.456631+0000","last_peered":"2023-08-26T09:25:15.456631+0000","last_clean":"2023-08-26T09:25:15.456631+0000","last_became_active":"2023-08-26T09:25:14.474660+0000","last_became_peered":"2023-08-26T09:25:14.474660+0000","last_unstale":"2023-08-26T09:25:15.456631+0000","last_undegraded":"2023-08-26T09:25:15.456631+0000","last_fullsized":"2023-08-26T09:25:15.456631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T17:21:11.812026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.913501+0000","last_change":"2023-08-26T09:25:13.466963+0000","last_active":"2023-08-26T09:25:15.913501+0000","last_peered":"2023-08-26T09:25:15.913501+0000","last_clean":"2023-08-26T09:25:15.913501+0000","last_became_active":"2023-08-26T09:25:13.466504+0000","last_became_peered":"2023-08-26T09:25:13.466504+0000","last_unstale":"2023-08-26T09:25:15.913501+0000","last_undegraded":"2023-08-26T09:25:15.913501+0000","last_fullsized":"2023-08-26T09:25:15.913501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:08:04.282019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456682+0000","last_change":"2023-08-26T09:25:14.475505+0000","last_active":"2023-08-26T09:25:15.456682+0000","last_peered":"2023-08-26T09:25:15.456682+0000","last_clean":"2023-08-26T09:25:15.456682+0000","last_became_active":"2023-08-26T09:25:14.475212+0000","last_became_peered":"2023-08-26T09:25:14.475212+0000","last_unstale":"2023-08-26T09:25:15.456682+0000","last_undegraded":"2023-08-26T09:25:15.456682+0000","last_fullsized":"2023-08-26T09:25:15.456682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:32:16.860545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.451108+0000","last_change":"2023-08-26T09:25:13.460544+0000","last_active":"2023-08-26T09:25:15.451108+0000","last_peered":"2023-08-26T09:25:15.451108+0000","last_clean":"2023-08-26T09:25:15.451108+0000","last_became_active":"2023-08-26T09:25:13.460251+0000","last_became_peered":"2023-08-26T09:25:13.460251+0000","last_unstale":"2023-08-26T09:25:15.451108+0000","last_undegraded":"2023-08-26T09:25:15.451108+0000","last_fullsized":"2023-08-26T09:25:15.451108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T20:38:25.405572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.450863+0000","last_change":"2023-08-26T09:25:14.474840+0000","last_active":"2023-08-26T09:25:15.450863+0000","last_peered":"2023-08-26T09:25:15.450863+0000","last_clean":"2023-08-26T09:25:15.450863+0000","last_became_active":"2023-08-26T09:25:14.474547+0000","last_became_peered":"2023-08-26T09:25:14.474547+0000","last_unstale":"2023-08-26T09:25:15.450863+0000","last_undegraded":"2023-08-26T09:25:15.450863+0000","last_fullsized":"2023-08-26T09:25:15.450863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:08:05.287372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912985+0000","last_change":"2023-08-26T09:25:13.466467+0000","last_active":"2023-08-26T09:25:15.912985+0000","last_peered":"2023-08-26T09:25:15.912985+0000","last_clean":"2023-08-26T09:25:15.912985+0000","last_became_active":"2023-08-26T09:25:13.466096+0000","last_became_peered":"2023-08-26T09:25:13.466096+0000","last_unstale":"2023-08-26T09:25:15.912985+0000","last_undegraded":"2023-08-26T09:25:15.912985+0000","last_fullsized":"2023-08-26T09:25:15.912985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:41:18.133401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456227+0000","last_change":"2023-08-26T09:25:14.471815+0000","last_active":"2023-08-26T09:25:15.456227+0000","last_peered":"2023-08-26T09:25:15.456227+0000","last_clean":"2023-08-26T09:25:15.456227+0000","last_became_active":"2023-08-26T09:25:14.471544+0000","last_became_peered":"2023-08-26T09:25:14.471544+0000","last_unstale":"2023-08-26T09:25:15.456227+0000","last_undegraded":"2023-08-26T09:25:15.456227+0000","last_fullsized":"2023-08-26T09:25:15.456227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T13:55:45.487107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914618+0000","last_change":"2023-08-26T09:25:14.473782+0000","last_active":"2023-08-26T09:25:15.914618+0000","last_peered":"2023-08-26T09:25:15.914618+0000","last_clean":"2023-08-26T09:25:15.914618+0000","last_became_active":"2023-08-26T09:25:14.473475+0000","last_became_peered":"2023-08-26T09:25:14.473475+0000","last_unstale":"2023-08-26T09:25:15.914618+0000","last_undegraded":"2023-08-26T09:25:15.914618+0000","last_fullsized":"2023-08-26T09:25:15.914618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:39:35.210853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.450708+0000","last_change":"2023-08-26T09:25:14.482778+0000","last_active":"2023-08-26T09:25:15.450708+0000","last_peered":"2023-08-26T09:25:15.450708+0000","last_clean":"2023-08-26T09:25:15.450708+0000","last_became_active":"2023-08-26T09:25:14.482218+0000","last_became_peered":"2023-08-26T09:25:14.482218+0000","last_unstale":"2023-08-26T09:25:15.450708+0000","last_undegraded":"2023-08-26T09:25:15.450708+0000","last_fullsized":"2023-08-26T09:25:15.450708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:08:30.313992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456397+0000","last_change":"2023-08-26T09:25:14.476104+0000","last_active":"2023-08-26T09:25:15.456397+0000","last_peered":"2023-08-26T09:25:15.456397+0000","last_clean":"2023-08-26T09:25:15.456397+0000","last_became_active":"2023-08-26T09:25:14.475809+0000","last_became_peered":"2023-08-26T09:25:14.475809+0000","last_unstale":"2023-08-26T09:25:15.456397+0000","last_undegraded":"2023-08-26T09:25:15.456397+0000","last_fullsized":"2023-08-26T09:25:15.456397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T19:36:33.198355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.451275+0000","last_change":"2023-08-26T09:25:14.478934+0000","last_active":"2023-08-26T09:25:15.451275+0000","last_peered":"2023-08-26T09:25:15.451275+0000","last_clean":"2023-08-26T09:25:15.451275+0000","last_became_active":"2023-08-26T09:25:14.474961+0000","last_became_peered":"2023-08-26T09:25:14.474961+0000","last_unstale":"2023-08-26T09:25:15.451275+0000","last_undegraded":"2023-08-26T09:25:15.451275+0000","last_fullsized":"2023-08-26T09:25:15.451275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:50:25.845586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.455647+0000","last_change":"2023-08-26T09:25:14.476525+0000","last_active":"2023-08-26T09:25:15.455647+0000","last_peered":"2023-08-26T09:25:15.455647+0000","last_clean":"2023-08-26T09:25:15.455647+0000","last_became_active":"2023-08-26T09:25:14.476195+0000","last_became_peered":"2023-08-26T09:25:14.476195+0000","last_unstale":"2023-08-26T09:25:15.455647+0000","last_undegraded":"2023-08-26T09:25:15.455647+0000","last_fullsized":"2023-08-26T09:25:15.455647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:39:35.210853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":827392,"data_stored":666624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":74428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":798720,"data_stored":664796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8779999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5739999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4700000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":73649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":200704,"data_stored":73067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":74518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.3260000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.6859999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.3250000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":76096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":75080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-26T09:25:23.276 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-26T09:25:23.432 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.427+0000 7f31ce63a700 1 Processor -- start 2023-08-26T09:25:23.432 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.427+0000 7f31ce63a700 1 -- start start 2023-08-26T09:25:23.434 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.427+0000 7f31ce63a700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f31c815a090 0x7f31c80cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:23.435 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.427+0000 7f31ce63a700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f31c806f4e0 0x7f31c80cd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:23.435 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.427+0000 7f31ce63a700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f31c80cb8e0 0x7f31c80cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:23.435 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.427+0000 7f31ce63a700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c80cc2b0 con 0x7f31c815a090 2023-08-26T09:25:23.435 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.427+0000 7f31ce63a700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c80cf7e0 con 0x7f31c80cb8e0 2023-08-26T09:25:23.436 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.427+0000 7f31ce63a700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c80caec0 con 0x7f31c806f4e0 2023-08-26T09:25:23.436 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.427+0000 7f31c7fff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f31c815a090 0x7f31c80cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:23.436 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.428+0000 7f31c7fff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f31c815a090 0x7f31c80cd2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44900/0 (socket says 172.21.15.92:44900) 2023-08-26T09:25:23.436 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.428+0000 7f31c7fff700 1 -- 172.21.15.92:0/3671227127 learned_addr learned my addr 172.21.15.92:0/3671227127 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:23.436 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.428+0000 7f31c77fe700 1 --2- 172.21.15.92:0/3671227127 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f31c806f4e0 0x7f31c80cd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:23.437 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.428+0000 7f31ccbd7700 1 --2- 172.21.15.92:0/3671227127 >> v2:172.21.15.188:3300/0 conn(0x7f31c80cb8e0 0x7f31c80cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:23.437 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.428+0000 7f31c7fff700 1 -- 172.21.15.92:0/3671227127 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f31c806f4e0 msgr2=0x7f31c80cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:23.437 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.428+0000 7f31c7fff700 1 --2- 172.21.15.92:0/3671227127 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f31c806f4e0 0x7f31c80cd900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:23.437 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.428+0000 7f31c7fff700 1 -- 172.21.15.92:0/3671227127 >> v2:172.21.15.188:3300/0 conn(0x7f31c80cb8e0 msgr2=0x7f31c80cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:23.437 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.428+0000 7f31c7fff700 1 --2- 172.21.15.92:0/3671227127 >> v2:172.21.15.188:3300/0 conn(0x7f31c80cb8e0 0x7f31c80cbd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:23.437 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.428+0000 7f31c7fff700 1 -- 172.21.15.92:0/3671227127 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c80cb160 con 0x7f31c815a090 2023-08-26T09:25:23.438 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.428+0000 7f31ccbd7700 1 --2- 172.21.15.92:0/3671227127 >> v2:172.21.15.188:3300/0 conn(0x7f31c80cb8e0 0x7f31c80cbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:25:23.438 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.428+0000 7f31c7fff700 1 --2- 172.21.15.92:0/3671227127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31c815a090 0x7f31c80cd2d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f31c80b28f0 tx=0x7f31b8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=996376d2bc90bae0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:23.438 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.428+0000 7f31c6ffd700 1 -- 172.21.15.92:0/3671227127 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b800b870 con 0x7f31c815a090 2023-08-26T09:25:23.438 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.428+0000 7f31c6ffd700 1 -- 172.21.15.92:0/3671227127 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b800b9d0 con 0x7f31c815a090 2023-08-26T09:25:23.438 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.428+0000 7f31c6ffd700 1 -- 172.21.15.92:0/3671227127 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b800bd60 con 0x7f31c815a090 2023-08-26T09:25:23.439 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.429+0000 7f31ce63a700 1 -- 172.21.15.92:0/3671227127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31c815a090 msgr2=0x7f31c80cd2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:23.439 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.429+0000 7f31ce63a700 1 --2- 172.21.15.92:0/3671227127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31c815a090 0x7f31c80cd2d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f31c80b28f0 tx=0x7f31b8009bd0 comp rx=0 tx=0).stop 2023-08-26T09:25:23.439 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.429+0000 7f31ce63a700 1 -- 172.21.15.92:0/3671227127 shutdown_connections 2023-08-26T09:25:23.439 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.429+0000 7f31ce63a700 1 --2- 172.21.15.92:0/3671227127 >> v2:172.21.15.188:3300/0 conn(0x7f31c80cb8e0 0x7f31c80cbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:23.439 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.429+0000 7f31ce63a700 1 --2- 172.21.15.92:0/3671227127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31c815a090 0x7f31c80cd2d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:23.440 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.429+0000 7f31ce63a700 1 --2- 172.21.15.92:0/3671227127 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f31c806f4e0 0x7f31c80cd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:23.440 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.429+0000 7f31ce63a700 1 -- 172.21.15.92:0/3671227127 >> 172.21.15.92:0/3671227127 conn(0x7f31c80cc7b0 msgr2=0x7f31c80ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:23.440 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.429+0000 7f31ce63a700 1 -- 172.21.15.92:0/3671227127 shutdown_connections 2023-08-26T09:25:23.440 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.429+0000 7f31ce63a700 1 -- 172.21.15.92:0/3671227127 wait complete. 2023-08-26T09:25:23.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.430+0000 7f31ce63a700 1 Processor -- start 2023-08-26T09:25:23.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.430+0000 7f31ce63a700 1 -- start start 2023-08-26T09:25:23.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.431+0000 7f31ce63a700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f31c806f4e0 0x7f31c80c1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:23.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.431+0000 7f31ce63a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31c80cb8e0 0x7f31c806a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:23.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.431+0000 7f31ce63a700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f31c815a090 0x7f31c806a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:23.444 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.431+0000 7f31ce63a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c80c24c0 con 0x7f31c80cb8e0 2023-08-26T09:25:23.444 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.431+0000 7f31ce63a700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c8145c50 con 0x7f31c815a090 2023-08-26T09:25:23.444 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.431+0000 7f31ce63a700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c8145f30 con 0x7f31c806f4e0 2023-08-26T09:25:23.444 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.431+0000 7f31c77fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31c80cb8e0 0x7f31c806a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:23.444 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.431+0000 7f31c77fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31c80cb8e0 0x7f31c806a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44908/0 (socket says 172.21.15.92:44908) 2023-08-26T09:25:23.445 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.431+0000 7f31c77fe700 1 -- 172.21.15.92:0/3418639234 learned_addr learned my addr 172.21.15.92:0/3418639234 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:23.445 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.431+0000 7f31ccbd7700 1 --2- 172.21.15.92:0/3418639234 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f31c815a090 0x7f31c806a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:23.445 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.431+0000 7f31c7fff700 1 --2- 172.21.15.92:0/3418639234 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f31c806f4e0 0x7f31c80c1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:23.445 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.431+0000 7f31c77fe700 1 -- 172.21.15.92:0/3418639234 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f31c806f4e0 msgr2=0x7f31c80c1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:23.445 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.431+0000 7f31c77fe700 1 --2- 172.21.15.92:0/3418639234 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f31c806f4e0 0x7f31c80c1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:23.446 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.431+0000 7f31c77fe700 1 -- 172.21.15.92:0/3418639234 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f31c815a090 msgr2=0x7f31c806a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:23.446 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.431+0000 7f31c77fe700 1 --2- 172.21.15.92:0/3418639234 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f31c815a090 0x7f31c806a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:23.446 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.431+0000 7f31c77fe700 1 -- 172.21.15.92:0/3418639234 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b8009550 con 0x7f31c80cb8e0 2023-08-26T09:25:23.446 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.431+0000 7f31c77fe700 1 --2- 172.21.15.92:0/3418639234 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31c80cb8e0 0x7f31c806a320 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f31bc00c7f0 tx=0x7f31bc00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:23.446 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.432+0000 7f31c4ff9700 1 -- 172.21.15.92:0/3418639234 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc011800 con 0x7f31c80cb8e0 2023-08-26T09:25:23.447 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.432+0000 7f31c4ff9700 1 -- 172.21.15.92:0/3418639234 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31bc011960 con 0x7f31c80cb8e0 2023-08-26T09:25:23.447 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.432+0000 7f31ce63a700 1 -- 172.21.15.92:0/3418639234 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31c8146210 con 0x7f31c80cb8e0 2023-08-26T09:25:23.447 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.432+0000 7f31c4ff9700 1 -- 172.21.15.92:0/3418639234 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc011d10 con 0x7f31c80cb8e0 2023-08-26T09:25:23.447 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.432+0000 7f31ce63a700 1 -- 172.21.15.92:0/3418639234 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31c81467d0 con 0x7f31c80cb8e0 2023-08-26T09:25:23.447 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.433+0000 7f31ce63a700 1 -- 172.21.15.92:0/3418639234 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31c81469f0 con 0x7f31c80cb8e0 2023-08-26T09:25:23.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.433+0000 7f31c4ff9700 1 -- 172.21.15.92:0/3418639234 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f31bc018360 con 0x7f31c80cb8e0 2023-08-26T09:25:23.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.433+0000 7f31c4ff9700 1 --2- 172.21.15.92:0/3418639234 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f31b406a0e0 0x7f31b406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:23.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.433+0000 7f31c4ff9700 1 -- 172.21.15.92:0/3418639234 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f31bc088440 con 0x7f31c80cb8e0 2023-08-26T09:25:23.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.433+0000 7f31c7fff700 1 --2- 172.21.15.92:0/3418639234 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f31b406a0e0 0x7f31b406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:23.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.434+0000 7f31c7fff700 1 --2- 172.21.15.92:0/3418639234 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f31b406a0e0 0x7f31b406c5a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f31c81f5840 tx=0x7f31b8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:23.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.438+0000 7f31c4ff9700 1 -- 172.21.15.92:0/3418639234 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f31bc053bc0 con 0x7f31c80cb8e0 2023-08-26T09:25:23.629 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.624+0000 7f31ce63a700 1 -- 172.21.15.92:0/3418639234 --> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f31c806e260 con 0x7f31b406a0e0 2023-08-26T09:25:23.636 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.631+0000 7f31c4ff9700 1 -- 172.21.15.92:0/3418639234 <== mgr.4107 v2:172.21.15.92:6832/1988454907 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286849 (secure 0 0 0) 0x7f31b801f070 con 0x7f31b406a0e0 2023-08-26T09:25:23.640 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:25:23.642 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.634+0000 7f31ce63a700 1 -- 172.21.15.92:0/3418639234 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f31b406a0e0 msgr2=0x7f31b406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:23.642 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.634+0000 7f31ce63a700 1 --2- 172.21.15.92:0/3418639234 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f31b406a0e0 0x7f31b406c5a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f31c81f5840 tx=0x7f31b8008030 comp rx=0 tx=0).stop 2023-08-26T09:25:23.642 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.634+0000 7f31ce63a700 1 -- 172.21.15.92:0/3418639234 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31c80cb8e0 msgr2=0x7f31c806a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:23.643 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.634+0000 7f31ce63a700 1 --2- 172.21.15.92:0/3418639234 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31c80cb8e0 0x7f31c806a320 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f31bc00c7f0 tx=0x7f31bc00cbb0 comp rx=0 tx=0).stop 2023-08-26T09:25:23.643 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.634+0000 7f31ce63a700 1 -- 172.21.15.92:0/3418639234 shutdown_connections 2023-08-26T09:25:23.643 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.634+0000 7f31ce63a700 1 --2- 172.21.15.92:0/3418639234 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f31b406a0e0 0x7f31b406c5a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:23.643 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.634+0000 7f31ce63a700 1 --2- 172.21.15.92:0/3418639234 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f31c815a090 0x7f31c806a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:23.643 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.634+0000 7f31ce63a700 1 --2- 172.21.15.92:0/3418639234 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f31c806f4e0 0x7f31c80c1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:23.644 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.634+0000 7f31ce63a700 1 --2- 172.21.15.92:0/3418639234 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31c80cb8e0 0x7f31c806a320 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:23.644 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.634+0000 7f31ce63a700 1 -- 172.21.15.92:0/3418639234 >> 172.21.15.92:0/3418639234 conn(0x7f31c80cc7b0 msgr2=0x7f31c80c5fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:23.644 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.634+0000 7f31ce63a700 1 -- 172.21.15.92:0/3418639234 shutdown_connections 2023-08-26T09:25:23.644 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.634+0000 7f31ce63a700 1 -- 172.21.15.92:0/3418639234 wait complete. 2023-08-26T09:25:23.644 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2023-08-26T09:25:23.652 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-08-26T09:25:22.940028+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219032,"kb_used_data":2816,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755688,"statfs":{"total":773094113280,"available":772869824512,"internally_reserved":0,"allocated":2883584,"data_stored":1778258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.487379"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912486+0000","last_change":"2023-08-26T09:25:14.464286+0000","last_active":"2023-08-26T09:25:15.912486+0000","last_peered":"2023-08-26T09:25:15.912486+0000","last_clean":"2023-08-26T09:25:15.912486+0000","last_became_active":"2023-08-26T09:25:14.463990+0000","last_became_peered":"2023-08-26T09:25:14.463990+0000","last_unstale":"2023-08-26T09:25:15.912486+0000","last_undegraded":"2023-08-26T09:25:15.912486+0000","last_fullsized":"2023-08-26T09:25:15.912486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T10:28:24.469066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912986+0000","last_change":"2023-08-26T09:25:14.478324+0000","last_active":"2023-08-26T09:25:15.912986+0000","last_peered":"2023-08-26T09:25:15.912986+0000","last_clean":"2023-08-26T09:25:15.912986+0000","last_became_active":"2023-08-26T09:25:14.477999+0000","last_became_peered":"2023-08-26T09:25:14.477999+0000","last_unstale":"2023-08-26T09:25:15.912986+0000","last_undegraded":"2023-08-26T09:25:15.912986+0000","last_fullsized":"2023-08-26T09:25:15.912986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:40:12.427554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456847+0000","last_change":"2023-08-26T09:25:14.480250+0000","last_active":"2023-08-26T09:25:15.456847+0000","last_peered":"2023-08-26T09:25:15.456847+0000","last_clean":"2023-08-26T09:25:15.456847+0000","last_became_active":"2023-08-26T09:25:14.478388+0000","last_became_peered":"2023-08-26T09:25:14.478388+0000","last_unstale":"2023-08-26T09:25:15.456847+0000","last_undegraded":"2023-08-26T09:25:15.456847+0000","last_fullsized":"2023-08-26T09:25:15.456847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:47:09.883784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914035+0000","last_change":"2023-08-26T09:25:14.465651+0000","last_active":"2023-08-26T09:25:15.914035+0000","last_peered":"2023-08-26T09:25:15.914035+0000","last_clean":"2023-08-26T09:25:15.914035+0000","last_became_active":"2023-08-26T09:25:14.465256+0000","last_became_peered":"2023-08-26T09:25:14.465256+0000","last_unstale":"2023-08-26T09:25:15.914035+0000","last_undegraded":"2023-08-26T09:25:15.914035+0000","last_fullsized":"2023-08-26T09:25:15.914035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T12:36:01.054979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912897+0000","last_change":"2023-08-26T09:25:14.464842+0000","last_active":"2023-08-26T09:25:15.912897+0000","last_peered":"2023-08-26T09:25:15.912897+0000","last_clean":"2023-08-26T09:25:15.912897+0000","last_became_active":"2023-08-26T09:25:14.464583+0000","last_became_peered":"2023-08-26T09:25:14.464583+0000","last_unstale":"2023-08-26T09:25:15.912897+0000","last_undegraded":"2023-08-26T09:25:15.912897+0000","last_fullsized":"2023-08-26T09:25:15.912897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:40:12.427554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456323+0000","last_change":"2023-08-26T09:25:14.477270+0000","last_active":"2023-08-26T09:25:15.456323+0000","last_peered":"2023-08-26T09:25:15.456323+0000","last_clean":"2023-08-26T09:25:15.456323+0000","last_became_active":"2023-08-26T09:25:14.476947+0000","last_became_peered":"2023-08-26T09:25:14.476947+0000","last_unstale":"2023-08-26T09:25:15.456323+0000","last_undegraded":"2023-08-26T09:25:15.456323+0000","last_fullsized":"2023-08-26T09:25:15.456323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:57:39.300454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914251+0000","last_change":"2023-08-26T09:25:14.481184+0000","last_active":"2023-08-26T09:25:15.914251+0000","last_peered":"2023-08-26T09:25:15.914251+0000","last_clean":"2023-08-26T09:25:15.914251+0000","last_became_active":"2023-08-26T09:25:14.480546+0000","last_became_peered":"2023-08-26T09:25:14.480546+0000","last_unstale":"2023-08-26T09:25:15.914251+0000","last_undegraded":"2023-08-26T09:25:15.914251+0000","last_fullsized":"2023-08-26T09:25:15.914251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T12:08:55.397933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912826+0000","last_change":"2023-08-26T09:25:14.476072+0000","last_active":"2023-08-26T09:25:15.912826+0000","last_peered":"2023-08-26T09:25:15.912826+0000","last_clean":"2023-08-26T09:25:15.912826+0000","last_became_active":"2023-08-26T09:25:14.475757+0000","last_became_peered":"2023-08-26T09:25:14.475757+0000","last_unstale":"2023-08-26T09:25:15.912826+0000","last_undegraded":"2023-08-26T09:25:15.912826+0000","last_fullsized":"2023-08-26T09:25:15.912826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:35:42.200335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912764+0000","last_change":"2023-08-26T09:25:14.465769+0000","last_active":"2023-08-26T09:25:15.912764+0000","last_peered":"2023-08-26T09:25:15.912764+0000","last_clean":"2023-08-26T09:25:15.912764+0000","last_became_active":"2023-08-26T09:25:14.465320+0000","last_became_peered":"2023-08-26T09:25:14.465320+0000","last_unstale":"2023-08-26T09:25:15.912764+0000","last_undegraded":"2023-08-26T09:25:15.912764+0000","last_fullsized":"2023-08-26T09:25:15.912764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:35:42.200335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.913305+0000","last_change":"2023-08-26T09:25:14.474303+0000","last_active":"2023-08-26T09:25:15.913305+0000","last_peered":"2023-08-26T09:25:15.913305+0000","last_clean":"2023-08-26T09:25:15.913305+0000","last_became_active":"2023-08-26T09:25:14.474007+0000","last_became_peered":"2023-08-26T09:25:14.474007+0000","last_unstale":"2023-08-26T09:25:15.913305+0000","last_undegraded":"2023-08-26T09:25:15.913305+0000","last_fullsized":"2023-08-26T09:25:15.913305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:08:30.313992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456892+0000","last_change":"2023-08-26T09:25:14.481555+0000","last_active":"2023-08-26T09:25:15.456892+0000","last_peered":"2023-08-26T09:25:15.456892+0000","last_clean":"2023-08-26T09:25:15.456892+0000","last_became_active":"2023-08-26T09:25:14.481266+0000","last_became_peered":"2023-08-26T09:25:14.481266+0000","last_unstale":"2023-08-26T09:25:15.456892+0000","last_undegraded":"2023-08-26T09:25:15.456892+0000","last_fullsized":"2023-08-26T09:25:15.456892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T16:56:24.503758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912603+0000","last_change":"2023-08-26T09:25:14.483240+0000","last_active":"2023-08-26T09:25:15.912603+0000","last_peered":"2023-08-26T09:25:15.912603+0000","last_clean":"2023-08-26T09:25:15.912603+0000","last_became_active":"2023-08-26T09:25:14.482944+0000","last_became_peered":"2023-08-26T09:25:14.482944+0000","last_unstale":"2023-08-26T09:25:15.912603+0000","last_undegraded":"2023-08-26T09:25:15.912603+0000","last_fullsized":"2023-08-26T09:25:15.912603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T19:09:52.055178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912575+0000","last_change":"2023-08-26T09:25:14.467043+0000","last_active":"2023-08-26T09:25:15.912575+0000","last_peered":"2023-08-26T09:25:15.912575+0000","last_clean":"2023-08-26T09:25:15.912575+0000","last_became_active":"2023-08-26T09:25:14.466612+0000","last_became_peered":"2023-08-26T09:25:14.466612+0000","last_unstale":"2023-08-26T09:25:15.912575+0000","last_undegraded":"2023-08-26T09:25:15.912575+0000","last_fullsized":"2023-08-26T09:25:15.912575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T13:47:16.562890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.913110+0000","last_change":"2023-08-26T09:25:14.475578+0000","last_active":"2023-08-26T09:25:15.913110+0000","last_peered":"2023-08-26T09:25:15.913110+0000","last_clean":"2023-08-26T09:25:15.913110+0000","last_became_active":"2023-08-26T09:25:14.475270+0000","last_became_peered":"2023-08-26T09:25:14.475270+0000","last_unstale":"2023-08-26T09:25:15.913110+0000","last_undegraded":"2023-08-26T09:25:15.913110+0000","last_fullsized":"2023-08-26T09:25:15.913110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:39:35.210853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914404+0000","last_change":"2023-08-26T09:25:14.481338+0000","last_active":"2023-08-26T09:25:15.914404+0000","last_peered":"2023-08-26T09:25:15.914404+0000","last_clean":"2023-08-26T09:25:15.914404+0000","last_became_active":"2023-08-26T09:25:14.480937+0000","last_became_peered":"2023-08-26T09:25:14.480937+0000","last_unstale":"2023-08-26T09:25:15.914404+0000","last_undegraded":"2023-08-26T09:25:15.914404+0000","last_fullsized":"2023-08-26T09:25:15.914404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T10:30:08.408755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456272+0000","last_change":"2023-08-26T09:25:14.478860+0000","last_active":"2023-08-26T09:25:15.456272+0000","last_peered":"2023-08-26T09:25:15.456272+0000","last_clean":"2023-08-26T09:25:15.456272+0000","last_became_active":"2023-08-26T09:25:14.475252+0000","last_became_peered":"2023-08-26T09:25:14.475252+0000","last_unstale":"2023-08-26T09:25:15.456272+0000","last_undegraded":"2023-08-26T09:25:15.456272+0000","last_fullsized":"2023-08-26T09:25:15.456272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:08:30.313992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912833+0000","last_change":"2023-08-26T09:25:14.465951+0000","last_active":"2023-08-26T09:25:15.912833+0000","last_peered":"2023-08-26T09:25:15.912833+0000","last_clean":"2023-08-26T09:25:15.912833+0000","last_became_active":"2023-08-26T09:25:14.465336+0000","last_became_peered":"2023-08-26T09:25:14.465336+0000","last_unstale":"2023-08-26T09:25:15.912833+0000","last_undegraded":"2023-08-26T09:25:15.912833+0000","last_fullsized":"2023-08-26T09:25:15.912833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T17:36:47.712402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.457012+0000","last_change":"2023-08-26T09:25:14.480642+0000","last_active":"2023-08-26T09:25:15.457012+0000","last_peered":"2023-08-26T09:25:15.457012+0000","last_clean":"2023-08-26T09:25:15.457012+0000","last_became_active":"2023-08-26T09:25:14.477065+0000","last_became_peered":"2023-08-26T09:25:14.477065+0000","last_unstale":"2023-08-26T09:25:15.457012+0000","last_undegraded":"2023-08-26T09:25:15.457012+0000","last_fullsized":"2023-08-26T09:25:15.457012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T16:55:45.411292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912654+0000","last_change":"2023-08-26T09:25:14.473064+0000","last_active":"2023-08-26T09:25:15.912654+0000","last_peered":"2023-08-26T09:25:15.912654+0000","last_clean":"2023-08-26T09:25:15.912654+0000","last_became_active":"2023-08-26T09:25:14.472726+0000","last_became_peered":"2023-08-26T09:25:14.472726+0000","last_unstale":"2023-08-26T09:25:15.912654+0000","last_undegraded":"2023-08-26T09:25:15.912654+0000","last_fullsized":"2023-08-26T09:25:15.912654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T14:27:21.893277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456821+0000","last_change":"2023-08-26T09:25:14.477899+0000","last_active":"2023-08-26T09:25:15.456821+0000","last_peered":"2023-08-26T09:25:15.456821+0000","last_clean":"2023-08-26T09:25:15.456821+0000","last_became_active":"2023-08-26T09:25:14.477646+0000","last_became_peered":"2023-08-26T09:25:14.477646+0000","last_unstale":"2023-08-26T09:25:15.456821+0000","last_undegraded":"2023-08-26T09:25:15.456821+0000","last_fullsized":"2023-08-26T09:25:15.456821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T21:16:03.436585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914892+0000","last_change":"2023-08-26T09:25:14.474723+0000","last_active":"2023-08-26T09:25:15.914892+0000","last_peered":"2023-08-26T09:25:15.914892+0000","last_clean":"2023-08-26T09:25:15.914892+0000","last_became_active":"2023-08-26T09:25:14.474265+0000","last_became_peered":"2023-08-26T09:25:14.474265+0000","last_unstale":"2023-08-26T09:25:15.914892+0000","last_undegraded":"2023-08-26T09:25:15.914892+0000","last_fullsized":"2023-08-26T09:25:15.914892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:50:25.845586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912833+0000","last_change":"2023-08-26T09:25:14.480019+0000","last_active":"2023-08-26T09:25:15.912833+0000","last_peered":"2023-08-26T09:25:15.912833+0000","last_clean":"2023-08-26T09:25:15.912833+0000","last_became_active":"2023-08-26T09:25:14.479765+0000","last_became_peered":"2023-08-26T09:25:14.479765+0000","last_unstale":"2023-08-26T09:25:15.912833+0000","last_undegraded":"2023-08-26T09:25:15.912833+0000","last_fullsized":"2023-08-26T09:25:15.912833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:53:08.855565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.450667+0000","last_change":"2023-08-26T09:25:14.467611+0000","last_active":"2023-08-26T09:25:15.450667+0000","last_peered":"2023-08-26T09:25:15.450667+0000","last_clean":"2023-08-26T09:25:15.450667+0000","last_became_active":"2023-08-26T09:25:14.467315+0000","last_became_peered":"2023-08-26T09:25:14.467315+0000","last_unstale":"2023-08-26T09:25:15.450667+0000","last_undegraded":"2023-08-26T09:25:15.450667+0000","last_fullsized":"2023-08-26T09:25:15.450667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T20:25:04.985842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914297+0000","last_change":"2023-08-26T09:25:14.474950+0000","last_active":"2023-08-26T09:25:15.914297+0000","last_peered":"2023-08-26T09:25:15.914297+0000","last_clean":"2023-08-26T09:25:15.914297+0000","last_became_active":"2023-08-26T09:25:14.474642+0000","last_became_peered":"2023-08-26T09:25:14.474642+0000","last_unstale":"2023-08-26T09:25:15.914297+0000","last_undegraded":"2023-08-26T09:25:15.914297+0000","last_fullsized":"2023-08-26T09:25:15.914297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T19:36:33.198355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.455614+0000","last_change":"2023-08-26T09:25:14.477808+0000","last_active":"2023-08-26T09:25:15.455614+0000","last_peered":"2023-08-26T09:25:15.455614+0000","last_clean":"2023-08-26T09:25:15.455614+0000","last_became_active":"2023-08-26T09:25:14.477502+0000","last_became_peered":"2023-08-26T09:25:14.477502+0000","last_unstale":"2023-08-26T09:25:15.455614+0000","last_undegraded":"2023-08-26T09:25:15.455614+0000","last_fullsized":"2023-08-26T09:25:15.455614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:40:12.427554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.455764+0000","last_change":"2023-08-26T09:25:14.478759+0000","last_active":"2023-08-26T09:25:15.455764+0000","last_peered":"2023-08-26T09:25:15.455764+0000","last_clean":"2023-08-26T09:25:15.455764+0000","last_became_active":"2023-08-26T09:25:14.478540+0000","last_became_peered":"2023-08-26T09:25:14.478540+0000","last_unstale":"2023-08-26T09:25:15.455764+0000","last_undegraded":"2023-08-26T09:25:15.455764+0000","last_fullsized":"2023-08-26T09:25:15.455764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T13:55:45.487107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.913386+0000","last_change":"2023-08-26T09:25:14.479900+0000","last_active":"2023-08-26T09:25:15.913386+0000","last_peered":"2023-08-26T09:25:15.913386+0000","last_clean":"2023-08-26T09:25:15.913386+0000","last_became_active":"2023-08-26T09:25:14.479407+0000","last_became_peered":"2023-08-26T09:25:14.479407+0000","last_unstale":"2023-08-26T09:25:15.913386+0000","last_undegraded":"2023-08-26T09:25:15.913386+0000","last_fullsized":"2023-08-26T09:25:15.913386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:41:19.138754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456515+0000","last_change":"2023-08-26T09:25:13.467208+0000","last_active":"2023-08-26T09:25:15.456515+0000","last_peered":"2023-08-26T09:25:15.456515+0000","last_clean":"2023-08-26T09:25:15.456515+0000","last_became_active":"2023-08-26T09:25:13.466920+0000","last_became_peered":"2023-08-26T09:25:13.466920+0000","last_unstale":"2023-08-26T09:25:15.456515+0000","last_undegraded":"2023-08-26T09:25:15.456515+0000","last_fullsized":"2023-08-26T09:25:15.456515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T13:12:05.420158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.450851+0000","last_change":"2023-08-26T09:25:14.474437+0000","last_active":"2023-08-26T09:25:15.450851+0000","last_peered":"2023-08-26T09:25:15.450851+0000","last_clean":"2023-08-26T09:25:15.450851+0000","last_became_active":"2023-08-26T09:25:14.474159+0000","last_became_peered":"2023-08-26T09:25:14.474159+0000","last_unstale":"2023-08-26T09:25:15.450851+0000","last_undegraded":"2023-08-26T09:25:15.450851+0000","last_fullsized":"2023-08-26T09:25:15.450851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T19:36:33.198355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.455463+0000","last_change":"2023-08-26T09:25:13.473039+0000","last_active":"2023-08-26T09:25:15.455463+0000","last_peered":"2023-08-26T09:25:15.455463+0000","last_clean":"2023-08-26T09:25:15.455463+0000","last_became_active":"2023-08-26T09:25:13.472691+0000","last_became_peered":"2023-08-26T09:25:13.472691+0000","last_unstale":"2023-08-26T09:25:15.455463+0000","last_undegraded":"2023-08-26T09:25:15.455463+0000","last_fullsized":"2023-08-26T09:25:15.455463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T17:36:46.707048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.913417+0000","last_change":"2023-08-26T09:25:14.476192+0000","last_active":"2023-08-26T09:25:15.913417+0000","last_peered":"2023-08-26T09:25:15.913417+0000","last_clean":"2023-08-26T09:25:15.913417+0000","last_became_active":"2023-08-26T09:25:14.475936+0000","last_became_peered":"2023-08-26T09:25:14.475936+0000","last_unstale":"2023-08-26T09:25:15.913417+0000","last_undegraded":"2023-08-26T09:25:15.913417+0000","last_fullsized":"2023-08-26T09:25:15.913417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:08:05.287372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.451045+0000","last_change":"2023-08-26T09:25:13.464715+0000","last_active":"2023-08-26T09:25:15.451045+0000","last_peered":"2023-08-26T09:25:15.451045+0000","last_clean":"2023-08-26T09:25:15.451045+0000","last_became_active":"2023-08-26T09:25:13.462699+0000","last_became_peered":"2023-08-26T09:25:13.462699+0000","last_unstale":"2023-08-26T09:25:15.451045+0000","last_undegraded":"2023-08-26T09:25:15.451045+0000","last_fullsized":"2023-08-26T09:25:15.451045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T17:21:10.806672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914232+0000","last_change":"2023-08-26T09:25:14.468187+0000","last_active":"2023-08-26T09:25:15.914232+0000","last_peered":"2023-08-26T09:25:15.914232+0000","last_clean":"2023-08-26T09:25:15.914232+0000","last_became_active":"2023-08-26T09:25:14.467908+0000","last_became_peered":"2023-08-26T09:25:14.467908+0000","last_unstale":"2023-08-26T09:25:15.914232+0000","last_undegraded":"2023-08-26T09:25:15.914232+0000","last_fullsized":"2023-08-26T09:25:15.914232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:35:42.200335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912929+0000","last_change":"2023-08-26T09:25:13.465714+0000","last_active":"2023-08-26T09:25:15.912929+0000","last_peered":"2023-08-26T09:25:15.912929+0000","last_clean":"2023-08-26T09:25:15.912929+0000","last_became_active":"2023-08-26T09:25:13.465457+0000","last_became_peered":"2023-08-26T09:25:13.465457+0000","last_unstale":"2023-08-26T09:25:15.912929+0000","last_undegraded":"2023-08-26T09:25:15.912929+0000","last_fullsized":"2023-08-26T09:25:15.912929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T16:12:41.071106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.450927+0000","last_change":"2023-08-26T09:25:14.480898+0000","last_active":"2023-08-26T09:25:15.450927+0000","last_peered":"2023-08-26T09:25:15.450927+0000","last_clean":"2023-08-26T09:25:15.450927+0000","last_became_active":"2023-08-26T09:25:14.480599+0000","last_became_peered":"2023-08-26T09:25:14.480599+0000","last_unstale":"2023-08-26T09:25:15.450927+0000","last_undegraded":"2023-08-26T09:25:15.450927+0000","last_fullsized":"2023-08-26T09:25:15.450927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T10:30:08.408755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.913038+0000","last_change":"2023-08-26T09:25:13.465637+0000","last_active":"2023-08-26T09:25:15.913038+0000","last_peered":"2023-08-26T09:25:15.913038+0000","last_clean":"2023-08-26T09:25:15.913038+0000","last_became_active":"2023-08-26T09:25:13.465347+0000","last_became_peered":"2023-08-26T09:25:13.465347+0000","last_unstale":"2023-08-26T09:25:15.913038+0000","last_undegraded":"2023-08-26T09:25:15.913038+0000","last_fullsized":"2023-08-26T09:25:15.913038+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T16:12:41.071106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.450800+0000","last_change":"2023-08-26T09:25:14.481625+0000","last_active":"2023-08-26T09:25:15.450800+0000","last_peered":"2023-08-26T09:25:15.450800+0000","last_clean":"2023-08-26T09:25:15.450800+0000","last_became_active":"2023-08-26T09:25:14.481225+0000","last_became_peered":"2023-08-26T09:25:14.481225+0000","last_unstale":"2023-08-26T09:25:15.450800+0000","last_undegraded":"2023-08-26T09:25:15.450800+0000","last_fullsized":"2023-08-26T09:25:15.450800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:57:39.300454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914883+0000","last_change":"2023-08-26T09:25:13.472891+0000","last_active":"2023-08-26T09:25:15.914883+0000","last_peered":"2023-08-26T09:25:15.914883+0000","last_clean":"2023-08-26T09:25:15.914883+0000","last_became_active":"2023-08-26T09:25:13.472559+0000","last_became_peered":"2023-08-26T09:25:13.472559+0000","last_unstale":"2023-08-26T09:25:15.914883+0000","last_undegraded":"2023-08-26T09:25:15.914883+0000","last_fullsized":"2023-08-26T09:25:15.914883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:47:08.878431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.455409+0000","last_change":"2023-08-26T09:25:14.477752+0000","last_active":"2023-08-26T09:25:15.455409+0000","last_peered":"2023-08-26T09:25:15.455409+0000","last_clean":"2023-08-26T09:25:15.455409+0000","last_became_active":"2023-08-26T09:25:14.477352+0000","last_became_peered":"2023-08-26T09:25:14.477352+0000","last_unstale":"2023-08-26T09:25:15.455409+0000","last_undegraded":"2023-08-26T09:25:15.455409+0000","last_fullsized":"2023-08-26T09:25:15.455409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:35:42.200335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456948+0000","last_change":"2023-08-26T09:25:13.463758+0000","last_active":"2023-08-26T09:25:15.456948+0000","last_peered":"2023-08-26T09:25:15.456948+0000","last_clean":"2023-08-26T09:25:15.456948+0000","last_became_active":"2023-08-26T09:25:13.462510+0000","last_became_peered":"2023-08-26T09:25:13.462510+0000","last_unstale":"2023-08-26T09:25:15.456948+0000","last_undegraded":"2023-08-26T09:25:15.456948+0000","last_fullsized":"2023-08-26T09:25:15.456948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T17:28:48.518473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456875+0000","last_change":"2023-08-26T09:25:14.471833+0000","last_active":"2023-08-26T09:25:15.456875+0000","last_peered":"2023-08-26T09:25:15.456875+0000","last_clean":"2023-08-26T09:25:15.456875+0000","last_became_active":"2023-08-26T09:25:14.471529+0000","last_became_peered":"2023-08-26T09:25:14.471529+0000","last_unstale":"2023-08-26T09:25:15.456875+0000","last_undegraded":"2023-08-26T09:25:15.456875+0000","last_fullsized":"2023-08-26T09:25:15.456875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:50:25.845586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914699+0000","last_change":"2023-08-26T09:25:13.467178+0000","last_active":"2023-08-26T09:25:15.914699+0000","last_peered":"2023-08-26T09:25:15.914699+0000","last_clean":"2023-08-26T09:25:15.914699+0000","last_became_active":"2023-08-26T09:25:13.466871+0000","last_became_peered":"2023-08-26T09:25:13.466871+0000","last_unstale":"2023-08-26T09:25:15.914699+0000","last_undegraded":"2023-08-26T09:25:15.914699+0000","last_fullsized":"2023-08-26T09:25:15.914699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T20:38:25.405572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.451584+0000","last_change":"2023-08-26T09:25:14.474363+0000","last_active":"2023-08-26T09:25:15.451584+0000","last_peered":"2023-08-26T09:25:15.451584+0000","last_clean":"2023-08-26T09:25:15.451584+0000","last_became_active":"2023-08-26T09:25:14.473676+0000","last_became_peered":"2023-08-26T09:25:14.473676+0000","last_unstale":"2023-08-26T09:25:15.451584+0000","last_undegraded":"2023-08-26T09:25:15.451584+0000","last_fullsized":"2023-08-26T09:25:15.451584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:32:16.860545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912984+0000","last_change":"2023-08-26T09:25:13.465320+0000","last_active":"2023-08-26T09:25:15.912984+0000","last_peered":"2023-08-26T09:25:15.912984+0000","last_clean":"2023-08-26T09:25:15.912984+0000","last_became_active":"2023-08-26T09:25:13.465025+0000","last_became_peered":"2023-08-26T09:25:13.465025+0000","last_unstale":"2023-08-26T09:25:15.912984+0000","last_undegraded":"2023-08-26T09:25:15.912984+0000","last_fullsized":"2023-08-26T09:25:15.912984+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:39:34.205499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.913337+0000","last_change":"2023-08-26T09:25:14.479704+0000","last_active":"2023-08-26T09:25:15.913337+0000","last_peered":"2023-08-26T09:25:15.913337+0000","last_clean":"2023-08-26T09:25:15.913337+0000","last_became_active":"2023-08-26T09:25:14.479039+0000","last_became_peered":"2023-08-26T09:25:14.479039+0000","last_unstale":"2023-08-26T09:25:15.913337+0000","last_undegraded":"2023-08-26T09:25:15.913337+0000","last_fullsized":"2023-08-26T09:25:15.913337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:57:39.300454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914313+0000","last_change":"2023-08-26T09:25:13.465191+0000","last_active":"2023-08-26T09:25:15.914313+0000","last_peered":"2023-08-26T09:25:15.914313+0000","last_clean":"2023-08-26T09:25:15.914313+0000","last_became_active":"2023-08-26T09:25:13.464895+0000","last_became_peered":"2023-08-26T09:25:13.464895+0000","last_unstale":"2023-08-26T09:25:15.914313+0000","last_undegraded":"2023-08-26T09:25:15.914313+0000","last_fullsized":"2023-08-26T09:25:15.914313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:08:04.282019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.913110+0000","last_change":"2023-08-26T09:25:14.461784+0000","last_active":"2023-08-26T09:25:15.913110+0000","last_peered":"2023-08-26T09:25:15.913110+0000","last_clean":"2023-08-26T09:25:15.913110+0000","last_became_active":"2023-08-26T09:25:14.461510+0000","last_became_peered":"2023-08-26T09:25:14.461510+0000","last_unstale":"2023-08-26T09:25:15.913110+0000","last_undegraded":"2023-08-26T09:25:15.913110+0000","last_fullsized":"2023-08-26T09:25:15.913110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:57:39.300454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.913708+0000","last_change":"2023-08-26T09:25:13.459408+0000","last_active":"2023-08-26T09:25:15.913708+0000","last_peered":"2023-08-26T09:25:15.913708+0000","last_clean":"2023-08-26T09:25:15.913708+0000","last_became_active":"2023-08-26T09:25:13.459125+0000","last_became_peered":"2023-08-26T09:25:13.459125+0000","last_unstale":"2023-08-26T09:25:15.913708+0000","last_undegraded":"2023-08-26T09:25:15.913708+0000","last_fullsized":"2023-08-26T09:25:15.913708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:20:02.388922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.451246+0000","last_change":"2023-08-26T09:25:14.479451+0000","last_active":"2023-08-26T09:25:15.451246+0000","last_peered":"2023-08-26T09:25:15.451246+0000","last_clean":"2023-08-26T09:25:15.451246+0000","last_became_active":"2023-08-26T09:25:14.479170+0000","last_became_peered":"2023-08-26T09:25:14.479170+0000","last_unstale":"2023-08-26T09:25:15.451246+0000","last_undegraded":"2023-08-26T09:25:15.451246+0000","last_fullsized":"2023-08-26T09:25:15.451246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:47:09.883784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914856+0000","last_change":"2023-08-26T09:25:13.466893+0000","last_active":"2023-08-26T09:25:15.914856+0000","last_peered":"2023-08-26T09:25:15.914856+0000","last_clean":"2023-08-26T09:25:15.914856+0000","last_became_active":"2023-08-26T09:25:13.466554+0000","last_became_peered":"2023-08-26T09:25:13.466554+0000","last_unstale":"2023-08-26T09:25:15.914856+0000","last_undegraded":"2023-08-26T09:25:15.914856+0000","last_fullsized":"2023-08-26T09:25:15.914856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T21:16:02.431231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912867+0000","last_change":"2023-08-26T09:25:14.479478+0000","last_active":"2023-08-26T09:25:15.912867+0000","last_peered":"2023-08-26T09:25:15.912867+0000","last_clean":"2023-08-26T09:25:15.912867+0000","last_became_active":"2023-08-26T09:25:14.479194+0000","last_became_peered":"2023-08-26T09:25:14.479194+0000","last_unstale":"2023-08-26T09:25:15.912867+0000","last_undegraded":"2023-08-26T09:25:15.912867+0000","last_fullsized":"2023-08-26T09:25:15.912867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T17:36:47.712402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914741+0000","last_change":"2023-08-26T09:25:13.465149+0000","last_active":"2023-08-26T09:25:15.914741+0000","last_peered":"2023-08-26T09:25:15.914741+0000","last_clean":"2023-08-26T09:25:15.914741+0000","last_became_active":"2023-08-26T09:25:13.464867+0000","last_became_peered":"2023-08-26T09:25:13.464867+0000","last_unstale":"2023-08-26T09:25:15.914741+0000","last_undegraded":"2023-08-26T09:25:15.914741+0000","last_fullsized":"2023-08-26T09:25:15.914741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:32:15.855191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456388+0000","last_change":"2023-08-26T09:25:14.482569+0000","last_active":"2023-08-26T09:25:15.456388+0000","last_peered":"2023-08-26T09:25:15.456388+0000","last_clean":"2023-08-26T09:25:15.456388+0000","last_became_active":"2023-08-26T09:25:14.482335+0000","last_became_peered":"2023-08-26T09:25:14.482335+0000","last_unstale":"2023-08-26T09:25:15.456388+0000","last_undegraded":"2023-08-26T09:25:15.456388+0000","last_fullsized":"2023-08-26T09:25:15.456388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T12:08:55.397933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914864+0000","last_change":"2023-08-26T09:25:13.465796+0000","last_active":"2023-08-26T09:25:15.914864+0000","last_peered":"2023-08-26T09:25:15.914864+0000","last_clean":"2023-08-26T09:25:15.914864+0000","last_became_active":"2023-08-26T09:25:13.465506+0000","last_became_peered":"2023-08-26T09:25:13.465506+0000","last_unstale":"2023-08-26T09:25:15.914864+0000","last_undegraded":"2023-08-26T09:25:15.914864+0000","last_fullsized":"2023-08-26T09:25:15.914864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:34:55.483540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914351+0000","last_change":"2023-08-26T09:25:14.478582+0000","last_active":"2023-08-26T09:25:15.914351+0000","last_peered":"2023-08-26T09:25:15.914351+0000","last_clean":"2023-08-26T09:25:15.914351+0000","last_became_active":"2023-08-26T09:25:14.478305+0000","last_became_peered":"2023-08-26T09:25:14.478305+0000","last_unstale":"2023-08-26T09:25:15.914351+0000","last_undegraded":"2023-08-26T09:25:15.914351+0000","last_fullsized":"2023-08-26T09:25:15.914351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:53:08.855565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.913249+0000","last_change":"2023-08-26T09:25:13.472805+0000","last_active":"2023-08-26T09:25:15.913249+0000","last_peered":"2023-08-26T09:25:15.913249+0000","last_clean":"2023-08-26T09:25:15.913249+0000","last_became_active":"2023-08-26T09:25:13.472533+0000","last_became_peered":"2023-08-26T09:25:13.472533+0000","last_unstale":"2023-08-26T09:25:15.913249+0000","last_undegraded":"2023-08-26T09:25:15.913249+0000","last_fullsized":"2023-08-26T09:25:15.913249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T13:55:44.481753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.913084+0000","last_change":"2023-08-26T09:25:14.475468+0000","last_active":"2023-08-26T09:25:15.913084+0000","last_peered":"2023-08-26T09:25:15.913084+0000","last_clean":"2023-08-26T09:25:15.913084+0000","last_became_active":"2023-08-26T09:25:14.475180+0000","last_became_peered":"2023-08-26T09:25:14.475180+0000","last_unstale":"2023-08-26T09:25:15.913084+0000","last_undegraded":"2023-08-26T09:25:15.913084+0000","last_fullsized":"2023-08-26T09:25:15.913084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:08:30.313992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.451147+0000","last_change":"2023-08-26T09:25:13.462794+0000","last_active":"2023-08-26T09:25:15.451147+0000","last_peered":"2023-08-26T09:25:15.451147+0000","last_clean":"2023-08-26T09:25:15.451147+0000","last_became_active":"2023-08-26T09:25:13.462517+0000","last_became_peered":"2023-08-26T09:25:13.462517+0000","last_unstale":"2023-08-26T09:25:15.451147+0000","last_undegraded":"2023-08-26T09:25:15.451147+0000","last_fullsized":"2023-08-26T09:25:15.451147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T21:16:02.431231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456794+0000","last_change":"2023-08-26T09:25:14.476660+0000","last_active":"2023-08-26T09:25:15.456794+0000","last_peered":"2023-08-26T09:25:15.456794+0000","last_clean":"2023-08-26T09:25:15.456794+0000","last_became_active":"2023-08-26T09:25:14.476382+0000","last_became_peered":"2023-08-26T09:25:14.476382+0000","last_unstale":"2023-08-26T09:25:15.456794+0000","last_undegraded":"2023-08-26T09:25:15.456794+0000","last_fullsized":"2023-08-26T09:25:15.456794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:34:56.488893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914383+0000","last_change":"2023-08-26T09:25:13.461050+0000","last_active":"2023-08-26T09:25:15.914383+0000","last_peered":"2023-08-26T09:25:15.914383+0000","last_clean":"2023-08-26T09:25:15.914383+0000","last_became_active":"2023-08-26T09:25:13.460752+0000","last_became_peered":"2023-08-26T09:25:13.460752+0000","last_unstale":"2023-08-26T09:25:15.914383+0000","last_undegraded":"2023-08-26T09:25:15.914383+0000","last_fullsized":"2023-08-26T09:25:15.914383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:40:11.422201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.457068+0000","last_change":"2023-08-26T09:25:14.475179+0000","last_active":"2023-08-26T09:25:15.457068+0000","last_peered":"2023-08-26T09:25:15.457068+0000","last_clean":"2023-08-26T09:25:15.457068+0000","last_became_active":"2023-08-26T09:25:14.474740+0000","last_became_peered":"2023-08-26T09:25:14.474740+0000","last_unstale":"2023-08-26T09:25:15.457068+0000","last_undegraded":"2023-08-26T09:25:15.457068+0000","last_fullsized":"2023-08-26T09:25:15.457068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:43:46.388415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456598+0000","last_change":"2023-08-26T09:25:13.460000+0000","last_active":"2023-08-26T09:25:15.456598+0000","last_peered":"2023-08-26T09:25:15.456598+0000","last_clean":"2023-08-26T09:25:15.456598+0000","last_became_active":"2023-08-26T09:25:13.459242+0000","last_became_peered":"2023-08-26T09:25:13.459242+0000","last_unstale":"2023-08-26T09:25:15.456598+0000","last_undegraded":"2023-08-26T09:25:15.456598+0000","last_fullsized":"2023-08-26T09:25:15.456598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T10:30:07.403402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.457088+0000","last_change":"2023-08-26T09:25:14.476877+0000","last_active":"2023-08-26T09:25:15.457088+0000","last_peered":"2023-08-26T09:25:15.457088+0000","last_clean":"2023-08-26T09:25:15.457088+0000","last_became_active":"2023-08-26T09:25:14.475838+0000","last_became_peered":"2023-08-26T09:25:14.475838+0000","last_unstale":"2023-08-26T09:25:15.457088+0000","last_undegraded":"2023-08-26T09:25:15.457088+0000","last_fullsized":"2023-08-26T09:25:15.457088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:11:33.355206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.450670+0000","last_change":"2023-08-26T09:25:13.462482+0000","last_active":"2023-08-26T09:25:15.450670+0000","last_peered":"2023-08-26T09:25:15.450670+0000","last_clean":"2023-08-26T09:25:15.450670+0000","last_became_active":"2023-08-26T09:25:13.461712+0000","last_became_peered":"2023-08-26T09:25:13.461712+0000","last_unstale":"2023-08-26T09:25:15.450670+0000","last_undegraded":"2023-08-26T09:25:15.450670+0000","last_fullsized":"2023-08-26T09:25:15.450670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T13:55:44.481753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.455779+0000","last_change":"2023-08-26T09:25:14.477795+0000","last_active":"2023-08-26T09:25:15.455779+0000","last_peered":"2023-08-26T09:25:15.455779+0000","last_clean":"2023-08-26T09:25:15.455779+0000","last_became_active":"2023-08-26T09:25:14.477279+0000","last_became_peered":"2023-08-26T09:25:14.477279+0000","last_unstale":"2023-08-26T09:25:15.455779+0000","last_undegraded":"2023-08-26T09:25:15.455779+0000","last_fullsized":"2023-08-26T09:25:15.455779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:08:30.313992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.451120+0000","last_change":"2023-08-26T09:25:13.464458+0000","last_active":"2023-08-26T09:25:15.451120+0000","last_peered":"2023-08-26T09:25:15.451120+0000","last_clean":"2023-08-26T09:25:15.451120+0000","last_became_active":"2023-08-26T09:25:13.464108+0000","last_became_peered":"2023-08-26T09:25:13.464108+0000","last_unstale":"2023-08-26T09:25:15.451120+0000","last_undegraded":"2023-08-26T09:25:15.451120+0000","last_fullsized":"2023-08-26T09:25:15.451120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:34:55.483540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456941+0000","last_change":"2023-08-26T09:25:08.404814+0000","last_active":"2023-08-26T09:25:15.456941+0000","last_peered":"2023-08-26T09:25:15.456941+0000","last_clean":"2023-08-26T09:25:15.456941+0000","last_became_active":"2023-08-26T09:25:08.404465+0000","last_became_peered":"2023-08-26T09:25:08.404465+0000","last_unstale":"2023-08-26T09:25:15.456941+0000","last_undegraded":"2023-08-26T09:25:15.456941+0000","last_fullsized":"2023-08-26T09:25:15.456941+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T17:16:37.346278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.451541+0000","last_change":"2023-08-26T09:25:14.481693+0000","last_active":"2023-08-26T09:25:15.451541+0000","last_peered":"2023-08-26T09:25:15.451541+0000","last_clean":"2023-08-26T09:25:15.451541+0000","last_became_active":"2023-08-26T09:25:14.481214+0000","last_became_peered":"2023-08-26T09:25:14.481214+0000","last_unstale":"2023-08-26T09:25:15.451541+0000","last_undegraded":"2023-08-26T09:25:15.451541+0000","last_fullsized":"2023-08-26T09:25:15.451541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:41:19.138754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.450798+0000","last_change":"2023-08-26T09:25:08.405372+0000","last_active":"2023-08-26T09:25:15.450798+0000","last_peered":"2023-08-26T09:25:15.450798+0000","last_clean":"2023-08-26T09:25:15.450798+0000","last_became_active":"2023-08-26T09:25:08.404984+0000","last_became_peered":"2023-08-26T09:25:08.404984+0000","last_unstale":"2023-08-26T09:25:15.450798+0000","last_undegraded":"2023-08-26T09:25:15.450798+0000","last_fullsized":"2023-08-26T09:25:15.450798+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T12:08:49.341773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:17.117778+0000","last_change":"2023-08-26T09:25:13.462159+0000","last_active":"2023-08-26T09:25:17.117778+0000","last_peered":"2023-08-26T09:25:17.117778+0000","last_clean":"2023-08-26T09:25:17.117778+0000","last_became_active":"2023-08-26T09:25:13.461876+0000","last_became_peered":"2023-08-26T09:25:13.461876+0000","last_unstale":"2023-08-26T09:25:17.117778+0000","last_undegraded":"2023-08-26T09:25:17.117778+0000","last_fullsized":"2023-08-26T09:25:17.117778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T19:36:32.193002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456480+0000","last_change":"2023-08-26T09:25:14.472318+0000","last_active":"2023-08-26T09:25:15.456480+0000","last_peered":"2023-08-26T09:25:15.456480+0000","last_clean":"2023-08-26T09:25:15.456480+0000","last_became_active":"2023-08-26T09:25:14.472047+0000","last_became_peered":"2023-08-26T09:25:14.472047+0000","last_unstale":"2023-08-26T09:25:15.456480+0000","last_undegraded":"2023-08-26T09:25:15.456480+0000","last_fullsized":"2023-08-26T09:25:15.456480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:08:05.287372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.455460+0000","last_change":"2023-08-26T09:25:08.410050+0000","last_active":"2023-08-26T09:25:15.455460+0000","last_peered":"2023-08-26T09:25:15.455460+0000","last_clean":"2023-08-26T09:25:15.455460+0000","last_became_active":"2023-08-26T09:25:08.409798+0000","last_became_peered":"2023-08-26T09:25:08.409798+0000","last_unstale":"2023-08-26T09:25:15.455460+0000","last_undegraded":"2023-08-26T09:25:15.455460+0000","last_fullsized":"2023-08-26T09:25:15.455460+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:53:02.799405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":169,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914315+0000","last_change":"2023-08-26T09:25:08.409089+0000","last_active":"2023-08-26T09:25:15.914315+0000","last_peered":"2023-08-26T09:25:15.914315+0000","last_clean":"2023-08-26T09:25:15.914315+0000","last_became_active":"2023-08-26T09:25:08.408185+0000","last_became_peered":"2023-08-26T09:25:08.408185+0000","last_unstale":"2023-08-26T09:25:15.914315+0000","last_undegraded":"2023-08-26T09:25:15.914315+0000","last_fullsized":"2023-08-26T09:25:15.914315+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T13:12:00.369352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912672+0000","last_change":"2023-08-26T09:25:13.460120+0000","last_active":"2023-08-26T09:25:15.912672+0000","last_peered":"2023-08-26T09:25:15.912672+0000","last_clean":"2023-08-26T09:25:15.912672+0000","last_became_active":"2023-08-26T09:25:13.459827+0000","last_became_peered":"2023-08-26T09:25:13.459827+0000","last_unstale":"2023-08-26T09:25:15.912672+0000","last_undegraded":"2023-08-26T09:25:15.912672+0000","last_fullsized":"2023-08-26T09:25:15.912672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T12:36:00.049625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.913234+0000","last_change":"2023-08-26T09:25:14.480583+0000","last_active":"2023-08-26T09:25:15.913234+0000","last_peered":"2023-08-26T09:25:15.913234+0000","last_clean":"2023-08-26T09:25:15.913234+0000","last_became_active":"2023-08-26T09:25:14.480314+0000","last_became_peered":"2023-08-26T09:25:14.480314+0000","last_unstale":"2023-08-26T09:25:15.913234+0000","last_undegraded":"2023-08-26T09:25:15.913234+0000","last_fullsized":"2023-08-26T09:25:15.913234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T12:08:55.397933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914494+0000","last_change":"2023-08-26T09:25:08.448979+0000","last_active":"2023-08-26T09:25:15.914494+0000","last_peered":"2023-08-26T09:25:15.914494+0000","last_clean":"2023-08-26T09:25:15.914494+0000","last_became_active":"2023-08-26T09:25:08.448706+0000","last_became_peered":"2023-08-26T09:25:08.448706+0000","last_unstale":"2023-08-26T09:25:15.914494+0000","last_undegraded":"2023-08-26T09:25:15.914494+0000","last_fullsized":"2023-08-26T09:25:15.914494+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T17:21:05.755866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.455347+0000","last_change":"2023-08-26T09:25:13.466718+0000","last_active":"2023-08-26T09:25:15.455347+0000","last_peered":"2023-08-26T09:25:15.455347+0000","last_clean":"2023-08-26T09:25:15.455347+0000","last_became_active":"2023-08-26T09:25:13.466411+0000","last_became_peered":"2023-08-26T09:25:13.466411+0000","last_unstale":"2023-08-26T09:25:15.455347+0000","last_undegraded":"2023-08-26T09:25:15.455347+0000","last_fullsized":"2023-08-26T09:25:15.455347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T12:36:00.049625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.455738+0000","last_change":"2023-08-26T09:25:14.477603+0000","last_active":"2023-08-26T09:25:15.455738+0000","last_peered":"2023-08-26T09:25:15.455738+0000","last_clean":"2023-08-26T09:25:15.455738+0000","last_became_active":"2023-08-26T09:25:14.476929+0000","last_became_peered":"2023-08-26T09:25:14.476929+0000","last_unstale":"2023-08-26T09:25:15.455738+0000","last_undegraded":"2023-08-26T09:25:15.455738+0000","last_fullsized":"2023-08-26T09:25:15.455738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:41:19.138754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914092+0000","last_change":"2023-08-26T09:25:08.448601+0000","last_active":"2023-08-26T09:25:15.914092+0000","last_peered":"2023-08-26T09:25:15.914092+0000","last_clean":"2023-08-26T09:25:15.914092+0000","last_became_active":"2023-08-26T09:25:08.448275+0000","last_became_peered":"2023-08-26T09:25:08.448275+0000","last_unstale":"2023-08-26T09:25:15.914092+0000","last_undegraded":"2023-08-26T09:25:15.914092+0000","last_fullsized":"2023-08-26T09:25:15.914092+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:57:33.244294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.450893+0000","last_change":"2023-08-26T09:25:13.464379+0000","last_active":"2023-08-26T09:25:15.450893+0000","last_peered":"2023-08-26T09:25:15.450893+0000","last_clean":"2023-08-26T09:25:15.450893+0000","last_became_active":"2023-08-26T09:25:13.463777+0000","last_became_peered":"2023-08-26T09:25:13.463777+0000","last_unstale":"2023-08-26T09:25:15.450893+0000","last_undegraded":"2023-08-26T09:25:15.450893+0000","last_fullsized":"2023-08-26T09:25:15.450893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T13:12:05.420158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914233+0000","last_change":"2023-08-26T09:25:14.479040+0000","last_active":"2023-08-26T09:25:15.914233+0000","last_peered":"2023-08-26T09:25:15.914233+0000","last_clean":"2023-08-26T09:25:15.914233+0000","last_became_active":"2023-08-26T09:25:14.478759+0000","last_became_peered":"2023-08-26T09:25:14.478759+0000","last_unstale":"2023-08-26T09:25:15.914233+0000","last_undegraded":"2023-08-26T09:25:15.914233+0000","last_fullsized":"2023-08-26T09:25:15.914233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T17:36:47.712402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912847+0000","last_change":"2023-08-26T09:25:08.449014+0000","last_active":"2023-08-26T09:25:15.912847+0000","last_peered":"2023-08-26T09:25:15.912847+0000","last_clean":"2023-08-26T09:25:15.912847+0000","last_became_active":"2023-08-26T09:25:08.448671+0000","last_became_peered":"2023-08-26T09:25:08.448671+0000","last_unstale":"2023-08-26T09:25:15.912847+0000","last_undegraded":"2023-08-26T09:25:15.912847+0000","last_fullsized":"2023-08-26T09:25:15.912847+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:53:02.799405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456678+0000","last_change":"2023-08-26T09:25:13.460870+0000","last_active":"2023-08-26T09:25:15.456678+0000","last_peered":"2023-08-26T09:25:15.456678+0000","last_clean":"2023-08-26T09:25:15.456678+0000","last_became_active":"2023-08-26T09:25:13.460491+0000","last_became_peered":"2023-08-26T09:25:13.460491+0000","last_unstale":"2023-08-26T09:25:15.456678+0000","last_undegraded":"2023-08-26T09:25:15.456678+0000","last_fullsized":"2023-08-26T09:25:15.456678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T20:38:25.405572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.455773+0000","last_change":"2023-08-26T09:25:14.477148+0000","last_active":"2023-08-26T09:25:15.455773+0000","last_peered":"2023-08-26T09:25:15.455773+0000","last_clean":"2023-08-26T09:25:15.455773+0000","last_became_active":"2023-08-26T09:25:14.476854+0000","last_became_peered":"2023-08-26T09:25:14.476854+0000","last_unstale":"2023-08-26T09:25:15.455773+0000","last_undegraded":"2023-08-26T09:25:15.455773+0000","last_fullsized":"2023-08-26T09:25:15.455773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:57:39.300454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.913808+0000","last_change":"2023-08-26T09:25:08.449159+0000","last_active":"2023-08-26T09:25:15.913808+0000","last_peered":"2023-08-26T09:25:15.913808+0000","last_clean":"2023-08-26T09:25:15.913808+0000","last_became_active":"2023-08-26T09:25:08.448870+0000","last_became_peered":"2023-08-26T09:25:08.448870+0000","last_unstale":"2023-08-26T09:25:15.913808+0000","last_undegraded":"2023-08-26T09:25:15.913808+0000","last_fullsized":"2023-08-26T09:25:15.913808+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T19:52:03.570007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.455740+0000","last_change":"2023-08-26T09:25:13.466685+0000","last_active":"2023-08-26T09:25:15.455740+0000","last_peered":"2023-08-26T09:25:15.455740+0000","last_clean":"2023-08-26T09:25:15.455740+0000","last_became_active":"2023-08-26T09:25:13.465771+0000","last_became_peered":"2023-08-26T09:25:13.465771+0000","last_unstale":"2023-08-26T09:25:15.455740+0000","last_undegraded":"2023-08-26T09:25:15.455740+0000","last_fullsized":"2023-08-26T09:25:15.455740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T20:25:03.980488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912999+0000","last_change":"2023-08-26T09:25:14.470265+0000","last_active":"2023-08-26T09:25:15.912999+0000","last_peered":"2023-08-26T09:25:15.912999+0000","last_clean":"2023-08-26T09:25:15.912999+0000","last_became_active":"2023-08-26T09:25:14.469955+0000","last_became_peered":"2023-08-26T09:25:14.469955+0000","last_unstale":"2023-08-26T09:25:15.912999+0000","last_undegraded":"2023-08-26T09:25:15.912999+0000","last_fullsized":"2023-08-26T09:25:15.912999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T20:25:04.985842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914470+0000","last_change":"2023-08-26T09:25:08.403552+0000","last_active":"2023-08-26T09:25:15.914470+0000","last_peered":"2023-08-26T09:25:15.914470+0000","last_clean":"2023-08-26T09:25:15.914470+0000","last_became_active":"2023-08-26T09:25:08.403261+0000","last_became_peered":"2023-08-26T09:25:08.403261+0000","last_unstale":"2023-08-26T09:25:15.914470+0000","last_undegraded":"2023-08-26T09:25:15.914470+0000","last_fullsized":"2023-08-26T09:25:15.914470+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T16:12:36.020300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.913475+0000","last_change":"2023-08-26T09:25:13.472922+0000","last_active":"2023-08-26T09:25:15.913475+0000","last_peered":"2023-08-26T09:25:15.913475+0000","last_clean":"2023-08-26T09:25:15.913475+0000","last_became_active":"2023-08-26T09:25:13.472617+0000","last_became_peered":"2023-08-26T09:25:13.472617+0000","last_unstale":"2023-08-26T09:25:15.913475+0000","last_undegraded":"2023-08-26T09:25:15.913475+0000","last_fullsized":"2023-08-26T09:25:15.913475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T12:08:54.392580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.455804+0000","last_change":"2023-08-26T09:25:14.478564+0000","last_active":"2023-08-26T09:25:15.455804+0000","last_peered":"2023-08-26T09:25:15.455804+0000","last_clean":"2023-08-26T09:25:15.455804+0000","last_became_active":"2023-08-26T09:25:14.476929+0000","last_became_peered":"2023-08-26T09:25:14.476929+0000","last_unstale":"2023-08-26T09:25:15.455804+0000","last_undegraded":"2023-08-26T09:25:15.455804+0000","last_fullsized":"2023-08-26T09:25:15.455804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T16:12:42.076460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.913060+0000","last_change":"2023-08-26T09:25:13.461920+0000","last_active":"2023-08-26T09:25:15.913060+0000","last_peered":"2023-08-26T09:25:15.913060+0000","last_clean":"2023-08-26T09:25:15.913060+0000","last_became_active":"2023-08-26T09:25:13.459797+0000","last_became_peered":"2023-08-26T09:25:13.459797+0000","last_unstale":"2023-08-26T09:25:15.913060+0000","last_undegraded":"2023-08-26T09:25:15.913060+0000","last_fullsized":"2023-08-26T09:25:15.913060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T13:55:44.481753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912637+0000","last_change":"2023-08-26T09:25:14.478962+0000","last_active":"2023-08-26T09:25:15.912637+0000","last_peered":"2023-08-26T09:25:15.912637+0000","last_clean":"2023-08-26T09:25:15.912637+0000","last_became_active":"2023-08-26T09:25:14.478697+0000","last_became_peered":"2023-08-26T09:25:14.478697+0000","last_unstale":"2023-08-26T09:25:15.912637+0000","last_undegraded":"2023-08-26T09:25:15.912637+0000","last_fullsized":"2023-08-26T09:25:15.912637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T16:51:33.426902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.913245+0000","last_change":"2023-08-26T09:25:13.462877+0000","last_active":"2023-08-26T09:25:15.913245+0000","last_peered":"2023-08-26T09:25:15.913245+0000","last_clean":"2023-08-26T09:25:15.913245+0000","last_became_active":"2023-08-26T09:25:13.462284+0000","last_became_peered":"2023-08-26T09:25:13.462284+0000","last_unstale":"2023-08-26T09:25:15.913245+0000","last_undegraded":"2023-08-26T09:25:15.913245+0000","last_fullsized":"2023-08-26T09:25:15.913245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T20:25:03.980488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456631+0000","last_change":"2023-08-26T09:25:14.474944+0000","last_active":"2023-08-26T09:25:15.456631+0000","last_peered":"2023-08-26T09:25:15.456631+0000","last_clean":"2023-08-26T09:25:15.456631+0000","last_became_active":"2023-08-26T09:25:14.474660+0000","last_became_peered":"2023-08-26T09:25:14.474660+0000","last_unstale":"2023-08-26T09:25:15.456631+0000","last_undegraded":"2023-08-26T09:25:15.456631+0000","last_fullsized":"2023-08-26T09:25:15.456631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T17:21:11.812026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.913501+0000","last_change":"2023-08-26T09:25:13.466963+0000","last_active":"2023-08-26T09:25:15.913501+0000","last_peered":"2023-08-26T09:25:15.913501+0000","last_clean":"2023-08-26T09:25:15.913501+0000","last_became_active":"2023-08-26T09:25:13.466504+0000","last_became_peered":"2023-08-26T09:25:13.466504+0000","last_unstale":"2023-08-26T09:25:15.913501+0000","last_undegraded":"2023-08-26T09:25:15.913501+0000","last_fullsized":"2023-08-26T09:25:15.913501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:08:04.282019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456682+0000","last_change":"2023-08-26T09:25:14.475505+0000","last_active":"2023-08-26T09:25:15.456682+0000","last_peered":"2023-08-26T09:25:15.456682+0000","last_clean":"2023-08-26T09:25:15.456682+0000","last_became_active":"2023-08-26T09:25:14.475212+0000","last_became_peered":"2023-08-26T09:25:14.475212+0000","last_unstale":"2023-08-26T09:25:15.456682+0000","last_undegraded":"2023-08-26T09:25:15.456682+0000","last_fullsized":"2023-08-26T09:25:15.456682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:32:16.860545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.451108+0000","last_change":"2023-08-26T09:25:13.460544+0000","last_active":"2023-08-26T09:25:15.451108+0000","last_peered":"2023-08-26T09:25:15.451108+0000","last_clean":"2023-08-26T09:25:15.451108+0000","last_became_active":"2023-08-26T09:25:13.460251+0000","last_became_peered":"2023-08-26T09:25:13.460251+0000","last_unstale":"2023-08-26T09:25:15.451108+0000","last_undegraded":"2023-08-26T09:25:15.451108+0000","last_fullsized":"2023-08-26T09:25:15.451108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T20:38:25.405572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.450863+0000","last_change":"2023-08-26T09:25:14.474840+0000","last_active":"2023-08-26T09:25:15.450863+0000","last_peered":"2023-08-26T09:25:15.450863+0000","last_clean":"2023-08-26T09:25:15.450863+0000","last_became_active":"2023-08-26T09:25:14.474547+0000","last_became_peered":"2023-08-26T09:25:14.474547+0000","last_unstale":"2023-08-26T09:25:15.450863+0000","last_undegraded":"2023-08-26T09:25:15.450863+0000","last_fullsized":"2023-08-26T09:25:15.450863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:08:05.287372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.912985+0000","last_change":"2023-08-26T09:25:13.466467+0000","last_active":"2023-08-26T09:25:15.912985+0000","last_peered":"2023-08-26T09:25:15.912985+0000","last_clean":"2023-08-26T09:25:15.912985+0000","last_became_active":"2023-08-26T09:25:13.466096+0000","last_became_peered":"2023-08-26T09:25:13.466096+0000","last_unstale":"2023-08-26T09:25:15.912985+0000","last_undegraded":"2023-08-26T09:25:15.912985+0000","last_fullsized":"2023-08-26T09:25:15.912985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:12.436134+0000","last_clean_scrub_stamp":"2023-08-26T09:25:12.436134+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:41:18.133401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456227+0000","last_change":"2023-08-26T09:25:14.471815+0000","last_active":"2023-08-26T09:25:15.456227+0000","last_peered":"2023-08-26T09:25:15.456227+0000","last_clean":"2023-08-26T09:25:15.456227+0000","last_became_active":"2023-08-26T09:25:14.471544+0000","last_became_peered":"2023-08-26T09:25:14.471544+0000","last_unstale":"2023-08-26T09:25:15.456227+0000","last_undegraded":"2023-08-26T09:25:15.456227+0000","last_fullsized":"2023-08-26T09:25:15.456227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T13:55:45.487107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.914618+0000","last_change":"2023-08-26T09:25:14.473782+0000","last_active":"2023-08-26T09:25:15.914618+0000","last_peered":"2023-08-26T09:25:15.914618+0000","last_clean":"2023-08-26T09:25:15.914618+0000","last_became_active":"2023-08-26T09:25:14.473475+0000","last_became_peered":"2023-08-26T09:25:14.473475+0000","last_unstale":"2023-08-26T09:25:15.914618+0000","last_undegraded":"2023-08-26T09:25:15.914618+0000","last_fullsized":"2023-08-26T09:25:15.914618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:39:35.210853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.450708+0000","last_change":"2023-08-26T09:25:14.482778+0000","last_active":"2023-08-26T09:25:15.450708+0000","last_peered":"2023-08-26T09:25:15.450708+0000","last_clean":"2023-08-26T09:25:15.450708+0000","last_became_active":"2023-08-26T09:25:14.482218+0000","last_became_peered":"2023-08-26T09:25:14.482218+0000","last_unstale":"2023-08-26T09:25:15.450708+0000","last_undegraded":"2023-08-26T09:25:15.450708+0000","last_fullsized":"2023-08-26T09:25:15.450708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:08:30.313992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.456397+0000","last_change":"2023-08-26T09:25:14.476104+0000","last_active":"2023-08-26T09:25:15.456397+0000","last_peered":"2023-08-26T09:25:15.456397+0000","last_clean":"2023-08-26T09:25:15.456397+0000","last_became_active":"2023-08-26T09:25:14.475809+0000","last_became_peered":"2023-08-26T09:25:14.475809+0000","last_unstale":"2023-08-26T09:25:15.456397+0000","last_undegraded":"2023-08-26T09:25:15.456397+0000","last_fullsized":"2023-08-26T09:25:15.456397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T19:36:33.198355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.451275+0000","last_change":"2023-08-26T09:25:14.478934+0000","last_active":"2023-08-26T09:25:15.451275+0000","last_peered":"2023-08-26T09:25:15.451275+0000","last_clean":"2023-08-26T09:25:15.451275+0000","last_became_active":"2023-08-26T09:25:14.474961+0000","last_became_peered":"2023-08-26T09:25:14.474961+0000","last_unstale":"2023-08-26T09:25:15.451275+0000","last_undegraded":"2023-08-26T09:25:15.451275+0000","last_fullsized":"2023-08-26T09:25:15.451275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:50:25.845586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-26T09:25:15.455647+0000","last_change":"2023-08-26T09:25:14.476525+0000","last_active":"2023-08-26T09:25:15.455647+0000","last_peered":"2023-08-26T09:25:15.455647+0000","last_clean":"2023-08-26T09:25:15.455647+0000","last_became_active":"2023-08-26T09:25:14.476195+0000","last_became_peered":"2023-08-26T09:25:14.476195+0000","last_unstale":"2023-08-26T09:25:15.455647+0000","last_undegraded":"2023-08-26T09:25:15.455647+0000","last_fullsized":"2023-08-26T09:25:15.455647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:13.441487+0000","last_clean_scrub_stamp":"2023-08-26T09:25:13.441487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:39:35.210853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":827392,"data_stored":666624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":74428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":798720,"data_stored":664796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8779999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5739999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4700000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":73649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":200704,"data_stored":73067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":74518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.3260000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.6859999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.3250000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":76096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":75080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-26T09:25:23.657 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-08-26T09:25:23.658 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-08-26T09:25:23.658 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-08-26T09:25:23.658 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-08-26T09:25:23.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.806+0000 7f8fdb228700 1 Processor -- start 2023-08-26T09:25:23.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.806+0000 7f8fdb228700 1 -- start start 2023-08-26T09:25:23.814 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.807+0000 7f8fdb228700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f8fd40ca620 0x7f8fd40caa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:23.814 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.807+0000 7f8fdb228700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8fd406cd60 0x7f8fd406d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:23.814 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.807+0000 7f8fdb228700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fd40cf4d0 con 0x7f8fd415d6c0 2023-08-26T09:25:23.814 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.807+0000 7f8fdb228700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fd40cb4a0 con 0x7f8fd40ca620 2023-08-26T09:25:23.814 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.807+0000 7f8fdb228700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd40caf40 con 0x7f8fd406cd60 2023-08-26T09:25:23.815 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.807+0000 7f8fd3fff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f8fd415d6c0 0x7f8fd40cea30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:56930/0 (socket says 172.21.15.92:56930) 2023-08-26T09:25:23.815 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.807+0000 7f8fd3fff700 1 -- 172.21.15.92:0/3903176175 learned_addr learned my addr 172.21.15.92:0/3903176175 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:23.815 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.807+0000 7f8fd8fc4700 1 --2- 172.21.15.92:0/3903176175 >> v2:172.21.15.188:3300/0 conn(0x7f8fd40ca620 0x7f8fd40caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:23.815 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.807+0000 7f8fd97c5700 1 --2- 172.21.15.92:0/3903176175 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8fd406cd60 0x7f8fd406d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:23.815 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.807+0000 7f8fd37fe700 1 -- 172.21.15.92:0/3903176175 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3966724101 0 0) 0x7f8fd40cf4d0 con 0x7f8fd415d6c0 2023-08-26T09:25:23.817 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.807+0000 7f8fd37fe700 1 -- 172.21.15.92:0/3903176175 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fc40035b0 con 0x7f8fd415d6c0 2023-08-26T09:25:23.817 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.807+0000 7f8fd37fe700 1 -- 172.21.15.92:0/3903176175 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1316853324 0 0) 0x7f8fc40035b0 con 0x7f8fd415d6c0 2023-08-26T09:25:23.817 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.807+0000 7f8fd8fc4700 1 -- 172.21.15.92:0/3903176175 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8fd406cd60 msgr2=0x7f8fd406d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:23.817 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.807+0000 7f8fd8fc4700 1 --2- 172.21.15.92:0/3903176175 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8fd406cd60 0x7f8fd406d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:23.818 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.807+0000 7f8fd8fc4700 1 -- 172.21.15.92:0/3903176175 >> v1:172.21.15.92:6789/0 conn(0x7f8fd415d6c0 legacy=0x7f8fd40cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:23.818 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.807+0000 7f8fd8fc4700 1 -- 172.21.15.92:0/3903176175 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd40ce3b0 con 0x7f8fd40ca620 2023-08-26T09:25:23.818 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.808+0000 7f8fd8fc4700 1 --2- 172.21.15.92:0/3903176175 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8fd40ca620 0x7f8fd40caa00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8009840 tx=0x7f8fc8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99404f1535114575 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:23.818 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.808+0000 7f8fd37fe700 1 -- 172.21.15.92:0/3903176175 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc0001670 con 0x7f8fd40ca620 2023-08-26T09:25:23.819 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.808+0000 7f8fd37fe700 1 -- 172.21.15.92:0/3903176175 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc8004030 con 0x7f8fd40ca620 2023-08-26T09:25:23.819 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.808+0000 7f8fd37fe700 1 -- 172.21.15.92:0/3903176175 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc80043c0 con 0x7f8fd40ca620 2023-08-26T09:25:23.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.808+0000 7f8fdb228700 1 -- 172.21.15.92:0/3903176175 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8fd40ca620 msgr2=0x7f8fd40caa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:23.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.808+0000 7f8fdb228700 1 --2- 172.21.15.92:0/3903176175 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8fd40ca620 0x7f8fd40caa00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8009840 tx=0x7f8fc8009b50 comp rx=0 tx=0).stop 2023-08-26T09:25:23.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.808+0000 7f8fdb228700 1 -- 172.21.15.92:0/3903176175 shutdown_connections 2023-08-26T09:25:23.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.808+0000 7f8fdb228700 1 --2- 172.21.15.92:0/3903176175 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8fd40ca620 0x7f8fd40caa00 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:23.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.808+0000 7f8fdb228700 1 --2- 172.21.15.92:0/3903176175 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8fd406cd60 0x7f8fd406d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:23.821 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.808+0000 7f8fdb228700 1 -- 172.21.15.92:0/3903176175 >> 172.21.15.92:0/3903176175 conn(0x7f8fd40cc7b0 msgr2=0x7f8fd40ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:23.821 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.808+0000 7f8fdb228700 1 -- 172.21.15.92:0/3903176175 shutdown_connections 2023-08-26T09:25:23.821 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.808+0000 7f8fdb228700 1 -- 172.21.15.92:0/3903176175 wait complete. 2023-08-26T09:25:23.825 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.809+0000 7f8fdb228700 1 Processor -- start 2023-08-26T09:25:23.825 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.810+0000 7f8fdb228700 1 -- start start 2023-08-26T09:25:23.826 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.810+0000 7f8fdb228700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8fd406cd60 0x7f8fd40c5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:23.826 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.810+0000 7f8fdb228700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8fd40ca620 0x7f8fd41583d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:23.826 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.810+0000 7f8fdb228700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8fd415d6c0 0x7f8fd4158910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:23.826 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.810+0000 7f8fdb228700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd415b560 con 0x7f8fd415d6c0 2023-08-26T09:25:23.827 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.810+0000 7f8fdb228700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd415abc0 con 0x7f8fd40ca620 2023-08-26T09:25:23.827 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.810+0000 7f8fdb228700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd415aea0 con 0x7f8fd406cd60 2023-08-26T09:25:23.827 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.810+0000 7f8fd97c5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8fd415d6c0 0x7f8fd4158910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:23.827 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.811+0000 7f8fd97c5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8fd415d6c0 0x7f8fd4158910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44922/0 (socket says 172.21.15.92:44922) 2023-08-26T09:25:23.827 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.811+0000 7f8fd97c5700 1 -- 172.21.15.92:0/60207778 learned_addr learned my addr 172.21.15.92:0/60207778 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:23.828 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.811+0000 7f8fd8fc4700 1 --2- 172.21.15.92:0/60207778 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8fd406cd60 0x7f8fd40c5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:23.828 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.811+0000 7f8fd3fff700 1 --2- 172.21.15.92:0/60207778 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8fd40ca620 0x7f8fd41583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:23.829 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.811+0000 7f8fd97c5700 1 -- 172.21.15.92:0/60207778 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8fd406cd60 msgr2=0x7f8fd40c5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:23.829 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.811+0000 7f8fd97c5700 1 --2- 172.21.15.92:0/60207778 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8fd406cd60 0x7f8fd40c5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:23.829 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.811+0000 7f8fd97c5700 1 -- 172.21.15.92:0/60207778 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8fd40ca620 msgr2=0x7f8fd41583d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:23.829 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.811+0000 7f8fd97c5700 1 --2- 172.21.15.92:0/60207778 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8fd40ca620 0x7f8fd41583d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:23.829 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.811+0000 7f8fd97c5700 1 -- 172.21.15.92:0/60207778 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc80094a0 con 0x7f8fd415d6c0 2023-08-26T09:25:23.830 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.811+0000 7f8fd97c5700 1 --2- 172.21.15.92:0/60207778 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8fd415d6c0 0x7f8fd4158910 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc00efc0 tx=0x7f8fcc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:23.830 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.811+0000 7f8fd17fa700 1 -- 172.21.15.92:0/60207778 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc009ea0 con 0x7f8fd415d6c0 2023-08-26T09:25:23.830 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.811+0000 7f8fd17fa700 1 -- 172.21.15.92:0/60207778 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fcc00f040 con 0x7f8fd415d6c0 2023-08-26T09:25:23.830 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.811+0000 7f8fd17fa700 1 -- 172.21.15.92:0/60207778 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc00ced0 con 0x7f8fd415d6c0 2023-08-26T09:25:23.831 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.811+0000 7f8fdb228700 1 -- 172.21.15.92:0/60207778 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fd415b180 con 0x7f8fd415d6c0 2023-08-26T09:25:23.831 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.811+0000 7f8fdb228700 1 -- 172.21.15.92:0/60207778 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fd415ce10 con 0x7f8fd415d6c0 2023-08-26T09:25:23.831 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.812+0000 7f8fdb228700 1 -- 172.21.15.92:0/60207778 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fd415b6a0 con 0x7f8fd415d6c0 2023-08-26T09:25:23.831 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.813+0000 7f8fd17fa700 1 -- 172.21.15.92:0/60207778 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8fcc014480 con 0x7f8fd415d6c0 2023-08-26T09:25:23.832 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.813+0000 7f8fd17fa700 1 --2- 172.21.15.92:0/60207778 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f8fb806a0e0 0x7f8fb806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:23.832 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.813+0000 7f8fd8fc4700 1 --2- 172.21.15.92:0/60207778 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f8fb806a0e0 0x7f8fb806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:23.832 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.813+0000 7f8fd17fa700 1 -- 172.21.15.92:0/60207778 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8fcc088de0 con 0x7f8fd415d6c0 2023-08-26T09:25:23.832 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.813+0000 7f8fd8fc4700 1 --2- 172.21.15.92:0/60207778 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f8fb806a0e0 0x7f8fb806c5a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8009790 tx=0x7f8fc8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:23.832 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:23.817+0000 7f8fd17fa700 1 -- 172.21.15.92:0/60207778 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8fd415b6a0 con 0x7f8fd415d6c0 2023-08-26T09:25:24.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.054+0000 7f8fdb228700 1 -- 172.21.15.92:0/60207778 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f8fd415b6a0 con 0x7f8fd415d6c0 2023-08-26T09:25:24.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.054+0000 7f8fd17fa700 1 -- 172.21.15.92:0/60207778 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f8fcc018040 con 0x7f8fd415d6c0 2023-08-26T09:25:24.060 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:25:24.060 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-08-26T09:25:24.062 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.056+0000 7f8fdb228700 1 -- 172.21.15.92:0/60207778 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f8fb806a0e0 msgr2=0x7f8fb806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:24.062 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.056+0000 7f8fdb228700 1 --2- 172.21.15.92:0/60207778 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f8fb806a0e0 0x7f8fb806c5a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8009790 tx=0x7f8fc8008030 comp rx=0 tx=0).stop 2023-08-26T09:25:24.062 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.056+0000 7f8fdb228700 1 -- 172.21.15.92:0/60207778 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8fd415d6c0 msgr2=0x7f8fd4158910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:24.062 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.056+0000 7f8fdb228700 1 --2- 172.21.15.92:0/60207778 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8fd415d6c0 0x7f8fd4158910 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc00efc0 tx=0x7f8fcc00c3a0 comp rx=0 tx=0).stop 2023-08-26T09:25:24.063 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.056+0000 7f8fdb228700 1 -- 172.21.15.92:0/60207778 shutdown_connections 2023-08-26T09:25:24.063 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.056+0000 7f8fdb228700 1 --2- 172.21.15.92:0/60207778 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8fd415d6c0 0x7f8fd4158910 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:24.063 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.056+0000 7f8fdb228700 1 --2- 172.21.15.92:0/60207778 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8fd406cd60 0x7f8fd40c5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:24.063 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.056+0000 7f8fdb228700 1 --2- 172.21.15.92:0/60207778 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f8fb806a0e0 0x7f8fb806c5a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:24.064 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.056+0000 7f8fdb228700 1 --2- 172.21.15.92:0/60207778 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8fd40ca620 0x7f8fd41583d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:24.064 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.056+0000 7f8fdb228700 1 -- 172.21.15.92:0/60207778 >> 172.21.15.92:0/60207778 conn(0x7f8fd40cc7b0 msgr2=0x7f8fd406d290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:24.064 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.056+0000 7f8fdb228700 1 -- 172.21.15.92:0/60207778 shutdown_connections 2023-08-26T09:25:24.065 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.056+0000 7f8fdb228700 1 -- 172.21.15.92:0/60207778 wait complete. 2023-08-26T09:25:24.074 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-08-26T09:25:24.074 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-26T09:25:24.194 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.189+0000 7f120374a700 1 Processor -- start 2023-08-26T09:25:24.194 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.189+0000 7f120374a700 1 -- start start 2023-08-26T09:25:24.197 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.190+0000 7f120374a700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f11fc06aa30 0x7f11fc0cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:24.197 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.190+0000 7f120374a700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f11fc066230 0x7f11fc06ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:24.197 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.190+0000 7f120374a700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11fc0cbcf0 con 0x7f11fc15d670 2023-08-26T09:25:24.198 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.190+0000 7f120374a700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11fc0cbfd0 con 0x7f11fc06aa30 2023-08-26T09:25:24.198 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.190+0000 7f120374a700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11fc0cc2b0 con 0x7f11fc066230 2023-08-26T09:25:24.198 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.190+0000 7f1200ce5700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f11fc06aa30 0x7f11fc0cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:24.198 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.190+0000 7f1200ce5700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f11fc06aa30 0x7f11fc0cfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44930/0 (socket says 172.21.15.92:44930) 2023-08-26T09:25:24.199 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.190+0000 7f1200ce5700 1 -- 172.21.15.92:0/2997311071 learned_addr learned my addr 172.21.15.92:0/2997311071 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:24.199 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.190+0000 7f1201ce7700 1 --2- 172.21.15.92:0/2997311071 >> v2:172.21.15.188:3300/0 conn(0x7f11fc066230 0x7f11fc06ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:24.199 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.190+0000 7f1200ce5700 1 -- 172.21.15.92:0/2997311071 >> v2:172.21.15.188:3300/0 conn(0x7f11fc066230 msgr2=0x7f11fc06ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:24.199 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.190+0000 7f1200ce5700 1 --2- 172.21.15.92:0/2997311071 >> v2:172.21.15.188:3300/0 conn(0x7f11fc066230 0x7f11fc06ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:24.200 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.190+0000 7f1200ce5700 1 -- 172.21.15.92:0/2997311071 >> v1:172.21.15.188:6789/0 conn(0x7f11fc15d670 legacy=0x7f11fc06a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:24.200 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.190+0000 7f1200ce5700 1 -- 172.21.15.92:0/2997311071 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11fc0cc590 con 0x7f11fc06aa30 2023-08-26T09:25:24.200 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.190+0000 7f1200ce5700 1 --2- 172.21.15.92:0/2997311071 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11fc06aa30 0x7f11fc0cfc80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f11fc0c63d0 tx=0x7f11ec009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65597cf116cf20de server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:24.200 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.190+0000 7f11f3fff700 1 -- 172.21.15.92:0/2997311071 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ec004230 con 0x7f11fc06aa30 2023-08-26T09:25:24.200 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.190+0000 7f11f3fff700 1 -- 172.21.15.92:0/2997311071 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11ec004390 con 0x7f11fc06aa30 2023-08-26T09:25:24.201 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.190+0000 7f11f3fff700 1 -- 172.21.15.92:0/2997311071 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ec0036a0 con 0x7f11fc06aa30 2023-08-26T09:25:24.201 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.191+0000 7f120374a700 1 -- 172.21.15.92:0/2997311071 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11fc06aa30 msgr2=0x7f11fc0cfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:24.201 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.191+0000 7f120374a700 1 --2- 172.21.15.92:0/2997311071 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11fc06aa30 0x7f11fc0cfc80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f11fc0c63d0 tx=0x7f11ec009bd0 comp rx=0 tx=0).stop 2023-08-26T09:25:24.201 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.191+0000 7f120374a700 1 -- 172.21.15.92:0/2997311071 shutdown_connections 2023-08-26T09:25:24.201 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.191+0000 7f120374a700 1 --2- 172.21.15.92:0/2997311071 >> v2:172.21.15.188:3300/0 conn(0x7f11fc066230 0x7f11fc06ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:24.202 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.191+0000 7f120374a700 1 --2- 172.21.15.92:0/2997311071 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11fc06aa30 0x7f11fc0cfc80 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:24.202 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.191+0000 7f120374a700 1 -- 172.21.15.92:0/2997311071 >> 172.21.15.92:0/2997311071 conn(0x7f11fc0b23c0 msgr2=0x7f11fc0b27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:24.202 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.191+0000 7f120374a700 1 -- 172.21.15.92:0/2997311071 shutdown_connections 2023-08-26T09:25:24.202 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.191+0000 7f120374a700 1 -- 172.21.15.92:0/2997311071 wait complete. 2023-08-26T09:25:24.203 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.192+0000 7f120374a700 1 Processor -- start 2023-08-26T09:25:24.203 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.192+0000 7f120374a700 1 -- start start 2023-08-26T09:25:24.206 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.193+0000 7f120374a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11fc066230 0x7f11fc15a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:24.206 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.193+0000 7f120374a700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f11fc06aa30 0x7f11fc15da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:24.206 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.193+0000 7f120374a700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f11fc0c6a10 0x7f11fc0c5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:24.207 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.193+0000 7f120374a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11fc0c3f20 con 0x7f11fc066230 2023-08-26T09:25:24.207 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.193+0000 7f120374a700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11fc0c7c90 con 0x7f11fc06aa30 2023-08-26T09:25:24.207 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.193+0000 7f120374a700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11fc0c41e0 con 0x7f11fc0c6a10 2023-08-26T09:25:24.207 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.193+0000 7f12014e6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11fc066230 0x7f11fc15a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:24.208 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.193+0000 7f12014e6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11fc066230 0x7f11fc15a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44934/0 (socket says 172.21.15.92:44934) 2023-08-26T09:25:24.208 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.193+0000 7f12014e6700 1 -- 172.21.15.92:0/4173034481 learned_addr learned my addr 172.21.15.92:0/4173034481 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:24.208 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.193+0000 7f1200ce5700 1 --2- 172.21.15.92:0/4173034481 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f11fc06aa30 0x7f11fc15da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:24.208 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.193+0000 7f1201ce7700 1 --2- 172.21.15.92:0/4173034481 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f11fc0c6a10 0x7f11fc0c5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:24.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.193+0000 7f12014e6700 1 -- 172.21.15.92:0/4173034481 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f11fc0c6a10 msgr2=0x7f11fc0c5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:24.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.193+0000 7f12014e6700 1 --2- 172.21.15.92:0/4173034481 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f11fc0c6a10 0x7f11fc0c5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:24.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.193+0000 7f12014e6700 1 -- 172.21.15.92:0/4173034481 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f11fc06aa30 msgr2=0x7f11fc15da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:24.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.193+0000 7f12014e6700 1 --2- 172.21.15.92:0/4173034481 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f11fc06aa30 0x7f11fc15da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:24.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.193+0000 7f12014e6700 1 -- 172.21.15.92:0/4173034481 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11ec009550 con 0x7f11fc066230 2023-08-26T09:25:24.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.193+0000 7f12014e6700 1 --2- 172.21.15.92:0/4173034481 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11fc066230 0x7f11fc15a440 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f11f800b480 tx=0x7f11f800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:24.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.194+0000 7f11f1ffb700 1 -- 172.21.15.92:0/4173034481 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f8004020 con 0x7f11fc066230 2023-08-26T09:25:24.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.194+0000 7f120374a700 1 -- 172.21.15.92:0/4173034481 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11fc0c73f0 con 0x7f11fc066230 2023-08-26T09:25:24.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.194+0000 7f11f1ffb700 1 -- 172.21.15.92:0/4173034481 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f8004180 con 0x7f11fc066230 2023-08-26T09:25:24.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.194+0000 7f11f1ffb700 1 -- 172.21.15.92:0/4173034481 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f8004530 con 0x7f11fc066230 2023-08-26T09:25:24.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.194+0000 7f120374a700 1 -- 172.21.15.92:0/4173034481 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11fc0c79b0 con 0x7f11fc066230 2023-08-26T09:25:24.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.195+0000 7f120374a700 1 -- 172.21.15.92:0/4173034481 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11fc04e660 con 0x7f11fc066230 2023-08-26T09:25:24.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.195+0000 7f11f1ffb700 1 -- 172.21.15.92:0/4173034481 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f11f80036d0 con 0x7f11fc066230 2023-08-26T09:25:24.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.195+0000 7f11f1ffb700 1 --2- 172.21.15.92:0/4173034481 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f11e006a0e0 0x7f11e006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:24.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.195+0000 7f1200ce5700 1 --2- 172.21.15.92:0/4173034481 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f11e006a0e0 0x7f11e006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:24.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.195+0000 7f11f1ffb700 1 -- 172.21.15.92:0/4173034481 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f11f8087df0 con 0x7f11fc066230 2023-08-26T09:25:24.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.196+0000 7f1200ce5700 1 --2- 172.21.15.92:0/4173034481 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f11e006a0e0 0x7f11e006c5a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f11ec009130 tx=0x7f11ec008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:24.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.200+0000 7f11f1ffb700 1 -- 172.21.15.92:0/4173034481 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f11f80534f0 con 0x7f11fc066230 2023-08-26T09:25:24.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.387+0000 7f120374a700 1 -- 172.21.15.92:0/4173034481 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f11fc0c67f0 con 0x7f11fc066230 2023-08-26T09:25:24.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.389+0000 7f11f1ffb700 1 -- 172.21.15.92:0/4173034481 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+18209 (secure 0 0 0) 0x7f11f8015090 con 0x7f11fc066230 2023-08-26T09:25:24.394 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:25:24.394 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":20,"fsid":"254a2d31-bd41-4507-8326-1b205ac24377","created":"2023-08-26T09:24:55.352131+0000","modified":"2023-08-26T09:25:15.447635+0000","last_up_change":"2023-08-26T09:25:06.124496+0000","last_in_change":"2023-08-26T09:24:57.840725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-26T09:25:06.650431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-26T09:25:06.973382+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-26T09:25:11.584141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-26T09:25:12.814990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e9e7638-4459-4d8d-8e40-130bcf48df66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6819","nonce":382827192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6824","nonce":382827192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6831","nonce":382827192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6827","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6829","nonce":382827192}]},"public_addr":"172.21.15.92:6819/382827192","cluster_addr":"172.21.15.92:6824/382827192","heartbeat_back_addr":"172.21.15.92:6831/382827192","heartbeat_front_addr":"172.21.15.92:6829/382827192","state":["exists","up"]},{"osd":1,"uuid":"164e68c9-aedd-4df5-9b70-f4b1ec3bda13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6809","nonce":618773438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6811","nonce":618773438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6815","nonce":618773438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6813","nonce":618773438}]},"public_addr":"172.21.15.92:6809/618773438","cluster_addr":"172.21.15.92:6811/618773438","heartbeat_back_addr":"172.21.15.92:6815/618773438","heartbeat_front_addr":"172.21.15.92:6813/618773438","state":["exists","up"]},{"osd":2,"uuid":"8701dfee-629a-4d30-82e4-b8fac340303f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6818","nonce":3697397687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6821","nonce":3697397687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6828","nonce":3697397687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6823","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6825","nonce":3697397687}]},"public_addr":"172.21.15.92:6818/3697397687","cluster_addr":"172.21.15.92:6821/3697397687","heartbeat_back_addr":"172.21.15.92:6828/3697397687","heartbeat_front_addr":"172.21.15.92:6825/3697397687","state":["exists","up"]},{"osd":3,"uuid":"93bdc94d-dc07-495f-995a-a6ad072f0247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6801","nonce":3579846453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6803","nonce":3579846453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6807","nonce":3579846453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6805","nonce":3579846453}]},"public_addr":"172.21.15.92:6801/3579846453","cluster_addr":"172.21.15.92:6803/3579846453","heartbeat_back_addr":"172.21.15.92:6807/3579846453","heartbeat_front_addr":"172.21.15.92:6805/3579846453","state":["exists","up"]},{"osd":4,"uuid":"d9d0ea80-8481-46a7-9677-c338d32cf1d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6809","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6811","nonce":3228383424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6813","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6815","nonce":3228383424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6821","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6823","nonce":3228383424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6817","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6819","nonce":3228383424}]},"public_addr":"172.21.15.188:6811/3228383424","cluster_addr":"172.21.15.188:6815/3228383424","heartbeat_back_addr":"172.21.15.188:6823/3228383424","heartbeat_front_addr":"172.21.15.188:6819/3228383424","state":["exists","up"]},{"osd":5,"uuid":"38d03253-467a-456f-bd5e-5a46532a0b18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6801","nonce":1655821054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6803","nonce":1655821054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6807","nonce":1655821054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6805","nonce":1655821054}]},"public_addr":"172.21.15.188:6801/1655821054","cluster_addr":"172.21.15.188:6803/1655821054","heartbeat_back_addr":"172.21.15.188:6807/1655821054","heartbeat_front_addr":"172.21.15.188:6805/1655821054","state":["exists","up"]},{"osd":6,"uuid":"d61564b5-136f-42e5-a843-626c2017cc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6810","nonce":2069976891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6814","nonce":2069976891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6822","nonce":2069976891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6818","nonce":2069976891}]},"public_addr":"172.21.15.188:6810/2069976891","cluster_addr":"172.21.15.188:6814/2069976891","heartbeat_back_addr":"172.21.15.188:6822/2069976891","heartbeat_front_addr":"172.21.15.188:6818/2069976891","state":["exists","up"]},{"osd":7,"uuid":"fae2949e-0d62-42cd-ba72-08f516084b20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6825","nonce":1882888860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6827","nonce":1882888860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6831","nonce":1882888860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6829","nonce":1882888860}]},"public_addr":"172.21.15.188:6825/1882888860","cluster_addr":"172.21.15.188:6827/1882888860","heartbeat_back_addr":"172.21.15.188:6831/1882888860","heartbeat_front_addr":"172.21.15.188:6829/1882888860","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.038523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.063160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.000857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.975572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.023848+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.765194+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.081365+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:05.110745+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-26T09:25:24.396 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.391+0000 7f120374a700 1 -- 172.21.15.92:0/4173034481 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f11e006a0e0 msgr2=0x7f11e006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:24.396 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.391+0000 7f120374a700 1 --2- 172.21.15.92:0/4173034481 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f11e006a0e0 0x7f11e006c5a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f11ec009130 tx=0x7f11ec008030 comp rx=0 tx=0).stop 2023-08-26T09:25:24.397 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.391+0000 7f120374a700 1 -- 172.21.15.92:0/4173034481 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11fc066230 msgr2=0x7f11fc15a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:24.397 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.391+0000 7f120374a700 1 --2- 172.21.15.92:0/4173034481 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11fc066230 0x7f11fc15a440 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f11f800b480 tx=0x7f11f800b840 comp rx=0 tx=0).stop 2023-08-26T09:25:24.397 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.391+0000 7f120374a700 1 -- 172.21.15.92:0/4173034481 shutdown_connections 2023-08-26T09:25:24.397 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.391+0000 7f120374a700 1 --2- 172.21.15.92:0/4173034481 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f11fc0c6a10 0x7f11fc0c5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:24.397 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.391+0000 7f120374a700 1 --2- 172.21.15.92:0/4173034481 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11fc066230 0x7f11fc15a440 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:24.398 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.391+0000 7f120374a700 1 --2- 172.21.15.92:0/4173034481 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f11e006a0e0 0x7f11e006c5a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:24.398 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.391+0000 7f120374a700 1 --2- 172.21.15.92:0/4173034481 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f11fc06aa30 0x7f11fc15da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:24.398 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.391+0000 7f120374a700 1 -- 172.21.15.92:0/4173034481 >> 172.21.15.92:0/4173034481 conn(0x7f11fc0b23c0 msgr2=0x7f11fc0b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:24.399 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.391+0000 7f120374a700 1 -- 172.21.15.92:0/4173034481 shutdown_connections 2023-08-26T09:25:24.399 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.391+0000 7f120374a700 1 -- 172.21.15.92:0/4173034481 wait complete. 2023-08-26T09:25:24.409 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-26T09:25:06.650431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-26T09:25:06.973382+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-26T09:25:11.584141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-26T09:25:12.814990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-26T09:25:24.410 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-26T09:25:24.537 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.528+0000 7f6954b03700 1 Processor -- start 2023-08-26T09:25:24.537 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.529+0000 7f6954b03700 1 -- start start 2023-08-26T09:25:24.537 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.529+0000 7f6954b03700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f695015d490 0x7f695006b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:24.537 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.529+0000 7f6954b03700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f69500b6250 0x7f69500b66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:24.538 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.529+0000 7f6954b03700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69500d25d0 con 0x7f69500b1eb0 2023-08-26T09:25:24.538 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.529+0000 7f6954b03700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69500cdc70 con 0x7f69500b6250 2023-08-26T09:25:24.538 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.529+0000 7f6954b03700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f695015d870 con 0x7f695015d490 2023-08-26T09:25:24.538 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.530+0000 7f694ed9d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f69500b6250 0x7f69500b66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:24.538 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.530+0000 7f694ed9d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f69500b6250 0x7f69500b66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44946/0 (socket says 172.21.15.92:44946) 2023-08-26T09:25:24.539 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.530+0000 7f694ed9d700 1 -- 172.21.15.92:0/73914650 learned_addr learned my addr 172.21.15.92:0/73914650 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:24.539 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.530+0000 7f694e59c700 1 --2- 172.21.15.92:0/73914650 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f695015d490 0x7f695006b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:24.539 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.530+0000 7f694ed9d700 1 -- 172.21.15.92:0/73914650 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f695015d490 msgr2=0x7f695006b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:24.539 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.530+0000 7f694ed9d700 1 --2- 172.21.15.92:0/73914650 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f695015d490 0x7f695006b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:24.539 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.530+0000 7f694ed9d700 1 -- 172.21.15.92:0/73914650 >> v1:172.21.15.188:6789/0 conn(0x7f69500b1eb0 legacy=0x7f69500ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:24.540 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.530+0000 7f694ed9d700 1 -- 172.21.15.92:0/73914650 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69500b57e0 con 0x7f69500b6250 2023-08-26T09:25:24.540 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.530+0000 7f694e59c700 1 --2- 172.21.15.92:0/73914650 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f695015d490 0x7f695006b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:25:24.540 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.530+0000 7f694ed9d700 1 --2- 172.21.15.92:0/73914650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69500b6250 0x7f69500b66e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6948009e50 tx=0x7f694800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a41fefa0c8dd1b6f server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:24.541 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.530+0000 7f694d59a700 1 -- 172.21.15.92:0/73914650 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694800e070 con 0x7f69500b6250 2023-08-26T09:25:24.541 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.530+0000 7f694d59a700 1 -- 172.21.15.92:0/73914650 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6948003a20 con 0x7f69500b6250 2023-08-26T09:25:24.541 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.530+0000 7f694d59a700 1 -- 172.21.15.92:0/73914650 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6948003dd0 con 0x7f69500b6250 2023-08-26T09:25:24.541 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.531+0000 7f6954b03700 1 -- 172.21.15.92:0/73914650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69500b6250 msgr2=0x7f69500b66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:24.541 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.531+0000 7f6954b03700 1 --2- 172.21.15.92:0/73914650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69500b6250 0x7f69500b66e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6948009e50 tx=0x7f694800b330 comp rx=0 tx=0).stop 2023-08-26T09:25:24.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.531+0000 7f6954b03700 1 -- 172.21.15.92:0/73914650 shutdown_connections 2023-08-26T09:25:24.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.531+0000 7f6954b03700 1 --2- 172.21.15.92:0/73914650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69500b6250 0x7f69500b66e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:24.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.531+0000 7f6954b03700 1 --2- 172.21.15.92:0/73914650 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f695015d490 0x7f695006b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:24.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.531+0000 7f6954b03700 1 -- 172.21.15.92:0/73914650 >> 172.21.15.92:0/73914650 conn(0x7f695006aac0 msgr2=0x7f695006aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:24.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.531+0000 7f6954b03700 1 -- 172.21.15.92:0/73914650 shutdown_connections 2023-08-26T09:25:24.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.531+0000 7f6954b03700 1 -- 172.21.15.92:0/73914650 wait complete. 2023-08-26T09:25:24.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.532+0000 7f6954b03700 1 Processor -- start 2023-08-26T09:25:24.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.532+0000 7f6954b03700 1 -- start start 2023-08-26T09:25:24.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.533+0000 7f6954b03700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69500b1eb0 0x7f695014ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:24.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.533+0000 7f6954b03700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69500b6250 0x7f69500c94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:24.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.533+0000 7f6954b03700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f695015d490 0x7f6950149290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:24.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.533+0000 7f6954b03700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695014f1a0 con 0x7f69500b6250 2023-08-26T09:25:24.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.533+0000 7f6954b03700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69500c99f0 con 0x7f695015d490 2023-08-26T09:25:24.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.533+0000 7f6954b03700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69500c8410 con 0x7f69500b1eb0 2023-08-26T09:25:24.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.533+0000 7f694dd9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69500b6250 0x7f69500c94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:24.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.533+0000 7f694dd9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69500b6250 0x7f69500c94b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44950/0 (socket says 172.21.15.92:44950) 2023-08-26T09:25:24.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.533+0000 7f694dd9b700 1 -- 172.21.15.92:0/895441571 learned_addr learned my addr 172.21.15.92:0/895441571 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:24.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.533+0000 7f694e59c700 1 --2- 172.21.15.92:0/895441571 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69500b1eb0 0x7f695014ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:24.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.533+0000 7f694ed9d700 1 --2- 172.21.15.92:0/895441571 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f695015d490 0x7f6950149290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:24.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.533+0000 7f694dd9b700 1 -- 172.21.15.92:0/895441571 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69500b1eb0 msgr2=0x7f695014ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:24.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.533+0000 7f694dd9b700 1 --2- 172.21.15.92:0/895441571 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69500b1eb0 0x7f695014ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:24.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.533+0000 7f694dd9b700 1 -- 172.21.15.92:0/895441571 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f695015d490 msgr2=0x7f6950149290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:24.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.533+0000 7f694dd9b700 1 --2- 172.21.15.92:0/895441571 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f695015d490 0x7f6950149290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:24.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.533+0000 7f694dd9b700 1 -- 172.21.15.92:0/895441571 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6948009b30 con 0x7f69500b6250 2023-08-26T09:25:24.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.533+0000 7f694dd9b700 1 --2- 172.21.15.92:0/895441571 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69500b6250 0x7f69500c94b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f694000b4a0 tx=0x7f694000b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:24.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.534+0000 7f693effd700 1 -- 172.21.15.92:0/895441571 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6940011830 con 0x7f69500b6250 2023-08-26T09:25:24.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.534+0000 7f693effd700 1 -- 172.21.15.92:0/895441571 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6940011990 con 0x7f69500b6250 2023-08-26T09:25:24.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.534+0000 7f6954b03700 1 -- 172.21.15.92:0/895441571 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69500c86f0 con 0x7f69500b6250 2023-08-26T09:25:24.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.534+0000 7f693effd700 1 -- 172.21.15.92:0/895441571 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6940011d40 con 0x7f69500b6250 2023-08-26T09:25:24.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.534+0000 7f6954b03700 1 -- 172.21.15.92:0/895441571 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69500c8cb0 con 0x7f69500b6250 2023-08-26T09:25:24.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.535+0000 7f6954b03700 1 -- 172.21.15.92:0/895441571 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f695004eeb0 con 0x7f69500b6250 2023-08-26T09:25:24.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.535+0000 7f693effd700 1 -- 172.21.15.92:0/895441571 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f694001a400 con 0x7f69500b6250 2023-08-26T09:25:24.551 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.535+0000 7f693effd700 1 --2- 172.21.15.92:0/895441571 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f693006a0e0 0x7f693006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:24.551 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.535+0000 7f693effd700 1 -- 172.21.15.92:0/895441571 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6940088260 con 0x7f69500b6250 2023-08-26T09:25:24.551 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.535+0000 7f694e59c700 1 --2- 172.21.15.92:0/895441571 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f693006a0e0 0x7f693006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:24.551 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.536+0000 7f694e59c700 1 --2- 172.21.15.92:0/895441571 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f693006a0e0 0x7f693006c5a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6944006fd0 tx=0x7f6944008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:24.551 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.540+0000 7f693effd700 1 -- 172.21.15.92:0/895441571 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f69400539e0 con 0x7f69500b6250 2023-08-26T09:25:24.732 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.727+0000 7f6954b03700 1 -- 172.21.15.92:0/895441571 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6950159c70 con 0x7f69500b6250 2023-08-26T09:25:24.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.727+0000 7f693effd700 1 -- 172.21.15.92:0/895441571 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6940057000 con 0x7f69500b6250 2023-08-26T09:25:24.733 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 8 2023-08-26T09:25:24.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.729+0000 7f6954b03700 1 -- 172.21.15.92:0/895441571 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f693006a0e0 msgr2=0x7f693006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:24.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.729+0000 7f6954b03700 1 --2- 172.21.15.92:0/895441571 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f693006a0e0 0x7f693006c5a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6944006fd0 tx=0x7f6944008040 comp rx=0 tx=0).stop 2023-08-26T09:25:24.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.729+0000 7f6954b03700 1 -- 172.21.15.92:0/895441571 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69500b6250 msgr2=0x7f69500c94b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:24.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.729+0000 7f6954b03700 1 --2- 172.21.15.92:0/895441571 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69500b6250 0x7f69500c94b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f694000b4a0 tx=0x7f694000b860 comp rx=0 tx=0).stop 2023-08-26T09:25:24.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.730+0000 7f6954b03700 1 -- 172.21.15.92:0/895441571 shutdown_connections 2023-08-26T09:25:24.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.730+0000 7f6954b03700 1 --2- 172.21.15.92:0/895441571 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f693006a0e0 0x7f693006c5a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:24.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.730+0000 7f6954b03700 1 --2- 172.21.15.92:0/895441571 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f695015d490 0x7f6950149290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:24.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.730+0000 7f6954b03700 1 --2- 172.21.15.92:0/895441571 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69500b1eb0 0x7f695014ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:24.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.730+0000 7f6954b03700 1 --2- 172.21.15.92:0/895441571 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69500b6250 0x7f69500c94b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:24.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.730+0000 7f6954b03700 1 -- 172.21.15.92:0/895441571 >> 172.21.15.92:0/895441571 conn(0x7f695006aac0 msgr2=0x7f69500ce040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:24.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.730+0000 7f6954b03700 1 -- 172.21.15.92:0/895441571 shutdown_connections 2023-08-26T09:25:24.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.730+0000 7f6954b03700 1 -- 172.21.15.92:0/895441571 wait complete. 2023-08-26T09:25:24.747 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-26T09:25:24.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.868+0000 7f86a6e9d700 1 Processor -- start 2023-08-26T09:25:24.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.868+0000 7f86a6e9d700 1 -- start start 2023-08-26T09:25:24.876 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.869+0000 7f86a6e9d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f86a0159dd0 0x7f86a00cf220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:24.876 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.869+0000 7f86a6e9d700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f86a006e110 0x7f86a006e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:24.876 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.869+0000 7f86a6e9d700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86a00c6200 con 0x7f86a0070d20 2023-08-26T09:25:24.877 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.869+0000 7f86a6e9d700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86a006eae0 con 0x7f86a0159dd0 2023-08-26T09:25:24.877 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.869+0000 7f86a6e9d700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86a00ce740 con 0x7f86a006e110 2023-08-26T09:25:24.877 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.869+0000 7f86a4c39700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f86a0159dd0 0x7f86a00cf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:24.877 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.869+0000 7f86a4c39700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f86a0159dd0 0x7f86a00cf220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44956/0 (socket says 172.21.15.92:44956) 2023-08-26T09:25:24.877 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.869+0000 7f86a4c39700 1 -- 172.21.15.92:0/2501885836 learned_addr learned my addr 172.21.15.92:0/2501885836 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:24.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.869+0000 7f86a543a700 1 --1- 172.21.15.92:0/2501885836 >> v1:172.21.15.92:6789/0 conn(0x7f86a0070d20 0x7f86a0071170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:56974/0 (socket says 172.21.15.92:56974) 2023-08-26T09:25:24.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.869+0000 7f869ffff700 1 --2- 172.21.15.92:0/2501885836 >> v2:172.21.15.188:3300/0 conn(0x7f86a006e110 0x7f86a006e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:24.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.869+0000 7f86a4c39700 1 -- 172.21.15.92:0/2501885836 >> v2:172.21.15.188:3300/0 conn(0x7f86a006e110 msgr2=0x7f86a006e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:24.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.869+0000 7f86a4c39700 1 --2- 172.21.15.92:0/2501885836 >> v2:172.21.15.188:3300/0 conn(0x7f86a006e110 0x7f86a006e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:24.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.869+0000 7f86a4c39700 1 -- 172.21.15.92:0/2501885836 >> v1:172.21.15.92:6789/0 conn(0x7f86a0070d20 legacy=0x7f86a0071170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:24.879 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.869+0000 7f86a4c39700 1 -- 172.21.15.92:0/2501885836 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a00cea20 con 0x7f86a0159dd0 2023-08-26T09:25:24.879 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.869+0000 7f869f7fe700 1 -- 172.21.15.92:0/2501885836 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2192550804 0 0) 0x7f86a00c6200 con 0x7f86a0070d20 2023-08-26T09:25:24.879 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.870+0000 7f86a4c39700 1 --2- 172.21.15.92:0/2501885836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86a0159dd0 0x7f86a00cf220 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f86a015d9a0 tx=0x7f8694009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c50f28a2b8304118 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:24.879 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.870+0000 7f869f7fe700 1 -- 172.21.15.92:0/2501885836 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869400b870 con 0x7f86a0159dd0 2023-08-26T09:25:24.879 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.870+0000 7f869f7fe700 1 -- 172.21.15.92:0/2501885836 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f869400b9d0 con 0x7f86a0159dd0 2023-08-26T09:25:24.880 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.870+0000 7f869f7fe700 1 -- 172.21.15.92:0/2501885836 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869400bd60 con 0x7f86a0159dd0 2023-08-26T09:25:24.880 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.870+0000 7f86a6e9d700 1 -- 172.21.15.92:0/2501885836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86a0159dd0 msgr2=0x7f86a00cf220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:24.880 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.870+0000 7f86a6e9d700 1 --2- 172.21.15.92:0/2501885836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86a0159dd0 0x7f86a00cf220 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f86a015d9a0 tx=0x7f8694009bd0 comp rx=0 tx=0).stop 2023-08-26T09:25:24.880 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.870+0000 7f86a6e9d700 1 -- 172.21.15.92:0/2501885836 shutdown_connections 2023-08-26T09:25:24.880 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.870+0000 7f86a6e9d700 1 --2- 172.21.15.92:0/2501885836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86a0159dd0 0x7f86a00cf220 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:24.881 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.870+0000 7f86a6e9d700 1 --2- 172.21.15.92:0/2501885836 >> v2:172.21.15.188:3300/0 conn(0x7f86a006e110 0x7f86a006e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:24.881 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.870+0000 7f86a6e9d700 1 -- 172.21.15.92:0/2501885836 >> 172.21.15.92:0/2501885836 conn(0x7f86a006b430 msgr2=0x7f86a006b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:24.882 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.870+0000 7f86a6e9d700 1 -- 172.21.15.92:0/2501885836 shutdown_connections 2023-08-26T09:25:24.882 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.870+0000 7f86a6e9d700 1 -- 172.21.15.92:0/2501885836 wait complete. 2023-08-26T09:25:24.884 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.872+0000 7f86a6e9d700 1 Processor -- start 2023-08-26T09:25:24.885 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.872+0000 7f86a6e9d700 1 -- start start 2023-08-26T09:25:24.885 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.873+0000 7f86a6e9d700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f86a006e110 0x7f86a013e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:24.885 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.873+0000 7f86a6e9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86a0070d20 0x7f86a015a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:24.885 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.873+0000 7f86a6e9d700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f86a0159dd0 0x7f86a006cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:24.885 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.873+0000 7f86a6e9d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a013eda0 con 0x7f86a0070d20 2023-08-26T09:25:24.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.873+0000 7f86a6e9d700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a015b680 con 0x7f86a0159dd0 2023-08-26T09:25:24.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.873+0000 7f86a6e9d700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86a015b350 con 0x7f86a006e110 2023-08-26T09:25:24.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.873+0000 7f869ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86a0070d20 0x7f86a015a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:24.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.873+0000 7f869ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86a0070d20 0x7f86a015a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44964/0 (socket says 172.21.15.92:44964) 2023-08-26T09:25:24.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.873+0000 7f869ffff700 1 -- 172.21.15.92:0/4164301721 learned_addr learned my addr 172.21.15.92:0/4164301721 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:24.887 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.873+0000 7f86a4c39700 1 --2- 172.21.15.92:0/4164301721 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f86a006e110 0x7f86a013e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:24.887 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.873+0000 7f86a543a700 1 --2- 172.21.15.92:0/4164301721 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f86a0159dd0 0x7f86a006cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:24.887 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.873+0000 7f869ffff700 1 -- 172.21.15.92:0/4164301721 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f86a006e110 msgr2=0x7f86a013e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:24.887 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.873+0000 7f869ffff700 1 --2- 172.21.15.92:0/4164301721 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f86a006e110 0x7f86a013e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:24.888 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.873+0000 7f869ffff700 1 -- 172.21.15.92:0/4164301721 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f86a0159dd0 msgr2=0x7f86a006cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:24.888 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.873+0000 7f869ffff700 1 --2- 172.21.15.92:0/4164301721 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f86a0159dd0 0x7f86a006cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:24.888 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.873+0000 7f869ffff700 1 -- 172.21.15.92:0/4164301721 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8694009550 con 0x7f86a0070d20 2023-08-26T09:25:24.888 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.874+0000 7f869ffff700 1 --2- 172.21.15.92:0/4164301721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86a0070d20 0x7f86a015a1b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f868c00c820 tx=0x7f868c00cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:24.888 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.874+0000 7f869d7fa700 1 -- 172.21.15.92:0/4164301721 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868c011800 con 0x7f86a0070d20 2023-08-26T09:25:24.888 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.874+0000 7f869d7fa700 1 -- 172.21.15.92:0/4164301721 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f868c011960 con 0x7f86a0070d20 2023-08-26T09:25:24.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.874+0000 7f86a6e9d700 1 -- 172.21.15.92:0/4164301721 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86a015a9e0 con 0x7f86a0070d20 2023-08-26T09:25:24.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.874+0000 7f869d7fa700 1 -- 172.21.15.92:0/4164301721 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868c011d10 con 0x7f86a0070d20 2023-08-26T09:25:24.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.874+0000 7f86a6e9d700 1 -- 172.21.15.92:0/4164301721 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86a015afa0 con 0x7f86a0070d20 2023-08-26T09:25:24.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.875+0000 7f86a6e9d700 1 -- 172.21.15.92:0/4164301721 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86a014efb0 con 0x7f86a0070d20 2023-08-26T09:25:24.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.875+0000 7f869d7fa700 1 -- 172.21.15.92:0/4164301721 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f868c018360 con 0x7f86a0070d20 2023-08-26T09:25:24.890 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.875+0000 7f869d7fa700 1 --2- 172.21.15.92:0/4164301721 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f868406a0e0 0x7f868406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:24.890 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.876+0000 7f86a4c39700 1 --2- 172.21.15.92:0/4164301721 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f868406a0e0 0x7f868406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:24.890 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.876+0000 7f869d7fa700 1 -- 172.21.15.92:0/4164301721 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f868c088460 con 0x7f86a0070d20 2023-08-26T09:25:24.890 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.876+0000 7f86a4c39700 1 --2- 172.21.15.92:0/4164301721 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f868406a0e0 0x7f868406c5a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f86a01f1b40 tx=0x7f8694008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:24.891 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:24.880+0000 7f869d7fa700 1 -- 172.21.15.92:0/4164301721 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f868c053b50 con 0x7f86a0070d20 2023-08-26T09:25:25.074 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.069+0000 7f86a6e9d700 1 -- 172.21.15.92:0/4164301721 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f86a004eeb0 con 0x7f86a0070d20 2023-08-26T09:25:25.075 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.070+0000 7f869d7fa700 1 -- 172.21.15.92:0/4164301721 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f868c057170 con 0x7f86a0070d20 2023-08-26T09:25:25.075 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 1 2023-08-26T09:25:25.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.072+0000 7f86a6e9d700 1 -- 172.21.15.92:0/4164301721 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f868406a0e0 msgr2=0x7f868406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:25.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.072+0000 7f86a6e9d700 1 --2- 172.21.15.92:0/4164301721 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f868406a0e0 0x7f868406c5a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f86a01f1b40 tx=0x7f8694008030 comp rx=0 tx=0).stop 2023-08-26T09:25:25.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.072+0000 7f86a6e9d700 1 -- 172.21.15.92:0/4164301721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86a0070d20 msgr2=0x7f86a015a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:25.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.072+0000 7f86a6e9d700 1 --2- 172.21.15.92:0/4164301721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86a0070d20 0x7f86a015a1b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f868c00c820 tx=0x7f868c00cbe0 comp rx=0 tx=0).stop 2023-08-26T09:25:25.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.072+0000 7f86a6e9d700 1 -- 172.21.15.92:0/4164301721 shutdown_connections 2023-08-26T09:25:25.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.072+0000 7f86a6e9d700 1 --2- 172.21.15.92:0/4164301721 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f868406a0e0 0x7f868406c5a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:25.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.072+0000 7f86a6e9d700 1 --2- 172.21.15.92:0/4164301721 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f86a0159dd0 0x7f86a006cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:25.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.072+0000 7f86a6e9d700 1 --2- 172.21.15.92:0/4164301721 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f86a006e110 0x7f86a013e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:25.079 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.072+0000 7f86a6e9d700 1 --2- 172.21.15.92:0/4164301721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86a0070d20 0x7f86a015a1b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:25.079 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.072+0000 7f86a6e9d700 1 -- 172.21.15.92:0/4164301721 >> 172.21.15.92:0/4164301721 conn(0x7f86a006b430 msgr2=0x7f86a00cbd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:25.079 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.072+0000 7f86a6e9d700 1 -- 172.21.15.92:0/4164301721 shutdown_connections 2023-08-26T09:25:25.079 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.072+0000 7f86a6e9d700 1 -- 172.21.15.92:0/4164301721 wait complete. 2023-08-26T09:25:25.089 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-26T09:25:25.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.207+0000 7f14ed524700 1 Processor -- start 2023-08-26T09:25:25.213 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.207+0000 7f14ed524700 1 -- start start 2023-08-26T09:25:25.215 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.208+0000 7f14ed524700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f14e80b2d70 0x7f14e815edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:25.216 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.208+0000 7f14ed524700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f14e80cb4a0 0x7f14e80cb900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:25.216 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.208+0000 7f14ed524700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14e806de90 con 0x7f14e80d0320 2023-08-26T09:25:25.216 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.208+0000 7f14ed524700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14e806eb10 con 0x7f14e80b2d70 2023-08-26T09:25:25.216 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.208+0000 7f14ed524700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14e806e170 con 0x7f14e80cb4a0 2023-08-26T09:25:25.217 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.208+0000 7f14e6ffd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f14e80b2d70 0x7f14e815edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:25.217 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.208+0000 7f14e6ffd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f14e80b2d70 0x7f14e815edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44970/0 (socket says 172.21.15.92:44970) 2023-08-26T09:25:25.217 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.208+0000 7f14e77fe700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f14e80d0320 0x7f14e815ba00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:56988/0 (socket says 172.21.15.92:56988) 2023-08-26T09:25:25.217 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.208+0000 7f14e6ffd700 1 -- 172.21.15.92:0/1033150204 learned_addr learned my addr 172.21.15.92:0/1033150204 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:25.218 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.208+0000 7f14e67fc700 1 --2- 172.21.15.92:0/1033150204 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f14e80cb4a0 0x7f14e80cb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:25.218 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.208+0000 7f14e6ffd700 1 -- 172.21.15.92:0/1033150204 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f14e80cb4a0 msgr2=0x7f14e80cb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:25.218 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.208+0000 7f14e6ffd700 1 --2- 172.21.15.92:0/1033150204 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f14e80cb4a0 0x7f14e80cb900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:25.218 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.208+0000 7f14e6ffd700 1 -- 172.21.15.92:0/1033150204 >> v1:172.21.15.92:6789/0 conn(0x7f14e80d0320 legacy=0x7f14e815ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:25.218 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.208+0000 7f14e5ffb700 1 -- 172.21.15.92:0/1033150204 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3154364205 0 0) 0x7f14e806de90 con 0x7f14e80d0320 2023-08-26T09:25:25.219 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.208+0000 7f14e6ffd700 1 -- 172.21.15.92:0/1033150204 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e806e450 con 0x7f14e80b2d70 2023-08-26T09:25:25.219 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.209+0000 7f14e6ffd700 1 --2- 172.21.15.92:0/1033150204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14e80b2d70 0x7f14e815edd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f14dc0098f0 tx=0x7f14dc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c518c1bea44fd73a server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:25.219 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.209+0000 7f14e5ffb700 1 -- 172.21.15.92:0/1033150204 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14dc00b8a0 con 0x7f14e80b2d70 2023-08-26T09:25:25.219 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.209+0000 7f14e5ffb700 1 -- 172.21.15.92:0/1033150204 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14dc00ba00 con 0x7f14e80b2d70 2023-08-26T09:25:25.219 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.209+0000 7f14e5ffb700 1 -- 172.21.15.92:0/1033150204 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14dc00bd90 con 0x7f14e80b2d70 2023-08-26T09:25:25.220 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.209+0000 7f14ed524700 1 -- 172.21.15.92:0/1033150204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14e80b2d70 msgr2=0x7f14e815edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:25.220 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.209+0000 7f14ed524700 1 --2- 172.21.15.92:0/1033150204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14e80b2d70 0x7f14e815edd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f14dc0098f0 tx=0x7f14dc009c00 comp rx=0 tx=0).stop 2023-08-26T09:25:25.220 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.209+0000 7f14ed524700 1 -- 172.21.15.92:0/1033150204 shutdown_connections 2023-08-26T09:25:25.220 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.209+0000 7f14ed524700 1 --2- 172.21.15.92:0/1033150204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14e80b2d70 0x7f14e815edd0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:25.220 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.209+0000 7f14ed524700 1 --2- 172.21.15.92:0/1033150204 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f14e80cb4a0 0x7f14e80cb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:25.221 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.209+0000 7f14ed524700 1 -- 172.21.15.92:0/1033150204 >> 172.21.15.92:0/1033150204 conn(0x7f14e80cd8d0 msgr2=0x7f14e80cdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:25.221 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.209+0000 7f14ed524700 1 -- 172.21.15.92:0/1033150204 shutdown_connections 2023-08-26T09:25:25.221 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.209+0000 7f14ed524700 1 -- 172.21.15.92:0/1033150204 wait complete. 2023-08-26T09:25:25.221 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.211+0000 7f14ed524700 1 Processor -- start 2023-08-26T09:25:25.221 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.211+0000 7f14ed524700 1 -- start start 2023-08-26T09:25:25.224 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.211+0000 7f14ed524700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f14e80b2d70 0x7f14e8148440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:25.224 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.211+0000 7f14ed524700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f14e80cb4a0 0x7f14e80b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:25.224 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.211+0000 7f14ed524700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14e80d0320 0x7f14e81f3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:25.224 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.211+0000 7f14ed524700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e80c4dd0 con 0x7f14e80d0320 2023-08-26T09:25:25.225 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.211+0000 7f14ed524700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e81f42a0 con 0x7f14e80b2d70 2023-08-26T09:25:25.225 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.211+0000 7f14ed524700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14e81f4580 con 0x7f14e80cb4a0 2023-08-26T09:25:25.225 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.211+0000 7f14e77fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14e80d0320 0x7f14e81f3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:25.225 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.212+0000 7f14e77fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14e80d0320 0x7f14e81f3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44980/0 (socket says 172.21.15.92:44980) 2023-08-26T09:25:25.225 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.212+0000 7f14e77fe700 1 -- 172.21.15.92:0/4276193354 learned_addr learned my addr 172.21.15.92:0/4276193354 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:25.226 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.212+0000 7f14e6ffd700 1 --2- 172.21.15.92:0/4276193354 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f14e80b2d70 0x7f14e8148440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:25.226 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.212+0000 7f14e67fc700 1 --2- 172.21.15.92:0/4276193354 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f14e80cb4a0 0x7f14e80b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:25.226 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.212+0000 7f14e77fe700 1 -- 172.21.15.92:0/4276193354 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f14e80cb4a0 msgr2=0x7f14e80b4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:25.226 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.212+0000 7f14e77fe700 1 --2- 172.21.15.92:0/4276193354 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f14e80cb4a0 0x7f14e80b4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:25.226 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.212+0000 7f14e77fe700 1 -- 172.21.15.92:0/4276193354 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f14e80b2d70 msgr2=0x7f14e8148440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:25.227 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.212+0000 7f14e77fe700 1 --2- 172.21.15.92:0/4276193354 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f14e80b2d70 0x7f14e8148440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:25.227 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.212+0000 7f14e77fe700 1 -- 172.21.15.92:0/4276193354 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14dc009550 con 0x7f14e80d0320 2023-08-26T09:25:25.227 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.212+0000 7f14e77fe700 1 --2- 172.21.15.92:0/4276193354 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14e80d0320 0x7f14e81f3800 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f14e0002230 tx=0x7f14e000cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:25.227 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.212+0000 7f14cf7fe700 1 -- 172.21.15.92:0/4276193354 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e000aac0 con 0x7f14e80d0320 2023-08-26T09:25:25.228 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.212+0000 7f14cf7fe700 1 -- 172.21.15.92:0/4276193354 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14e000ac40 con 0x7f14e80d0320 2023-08-26T09:25:25.228 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.212+0000 7f14ed524700 1 -- 172.21.15.92:0/4276193354 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14e80c4fe0 con 0x7f14e80d0320 2023-08-26T09:25:25.228 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.212+0000 7f14cf7fe700 1 -- 172.21.15.92:0/4276193354 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e00070d0 con 0x7f14e80d0320 2023-08-26T09:25:25.228 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.212+0000 7f14ed524700 1 -- 172.21.15.92:0/4276193354 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14e80cff60 con 0x7f14e80d0320 2023-08-26T09:25:25.228 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.213+0000 7f14ed524700 1 -- 172.21.15.92:0/4276193354 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14e80c5500 con 0x7f14e80d0320 2023-08-26T09:25:25.228 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.213+0000 7f14cf7fe700 1 -- 172.21.15.92:0/4276193354 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f14e0007250 con 0x7f14e80d0320 2023-08-26T09:25:25.229 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.214+0000 7f14cf7fe700 1 --2- 172.21.15.92:0/4276193354 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f14d406a0e0 0x7f14d406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:25.229 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.214+0000 7f14cf7fe700 1 -- 172.21.15.92:0/4276193354 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f14e0088280 con 0x7f14e80d0320 2023-08-26T09:25:25.229 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.214+0000 7f14e6ffd700 1 --2- 172.21.15.92:0/4276193354 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f14d406a0e0 0x7f14d406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:25.229 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.214+0000 7f14e6ffd700 1 --2- 172.21.15.92:0/4276193354 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f14d406a0e0 0x7f14d406c5a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f14dc014040 tx=0x7f14dc008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:25.230 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.218+0000 7f14cf7fe700 1 -- 172.21.15.92:0/4276193354 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f14e80c5500 con 0x7f14e80d0320 2023-08-26T09:25:25.412 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.406+0000 7f14ed524700 1 -- 172.21.15.92:0/4276193354 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f14e80c5500 con 0x7f14e80d0320 2023-08-26T09:25:25.412 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.407+0000 7f14cf7fe700 1 -- 172.21.15.92:0/4276193354 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f14e80c5500 con 0x7f14e80d0320 2023-08-26T09:25:25.412 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 32 2023-08-26T09:25:25.414 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.409+0000 7f14ed524700 1 -- 172.21.15.92:0/4276193354 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f14d406a0e0 msgr2=0x7f14d406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:25.415 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.409+0000 7f14ed524700 1 --2- 172.21.15.92:0/4276193354 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f14d406a0e0 0x7f14d406c5a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f14dc014040 tx=0x7f14dc008030 comp rx=0 tx=0).stop 2023-08-26T09:25:25.415 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.409+0000 7f14ed524700 1 -- 172.21.15.92:0/4276193354 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14e80d0320 msgr2=0x7f14e81f3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:25.415 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.409+0000 7f14ed524700 1 --2- 172.21.15.92:0/4276193354 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14e80d0320 0x7f14e81f3800 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f14e0002230 tx=0x7f14e000cf50 comp rx=0 tx=0).stop 2023-08-26T09:25:25.415 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.409+0000 7f14ed524700 1 -- 172.21.15.92:0/4276193354 shutdown_connections 2023-08-26T09:25:25.415 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.409+0000 7f14ed524700 1 --2- 172.21.15.92:0/4276193354 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f14d406a0e0 0x7f14d406c5a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:25.416 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.409+0000 7f14ed524700 1 --2- 172.21.15.92:0/4276193354 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f14e80b2d70 0x7f14e8148440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:25.416 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.409+0000 7f14ed524700 1 --2- 172.21.15.92:0/4276193354 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14e80d0320 0x7f14e81f3800 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:25.416 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.409+0000 7f14ed524700 1 --2- 172.21.15.92:0/4276193354 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f14e80cb4a0 0x7f14e80b4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:25.416 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.409+0000 7f14ed524700 1 -- 172.21.15.92:0/4276193354 >> 172.21.15.92:0/4276193354 conn(0x7f14e80cd8d0 msgr2=0x7f14e8155370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:25.416 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.409+0000 7f14ed524700 1 -- 172.21.15.92:0/4276193354 shutdown_connections 2023-08-26T09:25:25.417 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.409+0000 7f14ed524700 1 -- 172.21.15.92:0/4276193354 wait complete. 2023-08-26T09:25:25.426 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-26T09:25:25.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.544+0000 7f8aa83ee700 1 Processor -- start 2023-08-26T09:25:25.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.544+0000 7f8aa83ee700 1 -- start start 2023-08-26T09:25:25.551 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.545+0000 7f8aa83ee700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f8aa015d220 0x7f8aa00af390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:25.551 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.545+0000 7f8aa83ee700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8aa006db70 0x7f8aa0070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:25.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.545+0000 7f8aa83ee700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aa00aee50 con 0x7f8aa0071260 2023-08-26T09:25:25.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.545+0000 7f8aa83ee700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aa00af130 con 0x7f8aa015d220 2023-08-26T09:25:25.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.545+0000 7f8aa83ee700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa00c4cb0 con 0x7f8aa006db70 2023-08-26T09:25:25.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.545+0000 7f8aa618a700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f8aa015d220 0x7f8aa00af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:25.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.545+0000 7f8aa698b700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f8aa0071260 0x7f8aa0160d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:57002/0 (socket says 172.21.15.92:57002) 2023-08-26T09:25:25.553 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.545+0000 7f8aa698b700 1 -- 172.21.15.92:0/2408019118 learned_addr learned my addr 172.21.15.92:0/2408019118 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:25.553 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.545+0000 7f8aa5989700 1 --2- 172.21.15.92:0/2408019118 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8aa006db70 0x7f8aa0070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:25.553 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.545+0000 7f8aa5188700 1 -- 172.21.15.92:0/2408019118 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3347992823 0 0) 0x7f8aa00aee50 con 0x7f8aa0071260 2023-08-26T09:25:25.553 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.545+0000 7f8aa5188700 1 -- 172.21.15.92:0/2408019118 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a8c0035b0 con 0x7f8aa0071260 2023-08-26T09:25:25.553 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.545+0000 7f8aa618a700 1 -- 172.21.15.92:0/2408019118 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8aa006db70 msgr2=0x7f8aa0070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:25.554 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.545+0000 7f8aa618a700 1 --2- 172.21.15.92:0/2408019118 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8aa006db70 0x7f8aa0070d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:25.554 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.545+0000 7f8aa618a700 1 -- 172.21.15.92:0/2408019118 >> v1:172.21.15.92:6789/0 conn(0x7f8aa0071260 legacy=0x7f8aa0160d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:25.554 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.545+0000 7f8aa618a700 1 -- 172.21.15.92:0/2408019118 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa00c4f90 con 0x7f8aa015d220 2023-08-26T09:25:25.554 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.545+0000 7f8aa618a700 1 --2- 172.21.15.92:0/2408019118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8aa015d220 0x7f8aa00af390 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c009840 tx=0x7f8a9c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f18ec292e0d94168 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:25.554 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.545+0000 7f8aa5188700 1 -- 172.21.15.92:0/2408019118 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c011830 con 0x7f8aa015d220 2023-08-26T09:25:25.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.545+0000 7f8aa5188700 1 -- 172.21.15.92:0/2408019118 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a9c011990 con 0x7f8aa015d220 2023-08-26T09:25:25.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.545+0000 7f8aa5188700 1 -- 172.21.15.92:0/2408019118 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c011d20 con 0x7f8aa015d220 2023-08-26T09:25:25.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.546+0000 7f8aa83ee700 1 -- 172.21.15.92:0/2408019118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8aa015d220 msgr2=0x7f8aa00af390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:25.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.546+0000 7f8aa83ee700 1 --2- 172.21.15.92:0/2408019118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8aa015d220 0x7f8aa00af390 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c009840 tx=0x7f8a9c009b50 comp rx=0 tx=0).stop 2023-08-26T09:25:25.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.546+0000 7f8aa83ee700 1 -- 172.21.15.92:0/2408019118 shutdown_connections 2023-08-26T09:25:25.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.546+0000 7f8aa83ee700 1 --2- 172.21.15.92:0/2408019118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8aa015d220 0x7f8aa00af390 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:25.556 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.546+0000 7f8aa83ee700 1 --2- 172.21.15.92:0/2408019118 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8aa006db70 0x7f8aa0070d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:25.556 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.546+0000 7f8aa83ee700 1 -- 172.21.15.92:0/2408019118 >> 172.21.15.92:0/2408019118 conn(0x7f8aa006b430 msgr2=0x7f8aa006b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:25.556 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.546+0000 7f8aa83ee700 1 -- 172.21.15.92:0/2408019118 shutdown_connections 2023-08-26T09:25:25.556 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.546+0000 7f8aa83ee700 1 -- 172.21.15.92:0/2408019118 wait complete. 2023-08-26T09:25:25.558 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.547+0000 7f8aa83ee700 1 Processor -- start 2023-08-26T09:25:25.559 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.547+0000 7f8aa83ee700 1 -- start start 2023-08-26T09:25:25.559 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.548+0000 7f8aa83ee700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8aa006db70 0x7f8aa01425e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:25.559 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.548+0000 7f8aa83ee700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8aa0071260 0x7f8aa00b03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:25.559 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.548+0000 7f8aa83ee700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8aa015d220 0x7f8aa00b0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:25.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.548+0000 7f8aa83ee700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa015f470 con 0x7f8aa006db70 2023-08-26T09:25:25.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.548+0000 7f8aa83ee700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa015f170 con 0x7f8aa015d220 2023-08-26T09:25:25.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.548+0000 7f8aa83ee700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa0142b20 con 0x7f8aa0071260 2023-08-26T09:25:25.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.548+0000 7f8aa618a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8aa006db70 0x7f8aa01425e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:25.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.548+0000 7f8aa618a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8aa006db70 0x7f8aa01425e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44990/0 (socket says 172.21.15.92:44990) 2023-08-26T09:25:25.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.548+0000 7f8aa618a700 1 -- 172.21.15.92:0/422047522 learned_addr learned my addr 172.21.15.92:0/422047522 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:25.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.548+0000 7f8aa618a700 1 -- 172.21.15.92:0/422047522 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8aa0071260 msgr2=0x7f8aa00b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:25.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.548+0000 7f8aa618a700 1 --2- 172.21.15.92:0/422047522 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8aa0071260 0x7f8aa00b03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:25.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.548+0000 7f8aa618a700 1 -- 172.21.15.92:0/422047522 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8aa015d220 msgr2=0x7f8aa00b0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:25.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.548+0000 7f8aa618a700 1 --2- 172.21.15.92:0/422047522 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8aa015d220 0x7f8aa00b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:25.562 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.548+0000 7f8aa618a700 1 -- 172.21.15.92:0/422047522 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a9c0094a0 con 0x7f8aa006db70 2023-08-26T09:25:25.562 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.548+0000 7f8aa618a700 1 --2- 172.21.15.92:0/422047522 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8aa006db70 0x7f8aa01425e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c0090b0 tx=0x7f8a9c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:25.562 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.549+0000 7f8a96ffd700 1 -- 172.21.15.92:0/422047522 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c0036a0 con 0x7f8aa006db70 2023-08-26T09:25:25.562 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.549+0000 7f8a96ffd700 1 -- 172.21.15.92:0/422047522 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a9c01e070 con 0x7f8aa006db70 2023-08-26T09:25:25.562 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.549+0000 7f8a96ffd700 1 -- 172.21.15.92:0/422047522 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c003a60 con 0x7f8aa006db70 2023-08-26T09:25:25.563 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.549+0000 7f8aa83ee700 1 -- 172.21.15.92:0/422047522 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aa01445e0 con 0x7f8aa006db70 2023-08-26T09:25:25.563 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.549+0000 7f8aa83ee700 1 -- 172.21.15.92:0/422047522 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aa0144ba0 con 0x7f8aa006db70 2023-08-26T09:25:25.563 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.549+0000 7f8aa83ee700 1 -- 172.21.15.92:0/422047522 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aa015efd0 con 0x7f8aa006db70 2023-08-26T09:25:25.563 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.550+0000 7f8a96ffd700 1 -- 172.21.15.92:0/422047522 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8a9c003bc0 con 0x7f8aa006db70 2023-08-26T09:25:25.563 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.550+0000 7f8a96ffd700 1 --2- 172.21.15.92:0/422047522 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f8a8406a0e0 0x7f8a8406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:25.563 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.550+0000 7f8aa5989700 1 --2- 172.21.15.92:0/422047522 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f8a8406a0e0 0x7f8a8406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:25.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.550+0000 7f8a96ffd700 1 -- 172.21.15.92:0/422047522 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8a9c089510 con 0x7f8aa006db70 2023-08-26T09:25:25.565 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.551+0000 7f8aa5989700 1 --2- 172.21.15.92:0/422047522 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f8a8406a0e0 0x7f8a8406c5a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0161800 tx=0x7f8a90008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:25.566 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.555+0000 7f8a96ffd700 1 -- 172.21.15.92:0/422047522 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8aa015efd0 con 0x7f8aa006db70 2023-08-26T09:25:25.749 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.744+0000 7f8aa83ee700 1 -- 172.21.15.92:0/422047522 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8aa015efd0 con 0x7f8aa006db70 2023-08-26T09:25:25.749 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.744+0000 7f8a96ffd700 1 -- 172.21.15.92:0/422047522 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8aa015efd0 con 0x7f8aa006db70 2023-08-26T09:25:25.750 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 64 2023-08-26T09:25:25.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.746+0000 7f8aa83ee700 1 -- 172.21.15.92:0/422047522 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f8a8406a0e0 msgr2=0x7f8a8406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:25.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.746+0000 7f8aa83ee700 1 --2- 172.21.15.92:0/422047522 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f8a8406a0e0 0x7f8a8406c5a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0161800 tx=0x7f8a90008040 comp rx=0 tx=0).stop 2023-08-26T09:25:25.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.746+0000 7f8aa83ee700 1 -- 172.21.15.92:0/422047522 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8aa006db70 msgr2=0x7f8aa01425e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:25.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.746+0000 7f8aa83ee700 1 --2- 172.21.15.92:0/422047522 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8aa006db70 0x7f8aa01425e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c0090b0 tx=0x7f8a9c004750 comp rx=0 tx=0).stop 2023-08-26T09:25:25.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.746+0000 7f8aa83ee700 1 -- 172.21.15.92:0/422047522 shutdown_connections 2023-08-26T09:25:25.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.746+0000 7f8aa83ee700 1 --2- 172.21.15.92:0/422047522 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f8a8406a0e0 0x7f8a8406c5a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:25.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.746+0000 7f8aa83ee700 1 --2- 172.21.15.92:0/422047522 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8aa015d220 0x7f8aa00b0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:25.753 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.746+0000 7f8aa83ee700 1 --2- 172.21.15.92:0/422047522 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8aa006db70 0x7f8aa01425e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:25.753 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.746+0000 7f8aa83ee700 1 --2- 172.21.15.92:0/422047522 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8aa0071260 0x7f8aa00b03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:25.753 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.746+0000 7f8aa83ee700 1 -- 172.21.15.92:0/422047522 >> 172.21.15.92:0/422047522 conn(0x7f8aa006b430 msgr2=0x7f8aa00cd890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:25.753 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.746+0000 7f8aa83ee700 1 -- 172.21.15.92:0/422047522 shutdown_connections 2023-08-26T09:25:25.753 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.746+0000 7f8aa83ee700 1 -- 172.21.15.92:0/422047522 wait complete. 2023-08-26T09:25:25.764 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-26T09:25:25.884 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.879+0000 7fcbbbe68700 1 Processor -- start 2023-08-26T09:25:25.885 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.879+0000 7fcbbbe68700 1 -- start start 2023-08-26T09:25:25.887 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.880+0000 7fcbbbe68700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcbb415a090 0x7fcbb40cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:25.887 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.880+0000 7fcbbbe68700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fcbb406f4e0 0x7fcbb40cd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:25.887 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.880+0000 7fcbbbe68700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbb40cf7e0 con 0x7fcbb40cb8e0 2023-08-26T09:25:25.888 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.880+0000 7fcbbbe68700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbb40caec0 con 0x7fcbb406f4e0 2023-08-26T09:25:25.888 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.880+0000 7fcbbbe68700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb40cb160 con 0x7fcbb415a090 2023-08-26T09:25:25.888 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.880+0000 7fcbba405700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fcbb40cb8e0 0x7fcbb406e780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:57016/0 (socket says 172.21.15.92:57016) 2023-08-26T09:25:25.888 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.880+0000 7fcbba405700 1 -- 172.21.15.92:0/1362807120 learned_addr learned my addr 172.21.15.92:0/1362807120 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:25.888 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.881+0000 7fcbb9403700 1 --2- 172.21.15.92:0/1362807120 >> v2:172.21.15.92:3300/0 conn(0x7fcbb406f4e0 0x7fcbb40cd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:25.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.881+0000 7fcbb9c04700 1 --2- 172.21.15.92:0/1362807120 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcbb415a090 0x7fcbb40cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:25.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.881+0000 7fcbb8c02700 1 -- 172.21.15.92:0/1362807120 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1454808120 0 0) 0x7fcbb40cf7e0 con 0x7fcbb40cb8e0 2023-08-26T09:25:25.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.881+0000 7fcbb8c02700 1 -- 172.21.15.92:0/1362807120 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcba00035b0 con 0x7fcbb40cb8e0 2023-08-26T09:25:25.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.881+0000 7fcbb9403700 1 -- 172.21.15.92:0/1362807120 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcbb415a090 msgr2=0x7fcbb40cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:25.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.881+0000 7fcbb9403700 1 --2- 172.21.15.92:0/1362807120 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcbb415a090 0x7fcbb40cd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:25.890 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.881+0000 7fcbb9403700 1 -- 172.21.15.92:0/1362807120 >> v1:172.21.15.92:6789/0 conn(0x7fcbb40cb8e0 legacy=0x7fcbb406e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:25.890 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.881+0000 7fcbb9403700 1 -- 172.21.15.92:0/1362807120 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb40cb440 con 0x7fcbb406f4e0 2023-08-26T09:25:25.890 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.881+0000 7fcbb9403700 1 --2- 172.21.15.92:0/1362807120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbb406f4e0 0x7fcbb40cd900 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0009840 tx=0x7fcbb0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3cb149ba442f12f server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:25.890 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.881+0000 7fcbb8c02700 1 -- 172.21.15.92:0/1362807120 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb0011830 con 0x7fcbb406f4e0 2023-08-26T09:25:25.890 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.881+0000 7fcbb8c02700 1 -- 172.21.15.92:0/1362807120 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb0011990 con 0x7fcbb406f4e0 2023-08-26T09:25:25.891 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.881+0000 7fcbb8c02700 1 -- 172.21.15.92:0/1362807120 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb0011d20 con 0x7fcbb406f4e0 2023-08-26T09:25:25.891 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.882+0000 7fcbbbe68700 1 -- 172.21.15.92:0/1362807120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbb406f4e0 msgr2=0x7fcbb40cd900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:25.891 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.882+0000 7fcbbbe68700 1 --2- 172.21.15.92:0/1362807120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbb406f4e0 0x7fcbb40cd900 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0009840 tx=0x7fcbb0009b50 comp rx=0 tx=0).stop 2023-08-26T09:25:25.891 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.882+0000 7fcbbbe68700 1 -- 172.21.15.92:0/1362807120 shutdown_connections 2023-08-26T09:25:25.891 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.882+0000 7fcbbbe68700 1 --2- 172.21.15.92:0/1362807120 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcbb415a090 0x7fcbb40cd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:25.892 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.882+0000 7fcbbbe68700 1 --2- 172.21.15.92:0/1362807120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbb406f4e0 0x7fcbb40cd900 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:25.892 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.882+0000 7fcbbbe68700 1 -- 172.21.15.92:0/1362807120 >> 172.21.15.92:0/1362807120 conn(0x7fcbb40cc7b0 msgr2=0x7fcbb40ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:25.892 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.882+0000 7fcbbbe68700 1 -- 172.21.15.92:0/1362807120 shutdown_connections 2023-08-26T09:25:25.893 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.882+0000 7fcbbbe68700 1 -- 172.21.15.92:0/1362807120 wait complete. 2023-08-26T09:25:25.895 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.883+0000 7fcbbbe68700 1 Processor -- start 2023-08-26T09:25:25.896 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.883+0000 7fcbbbe68700 1 -- start start 2023-08-26T09:25:25.896 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.884+0000 7fcbbbe68700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcbb406f4e0 0x7fcbb41549e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:25.896 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.884+0000 7fcbbbe68700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcbb40cb8e0 0x7fcbb41589f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:25.896 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.884+0000 7fcbbbe68700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbb415a090 0x7fcbb41f02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:25.897 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.884+0000 7fcbbbe68700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb41f1a20 con 0x7fcbb415a090 2023-08-26T09:25:25.897 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.884+0000 7fcbbbe68700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb4154f20 con 0x7fcbb406f4e0 2023-08-26T09:25:25.897 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.884+0000 7fcbbbe68700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb41f0ea0 con 0x7fcbb40cb8e0 2023-08-26T09:25:25.897 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.884+0000 7fcbba405700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbb415a090 0x7fcbb41f02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:25.897 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.884+0000 7fcbba405700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbb415a090 0x7fcbb41f02d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45008/0 (socket says 172.21.15.92:45008) 2023-08-26T09:25:25.898 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.884+0000 7fcbba405700 1 -- 172.21.15.92:0/1043837399 learned_addr learned my addr 172.21.15.92:0/1043837399 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:25.898 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.884+0000 7fcbb9403700 1 --2- 172.21.15.92:0/1043837399 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcbb40cb8e0 0x7fcbb41589f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:25.898 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.884+0000 7fcbb9c04700 1 --2- 172.21.15.92:0/1043837399 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcbb406f4e0 0x7fcbb41549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:25.898 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.884+0000 7fcbba405700 1 -- 172.21.15.92:0/1043837399 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcbb40cb8e0 msgr2=0x7fcbb41589f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:25.899 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.884+0000 7fcbba405700 1 --2- 172.21.15.92:0/1043837399 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcbb40cb8e0 0x7fcbb41589f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:25.899 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.884+0000 7fcbba405700 1 -- 172.21.15.92:0/1043837399 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcbb406f4e0 msgr2=0x7fcbb41549e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:25.899 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.884+0000 7fcbba405700 1 --2- 172.21.15.92:0/1043837399 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcbb406f4e0 0x7fcbb41549e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:25.899 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.884+0000 7fcbba405700 1 -- 172.21.15.92:0/1043837399 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb00094a0 con 0x7fcbb415a090 2023-08-26T09:25:25.899 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.884+0000 7fcbba405700 1 --2- 172.21.15.92:0/1043837399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbb415a090 0x7fcbb41f02d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcbac00cb40 tx=0x7fcbac00cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:25.900 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.885+0000 7fcbaa7fc700 1 -- 172.21.15.92:0/1043837399 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbac00ab50 con 0x7fcbb415a090 2023-08-26T09:25:25.900 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.885+0000 7fcbbbe68700 1 -- 172.21.15.92:0/1043837399 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbb41f1180 con 0x7fcbb415a090 2023-08-26T09:25:25.900 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.885+0000 7fcbaa7fc700 1 -- 172.21.15.92:0/1043837399 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbac00acb0 con 0x7fcbb415a090 2023-08-26T09:25:25.900 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.885+0000 7fcbaa7fc700 1 -- 172.21.15.92:0/1043837399 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbac012620 con 0x7fcbb415a090 2023-08-26T09:25:25.900 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.885+0000 7fcbbbe68700 1 -- 172.21.15.92:0/1043837399 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbb41f1740 con 0x7fcbb415a090 2023-08-26T09:25:25.901 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.886+0000 7fcbbbe68700 1 -- 172.21.15.92:0/1043837399 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbb40675e0 con 0x7fcbb415a090 2023-08-26T09:25:25.901 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.886+0000 7fcbaa7fc700 1 -- 172.21.15.92:0/1043837399 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcbac01b3b0 con 0x7fcbb415a090 2023-08-26T09:25:25.901 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.886+0000 7fcbaa7fc700 1 --2- 172.21.15.92:0/1043837399 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fcb9806a0e0 0x7fcb9806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:25.901 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.886+0000 7fcbaa7fc700 1 -- 172.21.15.92:0/1043837399 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcbac0883d0 con 0x7fcbb415a090 2023-08-26T09:25:25.901 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.886+0000 7fcbb9c04700 1 --2- 172.21.15.92:0/1043837399 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fcb9806a0e0 0x7fcb9806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:25.902 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.887+0000 7fcbb9c04700 1 --2- 172.21.15.92:0/1043837399 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fcb9806a0e0 0x7fcb9806c5a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcba4009ad0 tx=0x7fcba4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:25.902 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:25.891+0000 7fcbaa7fc700 1 -- 172.21.15.92:0/1043837399 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fcbac053a40 con 0x7fcbb415a090 2023-08-26T09:25:26.129 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.124+0000 7fcbbbe68700 1 -- 172.21.15.92:0/1043837399 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcbb406e230 con 0x7fcbb415a090 2023-08-26T09:25:26.129 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.124+0000 7fcbaa7fc700 1 -- 172.21.15.92:0/1043837399 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4863 (secure 0 0 0) 0x7fcbac057060 con 0x7fcbb415a090 2023-08-26T09:25:26.130 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:25:26.130 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/856608283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6833","nonce":856608283},{"type":"v1","addr":"172.21.15.188:6835","nonce":856608283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4279,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/33581841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":33581841},{"type":"v1","addr":"172.21.15.92:6837","nonce":33581841}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6834/279535547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":279535547},{"type":"v1","addr":"172.21.15.188:6834","nonce":279535547}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-26T09:25:13.851186+0000","modified":"2023-08-26T09:25:17.482682+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6835/2933877114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2933877114},{"type":"v1","addr":"172.21.15.92:6835","nonce":2933877114}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-26T09:25:26.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.127+0000 7fcbbbe68700 1 -- 172.21.15.92:0/1043837399 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fcb9806a0e0 msgr2=0x7fcb9806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:26.133 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.127+0000 7fcbbbe68700 1 --2- 172.21.15.92:0/1043837399 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fcb9806a0e0 0x7fcb9806c5a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcba4009ad0 tx=0x7fcba4008040 comp rx=0 tx=0).stop 2023-08-26T09:25:26.133 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.127+0000 7fcbbbe68700 1 -- 172.21.15.92:0/1043837399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbb415a090 msgr2=0x7fcbb41f02d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:26.133 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.127+0000 7fcbbbe68700 1 --2- 172.21.15.92:0/1043837399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbb415a090 0x7fcbb41f02d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcbac00cb40 tx=0x7fcbac00cf00 comp rx=0 tx=0).stop 2023-08-26T09:25:26.133 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.127+0000 7fcbbbe68700 1 -- 172.21.15.92:0/1043837399 shutdown_connections 2023-08-26T09:25:26.133 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.127+0000 7fcbbbe68700 1 --2- 172.21.15.92:0/1043837399 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fcb9806a0e0 0x7fcb9806c5a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:26.134 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.127+0000 7fcbbbe68700 1 --2- 172.21.15.92:0/1043837399 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcbb406f4e0 0x7fcbb41549e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:26.134 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.127+0000 7fcbbbe68700 1 --2- 172.21.15.92:0/1043837399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbb415a090 0x7fcbb41f02d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:26.134 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.127+0000 7fcbbbe68700 1 --2- 172.21.15.92:0/1043837399 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcbb40cb8e0 0x7fcbb41589f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:26.134 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.127+0000 7fcbbbe68700 1 -- 172.21.15.92:0/1043837399 >> 172.21.15.92:0/1043837399 conn(0x7fcbb40cc7b0 msgr2=0x7fcbb4153240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:26.135 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.127+0000 7fcbbbe68700 1 -- 172.21.15.92:0/1043837399 shutdown_connections 2023-08-26T09:25:26.135 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.127+0000 7fcbbbe68700 1 -- 172.21.15.92:0/1043837399 wait complete. 2023-08-26T09:25:26.135 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 7 2023-08-26T09:25:26.144 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-26T09:25:26.264 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.259+0000 7fe0a07d1700 1 Processor -- start 2023-08-26T09:25:26.265 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.259+0000 7fe0a07d1700 1 -- start start 2023-08-26T09:25:26.267 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.260+0000 7fe0a07d1700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe098066020 0x7fe0980cfc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:26.268 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.260+0000 7fe0a07d1700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe0980ccab0 0x7fe09806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:26.268 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.260+0000 7fe0a07d1700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe098066550 con 0x7fe09806a590 2023-08-26T09:25:26.268 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.260+0000 7fe0a07d1700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0980cbcf0 con 0x7fe0980ccab0 2023-08-26T09:25:26.268 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.260+0000 7fe0a07d1700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0980cbfd0 con 0x7fe098066020 2023-08-26T09:25:26.268 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.260+0000 7fe09e56d700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fe09806a590 0x7fe09815e210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:57026/0 (socket says 172.21.15.92:57026) 2023-08-26T09:25:26.269 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.260+0000 7fe09e56d700 1 -- 172.21.15.92:0/4022250520 learned_addr learned my addr 172.21.15.92:0/4022250520 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:26.269 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.261+0000 7fe09dd6c700 1 --2- 172.21.15.92:0/4022250520 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe098066020 0x7fe0980cfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:26.269 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.261+0000 7fe09ed6e700 1 --2- 172.21.15.92:0/4022250520 >> v2:172.21.15.188:3300/0 conn(0x7fe0980ccab0 0x7fe09806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:26.269 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.261+0000 7fe09d56b700 1 -- 172.21.15.92:0/4022250520 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 864409047 0 0) 0x7fe098066550 con 0x7fe09806a590 2023-08-26T09:25:26.269 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.261+0000 7fe09d56b700 1 -- 172.21.15.92:0/4022250520 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0840035b0 con 0x7fe09806a590 2023-08-26T09:25:26.270 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.261+0000 7fe09d56b700 1 -- 172.21.15.92:0/4022250520 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2716061623 0 0) 0x7fe0840035b0 con 0x7fe09806a590 2023-08-26T09:25:26.270 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.261+0000 7fe09dd6c700 1 -- 172.21.15.92:0/4022250520 >> v2:172.21.15.188:3300/0 conn(0x7fe0980ccab0 msgr2=0x7fe09806c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:26.270 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.261+0000 7fe09dd6c700 1 --2- 172.21.15.92:0/4022250520 >> v2:172.21.15.188:3300/0 conn(0x7fe0980ccab0 0x7fe09806c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:26.270 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.261+0000 7fe09dd6c700 1 -- 172.21.15.92:0/4022250520 >> v1:172.21.15.92:6789/0 conn(0x7fe09806a590 legacy=0x7fe09815e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:26.270 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.261+0000 7fe09dd6c700 1 -- 172.21.15.92:0/4022250520 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0980cc2b0 con 0x7fe098066020 2023-08-26T09:25:26.271 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.261+0000 7fe09ed6e700 1 --2- 172.21.15.92:0/4022250520 >> v2:172.21.15.188:3300/0 conn(0x7fe0980ccab0 0x7fe09806c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-26T09:25:26.271 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.261+0000 7fe09dd6c700 1 --2- 172.21.15.92:0/4022250520 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe098066020 0x7fe0980cfc60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe094009840 tx=0x7fe094009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5847c1ec3cfb7504 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:26.271 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.261+0000 7fe09d56b700 1 -- 172.21.15.92:0/4022250520 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0880017f0 con 0x7fe098066020 2023-08-26T09:25:26.271 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.261+0000 7fe09d56b700 1 -- 172.21.15.92:0/4022250520 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe094004030 con 0x7fe098066020 2023-08-26T09:25:26.271 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.261+0000 7fe09d56b700 1 -- 172.21.15.92:0/4022250520 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0940043c0 con 0x7fe098066020 2023-08-26T09:25:26.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.262+0000 7fe0a07d1700 1 -- 172.21.15.92:0/4022250520 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe098066020 msgr2=0x7fe0980cfc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:26.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.262+0000 7fe0a07d1700 1 --2- 172.21.15.92:0/4022250520 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe098066020 0x7fe0980cfc60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe094009840 tx=0x7fe094009b50 comp rx=0 tx=0).stop 2023-08-26T09:25:26.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.262+0000 7fe0a07d1700 1 -- 172.21.15.92:0/4022250520 shutdown_connections 2023-08-26T09:25:26.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.262+0000 7fe0a07d1700 1 --2- 172.21.15.92:0/4022250520 >> v2:172.21.15.188:3300/0 conn(0x7fe0980ccab0 0x7fe09806c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:26.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.262+0000 7fe0a07d1700 1 --2- 172.21.15.92:0/4022250520 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe098066020 0x7fe0980cfc60 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:26.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.262+0000 7fe0a07d1700 1 -- 172.21.15.92:0/4022250520 >> 172.21.15.92:0/4022250520 conn(0x7fe0980b23c0 msgr2=0x7fe0980b27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:26.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.262+0000 7fe0a07d1700 1 -- 172.21.15.92:0/4022250520 shutdown_connections 2023-08-26T09:25:26.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.262+0000 7fe0a07d1700 1 -- 172.21.15.92:0/4022250520 wait complete. 2023-08-26T09:25:26.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.263+0000 7fe0a07d1700 1 Processor -- start 2023-08-26T09:25:26.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.263+0000 7fe0a07d1700 1 -- start start 2023-08-26T09:25:26.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.264+0000 7fe0a07d1700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe098066020 0x7fe098098560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:26.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.264+0000 7fe0a07d1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe09806a590 0x7fe0981f4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:26.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.264+0000 7fe0a07d1700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0980ccab0 0x7fe0981f0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:26.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.264+0000 7fe0a07d1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe098098aa0 con 0x7fe09806a590 2023-08-26T09:25:26.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.264+0000 7fe0a07d1700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0981f1680 con 0x7fe098066020 2023-08-26T09:25:26.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.264+0000 7fe0a07d1700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0981f41e0 con 0x7fe0980ccab0 2023-08-26T09:25:26.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.264+0000 7fe09dd6c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe09806a590 0x7fe0981f4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:26.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.264+0000 7fe09dd6c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe09806a590 0x7fe0981f4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45020/0 (socket says 172.21.15.92:45020) 2023-08-26T09:25:26.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.264+0000 7fe09dd6c700 1 -- 172.21.15.92:0/51657258 learned_addr learned my addr 172.21.15.92:0/51657258 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:26.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.264+0000 7fe09e56d700 1 --2- 172.21.15.92:0/51657258 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe098066020 0x7fe098098560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:26.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.264+0000 7fe09ed6e700 1 --2- 172.21.15.92:0/51657258 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0980ccab0 0x7fe0981f0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:26.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.264+0000 7fe09dd6c700 1 -- 172.21.15.92:0/51657258 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0980ccab0 msgr2=0x7fe0981f0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:26.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.264+0000 7fe09dd6c700 1 --2- 172.21.15.92:0/51657258 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0980ccab0 0x7fe0981f0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:26.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.264+0000 7fe09dd6c700 1 -- 172.21.15.92:0/51657258 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe098066020 msgr2=0x7fe098098560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:26.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.264+0000 7fe09dd6c700 1 --2- 172.21.15.92:0/51657258 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe098066020 0x7fe098098560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:26.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.264+0000 7fe09dd6c700 1 -- 172.21.15.92:0/51657258 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe090009a70 con 0x7fe09806a590 2023-08-26T09:25:26.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.264+0000 7fe09e56d700 1 --2- 172.21.15.92:0/51657258 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe098066020 0x7fe098098560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:26.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.264+0000 7fe09dd6c700 1 --2- 172.21.15.92:0/51657258 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe09806a590 0x7fe0981f4670 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe0940090b0 tx=0x7fe094004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:26.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.264+0000 7fe08effd700 1 -- 172.21.15.92:0/51657258 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe094003e20 con 0x7fe09806a590 2023-08-26T09:25:26.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.265+0000 7fe08effd700 1 -- 172.21.15.92:0/51657258 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09401f070 con 0x7fe09806a590 2023-08-26T09:25:26.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.265+0000 7fe0a07d1700 1 -- 172.21.15.92:0/51657258 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0940094a0 con 0x7fe09806a590 2023-08-26T09:25:26.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.265+0000 7fe08effd700 1 -- 172.21.15.92:0/51657258 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe094011870 con 0x7fe09806a590 2023-08-26T09:25:26.281 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.265+0000 7fe0a07d1700 1 -- 172.21.15.92:0/51657258 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0981f13a0 con 0x7fe09806a590 2023-08-26T09:25:26.281 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.266+0000 7fe0a07d1700 1 -- 172.21.15.92:0/51657258 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe098073c90 con 0x7fe09806a590 2023-08-26T09:25:26.281 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.266+0000 7fe08effd700 1 -- 172.21.15.92:0/51657258 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe0940119d0 con 0x7fe09806a590 2023-08-26T09:25:26.281 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.266+0000 7fe08effd700 1 --2- 172.21.15.92:0/51657258 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fe07c06a0e0 0x7fe07c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:26.281 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.266+0000 7fe09e56d700 1 --2- 172.21.15.92:0/51657258 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fe07c06a0e0 0x7fe07c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:26.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.267+0000 7fe08effd700 1 -- 172.21.15.92:0/51657258 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe094021070 con 0x7fe09806a590 2023-08-26T09:25:26.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.267+0000 7fe09e56d700 1 --2- 172.21.15.92:0/51657258 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fe07c06a0e0 0x7fe07c06c5a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe088000ef0 tx=0x7fe088009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:26.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.271+0000 7fe08effd700 1 -- 172.21.15.92:0/51657258 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe094055620 con 0x7fe09806a590 2023-08-26T09:25:26.471 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.466+0000 7fe0a07d1700 1 -- 172.21.15.92:0/51657258 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe09804e660 con 0x7fe09806a590 2023-08-26T09:25:26.472 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.467+0000 7fe08effd700 1 -- 172.21.15.92:0/51657258 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+18209 (secure 0 0 0) 0x7fe09402b090 con 0x7fe09806a590 2023-08-26T09:25:26.473 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:25:26.473 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":20,"fsid":"254a2d31-bd41-4507-8326-1b205ac24377","created":"2023-08-26T09:24:55.352131+0000","modified":"2023-08-26T09:25:15.447635+0000","last_up_change":"2023-08-26T09:25:06.124496+0000","last_in_change":"2023-08-26T09:24:57.840725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-26T09:25:06.650431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-26T09:25:06.973382+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-26T09:25:11.584141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-26T09:25:12.814990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e9e7638-4459-4d8d-8e40-130bcf48df66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6819","nonce":382827192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6824","nonce":382827192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6831","nonce":382827192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6827","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6829","nonce":382827192}]},"public_addr":"172.21.15.92:6819/382827192","cluster_addr":"172.21.15.92:6824/382827192","heartbeat_back_addr":"172.21.15.92:6831/382827192","heartbeat_front_addr":"172.21.15.92:6829/382827192","state":["exists","up"]},{"osd":1,"uuid":"164e68c9-aedd-4df5-9b70-f4b1ec3bda13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6809","nonce":618773438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6811","nonce":618773438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6815","nonce":618773438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6813","nonce":618773438}]},"public_addr":"172.21.15.92:6809/618773438","cluster_addr":"172.21.15.92:6811/618773438","heartbeat_back_addr":"172.21.15.92:6815/618773438","heartbeat_front_addr":"172.21.15.92:6813/618773438","state":["exists","up"]},{"osd":2,"uuid":"8701dfee-629a-4d30-82e4-b8fac340303f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6818","nonce":3697397687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6821","nonce":3697397687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6828","nonce":3697397687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6823","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6825","nonce":3697397687}]},"public_addr":"172.21.15.92:6818/3697397687","cluster_addr":"172.21.15.92:6821/3697397687","heartbeat_back_addr":"172.21.15.92:6828/3697397687","heartbeat_front_addr":"172.21.15.92:6825/3697397687","state":["exists","up"]},{"osd":3,"uuid":"93bdc94d-dc07-495f-995a-a6ad072f0247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6801","nonce":3579846453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6803","nonce":3579846453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6807","nonce":3579846453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6805","nonce":3579846453}]},"public_addr":"172.21.15.92:6801/3579846453","cluster_addr":"172.21.15.92:6803/3579846453","heartbeat_back_addr":"172.21.15.92:6807/3579846453","heartbeat_front_addr":"172.21.15.92:6805/3579846453","state":["exists","up"]},{"osd":4,"uuid":"d9d0ea80-8481-46a7-9677-c338d32cf1d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6809","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6811","nonce":3228383424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6813","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6815","nonce":3228383424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6821","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6823","nonce":3228383424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6817","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6819","nonce":3228383424}]},"public_addr":"172.21.15.188:6811/3228383424","cluster_addr":"172.21.15.188:6815/3228383424","heartbeat_back_addr":"172.21.15.188:6823/3228383424","heartbeat_front_addr":"172.21.15.188:6819/3228383424","state":["exists","up"]},{"osd":5,"uuid":"38d03253-467a-456f-bd5e-5a46532a0b18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6801","nonce":1655821054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6803","nonce":1655821054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6807","nonce":1655821054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6805","nonce":1655821054}]},"public_addr":"172.21.15.188:6801/1655821054","cluster_addr":"172.21.15.188:6803/1655821054","heartbeat_back_addr":"172.21.15.188:6807/1655821054","heartbeat_front_addr":"172.21.15.188:6805/1655821054","state":["exists","up"]},{"osd":6,"uuid":"d61564b5-136f-42e5-a843-626c2017cc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6810","nonce":2069976891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6814","nonce":2069976891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6822","nonce":2069976891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6818","nonce":2069976891}]},"public_addr":"172.21.15.188:6810/2069976891","cluster_addr":"172.21.15.188:6814/2069976891","heartbeat_back_addr":"172.21.15.188:6822/2069976891","heartbeat_front_addr":"172.21.15.188:6818/2069976891","state":["exists","up"]},{"osd":7,"uuid":"fae2949e-0d62-42cd-ba72-08f516084b20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6825","nonce":1882888860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6827","nonce":1882888860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6831","nonce":1882888860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6829","nonce":1882888860}]},"public_addr":"172.21.15.188:6825/1882888860","cluster_addr":"172.21.15.188:6827/1882888860","heartbeat_back_addr":"172.21.15.188:6831/1882888860","heartbeat_front_addr":"172.21.15.188:6829/1882888860","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.038523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.063160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.000857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.975572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.023848+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.765194+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.081365+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:05.110745+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-26T09:25:26.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.470+0000 7fe0a07d1700 1 -- 172.21.15.92:0/51657258 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fe07c06a0e0 msgr2=0x7fe07c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:26.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.470+0000 7fe0a07d1700 1 --2- 172.21.15.92:0/51657258 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fe07c06a0e0 0x7fe07c06c5a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe088000ef0 tx=0x7fe088009040 comp rx=0 tx=0).stop 2023-08-26T09:25:26.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.470+0000 7fe0a07d1700 1 -- 172.21.15.92:0/51657258 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe09806a590 msgr2=0x7fe0981f4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:26.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.470+0000 7fe0a07d1700 1 --2- 172.21.15.92:0/51657258 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe09806a590 0x7fe0981f4670 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe0940090b0 tx=0x7fe094004750 comp rx=0 tx=0).stop 2023-08-26T09:25:26.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.470+0000 7fe0a07d1700 1 -- 172.21.15.92:0/51657258 shutdown_connections 2023-08-26T09:25:26.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.470+0000 7fe0a07d1700 1 --2- 172.21.15.92:0/51657258 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fe07c06a0e0 0x7fe07c06c5a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:26.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.470+0000 7fe0a07d1700 1 --2- 172.21.15.92:0/51657258 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe098066020 0x7fe098098560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:26.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.470+0000 7fe0a07d1700 1 --2- 172.21.15.92:0/51657258 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0980ccab0 0x7fe0981f0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:26.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.470+0000 7fe0a07d1700 1 --2- 172.21.15.92:0/51657258 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe09806a590 0x7fe0981f4670 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:26.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.470+0000 7fe0a07d1700 1 -- 172.21.15.92:0/51657258 >> 172.21.15.92:0/51657258 conn(0x7fe0980b23c0 msgr2=0x7fe09815c150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:26.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.470+0000 7fe0a07d1700 1 -- 172.21.15.92:0/51657258 shutdown_connections 2023-08-26T09:25:26.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.470+0000 7fe0a07d1700 1 -- 172.21.15.92:0/51657258 wait complete. 2023-08-26T09:25:26.487 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-26T09:25:06.650431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-26T09:25:06.973382+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-26T09:25:11.584141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-26T09:25:12.814990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-26T09:25:26.488 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-26T09:25:26.610 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.605+0000 7f354ac24700 1 Processor -- start 2023-08-26T09:25:26.611 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.605+0000 7f354ac24700 1 -- start start 2023-08-26T09:25:26.613 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.606+0000 7f354ac24700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3544159dd0 0x7f35440cf220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:26.613 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.606+0000 7f354ac24700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f354406e110 0x7f354406e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:26.613 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.606+0000 7f354ac24700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f354406eab0 con 0x7f3544070d20 2023-08-26T09:25:26.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.606+0000 7f354ac24700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35440c6200 con 0x7f354406e110 2023-08-26T09:25:26.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.606+0000 7f354ac24700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35440ce740 con 0x7f3544159dd0 2023-08-26T09:25:26.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.606+0000 7f35491c1700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f3544070d20 0x7f35440711b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:57044/0 (socket says 172.21.15.92:57044) 2023-08-26T09:25:26.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.606+0000 7f35491c1700 1 -- 172.21.15.92:0/801292088 learned_addr learned my addr 172.21.15.92:0/801292088 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:26.615 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.606+0000 7f3543fff700 1 --2- 172.21.15.92:0/801292088 >> v2:172.21.15.188:3300/0 conn(0x7f354406e110 0x7f354406e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:26.615 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.606+0000 7f35489c0700 1 --2- 172.21.15.92:0/801292088 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3544159dd0 0x7f35440cf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:26.615 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.607+0000 7f35437fe700 1 -- 172.21.15.92:0/801292088 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 17045351 0 0) 0x7f354406eab0 con 0x7f3544070d20 2023-08-26T09:25:26.615 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.607+0000 7f35437fe700 1 -- 172.21.15.92:0/801292088 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35340035b0 con 0x7f3544070d20 2023-08-26T09:25:26.615 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.607+0000 7f3543fff700 1 -- 172.21.15.92:0/801292088 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3544159dd0 msgr2=0x7f35440cf220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:26.616 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.607+0000 7f3543fff700 1 --2- 172.21.15.92:0/801292088 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3544159dd0 0x7f35440cf220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:26.616 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.607+0000 7f3543fff700 1 -- 172.21.15.92:0/801292088 >> v1:172.21.15.92:6789/0 conn(0x7f3544070d20 legacy=0x7f35440711b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:26.617 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.607+0000 7f3543fff700 1 -- 172.21.15.92:0/801292088 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35440cea20 con 0x7f354406e110 2023-08-26T09:25:26.617 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.607+0000 7f35489c0700 1 --2- 172.21.15.92:0/801292088 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3544159dd0 0x7f35440cf220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-26T09:25:26.618 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.607+0000 7f3543fff700 1 --2- 172.21.15.92:0/801292088 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f354406e110 0x7f354406e570 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3530009840 tx=0x7f3530009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79f2e4218af4db84 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:26.618 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.607+0000 7f35437fe700 1 -- 172.21.15.92:0/801292088 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3530011830 con 0x7f354406e110 2023-08-26T09:25:26.618 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.607+0000 7f35437fe700 1 -- 172.21.15.92:0/801292088 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3530011990 con 0x7f354406e110 2023-08-26T09:25:26.618 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.607+0000 7f35437fe700 1 -- 172.21.15.92:0/801292088 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3530011d00 con 0x7f354406e110 2023-08-26T09:25:26.619 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.608+0000 7f354ac24700 1 -- 172.21.15.92:0/801292088 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f354406e110 msgr2=0x7f354406e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:26.619 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.608+0000 7f354ac24700 1 --2- 172.21.15.92:0/801292088 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f354406e110 0x7f354406e570 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3530009840 tx=0x7f3530009b50 comp rx=0 tx=0).stop 2023-08-26T09:25:26.619 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.608+0000 7f354ac24700 1 -- 172.21.15.92:0/801292088 shutdown_connections 2023-08-26T09:25:26.619 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.608+0000 7f354ac24700 1 --2- 172.21.15.92:0/801292088 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3544159dd0 0x7f35440cf220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:26.619 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.608+0000 7f354ac24700 1 --2- 172.21.15.92:0/801292088 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f354406e110 0x7f354406e570 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:26.620 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.608+0000 7f354ac24700 1 -- 172.21.15.92:0/801292088 >> 172.21.15.92:0/801292088 conn(0x7f354406b430 msgr2=0x7f354406b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:26.620 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.608+0000 7f354ac24700 1 -- 172.21.15.92:0/801292088 shutdown_connections 2023-08-26T09:25:26.620 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.608+0000 7f354ac24700 1 -- 172.21.15.92:0/801292088 wait complete. 2023-08-26T09:25:26.624 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.609+0000 7f354ac24700 1 Processor -- start 2023-08-26T09:25:26.624 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.609+0000 7f354ac24700 1 -- start start 2023-08-26T09:25:26.624 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.610+0000 7f354ac24700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f354406e110 0x7f35440c9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:26.624 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.610+0000 7f354ac24700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3544070d20 0x7f35440a91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:26.624 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.610+0000 7f354ac24700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3544159dd0 0x7f35441548e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:26.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.610+0000 7f354ac24700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3544154e20 con 0x7f3544070d20 2023-08-26T09:25:26.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.610+0000 7f354ac24700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35440a98a0 con 0x7f3544159dd0 2023-08-26T09:25:26.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.610+0000 7f354ac24700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35440a9b80 con 0x7f354406e110 2023-08-26T09:25:26.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.610+0000 7f3543fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3544070d20 0x7f35440a91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:26.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.610+0000 7f3543fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3544070d20 0x7f35440a91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45032/0 (socket says 172.21.15.92:45032) 2023-08-26T09:25:26.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.610+0000 7f3543fff700 1 -- 172.21.15.92:0/3896309021 learned_addr learned my addr 172.21.15.92:0/3896309021 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:26.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.610+0000 7f35489c0700 1 --2- 172.21.15.92:0/3896309021 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f354406e110 0x7f35440c9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:26.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.610+0000 7f35491c1700 1 --2- 172.21.15.92:0/3896309021 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3544159dd0 0x7f35441548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:26.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.610+0000 7f3543fff700 1 -- 172.21.15.92:0/3896309021 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f354406e110 msgr2=0x7f35440c9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:26.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.610+0000 7f3543fff700 1 --2- 172.21.15.92:0/3896309021 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f354406e110 0x7f35440c9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:26.627 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.610+0000 7f3543fff700 1 -- 172.21.15.92:0/3896309021 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3544159dd0 msgr2=0x7f35441548e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:26.627 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.610+0000 7f3543fff700 1 --2- 172.21.15.92:0/3896309021 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3544159dd0 0x7f35441548e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:26.627 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.610+0000 7f3543fff700 1 -- 172.21.15.92:0/3896309021 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35380094a0 con 0x7f3544070d20 2023-08-26T09:25:26.627 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.610+0000 7f35491c1700 1 --2- 172.21.15.92:0/3896309021 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3544159dd0 0x7f35441548e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:25:26.627 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.611+0000 7f3543fff700 1 --2- 172.21.15.92:0/3896309021 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3544070d20 0x7f35440a91a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3530009fd0 tx=0x7f3530004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:26.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.611+0000 7f35417fa700 1 -- 172.21.15.92:0/3896309021 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35300036a0 con 0x7f3544070d20 2023-08-26T09:25:26.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.611+0000 7f35417fa700 1 -- 172.21.15.92:0/3896309021 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f353001e070 con 0x7f3544070d20 2023-08-26T09:25:26.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.611+0000 7f35417fa700 1 -- 172.21.15.92:0/3896309021 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3530003a20 con 0x7f3544070d20 2023-08-26T09:25:26.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.611+0000 7f354ac24700 1 -- 172.21.15.92:0/3896309021 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35300094a0 con 0x7f3544070d20 2023-08-26T09:25:26.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.611+0000 7f354ac24700 1 -- 172.21.15.92:0/3896309021 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35440c9080 con 0x7f3544070d20 2023-08-26T09:25:26.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.612+0000 7f354ac24700 1 -- 172.21.15.92:0/3896309021 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f354404eeb0 con 0x7f3544070d20 2023-08-26T09:25:26.629 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.612+0000 7f35417fa700 1 -- 172.21.15.92:0/3896309021 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3530003b80 con 0x7f3544070d20 2023-08-26T09:25:26.629 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.612+0000 7f35417fa700 1 --2- 172.21.15.92:0/3896309021 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f352806a0e0 0x7f352806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:26.629 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.612+0000 7f35417fa700 1 -- 172.21.15.92:0/3896309021 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3530089570 con 0x7f3544070d20 2023-08-26T09:25:26.629 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.612+0000 7f35489c0700 1 --2- 172.21.15.92:0/3896309021 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f352806a0e0 0x7f352806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:26.629 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.613+0000 7f35489c0700 1 --2- 172.21.15.92:0/3896309021 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f352806a0e0 0x7f352806c5a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3538009d00 tx=0x7f3538008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:26.630 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.617+0000 7f35417fa700 1 -- 172.21.15.92:0/3896309021 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3530054c50 con 0x7f3544070d20 2023-08-26T09:25:26.809 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.804+0000 7f354ac24700 1 -- 172.21.15.92:0/3896309021 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f354406c290 con 0x7f3544070d20 2023-08-26T09:25:26.809 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.804+0000 7f35417fa700 1 -- 172.21.15.92:0/3896309021 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3530058270 con 0x7f3544070d20 2023-08-26T09:25:26.810 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 8 2023-08-26T09:25:26.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.806+0000 7f354ac24700 1 -- 172.21.15.92:0/3896309021 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f352806a0e0 msgr2=0x7f352806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:26.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.806+0000 7f354ac24700 1 --2- 172.21.15.92:0/3896309021 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f352806a0e0 0x7f352806c5a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3538009d00 tx=0x7f3538008040 comp rx=0 tx=0).stop 2023-08-26T09:25:26.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.806+0000 7f354ac24700 1 -- 172.21.15.92:0/3896309021 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3544070d20 msgr2=0x7f35440a91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:26.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.806+0000 7f354ac24700 1 --2- 172.21.15.92:0/3896309021 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3544070d20 0x7f35440a91a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3530009fd0 tx=0x7f3530004750 comp rx=0 tx=0).stop 2023-08-26T09:25:26.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.806+0000 7f354ac24700 1 -- 172.21.15.92:0/3896309021 shutdown_connections 2023-08-26T09:25:26.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.806+0000 7f354ac24700 1 --2- 172.21.15.92:0/3896309021 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f352806a0e0 0x7f352806c5a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:26.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.806+0000 7f354ac24700 1 --2- 172.21.15.92:0/3896309021 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3544159dd0 0x7f35441548e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:26.813 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.806+0000 7f354ac24700 1 --2- 172.21.15.92:0/3896309021 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f354406e110 0x7f35440c9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:26.813 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.806+0000 7f354ac24700 1 --2- 172.21.15.92:0/3896309021 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3544070d20 0x7f35440a91a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:26.813 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.806+0000 7f354ac24700 1 -- 172.21.15.92:0/3896309021 >> 172.21.15.92:0/3896309021 conn(0x7f354406b430 msgr2=0x7f354415ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:26.813 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.806+0000 7f354ac24700 1 -- 172.21.15.92:0/3896309021 shutdown_connections 2023-08-26T09:25:26.813 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.806+0000 7f354ac24700 1 -- 172.21.15.92:0/3896309021 wait complete. 2023-08-26T09:25:26.823 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-26T09:25:26.946 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.941+0000 7f961c66b700 1 Processor -- start 2023-08-26T09:25:26.946 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.941+0000 7f961c66b700 1 -- start start 2023-08-26T09:25:26.950 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.942+0000 7f961c66b700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9614159dd0 0x7f96140cf220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:26.950 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.942+0000 7f961c66b700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96140c6200 con 0x7f961406e110 2023-08-26T09:25:26.950 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.942+0000 7f961c66b700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96140ce740 con 0x7f9614071430 2023-08-26T09:25:26.950 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.942+0000 7f961c66b700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96140cea20 con 0x7f9614159dd0 2023-08-26T09:25:26.951 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.942+0000 7f9619c06700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f961406e110 0x7f9614070d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:57054/0 (socket says 172.21.15.92:57054) 2023-08-26T09:25:26.951 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.942+0000 7f9619c06700 1 -- 172.21.15.92:0/2229750566 learned_addr learned my addr 172.21.15.92:0/2229750566 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:26.951 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.942+0000 7f9619405700 1 -- 172.21.15.92:0/2229750566 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3336616127 0 0) 0x7f96140c6200 con 0x7f961406e110 2023-08-26T09:25:26.951 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.942+0000 7f961a407700 1 --2- 172.21.15.92:0/2229750566 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9614159dd0 0x7f96140cf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:26.951 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.942+0000 7f9619405700 1 -- 172.21.15.92:0/2229750566 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96000035b0 con 0x7f961406e110 2023-08-26T09:25:26.952 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.942+0000 7f9619405700 1 -- 172.21.15.92:0/2229750566 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 619327841 0 0) 0x7f96000035b0 con 0x7f961406e110 2023-08-26T09:25:26.952 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.942+0000 7f9619405700 1 -- 172.21.15.92:0/2229750566 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9614159dd0 msgr2=0x7f96140cf220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:26.952 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.942+0000 7f9619405700 1 --2- 172.21.15.92:0/2229750566 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9614159dd0 0x7f96140cf220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:26.952 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.942+0000 7f9619405700 1 -- 172.21.15.92:0/2229750566 >> v1:172.21.15.188:6789/0 conn(0x7f9614071430 legacy=0x7f96140c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:26.953 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.942+0000 7f9619405700 1 -- 172.21.15.92:0/2229750566 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96140ced00 con 0x7f961406e110 2023-08-26T09:25:26.953 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.942+0000 7f9619405700 1 -- 172.21.15.92:0/2229750566 <== mon.0 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1019361464 0 0) 0x7f9604001670 con 0x7f961406e110 2023-08-26T09:25:26.953 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.942+0000 7f9619405700 1 -- 172.21.15.92:0/2229750566 >> v1:172.21.15.92:6789/0 conn(0x7f961406e110 legacy=0x7f9614070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:26.953 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.942+0000 7f9619405700 1 --2- 172.21.15.92:0/2229750566 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9614159dd0 0x7f9600003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:26.953 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.942+0000 7f9619405700 1 --2- 172.21.15.92:0/2229750566 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9600004060 0x7f9600004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:26.954 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.942+0000 7f9619405700 1 --2- 172.21.15.92:0/2229750566 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9600004d90 0x7f9600005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:26.954 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.942+0000 7f9619405700 1 -- 172.21.15.92:0/2229750566 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96140cea20 con 0x7f9600004d90 2023-08-26T09:25:26.954 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.942+0000 7f9619405700 1 -- 172.21.15.92:0/2229750566 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960000bc50 con 0x7f9600004060 2023-08-26T09:25:26.954 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.942+0000 7f9619405700 1 -- 172.21.15.92:0/2229750566 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f960000be10 con 0x7f9614159dd0 2023-08-26T09:25:26.954 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.942+0000 7f961ac08700 1 --2- 172.21.15.92:0/2229750566 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9600004d90 0x7f9600005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:26.955 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.943+0000 7f9619c06700 1 --2- 172.21.15.92:0/2229750566 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9600004060 0x7f9600004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:26.955 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.943+0000 7f961a407700 1 --2- 172.21.15.92:0/2229750566 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9614159dd0 0x7f9600003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:26.955 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.943+0000 7f961ac08700 1 -- 172.21.15.92:0/2229750566 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9614159dd0 msgr2=0x7f9600003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:26.955 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.943+0000 7f961ac08700 1 --2- 172.21.15.92:0/2229750566 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9614159dd0 0x7f9600003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:26.955 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.943+0000 7f961ac08700 1 -- 172.21.15.92:0/2229750566 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9600004060 msgr2=0x7f9600004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:26.956 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.943+0000 7f961ac08700 1 --2- 172.21.15.92:0/2229750566 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9600004060 0x7f9600004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:26.956 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.943+0000 7f961ac08700 1 -- 172.21.15.92:0/2229750566 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96000035b0 con 0x7f9600004d90 2023-08-26T09:25:26.956 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.943+0000 7f961ac08700 1 --2- 172.21.15.92:0/2229750566 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9600004d90 0x7f9600005210 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f960c00c190 tx=0x7f9600005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4647a432f9efa4e server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:26.956 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.943+0000 7f9619405700 1 -- 172.21.15.92:0/2229750566 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960c001db0 con 0x7f9600004d90 2023-08-26T09:25:26.956 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.943+0000 7f9619405700 1 -- 172.21.15.92:0/2229750566 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960c00ccd0 con 0x7f9600004d90 2023-08-26T09:25:26.957 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.943+0000 7f9619405700 1 -- 172.21.15.92:0/2229750566 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960c003c40 con 0x7f9600004d90 2023-08-26T09:25:26.957 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.943+0000 7f961c66b700 1 -- 172.21.15.92:0/2229750566 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9600004d90 msgr2=0x7f9600005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:26.957 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.943+0000 7f961c66b700 1 --2- 172.21.15.92:0/2229750566 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9600004d90 0x7f9600005210 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f960c00c190 tx=0x7f9600005880 comp rx=0 tx=0).stop 2023-08-26T09:25:26.957 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.944+0000 7f961ac08700 1 -- 172.21.15.92:0/2229750566 reap_dead start 2023-08-26T09:25:26.957 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.944+0000 7f961c66b700 1 -- 172.21.15.92:0/2229750566 shutdown_connections 2023-08-26T09:25:26.958 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.944+0000 7f961c66b700 1 -- 172.21.15.92:0/2229750566 >> 172.21.15.92:0/2229750566 conn(0x7f961406b430 msgr2=0x7f961406b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:26.958 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.944+0000 7f961c66b700 1 -- 172.21.15.92:0/2229750566 shutdown_connections 2023-08-26T09:25:26.958 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.944+0000 7f961c66b700 1 -- 172.21.15.92:0/2229750566 wait complete. 2023-08-26T09:25:26.958 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.945+0000 7f961c66b700 1 Processor -- start 2023-08-26T09:25:26.958 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.945+0000 7f961c66b700 1 -- start start 2023-08-26T09:25:26.961 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.946+0000 7f961c66b700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9600004d90 0x7f96141549a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:26.961 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.946+0000 7f961c66b700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f96140a8db0 0x7f96140a9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:26.961 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.946+0000 7f961c66b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f961415bda0 0x7f961415c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:26.961 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.946+0000 7f961c66b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96141f06c0 con 0x7f961415bda0 2023-08-26T09:25:26.962 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.946+0000 7f961c66b700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9614154ee0 con 0x7f96140a8db0 2023-08-26T09:25:26.962 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.946+0000 7f961c66b700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f961415c760 con 0x7f9600004d90 2023-08-26T09:25:26.962 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.946+0000 7f961ac08700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f961415bda0 0x7f961415c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:26.962 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.946+0000 7f961ac08700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f961415bda0 0x7f961415c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45054/0 (socket says 172.21.15.92:45054) 2023-08-26T09:25:26.962 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.946+0000 7f961ac08700 1 -- 172.21.15.92:0/1128135787 learned_addr learned my addr 172.21.15.92:0/1128135787 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:26.963 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.946+0000 7f9619c06700 1 --2- 172.21.15.92:0/1128135787 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f96140a8db0 0x7f96140a9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:26.963 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.946+0000 7f961a407700 1 --2- 172.21.15.92:0/1128135787 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9600004d90 0x7f96141549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:26.963 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.946+0000 7f961ac08700 1 -- 172.21.15.92:0/1128135787 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9600004d90 msgr2=0x7f96141549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:26.963 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.946+0000 7f961ac08700 1 --2- 172.21.15.92:0/1128135787 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9600004d90 0x7f96141549a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:26.963 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.946+0000 7f961ac08700 1 -- 172.21.15.92:0/1128135787 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f96140a8db0 msgr2=0x7f96140a9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:26.964 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.946+0000 7f961ac08700 1 --2- 172.21.15.92:0/1128135787 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f96140a8db0 0x7f96140a9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:26.964 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.946+0000 7f961ac08700 1 -- 172.21.15.92:0/1128135787 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96140aa0d0 con 0x7f961415bda0 2023-08-26T09:25:26.964 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.946+0000 7f961ac08700 1 --2- 172.21.15.92:0/1128135787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f961415bda0 0x7f961415c220 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f960c001220 tx=0x7f960c0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:26.964 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.946+0000 7f960affd700 1 -- 172.21.15.92:0/1128135787 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960c00cad0 con 0x7f961415bda0 2023-08-26T09:25:26.964 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.946+0000 7f960affd700 1 -- 172.21.15.92:0/1128135787 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960c00ce40 con 0x7f961415bda0 2023-08-26T09:25:26.964 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.946+0000 7f961c66b700 1 -- 172.21.15.92:0/1128135787 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96141f08b0 con 0x7f961415bda0 2023-08-26T09:25:26.965 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.946+0000 7f960affd700 1 -- 172.21.15.92:0/1128135787 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960c005310 con 0x7f961415bda0 2023-08-26T09:25:26.965 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.946+0000 7f961c66b700 1 -- 172.21.15.92:0/1128135787 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96140a9b10 con 0x7f961415bda0 2023-08-26T09:25:26.965 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.947+0000 7f961c66b700 1 -- 172.21.15.92:0/1128135787 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96140b5f80 con 0x7f961415bda0 2023-08-26T09:25:26.965 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.947+0000 7f960affd700 1 -- 172.21.15.92:0/1128135787 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f960c019070 con 0x7f961415bda0 2023-08-26T09:25:26.965 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.948+0000 7f960affd700 1 --2- 172.21.15.92:0/1128135787 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f95f806a0e0 0x7f95f806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:26.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.948+0000 7f960affd700 1 -- 172.21.15.92:0/1128135787 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f960c0890b0 con 0x7f961415bda0 2023-08-26T09:25:26.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.948+0000 7f961a407700 1 --2- 172.21.15.92:0/1128135787 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f95f806a0e0 0x7f95f806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:26.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.948+0000 7f961a407700 1 --2- 172.21.15.92:0/1128135787 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f95f806a0e0 0x7f95f806c5a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9610009950 tx=0x7f9610008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:26.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:26.953+0000 7f960affd700 1 -- 172.21.15.92:0/1128135787 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f960c054950 con 0x7f961415bda0 2023-08-26T09:25:27.150 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.146+0000 7f961c66b700 1 -- 172.21.15.92:0/1128135787 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9614071250 con 0x7f961415bda0 2023-08-26T09:25:27.151 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.147+0000 7f960affd700 1 -- 172.21.15.92:0/1128135787 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f960c057f70 con 0x7f961415bda0 2023-08-26T09:25:27.151 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 1 2023-08-26T09:25:27.153 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.149+0000 7f961c66b700 1 -- 172.21.15.92:0/1128135787 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f95f806a0e0 msgr2=0x7f95f806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:27.153 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.149+0000 7f961c66b700 1 --2- 172.21.15.92:0/1128135787 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f95f806a0e0 0x7f95f806c5a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9610009950 tx=0x7f9610008040 comp rx=0 tx=0).stop 2023-08-26T09:25:27.154 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.149+0000 7f961c66b700 1 -- 172.21.15.92:0/1128135787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f961415bda0 msgr2=0x7f961415c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:27.154 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.149+0000 7f961c66b700 1 --2- 172.21.15.92:0/1128135787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f961415bda0 0x7f961415c220 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f960c001220 tx=0x7f960c0014a0 comp rx=0 tx=0).stop 2023-08-26T09:25:27.154 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.149+0000 7f961c66b700 1 -- 172.21.15.92:0/1128135787 shutdown_connections 2023-08-26T09:25:27.154 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.149+0000 7f961c66b700 1 --2- 172.21.15.92:0/1128135787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f961415bda0 0x7f961415c220 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:27.155 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.149+0000 7f961c66b700 1 --2- 172.21.15.92:0/1128135787 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9600004d90 0x7f96141549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:27.155 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.149+0000 7f961c66b700 1 --2- 172.21.15.92:0/1128135787 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f95f806a0e0 0x7f95f806c5a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:27.156 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.149+0000 7f961c66b700 1 --2- 172.21.15.92:0/1128135787 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f96140a8db0 0x7f96140a9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:27.156 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.149+0000 7f961c66b700 1 -- 172.21.15.92:0/1128135787 >> 172.21.15.92:0/1128135787 conn(0x7f961406b430 msgr2=0x7f961415a510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:27.157 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.149+0000 7f961c66b700 1 -- 172.21.15.92:0/1128135787 shutdown_connections 2023-08-26T09:25:27.157 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.149+0000 7f961c66b700 1 -- 172.21.15.92:0/1128135787 wait complete. 2023-08-26T09:25:27.165 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-26T09:25:27.288 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.283+0000 7fa0fef96700 1 Processor -- start 2023-08-26T09:25:27.288 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.283+0000 7fa0fef96700 1 -- start start 2023-08-26T09:25:27.290 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.284+0000 7fa0fef96700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa0f815a550 0x7fa0f80ce6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:27.290 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.284+0000 7fa0fef96700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa0f806b430 0x7fa0f80c9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:27.291 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.284+0000 7fa0fef96700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0f80724a0 con 0x7fa0f80c9fe0 2023-08-26T09:25:27.291 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.284+0000 7fa0fef96700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0f8072a00 con 0x7fa0f806b430 2023-08-26T09:25:27.291 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.284+0000 7fa0fef96700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0f80cb890 con 0x7fa0f815a550 2023-08-26T09:25:27.291 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.284+0000 7fa0f7fff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa0f806b430 0x7fa0f80c9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:27.291 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.284+0000 7fa0f7fff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa0f806b430 0x7fa0f80c9aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45058/0 (socket says 172.21.15.92:45058) 2023-08-26T09:25:27.292 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.285+0000 7fa0f7fff700 1 -- 172.21.15.92:0/1618887052 learned_addr learned my addr 172.21.15.92:0/1618887052 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:27.292 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.285+0000 7fa0fcd32700 1 --2- 172.21.15.92:0/1618887052 >> v2:172.21.15.188:3300/0 conn(0x7fa0f815a550 0x7fa0f80ce6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:27.292 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.285+0000 7fa0f7fff700 1 -- 172.21.15.92:0/1618887052 >> v2:172.21.15.188:3300/0 conn(0x7fa0f815a550 msgr2=0x7fa0f80ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:27.292 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.285+0000 7fa0f7fff700 1 --2- 172.21.15.92:0/1618887052 >> v2:172.21.15.188:3300/0 conn(0x7fa0f815a550 0x7fa0f80ce6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:27.293 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.285+0000 7fa0f7fff700 1 -- 172.21.15.92:0/1618887052 >> v1:172.21.15.188:6789/0 conn(0x7fa0f80c9fe0 legacy=0x7fa0f815dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:27.293 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.285+0000 7fa0f7fff700 1 -- 172.21.15.92:0/1618887052 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f8072720 con 0x7fa0f806b430 2023-08-26T09:25:27.293 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.285+0000 7fa0fcd32700 1 --2- 172.21.15.92:0/1618887052 >> v2:172.21.15.188:3300/0 conn(0x7fa0f815a550 0x7fa0f80ce6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:27.293 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.285+0000 7fa0f7fff700 1 --2- 172.21.15.92:0/1618887052 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0f806b430 0x7fa0f80c9aa0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa0f806d6d0 tx=0x7fa0e4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd87be86ffbf9bbf server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:27.293 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.285+0000 7fa0f77fe700 1 -- 172.21.15.92:0/1618887052 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e400b870 con 0x7fa0f806b430 2023-08-26T09:25:27.294 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.285+0000 7fa0f77fe700 1 -- 172.21.15.92:0/1618887052 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e400b9d0 con 0x7fa0f806b430 2023-08-26T09:25:27.294 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.285+0000 7fa0f77fe700 1 -- 172.21.15.92:0/1618887052 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e400bd60 con 0x7fa0f806b430 2023-08-26T09:25:27.294 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.286+0000 7fa0fef96700 1 -- 172.21.15.92:0/1618887052 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0f806b430 msgr2=0x7fa0f80c9aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:27.294 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.286+0000 7fa0fef96700 1 --2- 172.21.15.92:0/1618887052 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0f806b430 0x7fa0f80c9aa0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa0f806d6d0 tx=0x7fa0e4009bd0 comp rx=0 tx=0).stop 2023-08-26T09:25:27.294 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.286+0000 7fa0fef96700 1 -- 172.21.15.92:0/1618887052 shutdown_connections 2023-08-26T09:25:27.295 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.286+0000 7fa0fef96700 1 --2- 172.21.15.92:0/1618887052 >> v2:172.21.15.188:3300/0 conn(0x7fa0f815a550 0x7fa0f80ce6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:27.295 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.286+0000 7fa0fef96700 1 --2- 172.21.15.92:0/1618887052 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0f806b430 0x7fa0f80c9aa0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:27.295 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.286+0000 7fa0fef96700 1 -- 172.21.15.92:0/1618887052 >> 172.21.15.92:0/1618887052 conn(0x7fa0f80cf450 msgr2=0x7fa0f80cf860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:27.295 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.286+0000 7fa0fef96700 1 -- 172.21.15.92:0/1618887052 shutdown_connections 2023-08-26T09:25:27.295 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.286+0000 7fa0fef96700 1 -- 172.21.15.92:0/1618887052 wait complete. 2023-08-26T09:25:27.297 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.287+0000 7fa0fef96700 1 Processor -- start 2023-08-26T09:25:27.298 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.287+0000 7fa0fef96700 1 -- start start 2023-08-26T09:25:27.298 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.288+0000 7fa0fef96700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0f806b430 0x7fa0f80c6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:27.298 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.288+0000 7fa0fef96700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa0f80c9fe0 0x7fa0f814d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:27.298 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.288+0000 7fa0fef96700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa0f815a550 0x7fa0f80c3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:27.299 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.288+0000 7fa0fef96700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f80c3690 con 0x7fa0f806b430 2023-08-26T09:25:27.299 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.288+0000 7fa0fef96700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f80c56f0 con 0x7fa0f815a550 2023-08-26T09:25:27.299 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.288+0000 7fa0fef96700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f80c59d0 con 0x7fa0f80c9fe0 2023-08-26T09:25:27.299 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.288+0000 7fa0fcd32700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0f806b430 0x7fa0f80c6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:27.299 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.288+0000 7fa0fcd32700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0f806b430 0x7fa0f80c6a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45064/0 (socket says 172.21.15.92:45064) 2023-08-26T09:25:27.299 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.288+0000 7fa0fcd32700 1 -- 172.21.15.92:0/407480035 learned_addr learned my addr 172.21.15.92:0/407480035 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:27.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.288+0000 7fa0fd533700 1 --2- 172.21.15.92:0/407480035 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa0f815a550 0x7fa0f80c3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:27.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.288+0000 7fa0fcd32700 1 -- 172.21.15.92:0/407480035 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa0f80c9fe0 msgr2=0x7fa0f814d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:27.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.288+0000 7fa0fcd32700 1 --2- 172.21.15.92:0/407480035 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa0f80c9fe0 0x7fa0f814d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:27.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.288+0000 7fa0fcd32700 1 -- 172.21.15.92:0/407480035 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa0f815a550 msgr2=0x7fa0f80c3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:27.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.288+0000 7fa0fcd32700 1 --2- 172.21.15.92:0/407480035 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa0f815a550 0x7fa0f80c3150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:27.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.288+0000 7fa0fcd32700 1 -- 172.21.15.92:0/407480035 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e4009550 con 0x7fa0f806b430 2023-08-26T09:25:27.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.288+0000 7fa0fcd32700 1 --2- 172.21.15.92:0/407480035 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0f806b430 0x7fa0f80c6a30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec00e810 tx=0x7fa0ec00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:27.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.288+0000 7fa0f57fa700 1 -- 172.21.15.92:0/407480035 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec00c020 con 0x7fa0f806b430 2023-08-26T09:25:27.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.288+0000 7fa0f57fa700 1 -- 172.21.15.92:0/407480035 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0ec004250 con 0x7fa0f806b430 2023-08-26T09:25:27.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.288+0000 7fa0fef96700 1 -- 172.21.15.92:0/407480035 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0f80c5cb0 con 0x7fa0f806b430 2023-08-26T09:25:27.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.288+0000 7fa0f57fa700 1 -- 172.21.15.92:0/407480035 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec0036a0 con 0x7fa0f806b430 2023-08-26T09:25:27.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.288+0000 7fa0fef96700 1 -- 172.21.15.92:0/407480035 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0f80c70f0 con 0x7fa0f806b430 2023-08-26T09:25:27.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.289+0000 7fa0fef96700 1 -- 172.21.15.92:0/407480035 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0f804eeb0 con 0x7fa0f806b430 2023-08-26T09:25:27.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.290+0000 7fa0f57fa700 1 -- 172.21.15.92:0/407480035 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa0ec003800 con 0x7fa0f806b430 2023-08-26T09:25:27.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.290+0000 7fa0f57fa700 1 --2- 172.21.15.92:0/407480035 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa0dc06a0e0 0x7fa0dc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:27.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.290+0000 7fa0f57fa700 1 -- 172.21.15.92:0/407480035 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa0ec088020 con 0x7fa0f806b430 2023-08-26T09:25:27.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.290+0000 7fa0f7fff700 1 --2- 172.21.15.92:0/407480035 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa0dc06a0e0 0x7fa0dc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:27.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.291+0000 7fa0f7fff700 1 --2- 172.21.15.92:0/407480035 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa0dc06a0e0 0x7fa0dc06c5a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa0f806b380 tx=0x7fa0e4010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:27.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.295+0000 7fa0f57fa700 1 -- 172.21.15.92:0/407480035 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa0ec053710 con 0x7fa0f806b430 2023-08-26T09:25:27.487 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.483+0000 7fa0fef96700 1 -- 172.21.15.92:0/407480035 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa0f8074610 con 0x7fa0f806b430 2023-08-26T09:25:27.487 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.483+0000 7fa0f57fa700 1 -- 172.21.15.92:0/407480035 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa0ec056d30 con 0x7fa0f806b430 2023-08-26T09:25:27.488 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 32 2023-08-26T09:25:27.490 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.485+0000 7fa0fef96700 1 -- 172.21.15.92:0/407480035 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa0dc06a0e0 msgr2=0x7fa0dc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:27.490 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.485+0000 7fa0fef96700 1 --2- 172.21.15.92:0/407480035 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa0dc06a0e0 0x7fa0dc06c5a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa0f806b380 tx=0x7fa0e4010000 comp rx=0 tx=0).stop 2023-08-26T09:25:27.490 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.485+0000 7fa0fef96700 1 -- 172.21.15.92:0/407480035 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0f806b430 msgr2=0x7fa0f80c6a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:27.490 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.485+0000 7fa0fef96700 1 --2- 172.21.15.92:0/407480035 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0f806b430 0x7fa0f80c6a30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec00e810 tx=0x7fa0ec00ebd0 comp rx=0 tx=0).stop 2023-08-26T09:25:27.491 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.485+0000 7fa0fef96700 1 -- 172.21.15.92:0/407480035 shutdown_connections 2023-08-26T09:25:27.491 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.485+0000 7fa0fef96700 1 --2- 172.21.15.92:0/407480035 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa0dc06a0e0 0x7fa0dc06c5a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:27.491 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.485+0000 7fa0fef96700 1 --2- 172.21.15.92:0/407480035 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa0f815a550 0x7fa0f80c3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:27.491 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.485+0000 7fa0fef96700 1 --2- 172.21.15.92:0/407480035 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0f806b430 0x7fa0f80c6a30 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:27.491 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.485+0000 7fa0fef96700 1 --2- 172.21.15.92:0/407480035 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa0f80c9fe0 0x7fa0f814d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:27.492 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.485+0000 7fa0fef96700 1 -- 172.21.15.92:0/407480035 >> 172.21.15.92:0/407480035 conn(0x7fa0f80cf450 msgr2=0x7fa0f80af690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:27.492 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.485+0000 7fa0fef96700 1 -- 172.21.15.92:0/407480035 shutdown_connections 2023-08-26T09:25:27.492 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.485+0000 7fa0fef96700 1 -- 172.21.15.92:0/407480035 wait complete. 2023-08-26T09:25:27.501 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-26T09:25:27.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.620+0000 7f2a35393700 1 Processor -- start 2023-08-26T09:25:27.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.620+0000 7f2a35393700 1 -- start start 2023-08-26T09:25:27.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.620+0000 7f2a35393700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a300b28d0 0x7f2a300b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:27.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.620+0000 7f2a35393700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f2a3015da10 0x7f2a3015ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:27.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.620+0000 7f2a35393700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a3015e9b0 con 0x7f2a300ce450 2023-08-26T09:25:27.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.620+0000 7f2a35393700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a301614a0 con 0x7f2a3015da10 2023-08-26T09:25:27.627 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.620+0000 7f2a35393700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a300b31f0 con 0x7f2a300b28d0 2023-08-26T09:25:27.627 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.621+0000 7f2a2f7fe700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f2a3015da10 0x7f2a3015ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:27.627 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.621+0000 7f2a2f7fe700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f2a3015da10 0x7f2a3015ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.92:33882/0 (socket says 172.21.15.92:33882) 2023-08-26T09:25:27.627 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.621+0000 7f2a2f7fe700 1 -- 172.21.15.92:0/2197299168 learned_addr learned my addr 172.21.15.92:0/2197299168 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:27.627 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.621+0000 7f2a2effd700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a300b28d0 0x7f2a300b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:27.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.621+0000 7f2a2f7fe700 1 -- 172.21.15.92:0/2197299168 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a300b28d0 msgr2=0x7f2a300b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:27.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.621+0000 7f2a2f7fe700 1 --2- 172.21.15.92:0/2197299168 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a300b28d0 0x7f2a300b2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:27.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.621+0000 7f2a2f7fe700 1 -- 172.21.15.92:0/2197299168 >> v1:172.21.15.188:6789/0 conn(0x7f2a300ce450 legacy=0x7f2a30161930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:27.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.621+0000 7f2a2f7fe700 1 -- 172.21.15.92:0/2197299168 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a3015e3f0 con 0x7f2a3015da10 2023-08-26T09:25:27.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.621+0000 7f2a2dffb700 1 -- 172.21.15.92:0/2197299168 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3018672622 0 0) 0x7f2a3015e9b0 con 0x7f2a300ce450 2023-08-26T09:25:27.629 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.621+0000 7f2a2f7fe700 1 --2- 172.21.15.92:0/2197299168 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2a3015da10 0x7f2a3015ede0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2a28009e50 tx=0x7f2a2800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2cd667072cb30e50 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:27.629 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.621+0000 7f2a2dffb700 1 -- 172.21.15.92:0/2197299168 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2800e070 con 0x7f2a3015da10 2023-08-26T09:25:27.629 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.621+0000 7f2a2dffb700 1 -- 172.21.15.92:0/2197299168 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2800b910 con 0x7f2a3015da10 2023-08-26T09:25:27.629 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.621+0000 7f2a2dffb700 1 -- 172.21.15.92:0/2197299168 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2800bcc0 con 0x7f2a3015da10 2023-08-26T09:25:27.632 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.622+0000 7f2a35393700 1 -- 172.21.15.92:0/2197299168 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2a3015da10 msgr2=0x7f2a3015ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:27.632 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.622+0000 7f2a35393700 1 --2- 172.21.15.92:0/2197299168 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2a3015da10 0x7f2a3015ede0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2a28009e50 tx=0x7f2a2800b330 comp rx=0 tx=0).stop 2023-08-26T09:25:27.632 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.622+0000 7f2a35393700 1 -- 172.21.15.92:0/2197299168 shutdown_connections 2023-08-26T09:25:27.633 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.622+0000 7f2a35393700 1 --2- 172.21.15.92:0/2197299168 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2a3015da10 0x7f2a3015ede0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:27.633 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.622+0000 7f2a35393700 1 --2- 172.21.15.92:0/2197299168 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a300b28d0 0x7f2a300b2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:27.633 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.622+0000 7f2a35393700 1 -- 172.21.15.92:0/2197299168 >> 172.21.15.92:0/2197299168 conn(0x7f2a300cd8d0 msgr2=0x7f2a300cdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:27.633 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.622+0000 7f2a35393700 1 -- 172.21.15.92:0/2197299168 shutdown_connections 2023-08-26T09:25:27.633 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.622+0000 7f2a35393700 1 -- 172.21.15.92:0/2197299168 wait complete. 2023-08-26T09:25:27.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.623+0000 7f2a35393700 1 Processor -- start 2023-08-26T09:25:27.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.623+0000 7f2a35393700 1 -- start start 2023-08-26T09:25:27.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.624+0000 7f2a35393700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a300b28d0 0x7f2a300c5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:27.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.624+0000 7f2a35393700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a300ce450 0x7f2a30156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:27.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.624+0000 7f2a35393700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2a3015da10 0x7f2a300c73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:27.635 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.624+0000 7f2a35393700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a300adfa0 con 0x7f2a300ce450 2023-08-26T09:25:27.635 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.624+0000 7f2a35393700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a300c78e0 con 0x7f2a3015da10 2023-08-26T09:25:27.635 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.624+0000 7f2a35393700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a300c5fe0 con 0x7f2a300b28d0 2023-08-26T09:25:27.635 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.624+0000 7f2a2e7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a300ce450 0x7f2a30156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:27.635 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.624+0000 7f2a2e7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a300ce450 0x7f2a30156ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45078/0 (socket says 172.21.15.92:45078) 2023-08-26T09:25:27.636 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.624+0000 7f2a2e7fc700 1 -- 172.21.15.92:0/1087230588 learned_addr learned my addr 172.21.15.92:0/1087230588 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:27.636 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.624+0000 7f2a2effd700 1 --2- 172.21.15.92:0/1087230588 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a300b28d0 0x7f2a300c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:27.636 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.624+0000 7f2a2f7fe700 1 --2- 172.21.15.92:0/1087230588 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2a3015da10 0x7f2a300c73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:27.636 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.624+0000 7f2a2e7fc700 1 -- 172.21.15.92:0/1087230588 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a300b28d0 msgr2=0x7f2a300c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:27.636 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.624+0000 7f2a2e7fc700 1 --2- 172.21.15.92:0/1087230588 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a300b28d0 0x7f2a300c5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:27.636 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.624+0000 7f2a2e7fc700 1 -- 172.21.15.92:0/1087230588 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2a3015da10 msgr2=0x7f2a300c73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:27.637 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.624+0000 7f2a2e7fc700 1 --2- 172.21.15.92:0/1087230588 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2a3015da10 0x7f2a300c73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:27.637 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.624+0000 7f2a2e7fc700 1 -- 172.21.15.92:0/1087230588 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a28009b30 con 0x7f2a300ce450 2023-08-26T09:25:27.637 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.624+0000 7f2a2f7fe700 1 --2- 172.21.15.92:0/1087230588 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2a3015da10 0x7f2a300c73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:27.637 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.624+0000 7f2a2effd700 1 --2- 172.21.15.92:0/1087230588 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a300b28d0 0x7f2a300c5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:27.637 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.625+0000 7f2a2e7fc700 1 --2- 172.21.15.92:0/1087230588 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a300ce450 0x7f2a30156ab0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2a2000c520 tx=0x7f2a2000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:27.638 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.625+0000 7f2a177fe700 1 -- 172.21.15.92:0/1087230588 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a200054e0 con 0x7f2a300ce450 2023-08-26T09:25:27.638 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.625+0000 7f2a177fe700 1 -- 172.21.15.92:0/1087230588 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a20003680 con 0x7f2a300ce450 2023-08-26T09:25:27.638 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.625+0000 7f2a35393700 1 -- 172.21.15.92:0/1087230588 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a300c5a20 con 0x7f2a300ce450 2023-08-26T09:25:27.638 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.625+0000 7f2a177fe700 1 -- 172.21.15.92:0/1087230588 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a20003a30 con 0x7f2a300ce450 2023-08-26T09:25:27.638 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.625+0000 7f2a35393700 1 -- 172.21.15.92:0/1087230588 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a300ae1d0 con 0x7f2a300ce450 2023-08-26T09:25:27.639 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.626+0000 7f2a35393700 1 -- 172.21.15.92:0/1087230588 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a3004eeb0 con 0x7f2a300ce450 2023-08-26T09:25:27.639 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.626+0000 7f2a177fe700 1 -- 172.21.15.92:0/1087230588 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2a20003b90 con 0x7f2a300ce450 2023-08-26T09:25:27.639 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.626+0000 7f2a177fe700 1 --2- 172.21.15.92:0/1087230588 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f2a1c06a0e0 0x7f2a1c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:27.639 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.626+0000 7f2a177fe700 1 -- 172.21.15.92:0/1087230588 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2a200879f0 con 0x7f2a300ce450 2023-08-26T09:25:27.639 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.626+0000 7f2a2effd700 1 --2- 172.21.15.92:0/1087230588 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f2a1c06a0e0 0x7f2a1c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:27.639 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.627+0000 7f2a2effd700 1 --2- 172.21.15.92:0/1087230588 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f2a1c06a0e0 0x7f2a1c06c5a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2a24009c30 tx=0x7f2a24008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:27.640 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.631+0000 7f2a177fe700 1 -- 172.21.15.92:0/1087230588 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2a20053170 con 0x7f2a300ce450 2023-08-26T09:25:27.823 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.819+0000 7f2a35393700 1 -- 172.21.15.92:0/1087230588 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2a300b6dd0 con 0x7f2a300ce450 2023-08-26T09:25:27.824 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.820+0000 7f2a177fe700 1 -- 172.21.15.92:0/1087230588 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2a200170a0 con 0x7f2a300ce450 2023-08-26T09:25:27.825 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 64 2023-08-26T09:25:27.827 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.822+0000 7f2a35393700 1 -- 172.21.15.92:0/1087230588 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f2a1c06a0e0 msgr2=0x7f2a1c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:27.827 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.822+0000 7f2a35393700 1 --2- 172.21.15.92:0/1087230588 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f2a1c06a0e0 0x7f2a1c06c5a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2a24009c30 tx=0x7f2a24008040 comp rx=0 tx=0).stop 2023-08-26T09:25:27.827 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.822+0000 7f2a35393700 1 -- 172.21.15.92:0/1087230588 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a300ce450 msgr2=0x7f2a30156ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:27.827 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.822+0000 7f2a35393700 1 --2- 172.21.15.92:0/1087230588 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a300ce450 0x7f2a30156ab0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2a2000c520 tx=0x7f2a2000c8e0 comp rx=0 tx=0).stop 2023-08-26T09:25:27.828 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.822+0000 7f2a35393700 1 -- 172.21.15.92:0/1087230588 shutdown_connections 2023-08-26T09:25:27.828 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.822+0000 7f2a35393700 1 --2- 172.21.15.92:0/1087230588 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f2a1c06a0e0 0x7f2a1c06c5a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:27.828 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.822+0000 7f2a35393700 1 --2- 172.21.15.92:0/1087230588 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2a3015da10 0x7f2a300c73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:27.829 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.822+0000 7f2a35393700 1 --2- 172.21.15.92:0/1087230588 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a300b28d0 0x7f2a300c5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:27.829 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.822+0000 7f2a35393700 1 --2- 172.21.15.92:0/1087230588 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a300ce450 0x7f2a30156ab0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:27.829 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.822+0000 7f2a35393700 1 -- 172.21.15.92:0/1087230588 >> 172.21.15.92:0/1087230588 conn(0x7f2a300cd8d0 msgr2=0x7f2a301571d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:27.830 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.822+0000 7f2a35393700 1 -- 172.21.15.92:0/1087230588 shutdown_connections 2023-08-26T09:25:27.830 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.822+0000 7f2a35393700 1 -- 172.21.15.92:0/1087230588 wait complete. 2023-08-26T09:25:27.838 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-26T09:25:27.957 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.953+0000 7fd607773700 1 Processor -- start 2023-08-26T09:25:27.958 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.953+0000 7fd607773700 1 -- start start 2023-08-26T09:25:27.965 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.954+0000 7fd607773700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd60015a090 0x7fd6000cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:27.965 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.954+0000 7fd607773700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd60006f4e0 0x7fd6000cd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:27.965 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.954+0000 7fd607773700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6000cf7e0 con 0x7fd6000cb8e0 2023-08-26T09:25:27.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.954+0000 7fd607773700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6000caec0 con 0x7fd60006f4e0 2023-08-26T09:25:27.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.954+0000 7fd607773700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6000cb160 con 0x7fd60015a090 2023-08-26T09:25:27.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.954+0000 7fd605d10700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fd6000cb8e0 0x7fd60006e780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:57100/0 (socket says 172.21.15.92:57100) 2023-08-26T09:25:27.967 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.954+0000 7fd605d10700 1 -- 172.21.15.92:0/4245571128 learned_addr learned my addr 172.21.15.92:0/4245571128 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:27.967 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.955+0000 7fd604d0e700 1 --2- 172.21.15.92:0/4245571128 >> v2:172.21.15.188:3300/0 conn(0x7fd60006f4e0 0x7fd6000cd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:27.967 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.955+0000 7fd60550f700 1 --2- 172.21.15.92:0/4245571128 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd60015a090 0x7fd6000cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:27.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.955+0000 7fd5f3fff700 1 -- 172.21.15.92:0/4245571128 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3255657154 0 0) 0x7fd6000cf7e0 con 0x7fd6000cb8e0 2023-08-26T09:25:27.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.955+0000 7fd5f3fff700 1 -- 172.21.15.92:0/4245571128 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5ec0035b0 con 0x7fd6000cb8e0 2023-08-26T09:25:27.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.955+0000 7fd5f3fff700 1 -- 172.21.15.92:0/4245571128 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 294585611 0 0) 0x7fd5ec0035b0 con 0x7fd6000cb8e0 2023-08-26T09:25:27.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.955+0000 7fd5f3fff700 1 -- 172.21.15.92:0/4245571128 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd60015a090 msgr2=0x7fd6000cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:27.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.955+0000 7fd5f3fff700 1 --2- 172.21.15.92:0/4245571128 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd60015a090 0x7fd6000cd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:27.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.955+0000 7fd5f3fff700 1 -- 172.21.15.92:0/4245571128 >> v2:172.21.15.188:3300/0 conn(0x7fd60006f4e0 msgr2=0x7fd6000cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:27.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.955+0000 7fd5f3fff700 1 --2- 172.21.15.92:0/4245571128 >> v2:172.21.15.188:3300/0 conn(0x7fd60006f4e0 0x7fd6000cd900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:27.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.955+0000 7fd5f3fff700 1 -- 172.21.15.92:0/4245571128 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6000cb440 con 0x7fd6000cb8e0 2023-08-26T09:25:27.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.955+0000 7fd5f3fff700 1 -- 172.21.15.92:0/4245571128 <== mon.0 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1019361464 0 0) 0x7fd5f80019f0 con 0x7fd6000cb8e0 2023-08-26T09:25:27.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.955+0000 7fd5f3fff700 1 -- 172.21.15.92:0/4245571128 >> v1:172.21.15.92:6789/0 conn(0x7fd6000cb8e0 legacy=0x7fd60006e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:27.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.955+0000 7fd5f3fff700 1 --2- 172.21.15.92:0/4245571128 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5ec003a00 0x7fd5ec003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:27.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.955+0000 7fd5f3fff700 1 --2- 172.21.15.92:0/4245571128 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd5ec004850 0x7fd5ec004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:27.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.955+0000 7fd5f3fff700 1 --2- 172.21.15.92:0/4245571128 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd60015a090 0x7fd5ec005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:27.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.955+0000 7fd5f3fff700 1 -- 172.21.15.92:0/4245571128 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6000caec0 con 0x7fd5ec003a00 2023-08-26T09:25:27.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.955+0000 7fd5f3fff700 1 -- 172.21.15.92:0/4245571128 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6000cb160 con 0x7fd5ec004850 2023-08-26T09:25:27.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.955+0000 7fd5f3fff700 1 -- 172.21.15.92:0/4245571128 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ec00ba10 con 0x7fd60015a090 2023-08-26T09:25:27.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.955+0000 7fd60550f700 1 --2- 172.21.15.92:0/4245571128 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5ec003a00 0x7fd5ec003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:27.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.955+0000 7fd604d0e700 1 --2- 172.21.15.92:0/4245571128 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd5ec004850 0x7fd5ec004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:27.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.955+0000 7fd605d10700 1 --2- 172.21.15.92:0/4245571128 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd60015a090 0x7fd5ec005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:27.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.955+0000 7fd60550f700 1 -- 172.21.15.92:0/4245571128 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd60015a090 msgr2=0x7fd5ec005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:27.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.955+0000 7fd60550f700 1 --2- 172.21.15.92:0/4245571128 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd60015a090 0x7fd5ec005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:27.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.955+0000 7fd60550f700 1 -- 172.21.15.92:0/4245571128 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd5ec004850 msgr2=0x7fd5ec004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:27.973 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.955+0000 7fd60550f700 1 --2- 172.21.15.92:0/4245571128 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd5ec004850 0x7fd5ec004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:27.973 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.955+0000 7fd60550f700 1 -- 172.21.15.92:0/4245571128 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5ec0035b0 con 0x7fd5ec003a00 2023-08-26T09:25:27.973 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.955+0000 7fd60550f700 1 --2- 172.21.15.92:0/4245571128 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5ec003a00 0x7fd5ec003e20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc009b90 tx=0x7fd5ec005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=135c3e1dcc73a42f server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:27.973 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.956+0000 7fd5f3fff700 1 -- 172.21.15.92:0/4245571128 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc00e6c0 con 0x7fd5ec003a00 2023-08-26T09:25:27.973 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.956+0000 7fd5f3fff700 1 -- 172.21.15.92:0/4245571128 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5fc00e820 con 0x7fd5ec003a00 2023-08-26T09:25:27.974 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.956+0000 7fd5f3fff700 1 -- 172.21.15.92:0/4245571128 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc00eb90 con 0x7fd5ec003a00 2023-08-26T09:25:27.974 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.956+0000 7fd607773700 1 -- 172.21.15.92:0/4245571128 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5ec003a00 msgr2=0x7fd5ec003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:27.974 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.956+0000 7fd607773700 1 --2- 172.21.15.92:0/4245571128 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5ec003a00 0x7fd5ec003e20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc009b90 tx=0x7fd5ec005880 comp rx=0 tx=0).stop 2023-08-26T09:25:27.974 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.956+0000 7fd605d10700 1 -- 172.21.15.92:0/4245571128 reap_dead start 2023-08-26T09:25:27.974 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.956+0000 7fd607773700 1 -- 172.21.15.92:0/4245571128 shutdown_connections 2023-08-26T09:25:27.975 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.956+0000 7fd607773700 1 -- 172.21.15.92:0/4245571128 >> 172.21.15.92:0/4245571128 conn(0x7fd6000cc7b0 msgr2=0x7fd6000ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:27.975 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.956+0000 7fd607773700 1 -- 172.21.15.92:0/4245571128 shutdown_connections 2023-08-26T09:25:27.975 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.956+0000 7fd607773700 1 -- 172.21.15.92:0/4245571128 wait complete. 2023-08-26T09:25:27.975 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.957+0000 7fd607773700 1 Processor -- start 2023-08-26T09:25:27.975 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.957+0000 7fd607773700 1 -- start start 2023-08-26T09:25:27.976 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.958+0000 7fd607773700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5ec003a00 0x7fd6000b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:27.976 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.958+0000 7fd607773700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd60014fcf0 0x7fd60014bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:27.976 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.958+0000 7fd607773700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6000c9330 0x7fd6000c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:27.976 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.958+0000 7fd607773700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6000c9d20 con 0x7fd5ec003a00 2023-08-26T09:25:27.977 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.958+0000 7fd607773700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd600150e00 con 0x7fd60014fcf0 2023-08-26T09:25:27.977 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.958+0000 7fd607773700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6001501f0 con 0x7fd6000c9330 2023-08-26T09:25:27.977 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.958+0000 7fd60550f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5ec003a00 0x7fd6000b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:27.977 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.958+0000 7fd60550f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5ec003a00 0x7fd6000b4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45094/0 (socket says 172.21.15.92:45094) 2023-08-26T09:25:27.977 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.958+0000 7fd60550f700 1 -- 172.21.15.92:0/63411064 learned_addr learned my addr 172.21.15.92:0/63411064 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:27.978 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.958+0000 7fd604d0e700 1 --2- 172.21.15.92:0/63411064 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd60014fcf0 0x7fd60014bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:27.978 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.958+0000 7fd605d10700 1 --2- 172.21.15.92:0/63411064 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6000c9330 0x7fd6000c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:27.978 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.958+0000 7fd60550f700 1 -- 172.21.15.92:0/63411064 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6000c9330 msgr2=0x7fd6000c97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:27.979 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.958+0000 7fd60550f700 1 --2- 172.21.15.92:0/63411064 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6000c9330 0x7fd6000c97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:27.979 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.958+0000 7fd60550f700 1 -- 172.21.15.92:0/63411064 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd60014fcf0 msgr2=0x7fd60014bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:27.980 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.958+0000 7fd60550f700 1 --2- 172.21.15.92:0/63411064 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd60014fcf0 0x7fd60014bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:27.980 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.958+0000 7fd60550f700 1 -- 172.21.15.92:0/63411064 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6001504d0 con 0x7fd5ec003a00 2023-08-26T09:25:27.980 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.959+0000 7fd60550f700 1 --2- 172.21.15.92:0/63411064 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5ec003a00 0x7fd6000b4cc0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc00e4b0 tx=0x7fd5fc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:27.980 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.959+0000 7fd5f1ffb700 1 -- 172.21.15.92:0/63411064 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc00e6c0 con 0x7fd5ec003a00 2023-08-26T09:25:27.981 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.959+0000 7fd5f1ffb700 1 -- 172.21.15.92:0/63411064 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5fc0038a0 con 0x7fd5ec003a00 2023-08-26T09:25:27.981 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.959+0000 7fd5f1ffb700 1 -- 172.21.15.92:0/63411064 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc003c50 con 0x7fd5ec003a00 2023-08-26T09:25:27.981 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.959+0000 7fd607773700 1 -- 172.21.15.92:0/63411064 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6001507b0 con 0x7fd5ec003a00 2023-08-26T09:25:27.981 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.959+0000 7fd607773700 1 -- 172.21.15.92:0/63411064 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6000b3fd0 con 0x7fd5ec003a00 2023-08-26T09:25:27.981 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.960+0000 7fd607773700 1 -- 172.21.15.92:0/63411064 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd60004e660 con 0x7fd5ec003a00 2023-08-26T09:25:27.982 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.960+0000 7fd5f1ffb700 1 -- 172.21.15.92:0/63411064 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd5fc013470 con 0x7fd5ec003a00 2023-08-26T09:25:27.982 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.961+0000 7fd5f1ffb700 1 --2- 172.21.15.92:0/63411064 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fd5e406a0e0 0x7fd5e406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:27.982 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.961+0000 7fd5f1ffb700 1 -- 172.21.15.92:0/63411064 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd5fc089c30 con 0x7fd5ec003a00 2023-08-26T09:25:27.983 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.961+0000 7fd604d0e700 1 --2- 172.21.15.92:0/63411064 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fd5e406a0e0 0x7fd5e406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:27.983 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.961+0000 7fd604d0e700 1 --2- 172.21.15.92:0/63411064 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fd5e406a0e0 0x7fd5e406c5a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4009c00 tx=0x7fd5f4009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:27.983 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:27.965+0000 7fd5f1ffb700 1 -- 172.21.15.92:0/63411064 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd5fc058f60 con 0x7fd5ec003a00 2023-08-26T09:25:28.201 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.197+0000 7fd607773700 1 -- 172.21.15.92:0/63411064 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd60015a470 con 0x7fd5ec003a00 2023-08-26T09:25:28.202 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.197+0000 7fd5f1ffb700 1 -- 172.21.15.92:0/63411064 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4863 (secure 0 0 0) 0x7fd5fc017090 con 0x7fd5ec003a00 2023-08-26T09:25:28.202 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:25:28.202 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/856608283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6833","nonce":856608283},{"type":"v1","addr":"172.21.15.188:6835","nonce":856608283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4279,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/33581841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":33581841},{"type":"v1","addr":"172.21.15.92:6837","nonce":33581841}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6834/279535547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":279535547},{"type":"v1","addr":"172.21.15.188:6834","nonce":279535547}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-26T09:25:13.851186+0000","modified":"2023-08-26T09:25:17.482682+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6835/2933877114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2933877114},{"type":"v1","addr":"172.21.15.92:6835","nonce":2933877114}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-26T09:25:28.204 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.200+0000 7fd607773700 1 -- 172.21.15.92:0/63411064 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fd5e406a0e0 msgr2=0x7fd5e406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:28.204 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.200+0000 7fd607773700 1 --2- 172.21.15.92:0/63411064 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fd5e406a0e0 0x7fd5e406c5a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4009c00 tx=0x7fd5f4009210 comp rx=0 tx=0).stop 2023-08-26T09:25:28.204 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.200+0000 7fd607773700 1 -- 172.21.15.92:0/63411064 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5ec003a00 msgr2=0x7fd6000b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:28.205 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.200+0000 7fd607773700 1 --2- 172.21.15.92:0/63411064 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5ec003a00 0x7fd6000b4cc0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc00e4b0 tx=0x7fd5fc0047c0 comp rx=0 tx=0).stop 2023-08-26T09:25:28.205 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.200+0000 7fd607773700 1 -- 172.21.15.92:0/63411064 shutdown_connections 2023-08-26T09:25:28.205 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.200+0000 7fd607773700 1 --2- 172.21.15.92:0/63411064 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6000c9330 0x7fd6000c97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:28.205 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.200+0000 7fd607773700 1 --2- 172.21.15.92:0/63411064 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5ec003a00 0x7fd6000b4cc0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:28.205 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.200+0000 7fd607773700 1 --2- 172.21.15.92:0/63411064 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fd5e406a0e0 0x7fd5e406c5a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:28.206 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.200+0000 7fd607773700 1 --2- 172.21.15.92:0/63411064 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd60014fcf0 0x7fd60014bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:28.206 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.200+0000 7fd607773700 1 -- 172.21.15.92:0/63411064 >> 172.21.15.92:0/63411064 conn(0x7fd6000cc7b0 msgr2=0x7fd6000c5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:28.206 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.200+0000 7fd607773700 1 -- 172.21.15.92:0/63411064 shutdown_connections 2023-08-26T09:25:28.206 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.200+0000 7fd607773700 1 -- 172.21.15.92:0/63411064 wait complete. 2023-08-26T09:25:28.207 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 7 2023-08-26T09:25:28.216 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-26T09:25:28.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.334+0000 7f0b3b94b700 1 Processor -- start 2023-08-26T09:25:28.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.334+0000 7f0b3b94b700 1 -- start start 2023-08-26T09:25:28.340 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.335+0000 7f0b3b94b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0b34159d60 0x7f0b340ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:28.341 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.335+0000 7f0b3b94b700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0b3406e140 0x7f0b3406cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:28.341 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.335+0000 7f0b3b94b700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b3415e490 con 0x7f0b3406e720 2023-08-26T09:25:28.341 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.335+0000 7f0b3b94b700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b3415ea50 con 0x7f0b34159d60 2023-08-26T09:25:28.341 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.335+0000 7f0b3b94b700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3415e770 con 0x7f0b3406e140 2023-08-26T09:25:28.341 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.335+0000 7f0b396e7700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0b34159d60 0x7f0b340ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:28.342 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.335+0000 7f0b396e7700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0b34159d60 0x7f0b340ceb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45102/0 (socket says 172.21.15.92:45102) 2023-08-26T09:25:28.342 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.335+0000 7f0b396e7700 1 -- 172.21.15.92:0/1655020539 learned_addr learned my addr 172.21.15.92:0/1655020539 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:28.342 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.335+0000 7f0b38ee6700 1 --2- 172.21.15.92:0/1655020539 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0b3406e140 0x7f0b3406cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:28.342 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.335+0000 7f0b396e7700 1 -- 172.21.15.92:0/1655020539 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0b3406e140 msgr2=0x7f0b3406cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:28.342 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.335+0000 7f0b396e7700 1 --2- 172.21.15.92:0/1655020539 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0b3406e140 0x7f0b3406cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:28.343 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.335+0000 7f0b396e7700 1 -- 172.21.15.92:0/1655020539 >> v1:172.21.15.188:6789/0 conn(0x7f0b3406e720 legacy=0x7f0b340cad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:28.343 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.335+0000 7f0b396e7700 1 -- 172.21.15.92:0/1655020539 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b340ce350 con 0x7f0b34159d60 2023-08-26T09:25:28.343 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.335+0000 7f0b396e7700 1 --2- 172.21.15.92:0/1655020539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b34159d60 0x7f0b340ceb50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0b3000bb90 tx=0x7f0b3000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1ccd74b1765566e server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:28.343 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.335+0000 7f0b2bfff700 1 -- 172.21.15.92:0/1655020539 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3000dd50 con 0x7f0b34159d60 2023-08-26T09:25:28.343 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.335+0000 7f0b2bfff700 1 -- 172.21.15.92:0/1655020539 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b30010470 con 0x7f0b34159d60 2023-08-26T09:25:28.344 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.335+0000 7f0b2bfff700 1 -- 172.21.15.92:0/1655020539 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b30010800 con 0x7f0b34159d60 2023-08-26T09:25:28.344 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.336+0000 7f0b3b94b700 1 -- 172.21.15.92:0/1655020539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b34159d60 msgr2=0x7f0b340ceb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:28.344 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.336+0000 7f0b3b94b700 1 --2- 172.21.15.92:0/1655020539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b34159d60 0x7f0b340ceb50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0b3000bb90 tx=0x7f0b3000bea0 comp rx=0 tx=0).stop 2023-08-26T09:25:28.344 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.336+0000 7f0b3b94b700 1 -- 172.21.15.92:0/1655020539 shutdown_connections 2023-08-26T09:25:28.344 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.336+0000 7f0b3b94b700 1 --2- 172.21.15.92:0/1655020539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b34159d60 0x7f0b340ceb50 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:28.344 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.336+0000 7f0b3b94b700 1 --2- 172.21.15.92:0/1655020539 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0b3406e140 0x7f0b3406cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:28.345 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.336+0000 7f0b3b94b700 1 -- 172.21.15.92:0/1655020539 >> 172.21.15.92:0/1655020539 conn(0x7f0b340cfd80 msgr2=0x7f0b340d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:28.345 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.336+0000 7f0b3b94b700 1 -- 172.21.15.92:0/1655020539 shutdown_connections 2023-08-26T09:25:28.345 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.336+0000 7f0b3b94b700 1 -- 172.21.15.92:0/1655020539 wait complete. 2023-08-26T09:25:28.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.338+0000 7f0b3b94b700 1 Processor -- start 2023-08-26T09:25:28.348 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.338+0000 7f0b3b94b700 1 -- start start 2023-08-26T09:25:28.348 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.339+0000 7f0b3b94b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b3406e140 0x7f0b34149730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:28.348 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.339+0000 7f0b3b94b700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0b3406e720 0x7f0b341502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:28.348 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.339+0000 7f0b3b94b700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0b34159d60 0x7f0b3414ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:28.349 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.339+0000 7f0b3b94b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b341507e0 con 0x7f0b3406e140 2023-08-26T09:25:28.349 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.339+0000 7f0b3b94b700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3414ca00 con 0x7f0b34159d60 2023-08-26T09:25:28.349 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.339+0000 7f0b3b94b700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b34152260 con 0x7f0b3406e720 2023-08-26T09:25:28.349 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.339+0000 7f0b396e7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b3406e140 0x7f0b34149730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:28.349 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.339+0000 7f0b396e7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b3406e140 0x7f0b34149730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45108/0 (socket says 172.21.15.92:45108) 2023-08-26T09:25:28.349 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.339+0000 7f0b396e7700 1 -- 172.21.15.92:0/2312540585 learned_addr learned my addr 172.21.15.92:0/2312540585 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:28.350 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.339+0000 7f0b38ee6700 1 --2- 172.21.15.92:0/2312540585 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0b3406e720 0x7f0b341502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:28.350 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.339+0000 7f0b396e7700 1 -- 172.21.15.92:0/2312540585 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0b3406e720 msgr2=0x7f0b341502a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:28.350 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.339+0000 7f0b396e7700 1 --2- 172.21.15.92:0/2312540585 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0b3406e720 0x7f0b341502a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:28.350 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.339+0000 7f0b39ee8700 1 --2- 172.21.15.92:0/2312540585 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0b34159d60 0x7f0b3414ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:28.350 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.339+0000 7f0b396e7700 1 -- 172.21.15.92:0/2312540585 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0b34159d60 msgr2=0x7f0b3414ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:28.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.339+0000 7f0b396e7700 1 --2- 172.21.15.92:0/2312540585 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0b34159d60 0x7f0b3414ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:28.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.339+0000 7f0b396e7700 1 -- 172.21.15.92:0/2312540585 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b3000b7f0 con 0x7f0b3406e140 2023-08-26T09:25:28.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.339+0000 7f0b396e7700 1 --2- 172.21.15.92:0/2312540585 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b3406e140 0x7f0b34149730 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0b3000bee0 tx=0x7f0b30004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:28.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.339+0000 7f0b29ffb700 1 -- 172.21.15.92:0/2312540585 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3001f070 con 0x7f0b3406e140 2023-08-26T09:25:28.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.339+0000 7f0b29ffb700 1 -- 172.21.15.92:0/2312540585 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b300038b0 con 0x7f0b3406e140 2023-08-26T09:25:28.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.339+0000 7f0b3b94b700 1 -- 172.21.15.92:0/2312540585 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b34152540 con 0x7f0b3406e140 2023-08-26T09:25:28.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.339+0000 7f0b29ffb700 1 -- 172.21.15.92:0/2312540585 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b30003c20 con 0x7f0b3406e140 2023-08-26T09:25:28.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.339+0000 7f0b3b94b700 1 -- 172.21.15.92:0/2312540585 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b3406b0a0 con 0x7f0b3406e140 2023-08-26T09:25:28.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.340+0000 7f0b3b94b700 1 -- 172.21.15.92:0/2312540585 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b3414cce0 con 0x7f0b3406e140 2023-08-26T09:25:28.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.341+0000 7f0b29ffb700 1 -- 172.21.15.92:0/2312540585 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0b30019400 con 0x7f0b3406e140 2023-08-26T09:25:28.353 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.341+0000 7f0b29ffb700 1 --2- 172.21.15.92:0/2312540585 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f0b1806a0e0 0x7f0b1806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:28.353 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.341+0000 7f0b29ffb700 1 -- 172.21.15.92:0/2312540585 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0b3008ba70 con 0x7f0b3406e140 2023-08-26T09:25:28.353 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.341+0000 7f0b38ee6700 1 --2- 172.21.15.92:0/2312540585 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f0b1806a0e0 0x7f0b1806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:28.353 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.341+0000 7f0b38ee6700 1 --2- 172.21.15.92:0/2312540585 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f0b1806a0e0 0x7f0b1806c5a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0b24009950 tx=0x7f0b24008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:28.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.345+0000 7f0b29ffb700 1 -- 172.21.15.92:0/2312540585 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0b300571f0 con 0x7f0b3406e140 2023-08-26T09:25:28.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.538+0000 7f0b3b94b700 1 -- 172.21.15.92:0/2312540585 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0b3404e660 con 0x7f0b3406e140 2023-08-26T09:25:28.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.539+0000 7f0b29ffb700 1 -- 172.21.15.92:0/2312540585 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+18209 (secure 0 0 0) 0x7f0b3005a810 con 0x7f0b3406e140 2023-08-26T09:25:28.543 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:25:28.543 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":20,"fsid":"254a2d31-bd41-4507-8326-1b205ac24377","created":"2023-08-26T09:24:55.352131+0000","modified":"2023-08-26T09:25:15.447635+0000","last_up_change":"2023-08-26T09:25:06.124496+0000","last_in_change":"2023-08-26T09:24:57.840725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-26T09:25:06.650431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-26T09:25:06.973382+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-26T09:25:11.584141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-26T09:25:12.814990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e9e7638-4459-4d8d-8e40-130bcf48df66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6819","nonce":382827192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6824","nonce":382827192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6831","nonce":382827192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6827","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6829","nonce":382827192}]},"public_addr":"172.21.15.92:6819/382827192","cluster_addr":"172.21.15.92:6824/382827192","heartbeat_back_addr":"172.21.15.92:6831/382827192","heartbeat_front_addr":"172.21.15.92:6829/382827192","state":["exists","up"]},{"osd":1,"uuid":"164e68c9-aedd-4df5-9b70-f4b1ec3bda13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6809","nonce":618773438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6811","nonce":618773438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6815","nonce":618773438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6813","nonce":618773438}]},"public_addr":"172.21.15.92:6809/618773438","cluster_addr":"172.21.15.92:6811/618773438","heartbeat_back_addr":"172.21.15.92:6815/618773438","heartbeat_front_addr":"172.21.15.92:6813/618773438","state":["exists","up"]},{"osd":2,"uuid":"8701dfee-629a-4d30-82e4-b8fac340303f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6818","nonce":3697397687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6821","nonce":3697397687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6828","nonce":3697397687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6823","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6825","nonce":3697397687}]},"public_addr":"172.21.15.92:6818/3697397687","cluster_addr":"172.21.15.92:6821/3697397687","heartbeat_back_addr":"172.21.15.92:6828/3697397687","heartbeat_front_addr":"172.21.15.92:6825/3697397687","state":["exists","up"]},{"osd":3,"uuid":"93bdc94d-dc07-495f-995a-a6ad072f0247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6801","nonce":3579846453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6803","nonce":3579846453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6807","nonce":3579846453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6805","nonce":3579846453}]},"public_addr":"172.21.15.92:6801/3579846453","cluster_addr":"172.21.15.92:6803/3579846453","heartbeat_back_addr":"172.21.15.92:6807/3579846453","heartbeat_front_addr":"172.21.15.92:6805/3579846453","state":["exists","up"]},{"osd":4,"uuid":"d9d0ea80-8481-46a7-9677-c338d32cf1d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6809","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6811","nonce":3228383424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6813","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6815","nonce":3228383424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6821","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6823","nonce":3228383424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6817","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6819","nonce":3228383424}]},"public_addr":"172.21.15.188:6811/3228383424","cluster_addr":"172.21.15.188:6815/3228383424","heartbeat_back_addr":"172.21.15.188:6823/3228383424","heartbeat_front_addr":"172.21.15.188:6819/3228383424","state":["exists","up"]},{"osd":5,"uuid":"38d03253-467a-456f-bd5e-5a46532a0b18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6801","nonce":1655821054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6803","nonce":1655821054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6807","nonce":1655821054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6805","nonce":1655821054}]},"public_addr":"172.21.15.188:6801/1655821054","cluster_addr":"172.21.15.188:6803/1655821054","heartbeat_back_addr":"172.21.15.188:6807/1655821054","heartbeat_front_addr":"172.21.15.188:6805/1655821054","state":["exists","up"]},{"osd":6,"uuid":"d61564b5-136f-42e5-a843-626c2017cc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6810","nonce":2069976891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6814","nonce":2069976891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6822","nonce":2069976891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6818","nonce":2069976891}]},"public_addr":"172.21.15.188:6810/2069976891","cluster_addr":"172.21.15.188:6814/2069976891","heartbeat_back_addr":"172.21.15.188:6822/2069976891","heartbeat_front_addr":"172.21.15.188:6818/2069976891","state":["exists","up"]},{"osd":7,"uuid":"fae2949e-0d62-42cd-ba72-08f516084b20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6825","nonce":1882888860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6827","nonce":1882888860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6831","nonce":1882888860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6829","nonce":1882888860}]},"public_addr":"172.21.15.188:6825/1882888860","cluster_addr":"172.21.15.188:6827/1882888860","heartbeat_back_addr":"172.21.15.188:6831/1882888860","heartbeat_front_addr":"172.21.15.188:6829/1882888860","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.038523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.063160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.000857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.975572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.023848+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.765194+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.081365+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:05.110745+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-26T09:25:28.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.541+0000 7f0b3b94b700 1 -- 172.21.15.92:0/2312540585 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f0b1806a0e0 msgr2=0x7f0b1806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:28.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.541+0000 7f0b3b94b700 1 --2- 172.21.15.92:0/2312540585 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f0b1806a0e0 0x7f0b1806c5a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0b24009950 tx=0x7f0b24008040 comp rx=0 tx=0).stop 2023-08-26T09:25:28.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.541+0000 7f0b3b94b700 1 -- 172.21.15.92:0/2312540585 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b3406e140 msgr2=0x7f0b34149730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:28.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.541+0000 7f0b3b94b700 1 --2- 172.21.15.92:0/2312540585 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b3406e140 0x7f0b34149730 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0b3000bee0 tx=0x7f0b30004750 comp rx=0 tx=0).stop 2023-08-26T09:25:28.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.541+0000 7f0b3b94b700 1 -- 172.21.15.92:0/2312540585 shutdown_connections 2023-08-26T09:25:28.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.541+0000 7f0b3b94b700 1 --2- 172.21.15.92:0/2312540585 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f0b1806a0e0 0x7f0b1806c5a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:28.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.541+0000 7f0b3b94b700 1 --2- 172.21.15.92:0/2312540585 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0b34159d60 0x7f0b3414ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:28.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.541+0000 7f0b3b94b700 1 --2- 172.21.15.92:0/2312540585 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b3406e140 0x7f0b34149730 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:28.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.541+0000 7f0b3b94b700 1 --2- 172.21.15.92:0/2312540585 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0b3406e720 0x7f0b341502a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:28.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.541+0000 7f0b3b94b700 1 -- 172.21.15.92:0/2312540585 >> 172.21.15.92:0/2312540585 conn(0x7f0b340cfd80 msgr2=0x7f0b340b4c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:28.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.541+0000 7f0b3b94b700 1 -- 172.21.15.92:0/2312540585 shutdown_connections 2023-08-26T09:25:28.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.541+0000 7f0b3b94b700 1 -- 172.21.15.92:0/2312540585 wait complete. 2023-08-26T09:25:28.557 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-26T09:25:28.677 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.673+0000 7f0846e5c700 1 Processor -- start 2023-08-26T09:25:28.677 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.673+0000 7f0846e5c700 1 -- start start 2023-08-26T09:25:28.680 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.674+0000 7f0846e5c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f084015d550 0x7f08400ce050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:28.680 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.674+0000 7f0846e5c700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f08400ce590 0x7f08400d16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:28.680 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.674+0000 7f0846e5c700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f08400d1c00 0x7f084006a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:28.680 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.674+0000 7f0846e5c700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f084015d930 con 0x7f084015d550 2023-08-26T09:25:28.681 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.674+0000 7f0846e5c700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08400cea10 con 0x7f08400d1c00 2023-08-26T09:25:28.681 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.674+0000 7f0846e5c700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08400b64b0 con 0x7f08400ce590 2023-08-26T09:25:28.681 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.674+0000 7f0844bf8700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f084015d550 0x7f08400ce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:28.681 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.674+0000 7f0844bf8700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f084015d550 0x7f08400ce050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45116/0 (socket says 172.21.15.92:45116) 2023-08-26T09:25:28.682 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.674+0000 7f0844bf8700 1 -- 172.21.15.92:0/2597253932 learned_addr learned my addr 172.21.15.92:0/2597253932 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:28.682 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.674+0000 7f083ffff700 1 --2- 172.21.15.92:0/2597253932 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f08400ce590 0x7f08400d16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:28.682 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.674+0000 7f0844bf8700 1 -- 172.21.15.92:0/2597253932 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f08400ce590 msgr2=0x7f08400d16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:28.682 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.674+0000 7f0844bf8700 1 --2- 172.21.15.92:0/2597253932 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f08400ce590 0x7f08400d16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:28.682 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.674+0000 7f0844bf8700 1 -- 172.21.15.92:0/2597253932 >> v2:172.21.15.188:3300/0 conn(0x7f08400d1c00 msgr2=0x7f084006a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:28.683 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.674+0000 7f08453f9700 1 --2- 172.21.15.92:0/2597253932 >> v2:172.21.15.188:3300/0 conn(0x7f08400d1c00 0x7f084006a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:28.683 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.674+0000 7f0844bf8700 1 --2- 172.21.15.92:0/2597253932 >> v2:172.21.15.188:3300/0 conn(0x7f08400d1c00 0x7f084006a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:28.683 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.674+0000 7f0844bf8700 1 -- 172.21.15.92:0/2597253932 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08400b6d30 con 0x7f084015d550 2023-08-26T09:25:28.683 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.674+0000 7f0844bf8700 1 --2- 172.21.15.92:0/2597253932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f084015d550 0x7f08400ce050 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f084008c420 tx=0x7f0834009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5f9b12b5fd940ed server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:28.683 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.674+0000 7f083f7fe700 1 -- 172.21.15.92:0/2597253932 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083400b870 con 0x7f084015d550 2023-08-26T09:25:28.683 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.675+0000 7f083f7fe700 1 -- 172.21.15.92:0/2597253932 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f083400b9d0 con 0x7f084015d550 2023-08-26T09:25:28.684 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.675+0000 7f083f7fe700 1 -- 172.21.15.92:0/2597253932 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083400bd60 con 0x7f084015d550 2023-08-26T09:25:28.684 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.675+0000 7f0846e5c700 1 -- 172.21.15.92:0/2597253932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f084015d550 msgr2=0x7f08400ce050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:28.684 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.675+0000 7f0846e5c700 1 --2- 172.21.15.92:0/2597253932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f084015d550 0x7f08400ce050 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f084008c420 tx=0x7f0834009bd0 comp rx=0 tx=0).stop 2023-08-26T09:25:28.684 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.675+0000 7f0846e5c700 1 -- 172.21.15.92:0/2597253932 shutdown_connections 2023-08-26T09:25:28.684 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.675+0000 7f0846e5c700 1 --2- 172.21.15.92:0/2597253932 >> v2:172.21.15.188:3300/0 conn(0x7f08400d1c00 0x7f084006a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:28.685 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.675+0000 7f0846e5c700 1 --2- 172.21.15.92:0/2597253932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f084015d550 0x7f08400ce050 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:28.685 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.675+0000 7f0846e5c700 1 --2- 172.21.15.92:0/2597253932 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f08400ce590 0x7f08400d16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:28.685 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.675+0000 7f0846e5c700 1 -- 172.21.15.92:0/2597253932 >> 172.21.15.92:0/2597253932 conn(0x7f08400cfa90 msgr2=0x7f08400cfea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:28.685 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.675+0000 7f0846e5c700 1 -- 172.21.15.92:0/2597253932 shutdown_connections 2023-08-26T09:25:28.685 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.675+0000 7f0846e5c700 1 -- 172.21.15.92:0/2597253932 wait complete. 2023-08-26T09:25:28.688 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.676+0000 7f0846e5c700 1 Processor -- start 2023-08-26T09:25:28.689 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.676+0000 7f0846e5c700 1 -- start start 2023-08-26T09:25:28.689 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.677+0000 7f0846e5c700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f08400ce590 0x7f08400b4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:28.689 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.677+0000 7f0846e5c700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f08400d1c00 0x7f08401e7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:28.689 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.677+0000 7f0846e5c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f084015d550 0x7f08401e7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:28.690 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.677+0000 7f0846e5c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08400cb6d0 con 0x7f084015d550 2023-08-26T09:25:28.690 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.677+0000 7f0846e5c700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08400cb9b0 con 0x7f08400d1c00 2023-08-26T09:25:28.690 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.677+0000 7f0846e5c700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08400cbc90 con 0x7f08400ce590 2023-08-26T09:25:28.690 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.677+0000 7f08453f9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f084015d550 0x7f08401e7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:28.690 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.677+0000 7f08453f9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f084015d550 0x7f08401e7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45124/0 (socket says 172.21.15.92:45124) 2023-08-26T09:25:28.691 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.677+0000 7f08453f9700 1 -- 172.21.15.92:0/3912585642 learned_addr learned my addr 172.21.15.92:0/3912585642 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:28.691 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.677+0000 7f0844bf8700 1 --2- 172.21.15.92:0/3912585642 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f08400ce590 0x7f08400b4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:28.691 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.678+0000 7f083ffff700 1 --2- 172.21.15.92:0/3912585642 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f08400d1c00 0x7f08401e7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:28.691 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.678+0000 7f08453f9700 1 -- 172.21.15.92:0/3912585642 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f08400ce590 msgr2=0x7f08400b4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:28.691 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.678+0000 7f08453f9700 1 --2- 172.21.15.92:0/3912585642 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f08400ce590 0x7f08400b4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:28.692 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.678+0000 7f08453f9700 1 -- 172.21.15.92:0/3912585642 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f08400d1c00 msgr2=0x7f08401e7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:28.692 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.678+0000 7f08453f9700 1 --2- 172.21.15.92:0/3912585642 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f08400d1c00 0x7f08401e7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:28.692 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.678+0000 7f08453f9700 1 -- 172.21.15.92:0/3912585642 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0834009550 con 0x7f084015d550 2023-08-26T09:25:28.692 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.678+0000 7f0844bf8700 1 --2- 172.21.15.92:0/3912585642 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f08400ce590 0x7f08400b4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:28.692 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.678+0000 7f08453f9700 1 --2- 172.21.15.92:0/3912585642 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f084015d550 0x7f08401e7e60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f083800cd70 tx=0x7f083800a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:28.693 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.678+0000 7f083d7fa700 1 -- 172.21.15.92:0/3912585642 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0838003a20 con 0x7f084015d550 2023-08-26T09:25:28.693 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.678+0000 7f083d7fa700 1 -- 172.21.15.92:0/3912585642 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0838003b80 con 0x7f084015d550 2023-08-26T09:25:28.693 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.678+0000 7f0846e5c700 1 -- 172.21.15.92:0/3912585642 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08400cbf70 con 0x7f084015d550 2023-08-26T09:25:28.693 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.678+0000 7f083d7fa700 1 -- 172.21.15.92:0/3912585642 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0838004020 con 0x7f084015d550 2023-08-26T09:25:28.693 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.678+0000 7f0846e5c700 1 -- 172.21.15.92:0/3912585642 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08401f2c20 con 0x7f084015d550 2023-08-26T09:25:28.693 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.679+0000 7f0846e5c700 1 -- 172.21.15.92:0/3912585642 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f084004e660 con 0x7f084015d550 2023-08-26T09:25:28.694 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.679+0000 7f083d7fa700 1 -- 172.21.15.92:0/3912585642 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0838004180 con 0x7f084015d550 2023-08-26T09:25:28.694 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.680+0000 7f083d7fa700 1 --2- 172.21.15.92:0/3912585642 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f082406a110 0x7f082406c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:28.694 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.680+0000 7f083d7fa700 1 -- 172.21.15.92:0/3912585642 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0838012070 con 0x7f084015d550 2023-08-26T09:25:28.694 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.680+0000 7f0844bf8700 1 --2- 172.21.15.92:0/3912585642 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f082406a110 0x7f082406c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:28.694 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.680+0000 7f0844bf8700 1 --2- 172.21.15.92:0/3912585642 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f082406a110 0x7f082406c5d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0834014040 tx=0x7f0834008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:28.695 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.684+0000 7f083d7fa700 1 -- 172.21.15.92:0/3912585642 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f08380543c0 con 0x7f084015d550 2023-08-26T09:25:28.920 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.916+0000 7f0846e5c700 1 -- 172.21.15.92:0/3912585642 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f084006baa0 con 0x7f084015d550 2023-08-26T09:25:28.921 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.916+0000 7f083d7fa700 1 -- 172.21.15.92:0/3912585642 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4863 (secure 0 0 0) 0x7f08380579e0 con 0x7f084015d550 2023-08-26T09:25:28.921 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:25:28.921 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/856608283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6833","nonce":856608283},{"type":"v1","addr":"172.21.15.188:6835","nonce":856608283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4279,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/33581841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":33581841},{"type":"v1","addr":"172.21.15.92:6837","nonce":33581841}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6834/279535547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":279535547},{"type":"v1","addr":"172.21.15.188:6834","nonce":279535547}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-26T09:25:13.851186+0000","modified":"2023-08-26T09:25:17.482682+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6835/2933877114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2933877114},{"type":"v1","addr":"172.21.15.92:6835","nonce":2933877114}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-26T09:25:28.923 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.918+0000 7f0846e5c700 1 -- 172.21.15.92:0/3912585642 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f082406a110 msgr2=0x7f082406c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:28.924 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.918+0000 7f0846e5c700 1 --2- 172.21.15.92:0/3912585642 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f082406a110 0x7f082406c5d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0834014040 tx=0x7f0834008030 comp rx=0 tx=0).stop 2023-08-26T09:25:28.924 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.918+0000 7f0846e5c700 1 -- 172.21.15.92:0/3912585642 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f084015d550 msgr2=0x7f08401e7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:28.924 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.918+0000 7f0846e5c700 1 --2- 172.21.15.92:0/3912585642 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f084015d550 0x7f08401e7e60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f083800cd70 tx=0x7f083800a570 comp rx=0 tx=0).stop 2023-08-26T09:25:28.925 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.919+0000 7f0846e5c700 1 -- 172.21.15.92:0/3912585642 shutdown_connections 2023-08-26T09:25:28.925 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.919+0000 7f0846e5c700 1 --2- 172.21.15.92:0/3912585642 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f084015d550 0x7f08401e7e60 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:28.926 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.919+0000 7f0846e5c700 1 --2- 172.21.15.92:0/3912585642 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f08400ce590 0x7f08400b4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:28.926 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.919+0000 7f0846e5c700 1 --2- 172.21.15.92:0/3912585642 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f082406a110 0x7f082406c5d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:28.926 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.919+0000 7f0846e5c700 1 --2- 172.21.15.92:0/3912585642 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f08400d1c00 0x7f08401e7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:28.927 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.919+0000 7f0846e5c700 1 -- 172.21.15.92:0/3912585642 >> 172.21.15.92:0/3912585642 conn(0x7f08400cfa90 msgr2=0x7f08400d3870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:28.927 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.919+0000 7f0846e5c700 1 -- 172.21.15.92:0/3912585642 shutdown_connections 2023-08-26T09:25:28.927 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:28.919+0000 7f0846e5c700 1 -- 172.21.15.92:0/3912585642 wait complete. 2023-08-26T09:25:28.928 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 7 2023-08-26T09:25:29.337 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-26T09:25:13.851186+0000', 'modified': '2023-08-26T09:25:17.482682+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4287}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4287': {'gid': 4287, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.92:6835/2933877114', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6834', 'nonce': 2933877114}, {'type': 'v1', 'addr': '172.21.15.92:6835', 'nonce': 2933877114}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-26T09:25:29.338 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-26T09:25:29.338 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-08-26T09:25:29.465 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.459+0000 7f619ffad700 1 Processor -- start 2023-08-26T09:25:29.466 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.459+0000 7f619ffad700 1 -- start start 2023-08-26T09:25:29.466 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.460+0000 7f619ffad700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f6198160b90 0x7f61980cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:29.466 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.460+0000 7f619ffad700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f619806cf70 con 0x7f619806a320 2023-08-26T09:25:29.466 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.460+0000 7f619ffad700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6198161670 con 0x7f619806d8a0 2023-08-26T09:25:29.466 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.460+0000 7f619ffad700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6198160f70 con 0x7f6198160b90 2023-08-26T09:25:29.467 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.460+0000 7f619dd49700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f6198160b90 0x7f61980cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:29.467 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.460+0000 7f619e54a700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f619806a320 0x7f6198070ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:57148/0 (socket says 172.21.15.92:57148) 2023-08-26T09:25:29.467 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.460+0000 7f619e54a700 1 -- 172.21.15.92:0/2889516941 learned_addr learned my addr 172.21.15.92:0/2889516941 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:29.467 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.460+0000 7f619dd49700 1 -- 172.21.15.92:0/2889516941 >> v1:172.21.15.188:6789/0 conn(0x7f619806d8a0 legacy=0x7f6198161b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:29.467 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.460+0000 7f619dd49700 1 -- 172.21.15.92:0/2889516941 >> v1:172.21.15.92:6789/0 conn(0x7f619806a320 legacy=0x7f6198070ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:29.468 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.460+0000 7f619dd49700 1 -- 172.21.15.92:0/2889516941 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f619806d1c0 con 0x7f6198160b90 2023-08-26T09:25:29.468 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.460+0000 7f619cd47700 1 -- 172.21.15.92:0/2889516941 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1460715068 0 0) 0x7f619806cf70 con 0x7f619806a320 2023-08-26T09:25:29.468 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.460+0000 7f619dd49700 1 --2- 172.21.15.92:0/2889516941 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6198160b90 0x7f61980cf780 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6194009840 tx=0x7f6194009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e038c1d1dba09e1 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:29.468 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.461+0000 7f619cd47700 1 -- 172.21.15.92:0/2889516941 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6194011830 con 0x7f6198160b90 2023-08-26T09:25:29.468 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.461+0000 7f619cd47700 1 -- 172.21.15.92:0/2889516941 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6194011990 con 0x7f6198160b90 2023-08-26T09:25:29.469 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.461+0000 7f619cd47700 1 -- 172.21.15.92:0/2889516941 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6194011d20 con 0x7f6198160b90 2023-08-26T09:25:29.469 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.461+0000 7f619ffad700 1 -- 172.21.15.92:0/2889516941 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6198160b90 msgr2=0x7f61980cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:29.469 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.461+0000 7f619ffad700 1 --2- 172.21.15.92:0/2889516941 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6198160b90 0x7f61980cf780 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6194009840 tx=0x7f6194009b50 comp rx=0 tx=0).stop 2023-08-26T09:25:29.469 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.461+0000 7f619ffad700 1 -- 172.21.15.92:0/2889516941 shutdown_connections 2023-08-26T09:25:29.469 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.461+0000 7f619ffad700 1 --2- 172.21.15.92:0/2889516941 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6198160b90 0x7f61980cf780 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:29.470 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.461+0000 7f619ffad700 1 -- 172.21.15.92:0/2889516941 >> 172.21.15.92:0/2889516941 conn(0x7f61980cc790 msgr2=0x7f61980ccb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:29.471 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.461+0000 7f619ffad700 1 -- 172.21.15.92:0/2889516941 shutdown_connections 2023-08-26T09:25:29.471 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.461+0000 7f619ffad700 1 -- 172.21.15.92:0/2889516941 wait complete. 2023-08-26T09:25:29.480 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.462+0000 7f619ffad700 1 Processor -- start 2023-08-26T09:25:29.480 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.463+0000 7f619ffad700 1 -- start start 2023-08-26T09:25:29.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.463+0000 7f619ffad700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f619806a320 0x7f6198157640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:29.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.463+0000 7f619ffad700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f619806d8a0 0x7f61980c7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:29.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.463+0000 7f619ffad700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6198160b90 0x7f61980c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:29.482 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.463+0000 7f619ffad700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61980b2d70 con 0x7f6198160b90 2023-08-26T09:25:29.482 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.463+0000 7f619ffad700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61980c9d30 con 0x7f619806a320 2023-08-26T09:25:29.482 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.463+0000 7f619ffad700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61980af750 con 0x7f619806d8a0 2023-08-26T09:25:29.482 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.463+0000 7f619e54a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6198160b90 0x7f61980c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:29.483 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.463+0000 7f619e54a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6198160b90 0x7f61980c8180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45140/0 (socket says 172.21.15.92:45140) 2023-08-26T09:25:29.483 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.463+0000 7f619e54a700 1 -- 172.21.15.92:0/220389089 learned_addr learned my addr 172.21.15.92:0/220389089 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:29.483 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.463+0000 7f619dd49700 1 --2- 172.21.15.92:0/220389089 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f619806a320 0x7f6198157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:29.484 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.463+0000 7f619d548700 1 --2- 172.21.15.92:0/220389089 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f619806d8a0 0x7f61980c7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:29.484 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.464+0000 7f619e54a700 1 -- 172.21.15.92:0/220389089 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f619806d8a0 msgr2=0x7f61980c7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:29.484 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.464+0000 7f619e54a700 1 --2- 172.21.15.92:0/220389089 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f619806d8a0 0x7f61980c7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:29.484 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.464+0000 7f619e54a700 1 -- 172.21.15.92:0/220389089 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f619806a320 msgr2=0x7f6198157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:29.485 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.464+0000 7f619e54a700 1 --2- 172.21.15.92:0/220389089 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f619806a320 0x7f6198157640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:29.485 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.464+0000 7f619e54a700 1 -- 172.21.15.92:0/220389089 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61940094a0 con 0x7f6198160b90 2023-08-26T09:25:29.485 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.464+0000 7f619e54a700 1 --2- 172.21.15.92:0/220389089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6198160b90 0x7f61980c8180 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f619000cc70 tx=0x7f619000cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:29.486 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.464+0000 7f618e7fc700 1 -- 172.21.15.92:0/220389089 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619000aac0 con 0x7f6198160b90 2023-08-26T09:25:29.486 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.464+0000 7f618e7fc700 1 -- 172.21.15.92:0/220389089 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f619000ac40 con 0x7f6198160b90 2023-08-26T09:25:29.486 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.464+0000 7f619ffad700 1 -- 172.21.15.92:0/220389089 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61980c89c0 con 0x7f6198160b90 2023-08-26T09:25:29.487 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.464+0000 7f618e7fc700 1 -- 172.21.15.92:0/220389089 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61900070d0 con 0x7f6198160b90 2023-08-26T09:25:29.487 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.464+0000 7f619ffad700 1 -- 172.21.15.92:0/220389089 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61980b2990 con 0x7f6198160b90 2023-08-26T09:25:29.487 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.466+0000 7f618e7fc700 1 -- 172.21.15.92:0/220389089 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6190007250 con 0x7f6198160b90 2023-08-26T09:25:29.487 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.466+0000 7f618e7fc700 1 --2- 172.21.15.92:0/220389089 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f617c06a0e0 0x7f617c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:29.487 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.466+0000 7f618e7fc700 1 -- 172.21.15.92:0/220389089 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6190088310 con 0x7f6198160b90 2023-08-26T09:25:29.488 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.466+0000 7f619dd49700 1 --2- 172.21.15.92:0/220389089 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f617c06a0e0 0x7f617c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:29.488 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.467+0000 7f619dd49700 1 --2- 172.21.15.92:0/220389089 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f617c06a0e0 0x7f617c06c5a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f61940090b0 tx=0x7f619401c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:29.488 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.468+0000 7f61ac151b80 1 Processor -- start 2023-08-26T09:25:29.488 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.468+0000 7f61ac151b80 1 -- start start 2023-08-26T09:25:29.488 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.469+0000 7f61ac151b80 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561ccadf9a60 0x561ccae29970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:29.489 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.469+0000 7f61ac151b80 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561ccadf9e40 0x561ccae29eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:29.489 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.469+0000 7f61ac151b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ccadfcf60 0x561ccae144d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:29.489 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.469+0000 7f61ac151b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ccad66760 con 0x561ccadfcf60 2023-08-26T09:25:29.489 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.469+0000 7f61ac151b80 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ccad57730 con 0x561ccadf9e40 2023-08-26T09:25:29.489 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.469+0000 7f61ac151b80 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ccad55050 con 0x561ccadf9a60 2023-08-26T09:25:29.490 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.469+0000 7f619e54a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ccadfcf60 0x561ccae144d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:29.491 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.469+0000 7f619e54a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ccadfcf60 0x561ccae144d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45148/0 (socket says 172.21.15.92:45148) 2023-08-26T09:25:29.491 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.469+0000 7f619e54a700 1 -- 172.21.15.92:0/596247369 learned_addr learned my addr 172.21.15.92:0/596247369 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:29.491 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.469+0000 7f619d548700 1 --2- 172.21.15.92:0/596247369 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561ccadf9e40 0x561ccae29eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:29.492 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.469+0000 7f619dd49700 1 --2- 172.21.15.92:0/596247369 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561ccadf9a60 0x561ccae29970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:29.492 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.469+0000 7f619e54a700 1 -- 172.21.15.92:0/596247369 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561ccadf9a60 msgr2=0x561ccae29970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:29.492 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.469+0000 7f619e54a700 1 --2- 172.21.15.92:0/596247369 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561ccadf9a60 0x561ccae29970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:29.493 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.469+0000 7f619e54a700 1 -- 172.21.15.92:0/596247369 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561ccadf9e40 msgr2=0x561ccae29eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:29.493 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.469+0000 7f619e54a700 1 --2- 172.21.15.92:0/596247369 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561ccadf9e40 0x561ccae29eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:29.493 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.469+0000 7f619e54a700 1 -- 172.21.15.92:0/596247369 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ccabd05e0 con 0x561ccadfcf60 2023-08-26T09:25:29.493 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.469+0000 7f619dd49700 1 --2- 172.21.15.92:0/596247369 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561ccadf9a60 0x561ccae29970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:29.493 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.469+0000 7f619e54a700 1 --2- 172.21.15.92:0/596247369 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ccadfcf60 0x561ccae144d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6190086680 tx=0x7f6190057150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e026d274a8f13f1 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:29.494 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.469+0000 7f617b7fe700 1 -- 172.21.15.92:0/596247369 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619005b480 con 0x561ccadfcf60 2023-08-26T09:25:29.494 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.470+0000 7f617b7fe700 1 -- 172.21.15.92:0/596247369 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f619005f3d0 con 0x561ccadfcf60 2023-08-26T09:25:29.494 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.470+0000 7f617b7fe700 1 -- 172.21.15.92:0/596247369 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6190088070 con 0x561ccadfcf60 2023-08-26T09:25:29.494 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.470+0000 7f61ac151b80 1 -- 172.21.15.92:0/596247369 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ccadfcf60 msgr2=0x561ccae144d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:29.494 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.470+0000 7f61ac151b80 1 --2- 172.21.15.92:0/596247369 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ccadfcf60 0x561ccae144d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6190086680 tx=0x7f6190057150 comp rx=0 tx=0).stop 2023-08-26T09:25:29.495 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.470+0000 7f61ac151b80 1 -- 172.21.15.92:0/596247369 shutdown_connections 2023-08-26T09:25:29.495 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.470+0000 7f61ac151b80 1 --2- 172.21.15.92:0/596247369 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ccadfcf60 0x561ccae144d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:29.495 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.470+0000 7f61ac151b80 1 --2- 172.21.15.92:0/596247369 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561ccadf9a60 0x561ccae29970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:29.495 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.470+0000 7f61ac151b80 1 --2- 172.21.15.92:0/596247369 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561ccadf9e40 0x561ccae29eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:29.496 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.470+0000 7f61ac151b80 1 -- 172.21.15.92:0/596247369 >> 172.21.15.92:0/596247369 conn(0x561ccad73090 msgr2=0x561ccadff980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:29.496 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.470+0000 7f61ac151b80 1 -- 172.21.15.92:0/596247369 shutdown_connections 2023-08-26T09:25:29.496 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.470+0000 7f61ac151b80 1 -- 172.21.15.92:0/596247369 wait complete. 2023-08-26T09:25:29.496 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.471+0000 7f61ac151b80 1 -- start start 2023-08-26T09:25:29.497 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.471+0000 7f61ac151b80 1 Processor -- start 2023-08-26T09:25:29.497 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.472+0000 7f61ac151b80 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561ccadf9a60 0x561ccae53ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:29.497 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.472+0000 7f61ac151b80 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561ccadf9e40 0x561ccae46040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:29.498 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.472+0000 7f61ac151b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ccadfcf60 0x561ccae46580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:29.498 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.472+0000 7f61ac151b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ccad50940 con 0x561ccadfcf60 2023-08-26T09:25:29.498 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.472+0000 7f61ac151b80 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ccaceeb60 con 0x561ccadf9e40 2023-08-26T09:25:29.499 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.472+0000 7f61ac151b80 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ccacee860 con 0x561ccadf9a60 2023-08-26T09:25:29.499 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.472+0000 7f61ac151b80 10 client.0 _ll_register_callbacks cb 0x561ccac38a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-26T09:25:29.499 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.472+0000 7f619e54a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ccadfcf60 0x561ccae46580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:29.500 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.472+0000 7f619e54a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ccadfcf60 0x561ccae46580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45154/0 (socket says 172.21.15.92:45154) 2023-08-26T09:25:29.500 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.472+0000 7f619dd49700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561ccadf9a60 0x561ccae53ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:29.501 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.472+0000 7f619e54a700 1 -- 172.21.15.92:0/4161464370 learned_addr learned my addr 172.21.15.92:0/4161464370 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:29.501 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.472+0000 7f619d548700 1 --2- 172.21.15.92:0/4161464370 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561ccadf9e40 0x561ccae46040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:29.501 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.472+0000 7f619e54a700 1 -- 172.21.15.92:0/4161464370 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561ccadf9a60 msgr2=0x561ccae53ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:29.501 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.472+0000 7f619e54a700 1 --2- 172.21.15.92:0/4161464370 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561ccadf9a60 0x561ccae53ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:29.502 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.472+0000 7f619e54a700 1 -- 172.21.15.92:0/4161464370 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561ccadf9e40 msgr2=0x561ccae46040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:29.502 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.472+0000 7f619e54a700 1 --2- 172.21.15.92:0/4161464370 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561ccadf9e40 0x561ccae46040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:29.502 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.472+0000 7f619e54a700 1 -- 172.21.15.92:0/4161464370 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61980b2990 con 0x561ccadfcf60 2023-08-26T09:25:29.503 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.473+0000 7f619e54a700 1 --2- 172.21.15.92:0/4161464370 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ccadfcf60 0x561ccae46580 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f619005eea0 tx=0x7f619005a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d327aa10d58144ff server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:29.503 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.473+0000 7f6178ff9700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-08-26T09:25:29.503 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.473+0000 7f6178ff9700 1 -- 172.21.15.92:0/4161464370 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619005b500 con 0x561ccadfcf60 2023-08-26T09:25:29.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.473+0000 7f6178ff9700 1 -- 172.21.15.92:0/4161464370 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f619005b150 con 0x561ccadfcf60 2023-08-26T09:25:29.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.473+0000 7f61ac151b80 1 -- 172.21.15.92:0/4161464370 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561ccadf1b90 con 0x561ccadfcf60 2023-08-26T09:25:29.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.473+0000 7f6178ff9700 1 -- 172.21.15.92:0/4161464370 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6190086180 con 0x561ccadfcf60 2023-08-26T09:25:29.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.473+0000 7f61ac151b80 10 client.4692 fetch_fsmap learned FSMap version 7 2023-08-26T09:25:29.505 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.473+0000 7f61ac151b80 1 -- 172.21.15.92:0/4161464370 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x561ccab7cd90 con 0x561ccadfcf60 2023-08-26T09:25:29.505 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.473+0000 7f6178ff9700 1 -- 172.21.15.92:0/4161464370 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561ccadf1b90 con 0x561ccadfcf60 2023-08-26T09:25:29.505 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.473+0000 7f6178ff9700 1 -- 172.21.15.92:0/4161464370 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 7) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f619005ef40 con 0x561ccadfcf60 2023-08-26T09:25:29.506 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.473+0000 7f61ac151b80 10 client.4692 fetch_fsmap finished waiting for FSMap version 7 2023-08-26T09:25:29.506 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.473+0000 7f61ac151b80 10 client.4692 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-26T09:25:29.506 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.473+0000 7f61ac151b80 20 client.4692 populate_metadata read hostname 'smithi092' 2023-08-26T09:25:29.507 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.473+0000 7f61ac151b80 1 --2- 172.21.15.92:0/4161464370 >> [v2:172.21.15.92:6834/2933877114,v1:172.21.15.92:6835/2933877114] conn(0x561ccae566b0 0x561ccae56a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:29.507 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.473+0000 7f61ac151b80 4 client.4692 mds_command: new command op to 4287 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-26T09:25:29.507 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.473+0000 7f61ac151b80 1 -- 172.21.15.92:0/4161464370 --> [v2:172.21.15.92:6834/2933877114,v1:172.21.15.92:6835/2933877114] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561ccacf6b50 con 0x561ccae566b0 2023-08-26T09:25:29.508 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.473+0000 7f619dd49700 1 --2- 172.21.15.92:0/4161464370 >> [v2:172.21.15.92:6834/2933877114,v1:172.21.15.92:6835/2933877114] conn(0x561ccae566b0 0x561ccae56a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:29.508 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.473+0000 7f6178ff9700 10 client.4692 ms_handle_connect on v2:172.21.15.92:6834/2933877114 2023-08-26T09:25:29.508 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.474+0000 7f619dd49700 1 --2- 172.21.15.92:0/4161464370 >> [v2:172.21.15.92:6834/2933877114,v1:172.21.15.92:6835/2933877114] conn(0x561ccae566b0 0x561ccae56a90 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6562fbb4756bcfeb server_cookie=ebcfc9e4fe644f37 in_seq=0 out_seq=0 2023-08-26T09:25:29.508 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.474+0000 7f6178ff9700 1 -- 172.21.15.92:0/4161464370 <== mds.0 v2:172.21.15.92:6834/2933877114 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561ccacf6b50 con 0x561ccae566b0 2023-08-26T09:25:29.509 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.474+0000 7f6178ff9700 10 client.4692 handle_command_reply: tid=0 2023-08-26T09:25:29.509 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.474+0000 7f61ac151b80 1 client.4692 shutdown 2023-08-26T09:25:29.509 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.474+0000 7f61ac151b80 1 -- 172.21.15.92:0/4161464370 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ccadfcf60 msgr2=0x561ccae46580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:29.510 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.474+0000 7f61ac151b80 1 --2- 172.21.15.92:0/4161464370 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ccadfcf60 0x561ccae46580 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f619005eea0 tx=0x7f619005a040 comp rx=0 tx=0).stop 2023-08-26T09:25:29.510 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.474+0000 7f61ac151b80 1 -- 172.21.15.92:0/4161464370 shutdown_connections 2023-08-26T09:25:29.510 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.474+0000 7f61ac151b80 1 --2- 172.21.15.92:0/4161464370 >> [v2:172.21.15.92:6834/2933877114,v1:172.21.15.92:6835/2933877114] conn(0x561ccae566b0 0x561ccae56a90 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:29.510 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.474+0000 7f61ac151b80 1 --2- 172.21.15.92:0/4161464370 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ccadfcf60 0x561ccae46580 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:29.511 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.474+0000 7f61ac151b80 1 --2- 172.21.15.92:0/4161464370 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561ccadf9a60 0x561ccae53ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:29.511 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.474+0000 7f61ac151b80 1 --2- 172.21.15.92:0/4161464370 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561ccadf9e40 0x561ccae46040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:29.511 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.474+0000 7f61ac151b80 1 -- 172.21.15.92:0/4161464370 >> 172.21.15.92:0/4161464370 conn(0x561ccad73090 msgr2=0x561ccadfa2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:29.512 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.474+0000 7f6178ff9700 0 client.4692 ms_handle_reset on v2:172.21.15.92:6834/2933877114 2023-08-26T09:25:29.512 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.474+0000 7f61ac151b80 1 -- 172.21.15.92:0/4161464370 shutdown_connections 2023-08-26T09:25:29.512 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.474+0000 7f61ac151b80 1 -- 172.21.15.92:0/4161464370 wait complete. 2023-08-26T09:25:29.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.475+0000 7f61ac151b80 20 client.4692 trim_cache size 0 max 16384 2023-08-26T09:25:29.521 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.492+0000 7f61ac151b80 1 Processor -- start 2023-08-26T09:25:29.521 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.492+0000 7f61ac151b80 1 -- start start 2023-08-26T09:25:29.521 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.493+0000 7f61ac151b80 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561ccadf9a60 0x561ccae53b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:29.522 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.493+0000 7f61ac151b80 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561ccadf9e40 0x561ccae141d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:29.522 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.493+0000 7f61ac151b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ccadfcf60 0x561ccae5dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:29.522 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.493+0000 7f61ac151b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ccae55640 con 0x561ccadfcf60 2023-08-26T09:25:29.523 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.493+0000 7f61ac151b80 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ccabd28d0 con 0x561ccadf9e40 2023-08-26T09:25:29.523 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.493+0000 7f61ac151b80 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ccae55370 con 0x561ccadf9a60 2023-08-26T09:25:29.523 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.493+0000 7f619e54a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ccadfcf60 0x561ccae5dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:29.524 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.493+0000 7f619e54a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ccadfcf60 0x561ccae5dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45162/0 (socket says 172.21.15.92:45162) 2023-08-26T09:25:29.524 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.493+0000 7f619e54a700 1 -- 172.21.15.92:0/2163194245 learned_addr learned my addr 172.21.15.92:0/2163194245 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:29.524 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.493+0000 7f619e54a700 1 -- 172.21.15.92:0/2163194245 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561ccadf9a60 msgr2=0x561ccae53b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:29.524 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.493+0000 7f619dd49700 1 --2- 172.21.15.92:0/2163194245 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561ccadf9a60 0x561ccae53b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:29.524 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.493+0000 7f619d548700 1 --2- 172.21.15.92:0/2163194245 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561ccadf9e40 0x561ccae141d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:29.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.493+0000 7f619e54a700 1 --2- 172.21.15.92:0/2163194245 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561ccadf9a60 0x561ccae53b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:29.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.493+0000 7f619e54a700 1 -- 172.21.15.92:0/2163194245 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561ccadf9e40 msgr2=0x561ccae141d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:29.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.493+0000 7f619e54a700 1 --2- 172.21.15.92:0/2163194245 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561ccadf9e40 0x561ccae141d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:29.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.493+0000 7f619e54a700 1 -- 172.21.15.92:0/2163194245 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ccae2a390 con 0x561ccadfcf60 2023-08-26T09:25:29.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.493+0000 7f619e54a700 1 --2- 172.21.15.92:0/2163194245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ccadfcf60 0x561ccae5dcd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f619000a340 tx=0x7f6190081000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0939923d20b16d8 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:29.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.493+0000 7f617bfff700 1 -- 172.21.15.92:0/2163194245 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6190001d00 con 0x561ccadfcf60 2023-08-26T09:25:29.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.493+0000 7f617bfff700 1 -- 172.21.15.92:0/2163194245 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f619005b480 con 0x561ccadfcf60 2023-08-26T09:25:29.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.493+0000 7f617bfff700 1 -- 172.21.15.92:0/2163194245 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619005b070 con 0x561ccadfcf60 2023-08-26T09:25:29.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.494+0000 7f61ac151b80 1 -- 172.21.15.92:0/2163194245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ccadfcf60 msgr2=0x561ccae5dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:29.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.494+0000 7f61ac151b80 1 --2- 172.21.15.92:0/2163194245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ccadfcf60 0x561ccae5dcd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f619000a340 tx=0x7f6190081000 comp rx=0 tx=0).stop 2023-08-26T09:25:29.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.494+0000 7f61ac151b80 1 -- 172.21.15.92:0/2163194245 shutdown_connections 2023-08-26T09:25:29.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.494+0000 7f61ac151b80 1 --2- 172.21.15.92:0/2163194245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ccadfcf60 0x561ccae5dcd0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:29.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.494+0000 7f61ac151b80 1 --2- 172.21.15.92:0/2163194245 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561ccadf9a60 0x561ccae53b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:29.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.494+0000 7f61ac151b80 1 --2- 172.21.15.92:0/2163194245 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561ccadf9e40 0x561ccae141d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:29.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.494+0000 7f61ac151b80 1 -- 172.21.15.92:0/2163194245 >> 172.21.15.92:0/2163194245 conn(0x561ccad73090 msgr2=0x561ccadff860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:29.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.494+0000 7f61ac151b80 1 -- 172.21.15.92:0/2163194245 shutdown_connections 2023-08-26T09:25:29.528 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.494+0000 7f61ac151b80 1 -- 172.21.15.92:0/2163194245 wait complete. 2023-08-26T09:25:29.528 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.494+0000 7f61ac151b80 1 -- start start 2023-08-26T09:25:29.528 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.495+0000 7f61ac151b80 1 Processor -- start 2023-08-26T09:25:29.528 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.495+0000 7f61ac151b80 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561ccadf9a60 0x561ccae2d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:29.528 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.495+0000 7f61ac151b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ccadf9e40 0x561ccae5c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:29.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.495+0000 7f61ac151b80 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561ccadfcf60 0x561ccaeaaef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:29.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.495+0000 7f61ac151b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ccae5d180 con 0x561ccadf9e40 2023-08-26T09:25:29.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.495+0000 7f61ac151b80 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ccae14260 con 0x561ccadf9a60 2023-08-26T09:25:29.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.495+0000 7f61ac151b80 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ccae5ccb0 con 0x561ccadfcf60 2023-08-26T09:25:29.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.495+0000 7f61ac151b80 10 client.0 _ll_register_callbacks cb 0x7f6188001360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-26T09:25:29.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.495+0000 7f619d548700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ccadf9e40 0x561ccae5c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:29.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.496+0000 7f619d548700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ccadf9e40 0x561ccae5c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45166/0 (socket says 172.21.15.92:45166) 2023-08-26T09:25:29.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.496+0000 7f619d548700 1 -- 172.21.15.92:0/1900935635 learned_addr learned my addr 172.21.15.92:0/1900935635 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:29.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.496+0000 7f619e54a700 1 --2- 172.21.15.92:0/1900935635 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561ccadfcf60 0x561ccaeaaef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:29.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.496+0000 7f619dd49700 1 --2- 172.21.15.92:0/1900935635 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561ccadf9a60 0x561ccae2d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:29.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.496+0000 7f619d548700 1 -- 172.21.15.92:0/1900935635 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561ccadfcf60 msgr2=0x561ccaeaaef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:29.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.496+0000 7f619d548700 1 --2- 172.21.15.92:0/1900935635 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561ccadfcf60 0x561ccaeaaef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:29.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.496+0000 7f619d548700 1 -- 172.21.15.92:0/1900935635 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561ccadf9a60 msgr2=0x561ccae2d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:29.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.496+0000 7f619d548700 1 --2- 172.21.15.92:0/1900935635 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561ccadf9a60 0x561ccae2d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:29.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.496+0000 7f619d548700 1 -- 172.21.15.92:0/1900935635 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561ccab7cd90 con 0x561ccadf9e40 2023-08-26T09:25:29.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.496+0000 7f619d548700 1 --2- 172.21.15.92:0/1900935635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ccadf9e40 0x561ccae5c770 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6188000f60 tx=0x7f6188005650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2295c5d0238544e6 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:29.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.496+0000 7f6178ff9700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-08-26T09:25:29.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.496+0000 7f6178ff9700 1 -- 172.21.15.92:0/1900935635 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6188001c00 con 0x561ccadf9e40 2023-08-26T09:25:29.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.496+0000 7f61ac151b80 1 -- 172.21.15.92:0/1900935635 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f619005f3d0 con 0x561ccadf9e40 2023-08-26T09:25:29.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.496+0000 7f6178ff9700 1 -- 172.21.15.92:0/1900935635 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6188017430 con 0x561ccadf9e40 2023-08-26T09:25:29.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.496+0000 7f6178ff9700 1 -- 172.21.15.92:0/1900935635 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6188001d60 con 0x561ccadf9e40 2023-08-26T09:25:29.534 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.496+0000 7f61ac151b80 10 client.4698 fetch_fsmap learned FSMap version 7 2023-08-26T09:25:29.534 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.496+0000 7f61ac151b80 1 -- 172.21.15.92:0/1900935635 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x561ccab65c10 con 0x561ccadf9e40 2023-08-26T09:25:29.535 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.496+0000 7f6178ff9700 1 -- 172.21.15.92:0/1900935635 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f619005f3d0 con 0x561ccadf9e40 2023-08-26T09:25:29.535 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.496+0000 7f6178ff9700 1 -- 172.21.15.92:0/1900935635 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 7) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f6188012030 con 0x561ccadf9e40 2023-08-26T09:25:29.535 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.496+0000 7f61ac151b80 10 client.4698 fetch_fsmap finished waiting for FSMap version 7 2023-08-26T09:25:29.535 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.496+0000 7f61ac151b80 10 client.4698 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-26T09:25:29.535 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.496+0000 7f61ac151b80 20 client.4698 populate_metadata read hostname 'smithi092' 2023-08-26T09:25:29.536 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.496+0000 7f61ac151b80 1 --2- 172.21.15.92:0/1900935635 >> [v2:172.21.15.92:6834/2933877114,v1:172.21.15.92:6835/2933877114] conn(0x561ccadf8900 0x561ccadf8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:29.536 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.496+0000 7f61ac151b80 4 client.4698 mds_command: new command op to 4287 tid=0[{"prefix": "status"}] 2023-08-26T09:25:29.536 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.496+0000 7f61ac151b80 1 -- 172.21.15.92:0/1900935635 --> [v2:172.21.15.92:6834/2933877114,v1:172.21.15.92:6835/2933877114] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561ccad49920 con 0x561ccadf8900 2023-08-26T09:25:29.536 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.497+0000 7f619dd49700 1 --2- 172.21.15.92:0/1900935635 >> [v2:172.21.15.92:6834/2933877114,v1:172.21.15.92:6835/2933877114] conn(0x561ccadf8900 0x561ccadf8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:29.536 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.497+0000 7f6178ff9700 10 client.4698 ms_handle_connect on v2:172.21.15.92:6834/2933877114 2023-08-26T09:25:29.537 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.497+0000 7f619dd49700 1 --2- 172.21.15.92:0/1900935635 >> [v2:172.21.15.92:6834/2933877114,v1:172.21.15.92:6835/2933877114] conn(0x561ccadf8900 0x561ccadf8ce0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc961aaa530cca03 server_cookie=b79b6eb41c96e58e in_seq=0 out_seq=0 2023-08-26T09:25:29.537 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.497+0000 7f6178ff9700 1 -- 172.21.15.92:0/1900935635 <== mds.0 v2:172.21.15.92:6834/2933877114 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x561ccad49920 con 0x561ccadf8900 2023-08-26T09:25:29.537 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.497+0000 7f6178ff9700 10 client.4698 handle_command_reply: tid=0 2023-08-26T09:25:29.537 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.497+0000 7f61ac151b80 1 client.4698 shutdown 2023-08-26T09:25:29.537 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.497+0000 7f61ac151b80 1 -- 172.21.15.92:0/1900935635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ccadf9e40 msgr2=0x561ccae5c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:29.537 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.497+0000 7f61ac151b80 1 --2- 172.21.15.92:0/1900935635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ccadf9e40 0x561ccae5c770 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6188000f60 tx=0x7f6188005650 comp rx=0 tx=0).stop 2023-08-26T09:25:29.538 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.497+0000 7f61ac151b80 1 -- 172.21.15.92:0/1900935635 shutdown_connections 2023-08-26T09:25:29.538 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.497+0000 7f61ac151b80 1 --2- 172.21.15.92:0/1900935635 >> [v2:172.21.15.92:6834/2933877114,v1:172.21.15.92:6835/2933877114] conn(0x561ccadf8900 0x561ccadf8ce0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:29.538 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.497+0000 7f61ac151b80 1 --2- 172.21.15.92:0/1900935635 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561ccadf9a60 0x561ccae2d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:29.538 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.497+0000 7f61ac151b80 1 --2- 172.21.15.92:0/1900935635 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561ccadfcf60 0x561ccaeaaef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:29.538 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.497+0000 7f6178ff9700 0 client.4698 ms_handle_reset on v2:172.21.15.92:6834/2933877114 2023-08-26T09:25:29.539 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.497+0000 7f61ac151b80 1 --2- 172.21.15.92:0/1900935635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ccadf9e40 0x561ccae5c770 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:29.539 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.497+0000 7f61ac151b80 1 -- 172.21.15.92:0/1900935635 >> 172.21.15.92:0/1900935635 conn(0x561ccad73090 msgr2=0x561ccae149e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:29.539 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.497+0000 7f61ac151b80 1 -- 172.21.15.92:0/1900935635 shutdown_connections 2023-08-26T09:25:29.539 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.497+0000 7f61ac151b80 1 -- 172.21.15.92:0/1900935635 wait complete. 2023-08-26T09:25:29.539 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.498+0000 7f61ac151b80 20 client.4698 trim_cache size 0 max 16384 2023-08-26T09:25:29.540 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-08-26T09:25:29.540 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "254a2d31-bd41-4507-8326-1b205ac24377", 2023-08-26T09:25:29.540 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 0, 2023-08-26T09:25:29.540 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 4287, 2023-08-26T09:25:29.541 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2023-08-26T09:25:29.541 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2023-08-26T09:25:29.541 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2023-08-26T09:25:29.541 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 15.049776436, 2023-08-26T09:25:29.541 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 7, 2023-08-26T09:25:29.542 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 20, 2023-08-26T09:25:29.542 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 20, 2023-08-26T09:25:29.542 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 20.977001871999999 2023-08-26T09:25:29.542 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-08-26T09:25:29.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.498+0000 7f619ffad700 1 -- 172.21.15.92:0/220389089 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f617c06a0e0 msgr2=0x7f617c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:29.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.498+0000 7f619ffad700 1 --2- 172.21.15.92:0/220389089 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f617c06a0e0 0x7f617c06c5a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f61940090b0 tx=0x7f619401c040 comp rx=0 tx=0).stop 2023-08-26T09:25:29.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.498+0000 7f619ffad700 1 -- 172.21.15.92:0/220389089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6198160b90 msgr2=0x7f61980c8180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:29.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.498+0000 7f619ffad700 1 --2- 172.21.15.92:0/220389089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6198160b90 0x7f61980c8180 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f619000cc70 tx=0x7f619000cf80 comp rx=0 tx=0).stop 2023-08-26T09:25:29.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.498+0000 7f619ffad700 1 -- 172.21.15.92:0/220389089 shutdown_connections 2023-08-26T09:25:29.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.498+0000 7f619ffad700 1 --2- 172.21.15.92:0/220389089 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f617c06a0e0 0x7f617c06c5a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:29.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.498+0000 7f619ffad700 1 --2- 172.21.15.92:0/220389089 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f619806a320 0x7f6198157640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:29.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.498+0000 7f619ffad700 1 --2- 172.21.15.92:0/220389089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6198160b90 0x7f61980c8180 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:29.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.498+0000 7f619ffad700 1 --2- 172.21.15.92:0/220389089 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f619806d8a0 0x7f61980c7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:29.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.498+0000 7f619ffad700 1 -- 172.21.15.92:0/220389089 >> 172.21.15.92:0/220389089 conn(0x7f61980cc790 msgr2=0x7f61980cf6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:29.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.498+0000 7f619ffad700 1 -- 172.21.15.92:0/220389089 shutdown_connections 2023-08-26T09:25:29.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.498+0000 7f619ffad700 1 -- 172.21.15.92:0/220389089 wait complete. 2023-08-26T09:25:29.546 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-08-26T09:25:29.569 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-08-26T09:25:29.569 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-08-26T09:25:29.570 INFO:tasks.ceph_fuse:client.0 config is {} 2023-08-26T09:25:29.570 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-26T09:25:29.570 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-26T09:25:29.571 INFO:tasks.ceph_fuse:client.2 config is {} 2023-08-26T09:25:29.571 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-26T09:25:29.571 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-08-26T09:25:29.572 INFO:tasks.ceph_fuse:client.1 config is {} 2023-08-26T09:25:29.572 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-26T09:25:29.572 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-26T09:25:29.572 INFO:tasks.ceph_fuse:client.3 config is {} 2023-08-26T09:25:29.573 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-26T09:25:29.573 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-08-26T09:25:29.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:29.573 DEBUG:teuthology.orchestra.run.smithi188:> ip netns list 2023-08-26T09:25:29.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:29.595 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip link delete ceph-brx 2023-08-26T09:25:29.670 INFO:teuthology.orchestra.run.smithi188.stderr:Cannot find device "ceph-brx" 2023-08-26T09:25:29.672 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-26T09:25:29.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:29.672 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list 2023-08-26T09:25:29.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:29.690 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link delete ceph-brx 2023-08-26T09:25:29.758 INFO:teuthology.orchestra.run.smithi092.stderr:Cannot find device "ceph-brx" 2023-08-26T09:25:29.760 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-26T09:25:29.760 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-08-26T09:25:29.761 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-26T09:25:29.921 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.917+0000 7f0225d2f700 1 Processor -- start 2023-08-26T09:25:29.922 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.917+0000 7f0225d2f700 1 -- start start 2023-08-26T09:25:29.924 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.918+0000 7f0225d2f700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f022015f5e0 0x7f02200af140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:29.924 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.918+0000 7f0225d2f700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02200af680 0x7f02200afb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:29.925 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.918+0000 7f0225d2f700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02200cfc10 con 0x7f022015eaf0 2023-08-26T09:25:29.925 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.918+0000 7f0225d2f700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f022015fa40 con 0x7f022015f5e0 2023-08-26T09:25:29.925 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.918+0000 7f0225d2f700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02200caf00 con 0x7f02200af680 2023-08-26T09:25:29.925 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.918+0000 7f021effd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f022015f5e0 0x7f02200af140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:29.925 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.918+0000 7f021f7fe700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f022015eaf0 0x7f022015eed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:57186/0 (socket says 172.21.15.92:57186) 2023-08-26T09:25:29.926 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.918+0000 7f021effd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f022015f5e0 0x7f02200af140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45174/0 (socket says 172.21.15.92:45174) 2023-08-26T09:25:29.926 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.918+0000 7f021f7fe700 1 -- 172.21.15.92:0/2992757074 learned_addr learned my addr 172.21.15.92:0/2992757074 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:29.926 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.919+0000 7f021effd700 1 -- 172.21.15.92:0/2992757074 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02200af680 msgr2=0x7f02200afb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:29.926 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.919+0000 7f021ffff700 1 --2- 172.21.15.92:0/2992757074 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02200af680 0x7f02200afb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:29.926 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.919+0000 7f021effd700 1 --2- 172.21.15.92:0/2992757074 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02200af680 0x7f02200afb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:29.927 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.919+0000 7f021effd700 1 -- 172.21.15.92:0/2992757074 >> v1:172.21.15.92:6789/0 conn(0x7f022015eaf0 legacy=0x7f022015eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:29.927 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.919+0000 7f021e7fc700 1 -- 172.21.15.92:0/2992757074 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1902220623 0 0) 0x7f0210001110 con 0x7f022015eaf0 2023-08-26T09:25:29.927 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.919+0000 7f021effd700 1 -- 172.21.15.92:0/2992757074 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02200c9370 con 0x7f022015f5e0 2023-08-26T09:25:29.927 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.919+0000 7f021ffff700 1 --2- 172.21.15.92:0/2992757074 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02200af680 0x7f02200afb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:25:29.927 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.919+0000 7f021effd700 1 --2- 172.21.15.92:0/2992757074 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f022015f5e0 0x7f02200af140 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0208009840 tx=0x7f0208009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d953ce0034a73d0f server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:29.928 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.919+0000 7f021e7fc700 1 -- 172.21.15.92:0/2992757074 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0208011830 con 0x7f022015f5e0 2023-08-26T09:25:29.928 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.919+0000 7f021e7fc700 1 -- 172.21.15.92:0/2992757074 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0208011990 con 0x7f022015f5e0 2023-08-26T09:25:29.928 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.919+0000 7f021e7fc700 1 -- 172.21.15.92:0/2992757074 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0208011d20 con 0x7f022015f5e0 2023-08-26T09:25:29.928 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.919+0000 7f0225d2f700 1 -- 172.21.15.92:0/2992757074 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f022015f5e0 msgr2=0x7f02200af140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:29.928 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.919+0000 7f0225d2f700 1 --2- 172.21.15.92:0/2992757074 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f022015f5e0 0x7f02200af140 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0208009840 tx=0x7f0208009b50 comp rx=0 tx=0).stop 2023-08-26T09:25:29.928 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.920+0000 7f0225d2f700 1 -- 172.21.15.92:0/2992757074 shutdown_connections 2023-08-26T09:25:29.929 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.920+0000 7f0225d2f700 1 --2- 172.21.15.92:0/2992757074 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02200af680 0x7f02200afb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:29.929 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.920+0000 7f0225d2f700 1 --2- 172.21.15.92:0/2992757074 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f022015f5e0 0x7f02200af140 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:29.929 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.920+0000 7f0225d2f700 1 -- 172.21.15.92:0/2992757074 >> 172.21.15.92:0/2992757074 conn(0x7f02200cec80 msgr2=0x7f02200cf090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:29.929 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.920+0000 7f0225d2f700 1 -- 172.21.15.92:0/2992757074 shutdown_connections 2023-08-26T09:25:29.929 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.920+0000 7f0225d2f700 1 -- 172.21.15.92:0/2992757074 wait complete. 2023-08-26T09:25:29.932 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.921+0000 7f0225d2f700 1 Processor -- start 2023-08-26T09:25:29.932 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.921+0000 7f0225d2f700 1 -- start start 2023-08-26T09:25:29.933 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.922+0000 7f0225d2f700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02200af680 0x7f0220157bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:29.933 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.922+0000 7f0225d2f700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f022015eaf0 0x7f02200c6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:29.933 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.922+0000 7f0225d2f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f022015f5e0 0x7f02201f1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:29.933 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.922+0000 7f0225d2f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02201580f0 con 0x7f022015f5e0 2023-08-26T09:25:29.933 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.922+0000 7f0225d2f700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02200c5df0 con 0x7f022015eaf0 2023-08-26T09:25:29.934 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.922+0000 7f0225d2f700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02200c60d0 con 0x7f02200af680 2023-08-26T09:25:29.934 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.922+0000 7f021ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f022015f5e0 0x7f02201f1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:29.934 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.922+0000 7f021ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f022015f5e0 0x7f02201f1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45182/0 (socket says 172.21.15.92:45182) 2023-08-26T09:25:29.934 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.922+0000 7f021ffff700 1 -- 172.21.15.92:0/1278142928 learned_addr learned my addr 172.21.15.92:0/1278142928 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:29.934 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.922+0000 7f021f7fe700 1 --2- 172.21.15.92:0/1278142928 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02200af680 0x7f0220157bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:29.935 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.922+0000 7f021effd700 1 --2- 172.21.15.92:0/1278142928 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f022015eaf0 0x7f02200c6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:29.935 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.923+0000 7f021ffff700 1 -- 172.21.15.92:0/1278142928 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02200af680 msgr2=0x7f0220157bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:29.935 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.923+0000 7f021ffff700 1 --2- 172.21.15.92:0/1278142928 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02200af680 0x7f0220157bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:29.935 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.923+0000 7f021ffff700 1 -- 172.21.15.92:0/1278142928 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f022015eaf0 msgr2=0x7f02200c6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:29.935 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.923+0000 7f021ffff700 1 --2- 172.21.15.92:0/1278142928 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f022015eaf0 0x7f02200c6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:29.936 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.923+0000 7f021ffff700 1 -- 172.21.15.92:0/1278142928 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02080094a0 con 0x7f022015f5e0 2023-08-26T09:25:29.936 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.923+0000 7f021ffff700 1 --2- 172.21.15.92:0/1278142928 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f022015f5e0 0x7f02201f1be0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f021800cd50 tx=0x7f021800a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:29.936 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.923+0000 7f0217fff700 1 -- 172.21.15.92:0/1278142928 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021800cea0 con 0x7f022015f5e0 2023-08-26T09:25:29.936 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.923+0000 7f0217fff700 1 -- 172.21.15.92:0/1278142928 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021800f480 con 0x7f022015f5e0 2023-08-26T09:25:29.936 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.923+0000 7f0225d2f700 1 -- 172.21.15.92:0/1278142928 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02200c63b0 con 0x7f022015f5e0 2023-08-26T09:25:29.937 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.923+0000 7f0217fff700 1 -- 172.21.15.92:0/1278142928 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021800f830 con 0x7f022015f5e0 2023-08-26T09:25:29.937 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.923+0000 7f0225d2f700 1 -- 172.21.15.92:0/1278142928 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02200c6970 con 0x7f022015f5e0 2023-08-26T09:25:29.937 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.924+0000 7f0225d2f700 1 -- 172.21.15.92:0/1278142928 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02200c6b60 con 0x7f022015f5e0 2023-08-26T09:25:29.937 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.924+0000 7f0217fff700 1 -- 172.21.15.92:0/1278142928 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f021800b040 con 0x7f022015f5e0 2023-08-26T09:25:29.937 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.924+0000 7f0217fff700 1 --2- 172.21.15.92:0/1278142928 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f020006a0e0 0x7f020006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:29.938 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.925+0000 7f0217fff700 1 -- 172.21.15.92:0/1278142928 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0218088c80 con 0x7f022015f5e0 2023-08-26T09:25:29.938 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.925+0000 7f021f7fe700 1 --2- 172.21.15.92:0/1278142928 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f020006a0e0 0x7f020006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:29.938 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.925+0000 7f021f7fe700 1 --2- 172.21.15.92:0/1278142928 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f020006a0e0 0x7f020006c5a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0210000f60 tx=0x7f0210007e70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:29.938 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:29.929+0000 7f0217fff700 1 -- 172.21.15.92:0/1278142928 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0218054370 con 0x7f022015f5e0 2023-08-26T09:25:30.165 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:30.161+0000 7f0225d2f700 1 -- 172.21.15.92:0/1278142928 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f022004e660 con 0x7f022015f5e0 2023-08-26T09:25:30.165 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:30.161+0000 7f0217fff700 1 -- 172.21.15.92:0/1278142928 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0218057990 con 0x7f022015f5e0 2023-08-26T09:25:30.165 INFO:teuthology.orchestra.run.smithi092.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-26T09:25:30.167 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:30.163+0000 7f0225d2f700 1 -- 172.21.15.92:0/1278142928 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f020006a0e0 msgr2=0x7f020006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:30.167 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:30.163+0000 7f0225d2f700 1 --2- 172.21.15.92:0/1278142928 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f020006a0e0 0x7f020006c5a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0210000f60 tx=0x7f0210007e70 comp rx=0 tx=0).stop 2023-08-26T09:25:30.167 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:30.163+0000 7f0225d2f700 1 -- 172.21.15.92:0/1278142928 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f022015f5e0 msgr2=0x7f02201f1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:30.168 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:30.163+0000 7f0225d2f700 1 --2- 172.21.15.92:0/1278142928 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f022015f5e0 0x7f02201f1be0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f021800cd50 tx=0x7f021800a560 comp rx=0 tx=0).stop 2023-08-26T09:25:30.168 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:30.163+0000 7f0225d2f700 1 -- 172.21.15.92:0/1278142928 shutdown_connections 2023-08-26T09:25:30.168 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:30.163+0000 7f0225d2f700 1 --2- 172.21.15.92:0/1278142928 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f022015f5e0 0x7f02201f1be0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:30.168 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:30.163+0000 7f0225d2f700 1 --2- 172.21.15.92:0/1278142928 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02200af680 0x7f0220157bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:30.168 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:30.163+0000 7f0225d2f700 1 --2- 172.21.15.92:0/1278142928 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f020006a0e0 0x7f020006c5a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:30.169 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:30.163+0000 7f0225d2f700 1 --2- 172.21.15.92:0/1278142928 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f022015eaf0 0x7f02200c6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:30.169 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:30.163+0000 7f0225d2f700 1 -- 172.21.15.92:0/1278142928 >> 172.21.15.92:0/1278142928 conn(0x7f02200cec80 msgr2=0x7f0220071160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:30.169 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:30.163+0000 7f0225d2f700 1 -- 172.21.15.92:0/1278142928 shutdown_connections 2023-08-26T09:25:30.169 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:30.163+0000 7f0225d2f700 1 -- 172.21.15.92:0/1278142928 wait complete. 2023-08-26T09:25:30.179 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-26T09:25:30.179 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-26T09:25:30.179 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi092.front.sepia.ceph.com 2023-08-26T09:25:30.180 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-26T09:25:30.180 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-26T09:25:30.180 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-26T09:25:30.180 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-26T09:25:30.181 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-26T09:25:30.181 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-26T09:25:30.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:30.182 DEBUG:teuthology.orchestra.run.smithi092:> ip addr 2023-08-26T09:25:30.198 INFO:teuthology.orchestra.run.smithi092.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-26T09:25:30.199 INFO:teuthology.orchestra.run.smithi092.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-26T09:25:30.199 INFO:teuthology.orchestra.run.smithi092.stdout: inet 127.0.0.1/8 scope host lo 2023-08-26T09:25:30.199 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-08-26T09:25:30.199 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 ::1/128 scope host 2023-08-26T09:25:30.199 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-08-26T09:25:30.200 INFO:teuthology.orchestra.run.smithi092.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-26T09:25:30.200 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:d8:a1:b2 brd ff:ff:ff:ff:ff:ff 2023-08-26T09:25:30.200 INFO:teuthology.orchestra.run.smithi092.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-26T09:25:30.200 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:d8:a1:b3 brd ff:ff:ff:ff:ff:ff 2023-08-26T09:25:30.200 INFO:teuthology.orchestra.run.smithi092.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-26T09:25:30.201 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:8f:cd:44 brd ff:ff:ff:ff:ff:ff 2023-08-26T09:25:30.201 INFO:teuthology.orchestra.run.smithi092.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-26T09:25:30.201 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:8f:cd:45 brd ff:ff:ff:ff:ff:ff 2023-08-26T09:25:30.201 INFO:teuthology.orchestra.run.smithi092.stdout: inet 172.21.15.92/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-26T09:25:30.201 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft 42423sec preferred_lft 42423sec 2023-08-26T09:25:30.202 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::e2e8:d841:3034:9b69/64 scope link noprefixroute 2023-08-26T09:25:30.202 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-08-26T09:25:30.203 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-08-26T09:25:30.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:30.203 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2023-08-26T09:25:30.204 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2023-08-26T09:25:30.204 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link add name ceph-brx type bridge 2023-08-26T09:25:30.204 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip addr flush dev ceph-brx 2023-08-26T09:25:30.205 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set ceph-brx up 2023-08-26T09:25:30.205 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-08-26T09:25:30.205 DEBUG:teuthology.orchestra.run.smithi092:> ') 2023-08-26T09:25:30.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:30.369 DEBUG:teuthology.orchestra.run.smithi092:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-26T09:25:30.396 INFO:teuthology.orchestra.run.smithi092.stdout:1 2023-08-26T09:25:30.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:30.397 DEBUG:teuthology.orchestra.run.smithi092:> route 2023-08-26T09:25:30.467 INFO:teuthology.orchestra.run.smithi092.stdout:Kernel IP routing table 2023-08-26T09:25:30.468 INFO:teuthology.orchestra.run.smithi092.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-26T09:25:30.468 INFO:teuthology.orchestra.run.smithi092.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-26T09:25:30.468 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-26T09:25:30.469 INFO:teuthology.orchestra.run.smithi092.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-26T09:25:30.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:30.470 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2023-08-26T09:25:30.470 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2023-08-26T09:25:30.470 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-26T09:25:30.471 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-26T09:25:30.471 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-26T09:25:30.471 DEBUG:teuthology.orchestra.run.smithi092:> ') 2023-08-26T09:25:30.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:30.721 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list 2023-08-26T09:25:30.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:30.739 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list-id 2023-08-26T09:25:30.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:30.795 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2023-08-26T09:25:30.795 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2023-08-26T09:25:30.796 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-26T09:25:30.796 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-08-26T09:25:30.796 DEBUG:teuthology.orchestra.run.smithi092:> ') 2023-08-26T09:25:30.887 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-08-26T09:25:30.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:30.888 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2023-08-26T09:25:30.889 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2023-08-26T09:25:30.889 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-08-26T09:25:30.889 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-08-26T09:25:30.889 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-08-26T09:25:30.890 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-08-26T09:25:30.890 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-08-26T09:25:30.890 DEBUG:teuthology.orchestra.run.smithi092:> ') 2023-08-26T09:25:31.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:31.092 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2023-08-26T09:25:31.092 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2023-08-26T09:25:31.092 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set brx.0 up 2023-08-26T09:25:31.093 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set dev brx.0 master ceph-brx 2023-08-26T09:25:31.093 DEBUG:teuthology.orchestra.run.smithi092:> ') 2023-08-26T09:25:31.195 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-08-26T09:25:31.196 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-26T09:25:31.196 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-26T09:25:31.215 INFO:teuthology.orchestra.run.smithi092.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-26T09:25:31.216 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-26T09:25:31.216 DEBUG:teuthology.orchestra.run.smithi092:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-26T09:25:31.273 DEBUG:teuthology.orchestra.run.smithi092:> sudo modprobe fuse 2023-08-26T09:25:31.341 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-26T09:25:31.341 DEBUG:teuthology.orchestra.run.smithi092:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-26T09:25:31.407 INFO:teuthology.orchestra.run.smithi092.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-26T09:25:31.408 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-26T09:25:31.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:31.409 DEBUG:teuthology.orchestra.run.smithi092:> ls /sys/fs/fuse/connections 2023-08-26T09:25:31.465 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-08-26T09:25:31.466 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-08-26T09:25:31.508 DEBUG:teuthology.orchestra.run.smithi092:> sudo modprobe fuse 2023-08-26T09:25:31.534 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-26T09:25:31.534 DEBUG:teuthology.orchestra.run.smithi092:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-26T09:25:31.604 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi092.stderr:2023-08-26T09:25:31.600+0000 7f9aba2c85c0 -1 init, newargv = 0x55e48198e9c0 newargc=15 2023-08-26T09:25:31.604 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi092.stderr:ceph-fuse[113451]: starting ceph client 2023-08-26T09:25:31.609 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi092.stderr:ceph-fuse[113451]: starting fuse 2023-08-26T09:25:31.610 INFO:teuthology.orchestra.run.smithi092.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-26T09:25:31.611 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-26T09:25:31.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:31.613 DEBUG:teuthology.orchestra.run.smithi092:> ls /sys/fs/fuse/connections 2023-08-26T09:25:31.670 INFO:teuthology.orchestra.run.smithi092.stdout:47 2023-08-26T09:25:31.670 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-08-26T09:25:31.670 DEBUG:teuthology.orchestra.run.smithi092:> sudo stdin-killer -- python3 -c ' 2023-08-26T09:25:31.671 DEBUG:teuthology.orchestra.run.smithi092:> import glob 2023-08-26T09:25:31.671 DEBUG:teuthology.orchestra.run.smithi092:> import re 2023-08-26T09:25:31.672 DEBUG:teuthology.orchestra.run.smithi092:> import os 2023-08-26T09:25:31.672 DEBUG:teuthology.orchestra.run.smithi092:> import subprocess 2023-08-26T09:25:31.672 DEBUG:teuthology.orchestra.run.smithi092:> 2023-08-26T09:25:31.672 DEBUG:teuthology.orchestra.run.smithi092:> def _find_admin_socket(client_name): 2023-08-26T09:25:31.673 DEBUG:teuthology.orchestra.run.smithi092:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-08-26T09:25:31.673 DEBUG:teuthology.orchestra.run.smithi092:> files = glob.glob(asok_path) 2023-08-26T09:25:31.673 DEBUG:teuthology.orchestra.run.smithi092:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-08-26T09:25:31.674 DEBUG:teuthology.orchestra.run.smithi092:> 2023-08-26T09:25:31.674 DEBUG:teuthology.orchestra.run.smithi092:> # Given a non-glob path, it better be there 2023-08-26T09:25:31.674 DEBUG:teuthology.orchestra.run.smithi092:> if "*" not in asok_path: 2023-08-26T09:25:31.674 DEBUG:teuthology.orchestra.run.smithi092:> assert(len(files) == 1) 2023-08-26T09:25:31.675 DEBUG:teuthology.orchestra.run.smithi092:> return files[0] 2023-08-26T09:25:31.675 DEBUG:teuthology.orchestra.run.smithi092:> 2023-08-26T09:25:31.675 DEBUG:teuthology.orchestra.run.smithi092:> for f in files: 2023-08-26T09:25:31.676 DEBUG:teuthology.orchestra.run.smithi092:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-08-26T09:25:31.676 DEBUG:teuthology.orchestra.run.smithi092:> if os.path.exists("/proc/{0}".format(pid)): 2023-08-26T09:25:31.676 DEBUG:teuthology.orchestra.run.smithi092:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-08-26T09:25:31.677 DEBUG:teuthology.orchestra.run.smithi092:> contents = proc_f.read() 2023-08-26T09:25:31.677 DEBUG:teuthology.orchestra.run.smithi092:> if mountpoint in contents: 2023-08-26T09:25:31.677 DEBUG:teuthology.orchestra.run.smithi092:> return f 2023-08-26T09:25:31.678 DEBUG:teuthology.orchestra.run.smithi092:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-08-26T09:25:31.678 DEBUG:teuthology.orchestra.run.smithi092:> 2023-08-26T09:25:31.678 DEBUG:teuthology.orchestra.run.smithi092:> print(_find_admin_socket("client.0")) 2023-08-26T09:25:31.678 DEBUG:teuthology.orchestra.run.smithi092:> ' 2023-08-26T09:25:31.793 INFO:teuthology.orchestra.run.smithi092.stdout:/var/run/ceph/ceph-client.0.113451.asok 2023-08-26T09:25:31.796 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-08-26T09:25:31.803 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.113451.asok 2023-08-26T09:25:31.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:31.804 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.113451.asok status 2023-08-26T09:25:31.959 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-08-26T09:25:31.960 INFO:teuthology.orchestra.run.smithi092.stdout: "metadata": { 2023-08-26T09:25:31.960 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_sha1": "e7eb9853fddaf661c68f207346131a7e00d8ed2f", 2023-08-26T09:25:31.960 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_version": "ceph version 18.0.0-5706-ge7eb9853 (e7eb9853fddaf661c68f207346131a7e00d8ed2f) reef (dev)", 2023-08-26T09:25:31.960 INFO:teuthology.orchestra.run.smithi092.stdout: "entity_id": "0", 2023-08-26T09:25:31.961 INFO:teuthology.orchestra.run.smithi092.stdout: "hostname": "smithi092", 2023-08-26T09:25:31.961 INFO:teuthology.orchestra.run.smithi092.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-08-26T09:25:31.961 INFO:teuthology.orchestra.run.smithi092.stdout: "pid": "113451", 2023-08-26T09:25:31.961 INFO:teuthology.orchestra.run.smithi092.stdout: "root": "/" 2023-08-26T09:25:31.961 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-08-26T09:25:31.962 INFO:teuthology.orchestra.run.smithi092.stdout: "dentry_count": 0, 2023-08-26T09:25:31.962 INFO:teuthology.orchestra.run.smithi092.stdout: "dentry_pinned_count": 0, 2023-08-26T09:25:31.962 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 4713, 2023-08-26T09:25:31.962 INFO:teuthology.orchestra.run.smithi092.stdout: "inst": { 2023-08-26T09:25:31.962 INFO:teuthology.orchestra.run.smithi092.stdout: "name": { 2023-08-26T09:25:31.963 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "client", 2023-08-26T09:25:31.963 INFO:teuthology.orchestra.run.smithi092.stdout: "num": 4713 2023-08-26T09:25:31.963 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-08-26T09:25:31.963 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": { 2023-08-26T09:25:31.963 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "v1", 2023-08-26T09:25:31.964 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": "192.168.0.1:0", 2023-08-26T09:25:31.964 INFO:teuthology.orchestra.run.smithi092.stdout: "nonce": 2486693489 2023-08-26T09:25:31.964 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-08-26T09:25:31.964 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-08-26T09:25:31.964 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": { 2023-08-26T09:25:31.965 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "v1", 2023-08-26T09:25:31.965 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": "192.168.0.1:0", 2023-08-26T09:25:31.965 INFO:teuthology.orchestra.run.smithi092.stdout: "nonce": 2486693489 2023-08-26T09:25:31.965 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-08-26T09:25:31.965 INFO:teuthology.orchestra.run.smithi092.stdout: "inst_str": "client.4713 192.168.0.1:0/2486693489", 2023-08-26T09:25:31.966 INFO:teuthology.orchestra.run.smithi092.stdout: "addr_str": "192.168.0.1:0/2486693489", 2023-08-26T09:25:31.966 INFO:teuthology.orchestra.run.smithi092.stdout: "inode_count": 1, 2023-08-26T09:25:31.966 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_epoch": 7, 2023-08-26T09:25:31.966 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_epoch": 20, 2023-08-26T09:25:31.966 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_epoch_barrier": 0, 2023-08-26T09:25:31.966 INFO:teuthology.orchestra.run.smithi092.stdout: "blocklisted": false, 2023-08-26T09:25:31.967 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs" 2023-08-26T09:25:31.967 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-08-26T09:25:31.970 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-26T09:25:32.090 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.086+0000 7f3801357700 1 Processor -- start 2023-08-26T09:25:32.090 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.086+0000 7f3801357700 1 -- start start 2023-08-26T09:25:32.092 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.086+0000 7f3801357700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f37fc15d550 0x7f37fc0ce050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:32.092 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.086+0000 7f3801357700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f37fc0d1dd0 0x7f37fc0b71c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:32.093 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.086+0000 7f3801357700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37fc0b64b0 con 0x7f37fc0ce590 2023-08-26T09:25:32.093 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.086+0000 7f3801357700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37fc0cea40 con 0x7f37fc0d1dd0 2023-08-26T09:25:32.093 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.086+0000 7f3801357700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37fc15d930 con 0x7f37fc15d550 2023-08-26T09:25:32.093 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.087+0000 7f37fb7fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f37fc0d1dd0 0x7f37fc0b71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:32.093 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.087+0000 7f37fa7fc700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f37fc0ce590 0x7f37fc0d16c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:57216/0 (socket says 172.21.15.92:57216) 2023-08-26T09:25:32.094 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.087+0000 7f37fa7fc700 1 -- 172.21.15.92:0/18324229 learned_addr learned my addr 172.21.15.92:0/18324229 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:32.094 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.087+0000 7f37faffd700 1 --2- 172.21.15.92:0/18324229 >> v2:172.21.15.188:3300/0 conn(0x7f37fc15d550 0x7f37fc0ce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:32.094 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.087+0000 7f37fb7fe700 1 -- 172.21.15.92:0/18324229 >> v2:172.21.15.188:3300/0 conn(0x7f37fc15d550 msgr2=0x7f37fc0ce050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:32.094 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.087+0000 7f37fb7fe700 1 --2- 172.21.15.92:0/18324229 >> v2:172.21.15.188:3300/0 conn(0x7f37fc15d550 0x7f37fc0ce050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:32.094 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.087+0000 7f37fb7fe700 1 -- 172.21.15.92:0/18324229 >> v1:172.21.15.92:6789/0 conn(0x7f37fc0ce590 legacy=0x7f37fc0d16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:32.095 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.087+0000 7f37f9ffb700 1 -- 172.21.15.92:0/18324229 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4259670480 0 0) 0x7f37fc0b64b0 con 0x7f37fc0ce590 2023-08-26T09:25:32.095 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.087+0000 7f37fb7fe700 1 -- 172.21.15.92:0/18324229 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37fc0d21e0 con 0x7f37fc0d1dd0 2023-08-26T09:25:32.095 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.087+0000 7f37fb7fe700 1 --2- 172.21.15.92:0/18324229 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f37fc0d1dd0 0x7f37fc0b71c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f37fc0d40a0 tx=0x7f37f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d1d79e4bfe62d2f server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:32.095 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.087+0000 7f37f9ffb700 1 -- 172.21.15.92:0/18324229 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f400e070 con 0x7f37fc0d1dd0 2023-08-26T09:25:32.095 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.087+0000 7f37f9ffb700 1 -- 172.21.15.92:0/18324229 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f400bbd0 con 0x7f37fc0d1dd0 2023-08-26T09:25:32.096 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.087+0000 7f37f9ffb700 1 -- 172.21.15.92:0/18324229 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f4012430 con 0x7f37fc0d1dd0 2023-08-26T09:25:32.096 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.088+0000 7f3801357700 1 -- 172.21.15.92:0/18324229 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f37fc0d1dd0 msgr2=0x7f37fc0b71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:32.096 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.088+0000 7f3801357700 1 --2- 172.21.15.92:0/18324229 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f37fc0d1dd0 0x7f37fc0b71c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f37fc0d40a0 tx=0x7f37f400b330 comp rx=0 tx=0).stop 2023-08-26T09:25:32.096 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.088+0000 7f3801357700 1 -- 172.21.15.92:0/18324229 shutdown_connections 2023-08-26T09:25:32.096 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.088+0000 7f3801357700 1 --2- 172.21.15.92:0/18324229 >> v2:172.21.15.188:3300/0 conn(0x7f37fc15d550 0x7f37fc0ce050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:32.097 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.088+0000 7f3801357700 1 --2- 172.21.15.92:0/18324229 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f37fc0d1dd0 0x7f37fc0b71c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:32.097 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.088+0000 7f3801357700 1 -- 172.21.15.92:0/18324229 >> 172.21.15.92:0/18324229 conn(0x7f37fc0cfa90 msgr2=0x7f37fc0cfea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:32.097 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.088+0000 7f3801357700 1 -- 172.21.15.92:0/18324229 shutdown_connections 2023-08-26T09:25:32.097 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.088+0000 7f3801357700 1 -- 172.21.15.92:0/18324229 wait complete. 2023-08-26T09:25:32.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.089+0000 7f3801357700 1 Processor -- start 2023-08-26T09:25:32.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.090+0000 7f3801357700 1 -- start start 2023-08-26T09:25:32.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.090+0000 7f3801357700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f37fc0ce590 0x7f37fc157ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:32.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.090+0000 7f3801357700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f37fc0d1dd0 0x7f37fc0ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:32.101 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.090+0000 7f3801357700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f37fc15d550 0x7f37fc15e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:32.101 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.090+0000 7f3801357700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37fc158fb0 con 0x7f37fc0d1dd0 2023-08-26T09:25:32.101 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.090+0000 7f3801357700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37fc0cd030 con 0x7f37fc0ce590 2023-08-26T09:25:32.101 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.090+0000 7f3801357700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37fc158330 con 0x7f37fc15d550 2023-08-26T09:25:32.101 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.091+0000 7f37fa7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f37fc0d1dd0 0x7f37fc0ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:32.102 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.091+0000 7f37fa7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f37fc0d1dd0 0x7f37fc0ccaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45210/0 (socket says 172.21.15.92:45210) 2023-08-26T09:25:32.102 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.091+0000 7f37fa7fc700 1 -- 172.21.15.92:0/813995220 learned_addr learned my addr 172.21.15.92:0/813995220 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:32.102 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.091+0000 7f37fb7fe700 1 --2- 172.21.15.92:0/813995220 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f37fc15d550 0x7f37fc15e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:32.102 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.091+0000 7f37faffd700 1 --2- 172.21.15.92:0/813995220 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f37fc0ce590 0x7f37fc157ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:32.102 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.091+0000 7f37fa7fc700 1 -- 172.21.15.92:0/813995220 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f37fc15d550 msgr2=0x7f37fc15e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:32.103 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.091+0000 7f37fa7fc700 1 --2- 172.21.15.92:0/813995220 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f37fc15d550 0x7f37fc15e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:32.103 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.091+0000 7f37fa7fc700 1 -- 172.21.15.92:0/813995220 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f37fc0ce590 msgr2=0x7f37fc157ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:32.103 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.091+0000 7f37fa7fc700 1 --2- 172.21.15.92:0/813995220 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f37fc0ce590 0x7f37fc157ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:32.103 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.091+0000 7f37fa7fc700 1 -- 172.21.15.92:0/813995220 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f4009a70 con 0x7f37fc0d1dd0 2023-08-26T09:25:32.103 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.091+0000 7f37fb7fe700 1 --2- 172.21.15.92:0/813995220 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f37fc15d550 0x7f37fc15e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:32.104 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.091+0000 7f37faffd700 1 --2- 172.21.15.92:0/813995220 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f37fc0ce590 0x7f37fc157ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:32.104 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.091+0000 7f37fa7fc700 1 --2- 172.21.15.92:0/813995220 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f37fc0d1dd0 0x7f37fc0ccaf0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f37f0005910 tx=0x7f37f000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:32.104 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.091+0000 7f37e37fe700 1 -- 172.21.15.92:0/813995220 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f0005d70 con 0x7f37fc0d1dd0 2023-08-26T09:25:32.104 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.091+0000 7f37e37fe700 1 -- 172.21.15.92:0/813995220 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f00070d0 con 0x7f37fc0d1dd0 2023-08-26T09:25:32.104 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.091+0000 7f3801357700 1 -- 172.21.15.92:0/813995220 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37fc158610 con 0x7f37fc0d1dd0 2023-08-26T09:25:32.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.091+0000 7f37e37fe700 1 -- 172.21.15.92:0/813995220 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f0007460 con 0x7f37fc0d1dd0 2023-08-26T09:25:32.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.091+0000 7f3801357700 1 -- 172.21.15.92:0/813995220 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37fc158bd0 con 0x7f37fc0d1dd0 2023-08-26T09:25:32.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.092+0000 7f3801357700 1 -- 172.21.15.92:0/813995220 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37fc1590f0 con 0x7f37fc0d1dd0 2023-08-26T09:25:32.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.093+0000 7f37e37fe700 1 -- 172.21.15.92:0/813995220 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f37f00075c0 con 0x7f37fc0d1dd0 2023-08-26T09:25:32.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.093+0000 7f37e37fe700 1 --2- 172.21.15.92:0/813995220 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f37e806a0e0 0x7f37e806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:32.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.093+0000 7f37e37fe700 1 -- 172.21.15.92:0/813995220 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f37f0087a60 con 0x7f37fc0d1dd0 2023-08-26T09:25:32.106 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.093+0000 7f37faffd700 1 --2- 172.21.15.92:0/813995220 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f37e806a0e0 0x7f37e806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:32.106 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.093+0000 7f37faffd700 1 --2- 172.21.15.92:0/813995220 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f37e806a0e0 0x7f37e806c5a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f37ec0099f0 tx=0x7f37ec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:32.106 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.097+0000 7f37e37fe700 1 -- 172.21.15.92:0/813995220 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f37fc1590f0 con 0x7f37fc0d1dd0 2023-08-26T09:25:32.340 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.336+0000 7f3801357700 1 -- 172.21.15.92:0/813995220 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f37fc1590f0 con 0x7f37fc0d1dd0 2023-08-26T09:25:32.340 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.336+0000 7f37e37fe700 1 -- 172.21.15.92:0/813995220 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f37f0017060 con 0x7f37fc0d1dd0 2023-08-26T09:25:32.341 INFO:teuthology.orchestra.run.smithi092.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-26T09:25:32.343 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.338+0000 7f3801357700 1 -- 172.21.15.92:0/813995220 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f37e806a0e0 msgr2=0x7f37e806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:32.343 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.338+0000 7f3801357700 1 --2- 172.21.15.92:0/813995220 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f37e806a0e0 0x7f37e806c5a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f37ec0099f0 tx=0x7f37ec008040 comp rx=0 tx=0).stop 2023-08-26T09:25:32.343 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.338+0000 7f3801357700 1 -- 172.21.15.92:0/813995220 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f37fc0d1dd0 msgr2=0x7f37fc0ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:32.344 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.338+0000 7f3801357700 1 --2- 172.21.15.92:0/813995220 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f37fc0d1dd0 0x7f37fc0ccaf0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f37f0005910 tx=0x7f37f000c8b0 comp rx=0 tx=0).stop 2023-08-26T09:25:32.344 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.338+0000 7f3801357700 1 -- 172.21.15.92:0/813995220 shutdown_connections 2023-08-26T09:25:32.344 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.338+0000 7f3801357700 1 --2- 172.21.15.92:0/813995220 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f37e806a0e0 0x7f37e806c5a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:32.344 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.338+0000 7f3801357700 1 --2- 172.21.15.92:0/813995220 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f37fc0ce590 0x7f37fc157ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:32.344 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.338+0000 7f3801357700 1 --2- 172.21.15.92:0/813995220 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f37fc15d550 0x7f37fc15e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:32.345 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.338+0000 7f3801357700 1 --2- 172.21.15.92:0/813995220 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f37fc0d1dd0 0x7f37fc0ccaf0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:32.345 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.338+0000 7f3801357700 1 -- 172.21.15.92:0/813995220 >> 172.21.15.92:0/813995220 conn(0x7f37fc0cfa90 msgr2=0x7f37fc0d3900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:32.345 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.338+0000 7f3801357700 1 -- 172.21.15.92:0/813995220 shutdown_connections 2023-08-26T09:25:32.345 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:32.338+0000 7f3801357700 1 -- 172.21.15.92:0/813995220 wait complete. 2023-08-26T09:25:32.354 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-26T09:25:32.355 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-26T09:25:32.355 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi092.front.sepia.ceph.com 2023-08-26T09:25:32.355 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-08-26T09:25:32.355 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-08-26T09:25:32.356 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-26T09:25:32.356 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-26T09:25:32.356 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-26T09:25:32.356 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-08-26T09:25:32.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:32.357 DEBUG:teuthology.orchestra.run.smithi092:> ip addr 2023-08-26T09:25:32.374 INFO:teuthology.orchestra.run.smithi092.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-26T09:25:32.375 INFO:teuthology.orchestra.run.smithi092.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-26T09:25:32.375 INFO:teuthology.orchestra.run.smithi092.stdout: inet 127.0.0.1/8 scope host lo 2023-08-26T09:25:32.375 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-08-26T09:25:32.376 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 ::1/128 scope host 2023-08-26T09:25:32.376 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-08-26T09:25:32.376 INFO:teuthology.orchestra.run.smithi092.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-26T09:25:32.376 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:d8:a1:b2 brd ff:ff:ff:ff:ff:ff 2023-08-26T09:25:32.376 INFO:teuthology.orchestra.run.smithi092.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-26T09:25:32.377 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:d8:a1:b3 brd ff:ff:ff:ff:ff:ff 2023-08-26T09:25:32.377 INFO:teuthology.orchestra.run.smithi092.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-26T09:25:32.377 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:8f:cd:44 brd ff:ff:ff:ff:ff:ff 2023-08-26T09:25:32.377 INFO:teuthology.orchestra.run.smithi092.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-26T09:25:32.378 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:8f:cd:45 brd ff:ff:ff:ff:ff:ff 2023-08-26T09:25:32.378 INFO:teuthology.orchestra.run.smithi092.stdout: inet 172.21.15.92/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-26T09:25:32.378 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft 42421sec preferred_lft 42421sec 2023-08-26T09:25:32.378 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::e2e8:d841:3034:9b69/64 scope link noprefixroute 2023-08-26T09:25:32.378 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-08-26T09:25:32.379 INFO:teuthology.orchestra.run.smithi092.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-26T09:25:32.379 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 3e:f2:37:41:6b:5e brd ff:ff:ff:ff:ff:ff 2023-08-26T09:25:32.379 INFO:teuthology.orchestra.run.smithi092.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-26T09:25:32.379 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-08-26T09:25:32.379 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::dc42:1cff:fe60:5c5d/64 scope link 2023-08-26T09:25:32.380 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-08-26T09:25:32.380 INFO:teuthology.orchestra.run.smithi092.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-26T09:25:32.380 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 3e:f2:37:41:6b:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-26T09:25:32.380 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::3cf2:37ff:fe41:6b5e/64 scope link 2023-08-26T09:25:32.380 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-08-26T09:25:32.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:32.381 DEBUG:teuthology.orchestra.run.smithi092:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-26T09:25:32.441 INFO:teuthology.orchestra.run.smithi092.stdout:1 2023-08-26T09:25:32.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:32.443 DEBUG:teuthology.orchestra.run.smithi092:> route 2023-08-26T09:25:32.500 INFO:teuthology.orchestra.run.smithi092.stdout:Kernel IP routing table 2023-08-26T09:25:32.501 INFO:teuthology.orchestra.run.smithi092.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-26T09:25:32.501 INFO:teuthology.orchestra.run.smithi092.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-26T09:25:32.501 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-26T09:25:32.501 INFO:teuthology.orchestra.run.smithi092.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-26T09:25:32.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:32.502 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2023-08-26T09:25:32.503 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2023-08-26T09:25:32.503 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-26T09:25:32.503 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-26T09:25:32.503 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-26T09:25:32.504 DEBUG:teuthology.orchestra.run.smithi092:> ') 2023-08-26T09:25:32.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:32.605 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list 2023-08-26T09:25:32.621 INFO:teuthology.orchestra.run.smithi092.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-26T09:25:32.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:32.622 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list-id 2023-08-26T09:25:32.678 INFO:teuthology.orchestra.run.smithi092.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-08-26T09:25:32.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:32.679 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2023-08-26T09:25:32.679 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2023-08-26T09:25:32.679 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-26T09:25:32.680 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-08-26T09:25:32.680 DEBUG:teuthology.orchestra.run.smithi092:> ') 2023-08-26T09:25:32.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:32.772 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-08-26T09:25:32.811 INFO:teuthology.orchestra.run.smithi092.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-26T09:25:32.812 INFO:teuthology.orchestra.run.smithi092.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-26T09:25:32.812 INFO:teuthology.orchestra.run.smithi092.stdout: inet 127.0.0.1/8 scope host lo 2023-08-26T09:25:32.812 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-08-26T09:25:32.812 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 ::1/128 scope host 2023-08-26T09:25:32.813 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-08-26T09:25:32.813 INFO:teuthology.orchestra.run.smithi092.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-26T09:25:32.813 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether f6:a3:80:c4:39:16 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-26T09:25:32.813 INFO:teuthology.orchestra.run.smithi092.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-26T09:25:32.813 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-08-26T09:25:32.814 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::f4a3:80ff:fec4:3916/64 scope link tentative 2023-08-26T09:25:32.814 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-08-26T09:25:32.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:32.829 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-08-26T09:25:32.905 INFO:teuthology.orchestra.run.smithi092.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-26T09:25:32.906 INFO:teuthology.orchestra.run.smithi092.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-26T09:25:32.906 INFO:teuthology.orchestra.run.smithi092.stdout: inet 127.0.0.1/8 scope host lo 2023-08-26T09:25:32.906 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-08-26T09:25:32.907 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 ::1/128 scope host 2023-08-26T09:25:32.907 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-08-26T09:25:32.907 INFO:teuthology.orchestra.run.smithi092.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-26T09:25:32.907 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether f6:a3:80:c4:39:16 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-26T09:25:32.907 INFO:teuthology.orchestra.run.smithi092.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-26T09:25:32.908 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-08-26T09:25:32.908 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::f4a3:80ff:fec4:3916/64 scope link tentative 2023-08-26T09:25:32.908 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-08-26T09:25:32.922 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-08-26T09:25:32.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:32.923 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2023-08-26T09:25:32.923 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2023-08-26T09:25:32.923 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-08-26T09:25:32.924 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-08-26T09:25:32.924 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-08-26T09:25:32.924 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-08-26T09:25:32.925 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-08-26T09:25:32.925 DEBUG:teuthology.orchestra.run.smithi092:> ') 2023-08-26T09:25:33.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:33.186 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2023-08-26T09:25:33.186 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2023-08-26T09:25:33.186 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set brx.1 up 2023-08-26T09:25:33.187 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set dev brx.1 master ceph-brx 2023-08-26T09:25:33.187 DEBUG:teuthology.orchestra.run.smithi092:> ') 2023-08-26T09:25:33.297 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-08-26T09:25:33.297 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-26T09:25:33.297 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-08-26T09:25:33.320 INFO:teuthology.orchestra.run.smithi092.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-08-26T09:25:33.320 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-26T09:25:33.321 DEBUG:teuthology.orchestra.run.smithi092:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-08-26T09:25:33.377 DEBUG:teuthology.orchestra.run.smithi092:> sudo modprobe fuse 2023-08-26T09:25:33.445 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-26T09:25:33.445 DEBUG:teuthology.orchestra.run.smithi092:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-26T09:25:33.516 INFO:teuthology.orchestra.run.smithi092.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-26T09:25:33.517 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-26T09:25:33.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:33.518 DEBUG:teuthology.orchestra.run.smithi092:> ls /sys/fs/fuse/connections 2023-08-26T09:25:33.576 INFO:teuthology.orchestra.run.smithi092.stdout:47 2023-08-26T09:25:33.576 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [47] 2023-08-26T09:25:33.577 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-08-26T09:25:33.621 DEBUG:teuthology.orchestra.run.smithi092:> sudo modprobe fuse 2023-08-26T09:25:33.647 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-26T09:25:33.647 DEBUG:teuthology.orchestra.run.smithi092:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-26T09:25:33.709 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi092.stderr:2023-08-26T09:25:33.702+0000 7f9dfc4235c0 -1 init, newargv = 0x560dd2a78570 newargc=15 2023-08-26T09:25:33.709 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi092.stderr:ceph-fuse[114104]: starting ceph client 2023-08-26T09:25:33.711 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi092.stderr:ceph-fuse[114104]: starting fuse 2023-08-26T09:25:33.718 INFO:teuthology.orchestra.run.smithi092.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-26T09:25:33.719 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-26T09:25:33.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:33.720 DEBUG:teuthology.orchestra.run.smithi092:> ls /sys/fs/fuse/connections 2023-08-26T09:25:33.782 INFO:teuthology.orchestra.run.smithi092.stdout:47 2023-08-26T09:25:33.782 INFO:teuthology.orchestra.run.smithi092.stdout:48 2023-08-26T09:25:33.782 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47, 48] 2023-08-26T09:25:33.783 DEBUG:teuthology.orchestra.run.smithi092:> sudo stdin-killer -- python3 -c ' 2023-08-26T09:25:33.783 DEBUG:teuthology.orchestra.run.smithi092:> import glob 2023-08-26T09:25:33.783 DEBUG:teuthology.orchestra.run.smithi092:> import re 2023-08-26T09:25:33.784 DEBUG:teuthology.orchestra.run.smithi092:> import os 2023-08-26T09:25:33.784 DEBUG:teuthology.orchestra.run.smithi092:> import subprocess 2023-08-26T09:25:33.784 DEBUG:teuthology.orchestra.run.smithi092:> 2023-08-26T09:25:33.785 DEBUG:teuthology.orchestra.run.smithi092:> def _find_admin_socket(client_name): 2023-08-26T09:25:33.785 DEBUG:teuthology.orchestra.run.smithi092:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-08-26T09:25:33.785 DEBUG:teuthology.orchestra.run.smithi092:> files = glob.glob(asok_path) 2023-08-26T09:25:33.785 DEBUG:teuthology.orchestra.run.smithi092:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-08-26T09:25:33.786 DEBUG:teuthology.orchestra.run.smithi092:> 2023-08-26T09:25:33.786 DEBUG:teuthology.orchestra.run.smithi092:> # Given a non-glob path, it better be there 2023-08-26T09:25:33.786 DEBUG:teuthology.orchestra.run.smithi092:> if "*" not in asok_path: 2023-08-26T09:25:33.787 DEBUG:teuthology.orchestra.run.smithi092:> assert(len(files) == 1) 2023-08-26T09:25:33.787 DEBUG:teuthology.orchestra.run.smithi092:> return files[0] 2023-08-26T09:25:33.788 DEBUG:teuthology.orchestra.run.smithi092:> 2023-08-26T09:25:33.788 DEBUG:teuthology.orchestra.run.smithi092:> for f in files: 2023-08-26T09:25:33.788 DEBUG:teuthology.orchestra.run.smithi092:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-08-26T09:25:33.788 DEBUG:teuthology.orchestra.run.smithi092:> if os.path.exists("/proc/{0}".format(pid)): 2023-08-26T09:25:33.789 DEBUG:teuthology.orchestra.run.smithi092:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-08-26T09:25:33.789 DEBUG:teuthology.orchestra.run.smithi092:> contents = proc_f.read() 2023-08-26T09:25:33.790 DEBUG:teuthology.orchestra.run.smithi092:> if mountpoint in contents: 2023-08-26T09:25:33.790 DEBUG:teuthology.orchestra.run.smithi092:> return f 2023-08-26T09:25:33.790 DEBUG:teuthology.orchestra.run.smithi092:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-08-26T09:25:33.790 DEBUG:teuthology.orchestra.run.smithi092:> 2023-08-26T09:25:33.791 DEBUG:teuthology.orchestra.run.smithi092:> print(_find_admin_socket("client.2")) 2023-08-26T09:25:33.791 DEBUG:teuthology.orchestra.run.smithi092:> ' 2023-08-26T09:25:33.906 INFO:teuthology.orchestra.run.smithi092.stdout:/var/run/ceph/ceph-client.2.114104.asok 2023-08-26T09:25:33.909 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-08-26T09:25:33.915 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.114104.asok 2023-08-26T09:25:33.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:33.916 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.114104.asok status 2023-08-26T09:25:34.073 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-08-26T09:25:34.073 INFO:teuthology.orchestra.run.smithi092.stdout: "metadata": { 2023-08-26T09:25:34.074 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_sha1": "e7eb9853fddaf661c68f207346131a7e00d8ed2f", 2023-08-26T09:25:34.074 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_version": "ceph version 18.0.0-5706-ge7eb9853 (e7eb9853fddaf661c68f207346131a7e00d8ed2f) reef (dev)", 2023-08-26T09:25:34.075 INFO:teuthology.orchestra.run.smithi092.stdout: "entity_id": "2", 2023-08-26T09:25:34.075 INFO:teuthology.orchestra.run.smithi092.stdout: "hostname": "smithi092", 2023-08-26T09:25:34.075 INFO:teuthology.orchestra.run.smithi092.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-08-26T09:25:34.075 INFO:teuthology.orchestra.run.smithi092.stdout: "pid": "114104", 2023-08-26T09:25:34.076 INFO:teuthology.orchestra.run.smithi092.stdout: "root": "/" 2023-08-26T09:25:34.076 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-08-26T09:25:34.076 INFO:teuthology.orchestra.run.smithi092.stdout: "dentry_count": 0, 2023-08-26T09:25:34.076 INFO:teuthology.orchestra.run.smithi092.stdout: "dentry_pinned_count": 0, 2023-08-26T09:25:34.077 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 4731, 2023-08-26T09:25:34.077 INFO:teuthology.orchestra.run.smithi092.stdout: "inst": { 2023-08-26T09:25:34.077 INFO:teuthology.orchestra.run.smithi092.stdout: "name": { 2023-08-26T09:25:34.077 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "client", 2023-08-26T09:25:34.078 INFO:teuthology.orchestra.run.smithi092.stdout: "num": 4731 2023-08-26T09:25:34.078 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-08-26T09:25:34.078 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": { 2023-08-26T09:25:34.078 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "v1", 2023-08-26T09:25:34.079 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": "192.168.0.2:0", 2023-08-26T09:25:34.079 INFO:teuthology.orchestra.run.smithi092.stdout: "nonce": 3274158836 2023-08-26T09:25:34.079 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-08-26T09:25:34.079 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-08-26T09:25:34.079 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": { 2023-08-26T09:25:34.080 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "v1", 2023-08-26T09:25:34.080 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": "192.168.0.2:0", 2023-08-26T09:25:34.080 INFO:teuthology.orchestra.run.smithi092.stdout: "nonce": 3274158836 2023-08-26T09:25:34.080 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-08-26T09:25:34.081 INFO:teuthology.orchestra.run.smithi092.stdout: "inst_str": "client.4731 192.168.0.2:0/3274158836", 2023-08-26T09:25:34.081 INFO:teuthology.orchestra.run.smithi092.stdout: "addr_str": "192.168.0.2:0/3274158836", 2023-08-26T09:25:34.081 INFO:teuthology.orchestra.run.smithi092.stdout: "inode_count": 1, 2023-08-26T09:25:34.081 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_epoch": 7, 2023-08-26T09:25:34.082 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_epoch": 20, 2023-08-26T09:25:34.082 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_epoch_barrier": 0, 2023-08-26T09:25:34.083 INFO:teuthology.orchestra.run.smithi092.stdout: "blocklisted": false, 2023-08-26T09:25:34.083 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs" 2023-08-26T09:25:34.083 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-08-26T09:25:34.084 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-26T09:25:34.208 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.201+0000 7f33b4a4f700 1 Processor -- start 2023-08-26T09:25:34.208 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.201+0000 7f33b4a4f700 1 -- start start 2023-08-26T09:25:34.208 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.202+0000 7f33b4a4f700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f33b015d6c0 0x7f33b00cea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:34.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.202+0000 7f33b4a4f700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33b00cf4d0 con 0x7f33b00cef70 2023-08-26T09:25:34.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.202+0000 7f33b4a4f700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33b00ce3b0 con 0x7f33b00ca620 2023-08-26T09:25:34.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.202+0000 7f33b4a4f700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33b00cb4a0 con 0x7f33b015d6c0 2023-08-26T09:25:34.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.203+0000 7f33add9b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f33b015d6c0 0x7f33b00cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:34.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.203+0000 7f33aed9d700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f33b00cef70 0x7f33b006cd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:57252/0 (socket says 172.21.15.92:57252) 2023-08-26T09:25:34.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.203+0000 7f33aed9d700 1 -- 172.21.15.92:0/3862264395 learned_addr learned my addr 172.21.15.92:0/3862264395 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:34.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.203+0000 7f33add9b700 1 -- 172.21.15.92:0/3862264395 >> v1:172.21.15.188:6789/0 conn(0x7f33b00ca620 legacy=0x7f33b00caa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:34.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.203+0000 7f33add9b700 1 -- 172.21.15.92:0/3862264395 >> v1:172.21.15.92:6789/0 conn(0x7f33b00cef70 legacy=0x7f33b006cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:34.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.203+0000 7f33ad59a700 1 -- 172.21.15.92:0/3862264395 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2140785858 0 0) 0x7f33b00cf4d0 con 0x7f33b00cef70 2023-08-26T09:25:34.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.203+0000 7f33add9b700 1 -- 172.21.15.92:0/3862264395 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b00ce690 con 0x7f33b015d6c0 2023-08-26T09:25:34.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.203+0000 7f33add9b700 1 --2- 172.21.15.92:0/3862264395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33b015d6c0 0x7f33b00cea30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f33a0009840 tx=0x7f33a0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c41d0b018d165a1 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:34.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.203+0000 7f33ad59a700 1 -- 172.21.15.92:0/3862264395 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a0004230 con 0x7f33b015d6c0 2023-08-26T09:25:34.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.203+0000 7f33ad59a700 1 -- 172.21.15.92:0/3862264395 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a0004390 con 0x7f33b015d6c0 2023-08-26T09:25:34.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.203+0000 7f33ad59a700 1 -- 172.21.15.92:0/3862264395 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a00036a0 con 0x7f33b015d6c0 2023-08-26T09:25:34.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.204+0000 7f33b4a4f700 1 -- 172.21.15.92:0/3862264395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33b015d6c0 msgr2=0x7f33b00cea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:34.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.204+0000 7f33b4a4f700 1 --2- 172.21.15.92:0/3862264395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33b015d6c0 0x7f33b00cea30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f33a0009840 tx=0x7f33a0009b50 comp rx=0 tx=0).stop 2023-08-26T09:25:34.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.204+0000 7f33b4a4f700 1 -- 172.21.15.92:0/3862264395 shutdown_connections 2023-08-26T09:25:34.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.204+0000 7f33b4a4f700 1 --2- 172.21.15.92:0/3862264395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33b015d6c0 0x7f33b00cea30 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:34.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.204+0000 7f33b4a4f700 1 -- 172.21.15.92:0/3862264395 >> 172.21.15.92:0/3862264395 conn(0x7f33b00cc7b0 msgr2=0x7f33b00ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:34.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.204+0000 7f33b4a4f700 1 -- 172.21.15.92:0/3862264395 shutdown_connections 2023-08-26T09:25:34.213 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.204+0000 7f33b4a4f700 1 -- 172.21.15.92:0/3862264395 wait complete. 2023-08-26T09:25:34.215 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.205+0000 7f33b4a4f700 1 Processor -- start 2023-08-26T09:25:34.215 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.205+0000 7f33b4a4f700 1 -- start start 2023-08-26T09:25:34.215 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.206+0000 7f33b4a4f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33b00ca620 0x7f33b014ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:34.216 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.206+0000 7f33b4a4f700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f33b00cef70 0x7f33b015ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:34.216 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.206+0000 7f33b4a4f700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f33b015d6c0 0x7f33b015bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:34.216 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.206+0000 7f33b4a4f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b0156030 con 0x7f33b00ca620 2023-08-26T09:25:34.216 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.206+0000 7f33b4a4f700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b006e0e0 con 0x7f33b015d6c0 2023-08-26T09:25:34.216 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.206+0000 7f33b4a4f700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b015b2b0 con 0x7f33b00cef70 2023-08-26T09:25:34.217 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.206+0000 7f33ae59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33b00ca620 0x7f33b014ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:34.217 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.206+0000 7f33ae59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33b00ca620 0x7f33b014ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45240/0 (socket says 172.21.15.92:45240) 2023-08-26T09:25:34.217 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.206+0000 7f33ae59c700 1 -- 172.21.15.92:0/1162942932 learned_addr learned my addr 172.21.15.92:0/1162942932 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:34.217 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.206+0000 7f33add9b700 1 --2- 172.21.15.92:0/1162942932 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f33b00cef70 0x7f33b015ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:34.217 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.206+0000 7f33ae59c700 1 -- 172.21.15.92:0/1162942932 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f33b00cef70 msgr2=0x7f33b015ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:34.218 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.206+0000 7f33ae59c700 1 --2- 172.21.15.92:0/1162942932 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f33b00cef70 0x7f33b015ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:34.218 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.206+0000 7f33aed9d700 1 --2- 172.21.15.92:0/1162942932 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f33b015d6c0 0x7f33b015bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:34.218 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.206+0000 7f33ae59c700 1 -- 172.21.15.92:0/1162942932 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f33b015d6c0 msgr2=0x7f33b015bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:34.218 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.206+0000 7f33ae59c700 1 --2- 172.21.15.92:0/1162942932 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f33b015d6c0 0x7f33b015bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:34.218 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.206+0000 7f33ae59c700 1 -- 172.21.15.92:0/1162942932 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a00094a0 con 0x7f33b00ca620 2023-08-26T09:25:34.219 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.206+0000 7f33ae59c700 1 --2- 172.21.15.92:0/1162942932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33b00ca620 0x7f33b014ddf0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f33a400c4d0 tx=0x7f33a400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:34.219 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.207+0000 7f339effd700 1 -- 172.21.15.92:0/1162942932 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a4011790 con 0x7f33b00ca620 2023-08-26T09:25:34.219 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.207+0000 7f339effd700 1 -- 172.21.15.92:0/1162942932 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a40118f0 con 0x7f33b00ca620 2023-08-26T09:25:34.219 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.207+0000 7f33b4a4f700 1 -- 172.21.15.92:0/1162942932 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33b0155690 con 0x7f33b00ca620 2023-08-26T09:25:34.219 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.207+0000 7f339effd700 1 -- 172.21.15.92:0/1162942932 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a4011ca0 con 0x7f33b00ca620 2023-08-26T09:25:34.219 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.207+0000 7f33b4a4f700 1 -- 172.21.15.92:0/1162942932 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33b0155c50 con 0x7f33b00ca620 2023-08-26T09:25:34.220 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.208+0000 7f33b4a4f700 1 -- 172.21.15.92:0/1162942932 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33b004e660 con 0x7f33b00ca620 2023-08-26T09:25:34.220 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.208+0000 7f339effd700 1 -- 172.21.15.92:0/1162942932 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f33a401c460 con 0x7f33b00ca620 2023-08-26T09:25:34.220 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.208+0000 7f339effd700 1 --2- 172.21.15.92:0/1162942932 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f339006a0e0 0x7f339006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:34.220 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.208+0000 7f339effd700 1 -- 172.21.15.92:0/1162942932 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f33a40882f0 con 0x7f33b00ca620 2023-08-26T09:25:34.220 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.208+0000 7f33add9b700 1 --2- 172.21.15.92:0/1162942932 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f339006a0e0 0x7f339006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:34.221 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.209+0000 7f33add9b700 1 --2- 172.21.15.92:0/1162942932 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f339006a0e0 0x7f339006c5a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f33b01554c0 tx=0x7f33a0013040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:34.221 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.213+0000 7f339effd700 1 -- 172.21.15.92:0/1162942932 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f33a4053a70 con 0x7f33b00ca620 2023-08-26T09:25:34.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.444+0000 7f33b4a4f700 1 -- 172.21.15.92:0/1162942932 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f33b006f2d0 con 0x7f33b00ca620 2023-08-26T09:25:34.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.444+0000 7f339effd700 1 -- 172.21.15.92:0/1162942932 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f33a4057090 con 0x7f33b00ca620 2023-08-26T09:25:34.449 INFO:teuthology.orchestra.run.smithi092.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-26T09:25:34.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.446+0000 7f33b4a4f700 1 -- 172.21.15.92:0/1162942932 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f339006a0e0 msgr2=0x7f339006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:34.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.446+0000 7f33b4a4f700 1 --2- 172.21.15.92:0/1162942932 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f339006a0e0 0x7f339006c5a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f33b01554c0 tx=0x7f33a0013040 comp rx=0 tx=0).stop 2023-08-26T09:25:34.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.446+0000 7f33b4a4f700 1 -- 172.21.15.92:0/1162942932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33b00ca620 msgr2=0x7f33b014ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:34.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.446+0000 7f33b4a4f700 1 --2- 172.21.15.92:0/1162942932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33b00ca620 0x7f33b014ddf0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f33a400c4d0 tx=0x7f33a400c890 comp rx=0 tx=0).stop 2023-08-26T09:25:34.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.447+0000 7f33b4a4f700 1 -- 172.21.15.92:0/1162942932 shutdown_connections 2023-08-26T09:25:34.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.447+0000 7f33b4a4f700 1 --2- 172.21.15.92:0/1162942932 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f339006a0e0 0x7f339006c5a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:34.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.447+0000 7f33b4a4f700 1 --2- 172.21.15.92:0/1162942932 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f33b015d6c0 0x7f33b015bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:34.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.447+0000 7f33b4a4f700 1 --2- 172.21.15.92:0/1162942932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33b00ca620 0x7f33b014ddf0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:34.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.447+0000 7f33b4a4f700 1 --2- 172.21.15.92:0/1162942932 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f33b00cef70 0x7f33b015ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:34.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.447+0000 7f33b4a4f700 1 -- 172.21.15.92:0/1162942932 >> 172.21.15.92:0/1162942932 conn(0x7f33b00cc7b0 msgr2=0x7f33b00733c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:34.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.447+0000 7f33b4a4f700 1 -- 172.21.15.92:0/1162942932 shutdown_connections 2023-08-26T09:25:34.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:34.447+0000 7f33b4a4f700 1 -- 172.21.15.92:0/1162942932 wait complete. 2023-08-26T09:25:34.463 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-26T09:25:34.463 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-26T09:25:34.463 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi188.front.sepia.ceph.com 2023-08-26T09:25:34.464 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-08-26T09:25:34.464 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-26T09:25:34.464 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-26T09:25:34.464 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-26T09:25:34.465 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-26T09:25:34.465 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-26T09:25:34.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:34.465 DEBUG:teuthology.orchestra.run.smithi188:> ip addr 2023-08-26T09:25:34.487 INFO:teuthology.orchestra.run.smithi188.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-26T09:25:34.488 INFO:teuthology.orchestra.run.smithi188.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-26T09:25:34.488 INFO:teuthology.orchestra.run.smithi188.stdout: inet 127.0.0.1/8 scope host lo 2023-08-26T09:25:34.488 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-08-26T09:25:34.488 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 ::1/128 scope host 2023-08-26T09:25:34.489 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-08-26T09:25:34.489 INFO:teuthology.orchestra.run.smithi188.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-26T09:25:34.489 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 0c:c4:7a:d9:37:48 brd ff:ff:ff:ff:ff:ff 2023-08-26T09:25:34.489 INFO:teuthology.orchestra.run.smithi188.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-26T09:25:34.489 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 0c:c4:7a:d9:37:49 brd ff:ff:ff:ff:ff:ff 2023-08-26T09:25:34.490 INFO:teuthology.orchestra.run.smithi188.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-26T09:25:34.490 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 0c:c4:7a:88:80:38 brd ff:ff:ff:ff:ff:ff 2023-08-26T09:25:34.490 INFO:teuthology.orchestra.run.smithi188.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-26T09:25:34.490 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 0c:c4:7a:88:80:39 brd ff:ff:ff:ff:ff:ff 2023-08-26T09:25:34.490 INFO:teuthology.orchestra.run.smithi188.stdout: inet 172.21.15.188/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-26T09:25:34.490 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft 42420sec preferred_lft 42420sec 2023-08-26T09:25:34.491 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 fe80::e982:ca66:9cb6:1638/64 scope link noprefixroute 2023-08-26T09:25:34.491 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-08-26T09:25:34.491 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-08-26T09:25:34.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:34.492 DEBUG:teuthology.orchestra.run.smithi188:> (cd / && exec bash -c ' 2023-08-26T09:25:34.492 DEBUG:teuthology.orchestra.run.smithi188:> set -e 2023-08-26T09:25:34.492 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip link add name ceph-brx type bridge 2023-08-26T09:25:34.493 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip addr flush dev ceph-brx 2023-08-26T09:25:34.493 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip link set ceph-brx up 2023-08-26T09:25:34.493 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-08-26T09:25:34.494 DEBUG:teuthology.orchestra.run.smithi188:> ') 2023-08-26T09:25:34.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:34.676 DEBUG:teuthology.orchestra.run.smithi188:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-26T09:25:34.704 INFO:teuthology.orchestra.run.smithi188.stdout:1 2023-08-26T09:25:34.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:34.705 DEBUG:teuthology.orchestra.run.smithi188:> route 2023-08-26T09:25:34.774 INFO:teuthology.orchestra.run.smithi188.stdout:Kernel IP routing table 2023-08-26T09:25:34.774 INFO:teuthology.orchestra.run.smithi188.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-26T09:25:34.774 INFO:teuthology.orchestra.run.smithi188.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-26T09:25:34.775 INFO:teuthology.orchestra.run.smithi188.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-26T09:25:34.775 INFO:teuthology.orchestra.run.smithi188.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-26T09:25:34.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:34.776 DEBUG:teuthology.orchestra.run.smithi188:> (cd / && exec bash -c ' 2023-08-26T09:25:34.776 DEBUG:teuthology.orchestra.run.smithi188:> set -e 2023-08-26T09:25:34.776 DEBUG:teuthology.orchestra.run.smithi188:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-26T09:25:34.776 DEBUG:teuthology.orchestra.run.smithi188:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-26T09:25:34.777 DEBUG:teuthology.orchestra.run.smithi188:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-26T09:25:34.777 DEBUG:teuthology.orchestra.run.smithi188:> ') 2023-08-26T09:25:35.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:35.046 DEBUG:teuthology.orchestra.run.smithi188:> ip netns list 2023-08-26T09:25:35.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:35.064 DEBUG:teuthology.orchestra.run.smithi188:> ip netns list-id 2023-08-26T09:25:35.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:35.121 DEBUG:teuthology.orchestra.run.smithi188:> (cd / && exec bash -c ' 2023-08-26T09:25:35.122 DEBUG:teuthology.orchestra.run.smithi188:> set -e 2023-08-26T09:25:35.122 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-26T09:25:35.122 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-08-26T09:25:35.122 DEBUG:teuthology.orchestra.run.smithi188:> ') 2023-08-26T09:25:35.215 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-08-26T09:25:35.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:35.216 DEBUG:teuthology.orchestra.run.smithi188:> (cd / && exec bash -c ' 2023-08-26T09:25:35.217 DEBUG:teuthology.orchestra.run.smithi188:> set -e 2023-08-26T09:25:35.217 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-08-26T09:25:35.217 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-08-26T09:25:35.218 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-08-26T09:25:35.218 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-08-26T09:25:35.218 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-08-26T09:25:35.219 DEBUG:teuthology.orchestra.run.smithi188:> ') 2023-08-26T09:25:35.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:35.437 DEBUG:teuthology.orchestra.run.smithi188:> (cd / && exec bash -c ' 2023-08-26T09:25:35.438 DEBUG:teuthology.orchestra.run.smithi188:> set -e 2023-08-26T09:25:35.439 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip link set brx.0 up 2023-08-26T09:25:35.439 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip link set dev brx.0 master ceph-brx 2023-08-26T09:25:35.440 DEBUG:teuthology.orchestra.run.smithi188:> ') 2023-08-26T09:25:35.540 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-08-26T09:25:35.540 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-26T09:25:35.540 DEBUG:teuthology.orchestra.run.smithi188:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-08-26T09:25:35.560 INFO:teuthology.orchestra.run.smithi188.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-08-26T09:25:35.561 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-26T09:25:35.561 DEBUG:teuthology.orchestra.run.smithi188:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-08-26T09:25:35.616 DEBUG:teuthology.orchestra.run.smithi188:> sudo modprobe fuse 2023-08-26T09:25:35.683 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-26T09:25:35.683 DEBUG:teuthology.orchestra.run.smithi188:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-26T09:25:35.749 INFO:teuthology.orchestra.run.smithi188.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-26T09:25:35.750 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-26T09:25:35.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:35.751 DEBUG:teuthology.orchestra.run.smithi188:> ls /sys/fs/fuse/connections 2023-08-26T09:25:35.808 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-08-26T09:25:35.808 DEBUG:teuthology.orchestra.run.smithi188:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-08-26T09:25:35.852 DEBUG:teuthology.orchestra.run.smithi188:> sudo modprobe fuse 2023-08-26T09:25:35.878 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-26T09:25:35.878 DEBUG:teuthology.orchestra.run.smithi188:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-26T09:25:35.944 INFO:teuthology.orchestra.run.smithi188.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-26T09:25:35.945 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-26T09:25:35.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:35.946 DEBUG:teuthology.orchestra.run.smithi188:> ls /sys/fs/fuse/connections 2023-08-26T09:25:35.947 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi188.stderr:2023-08-26T09:25:35.942+0000 7ffa64c4a5c0 -1 init, newargv = 0x55c88af0a7a0 newargc=15 2023-08-26T09:25:35.947 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi188.stderr:ceph-fuse[109913]: starting ceph client 2023-08-26T09:25:35.951 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi188.stderr:ceph-fuse[109913]: starting fuse 2023-08-26T09:25:35.966 INFO:teuthology.orchestra.run.smithi188.stdout:47 2023-08-26T09:25:35.966 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-08-26T09:25:35.967 DEBUG:teuthology.orchestra.run.smithi188:> sudo stdin-killer -- python3 -c ' 2023-08-26T09:25:35.967 DEBUG:teuthology.orchestra.run.smithi188:> import glob 2023-08-26T09:25:35.967 DEBUG:teuthology.orchestra.run.smithi188:> import re 2023-08-26T09:25:35.968 DEBUG:teuthology.orchestra.run.smithi188:> import os 2023-08-26T09:25:35.968 DEBUG:teuthology.orchestra.run.smithi188:> import subprocess 2023-08-26T09:25:35.968 DEBUG:teuthology.orchestra.run.smithi188:> 2023-08-26T09:25:35.969 DEBUG:teuthology.orchestra.run.smithi188:> def _find_admin_socket(client_name): 2023-08-26T09:25:35.969 DEBUG:teuthology.orchestra.run.smithi188:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-08-26T09:25:35.969 DEBUG:teuthology.orchestra.run.smithi188:> files = glob.glob(asok_path) 2023-08-26T09:25:35.969 DEBUG:teuthology.orchestra.run.smithi188:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-08-26T09:25:35.970 DEBUG:teuthology.orchestra.run.smithi188:> 2023-08-26T09:25:35.970 DEBUG:teuthology.orchestra.run.smithi188:> # Given a non-glob path, it better be there 2023-08-26T09:25:35.970 DEBUG:teuthology.orchestra.run.smithi188:> if "*" not in asok_path: 2023-08-26T09:25:35.971 DEBUG:teuthology.orchestra.run.smithi188:> assert(len(files) == 1) 2023-08-26T09:25:35.971 DEBUG:teuthology.orchestra.run.smithi188:> return files[0] 2023-08-26T09:25:35.972 DEBUG:teuthology.orchestra.run.smithi188:> 2023-08-26T09:25:35.972 DEBUG:teuthology.orchestra.run.smithi188:> for f in files: 2023-08-26T09:25:35.973 DEBUG:teuthology.orchestra.run.smithi188:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-08-26T09:25:35.973 DEBUG:teuthology.orchestra.run.smithi188:> if os.path.exists("/proc/{0}".format(pid)): 2023-08-26T09:25:35.973 DEBUG:teuthology.orchestra.run.smithi188:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-08-26T09:25:35.974 DEBUG:teuthology.orchestra.run.smithi188:> contents = proc_f.read() 2023-08-26T09:25:35.974 DEBUG:teuthology.orchestra.run.smithi188:> if mountpoint in contents: 2023-08-26T09:25:35.974 DEBUG:teuthology.orchestra.run.smithi188:> return f 2023-08-26T09:25:35.974 DEBUG:teuthology.orchestra.run.smithi188:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-08-26T09:25:35.975 DEBUG:teuthology.orchestra.run.smithi188:> 2023-08-26T09:25:35.975 DEBUG:teuthology.orchestra.run.smithi188:> print(_find_admin_socket("client.1")) 2023-08-26T09:25:35.975 DEBUG:teuthology.orchestra.run.smithi188:> ' 2023-08-26T09:25:36.089 INFO:teuthology.orchestra.run.smithi188.stdout:/var/run/ceph/ceph-client.1.109913.asok 2023-08-26T09:25:36.091 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:25:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-08-26T09:25:36.098 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.109913.asok 2023-08-26T09:25:36.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:36.098 DEBUG:teuthology.orchestra.run.smithi188:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.109913.asok status 2023-08-26T09:25:36.254 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2023-08-26T09:25:36.254 INFO:teuthology.orchestra.run.smithi188.stdout: "metadata": { 2023-08-26T09:25:36.254 INFO:teuthology.orchestra.run.smithi188.stdout: "ceph_sha1": "e7eb9853fddaf661c68f207346131a7e00d8ed2f", 2023-08-26T09:25:36.254 INFO:teuthology.orchestra.run.smithi188.stdout: "ceph_version": "ceph version 18.0.0-5706-ge7eb9853 (e7eb9853fddaf661c68f207346131a7e00d8ed2f) reef (dev)", 2023-08-26T09:25:36.255 INFO:teuthology.orchestra.run.smithi188.stdout: "entity_id": "1", 2023-08-26T09:25:36.255 INFO:teuthology.orchestra.run.smithi188.stdout: "hostname": "smithi188", 2023-08-26T09:25:36.255 INFO:teuthology.orchestra.run.smithi188.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-08-26T09:25:36.255 INFO:teuthology.orchestra.run.smithi188.stdout: "pid": "109913", 2023-08-26T09:25:36.255 INFO:teuthology.orchestra.run.smithi188.stdout: "root": "/" 2023-08-26T09:25:36.256 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2023-08-26T09:25:36.256 INFO:teuthology.orchestra.run.smithi188.stdout: "dentry_count": 0, 2023-08-26T09:25:36.256 INFO:teuthology.orchestra.run.smithi188.stdout: "dentry_pinned_count": 0, 2023-08-26T09:25:36.256 INFO:teuthology.orchestra.run.smithi188.stdout: "id": 4609, 2023-08-26T09:25:36.256 INFO:teuthology.orchestra.run.smithi188.stdout: "inst": { 2023-08-26T09:25:36.257 INFO:teuthology.orchestra.run.smithi188.stdout: "name": { 2023-08-26T09:25:36.257 INFO:teuthology.orchestra.run.smithi188.stdout: "type": "client", 2023-08-26T09:25:36.257 INFO:teuthology.orchestra.run.smithi188.stdout: "num": 4609 2023-08-26T09:25:36.257 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2023-08-26T09:25:36.257 INFO:teuthology.orchestra.run.smithi188.stdout: "addr": { 2023-08-26T09:25:36.258 INFO:teuthology.orchestra.run.smithi188.stdout: "type": "v1", 2023-08-26T09:25:36.258 INFO:teuthology.orchestra.run.smithi188.stdout: "addr": "192.168.0.1:0", 2023-08-26T09:25:36.258 INFO:teuthology.orchestra.run.smithi188.stdout: "nonce": 1906182886 2023-08-26T09:25:36.258 INFO:teuthology.orchestra.run.smithi188.stdout: } 2023-08-26T09:25:36.258 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2023-08-26T09:25:36.259 INFO:teuthology.orchestra.run.smithi188.stdout: "addr": { 2023-08-26T09:25:36.259 INFO:teuthology.orchestra.run.smithi188.stdout: "type": "v1", 2023-08-26T09:25:36.259 INFO:teuthology.orchestra.run.smithi188.stdout: "addr": "192.168.0.1:0", 2023-08-26T09:25:36.259 INFO:teuthology.orchestra.run.smithi188.stdout: "nonce": 1906182886 2023-08-26T09:25:36.259 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2023-08-26T09:25:36.260 INFO:teuthology.orchestra.run.smithi188.stdout: "inst_str": "client.4609 192.168.0.1:0/1906182886", 2023-08-26T09:25:36.260 INFO:teuthology.orchestra.run.smithi188.stdout: "addr_str": "192.168.0.1:0/1906182886", 2023-08-26T09:25:36.260 INFO:teuthology.orchestra.run.smithi188.stdout: "inode_count": 1, 2023-08-26T09:25:36.260 INFO:teuthology.orchestra.run.smithi188.stdout: "mds_epoch": 7, 2023-08-26T09:25:36.260 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_epoch": 20, 2023-08-26T09:25:36.261 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_epoch_barrier": 0, 2023-08-26T09:25:36.261 INFO:teuthology.orchestra.run.smithi188.stdout: "blocklisted": false, 2023-08-26T09:25:36.261 INFO:teuthology.orchestra.run.smithi188.stdout: "fs_name": "cephfs" 2023-08-26T09:25:36.261 INFO:teuthology.orchestra.run.smithi188.stdout:} 2023-08-26T09:25:36.263 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-26T09:25:36.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.399+0000 7f3298d7b700 1 Processor -- start 2023-08-26T09:25:36.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.399+0000 7f3298d7b700 1 -- start start 2023-08-26T09:25:36.405 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.400+0000 7f3298d7b700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f32940ca620 0x7f32940caa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:36.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.400+0000 7f3298d7b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f329415d6c0 0x7f32940cea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:36.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.400+0000 7f3298d7b700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32940cf4d0 con 0x7f32940cef70 2023-08-26T09:25:36.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.400+0000 7f3298d7b700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32940cb4a0 con 0x7f329415d6c0 2023-08-26T09:25:36.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.400+0000 7f3298d7b700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32940caf40 con 0x7f32940ca620 2023-08-26T09:25:36.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.400+0000 7f3291d9b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f329415d6c0 0x7f32940cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:36.407 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.400+0000 7f3292d9d700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f32940cef70 0x7f329406a320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:57266/0 (socket says 172.21.15.92:57266) 2023-08-26T09:25:36.407 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.400+0000 7f3292d9d700 1 -- 172.21.15.92:0/2713801407 learned_addr learned my addr 172.21.15.92:0/2713801407 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:36.407 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.400+0000 7f329259c700 1 --2- 172.21.15.92:0/2713801407 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f32940ca620 0x7f32940caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:36.407 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.400+0000 7f3291d9b700 1 -- 172.21.15.92:0/2713801407 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f32940ca620 msgr2=0x7f32940caa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:36.407 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.400+0000 7f3291d9b700 1 --2- 172.21.15.92:0/2713801407 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f32940ca620 0x7f32940caa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:36.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.400+0000 7f3291d9b700 1 -- 172.21.15.92:0/2713801407 >> v1:172.21.15.92:6789/0 conn(0x7f32940cef70 legacy=0x7f329406a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:36.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.400+0000 7f3291d9b700 1 -- 172.21.15.92:0/2713801407 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32940ce3b0 con 0x7f329415d6c0 2023-08-26T09:25:36.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.400+0000 7f329159a700 1 -- 172.21.15.92:0/2713801407 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 368485949 0 0) 0x7f32940cf4d0 con 0x7f32940cef70 2023-08-26T09:25:36.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.400+0000 7f3291d9b700 1 --2- 172.21.15.92:0/2713801407 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f329415d6c0 0x7f32940cea30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3284009840 tx=0x7f3284009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88b936104c362869 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:36.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.400+0000 7f329159a700 1 -- 172.21.15.92:0/2713801407 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3284011830 con 0x7f329415d6c0 2023-08-26T09:25:36.409 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.401+0000 7f329159a700 1 -- 172.21.15.92:0/2713801407 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3284011990 con 0x7f329415d6c0 2023-08-26T09:25:36.409 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.401+0000 7f329159a700 1 -- 172.21.15.92:0/2713801407 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3284011d20 con 0x7f329415d6c0 2023-08-26T09:25:36.409 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.401+0000 7f3298d7b700 1 -- 172.21.15.92:0/2713801407 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f329415d6c0 msgr2=0x7f32940cea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:36.409 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.401+0000 7f3298d7b700 1 --2- 172.21.15.92:0/2713801407 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f329415d6c0 0x7f32940cea30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3284009840 tx=0x7f3284009b50 comp rx=0 tx=0).stop 2023-08-26T09:25:36.409 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.401+0000 7f3298d7b700 1 -- 172.21.15.92:0/2713801407 shutdown_connections 2023-08-26T09:25:36.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.401+0000 7f3298d7b700 1 --2- 172.21.15.92:0/2713801407 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f32940ca620 0x7f32940caa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:36.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.401+0000 7f3298d7b700 1 --2- 172.21.15.92:0/2713801407 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f329415d6c0 0x7f32940cea30 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:36.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.401+0000 7f3298d7b700 1 -- 172.21.15.92:0/2713801407 >> 172.21.15.92:0/2713801407 conn(0x7f32940cc7b0 msgr2=0x7f32940ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:36.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.401+0000 7f3298d7b700 1 -- 172.21.15.92:0/2713801407 shutdown_connections 2023-08-26T09:25:36.411 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.401+0000 7f3298d7b700 1 -- 172.21.15.92:0/2713801407 wait complete. 2023-08-26T09:25:36.413 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.403+0000 7f3298d7b700 1 Processor -- start 2023-08-26T09:25:36.413 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.403+0000 7f3298d7b700 1 -- start start 2023-08-26T09:25:36.414 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.403+0000 7f3298d7b700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f32940ca620 0x7f3294150d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:36.414 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.403+0000 7f3298d7b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32940cef70 0x7f32940c7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:36.414 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.403+0000 7f3298d7b700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f329415d6c0 0x7f32940c7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:36.414 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.403+0000 7f3298d7b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32940c9cf0 con 0x7f32940cef70 2023-08-26T09:25:36.414 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.403+0000 7f3298d7b700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f329415ef30 con 0x7f329415d6c0 2023-08-26T09:25:36.415 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.403+0000 7f3298d7b700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32940c81a0 con 0x7f32940ca620 2023-08-26T09:25:36.415 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.404+0000 7f3291d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32940cef70 0x7f32940c7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:36.415 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.404+0000 7f3291d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32940cef70 0x7f32940c7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45256/0 (socket says 172.21.15.92:45256) 2023-08-26T09:25:36.415 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.404+0000 7f3291d9b700 1 -- 172.21.15.92:0/2143959324 learned_addr learned my addr 172.21.15.92:0/2143959324 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:36.415 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.404+0000 7f329259c700 1 --2- 172.21.15.92:0/2143959324 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f32940ca620 0x7f3294150d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:36.416 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.404+0000 7f3292d9d700 1 --2- 172.21.15.92:0/2143959324 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f329415d6c0 0x7f32940c7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:36.416 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.404+0000 7f3291d9b700 1 -- 172.21.15.92:0/2143959324 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f32940ca620 msgr2=0x7f3294150d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:36.416 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.404+0000 7f3291d9b700 1 --2- 172.21.15.92:0/2143959324 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f32940ca620 0x7f3294150d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:36.416 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.404+0000 7f3291d9b700 1 -- 172.21.15.92:0/2143959324 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f329415d6c0 msgr2=0x7f32940c7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:36.416 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.404+0000 7f3291d9b700 1 --2- 172.21.15.92:0/2143959324 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f329415d6c0 0x7f32940c7770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:36.417 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.404+0000 7f3291d9b700 1 -- 172.21.15.92:0/2143959324 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32840094a0 con 0x7f32940cef70 2023-08-26T09:25:36.417 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.404+0000 7f3291d9b700 1 --2- 172.21.15.92:0/2143959324 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32940cef70 0x7f32940c7230 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3284009f50 tx=0x7f3284004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:36.417 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.404+0000 7f3282ffd700 1 -- 172.21.15.92:0/2143959324 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32840036a0 con 0x7f32940cef70 2023-08-26T09:25:36.417 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.404+0000 7f3282ffd700 1 -- 172.21.15.92:0/2143959324 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f328401f070 con 0x7f32940cef70 2023-08-26T09:25:36.417 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.404+0000 7f3298d7b700 1 -- 172.21.15.92:0/2143959324 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32940c9400 con 0x7f32940cef70 2023-08-26T09:25:36.418 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.404+0000 7f3282ffd700 1 -- 172.21.15.92:0/2143959324 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3284003a60 con 0x7f32940cef70 2023-08-26T09:25:36.418 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.404+0000 7f3298d7b700 1 -- 172.21.15.92:0/2143959324 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32940c9980 con 0x7f32940cef70 2023-08-26T09:25:36.418 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.405+0000 7f3298d7b700 1 -- 172.21.15.92:0/2143959324 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32940c9b10 con 0x7f32940cef70 2023-08-26T09:25:36.418 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.406+0000 7f3282ffd700 1 -- 172.21.15.92:0/2143959324 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3284003bc0 con 0x7f32940cef70 2023-08-26T09:25:36.418 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.406+0000 7f3282ffd700 1 --2- 172.21.15.92:0/2143959324 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f327406a0e0 0x7f327406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:36.419 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.406+0000 7f3282ffd700 1 -- 172.21.15.92:0/2143959324 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3284021070 con 0x7f32940cef70 2023-08-26T09:25:36.419 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.406+0000 7f329259c700 1 --2- 172.21.15.92:0/2143959324 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f327406a0e0 0x7f327406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:36.419 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.407+0000 7f329259c700 1 --2- 172.21.15.92:0/2143959324 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f327406a0e0 0x7f327406c5a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3288006b20 tx=0x7f3288008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:36.420 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.411+0000 7f3282ffd700 1 -- 172.21.15.92:0/2143959324 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f32840555e0 con 0x7f32940cef70 2023-08-26T09:25:36.648 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.644+0000 7f3298d7b700 1 -- 172.21.15.92:0/2143959324 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f329415f080 con 0x7f32940cef70 2023-08-26T09:25:36.648 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.644+0000 7f3282ffd700 1 -- 172.21.15.92:0/2143959324 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f329415f080 con 0x7f32940cef70 2023-08-26T09:25:36.649 INFO:teuthology.orchestra.run.smithi092.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-26T09:25:36.651 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.646+0000 7f3298d7b700 1 -- 172.21.15.92:0/2143959324 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f327406a0e0 msgr2=0x7f327406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:36.651 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.646+0000 7f3298d7b700 1 --2- 172.21.15.92:0/2143959324 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f327406a0e0 0x7f327406c5a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3288006b20 tx=0x7f3288008040 comp rx=0 tx=0).stop 2023-08-26T09:25:36.651 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.646+0000 7f3298d7b700 1 -- 172.21.15.92:0/2143959324 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32940cef70 msgr2=0x7f32940c7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:36.651 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.646+0000 7f3298d7b700 1 --2- 172.21.15.92:0/2143959324 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32940cef70 0x7f32940c7230 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3284009f50 tx=0x7f3284004750 comp rx=0 tx=0).stop 2023-08-26T09:25:36.651 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.646+0000 7f3298d7b700 1 -- 172.21.15.92:0/2143959324 shutdown_connections 2023-08-26T09:25:36.652 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.646+0000 7f3298d7b700 1 --2- 172.21.15.92:0/2143959324 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f327406a0e0 0x7f327406c5a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:36.652 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.646+0000 7f3298d7b700 1 --2- 172.21.15.92:0/2143959324 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f329415d6c0 0x7f32940c7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:36.652 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.646+0000 7f3298d7b700 1 --2- 172.21.15.92:0/2143959324 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f32940ca620 0x7f3294150d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:36.652 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.646+0000 7f3298d7b700 1 --2- 172.21.15.92:0/2143959324 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32940cef70 0x7f32940c7230 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:36.652 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.646+0000 7f3298d7b700 1 -- 172.21.15.92:0/2143959324 >> 172.21.15.92:0/2143959324 conn(0x7f32940cc7b0 msgr2=0x7f3294070e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:36.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.646+0000 7f3298d7b700 1 -- 172.21.15.92:0/2143959324 shutdown_connections 2023-08-26T09:25:36.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:36.646+0000 7f3298d7b700 1 -- 172.21.15.92:0/2143959324 wait complete. 2023-08-26T09:25:36.662 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-26T09:25:36.663 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-26T09:25:36.663 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi188.front.sepia.ceph.com 2023-08-26T09:25:36.664 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-08-26T09:25:36.665 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-08-26T09:25:36.665 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-26T09:25:36.665 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-26T09:25:36.665 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-26T09:25:36.666 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-08-26T09:25:36.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:36.666 DEBUG:teuthology.orchestra.run.smithi188:> ip addr 2023-08-26T09:25:36.684 INFO:teuthology.orchestra.run.smithi188.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-26T09:25:36.685 INFO:teuthology.orchestra.run.smithi188.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-26T09:25:36.685 INFO:teuthology.orchestra.run.smithi188.stdout: inet 127.0.0.1/8 scope host lo 2023-08-26T09:25:36.685 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-08-26T09:25:36.685 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 ::1/128 scope host 2023-08-26T09:25:36.686 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-08-26T09:25:36.686 INFO:teuthology.orchestra.run.smithi188.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-26T09:25:36.686 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 0c:c4:7a:d9:37:48 brd ff:ff:ff:ff:ff:ff 2023-08-26T09:25:36.686 INFO:teuthology.orchestra.run.smithi188.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-26T09:25:36.686 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 0c:c4:7a:d9:37:49 brd ff:ff:ff:ff:ff:ff 2023-08-26T09:25:36.687 INFO:teuthology.orchestra.run.smithi188.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-26T09:25:36.687 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 0c:c4:7a:88:80:38 brd ff:ff:ff:ff:ff:ff 2023-08-26T09:25:36.687 INFO:teuthology.orchestra.run.smithi188.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-26T09:25:36.687 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 0c:c4:7a:88:80:39 brd ff:ff:ff:ff:ff:ff 2023-08-26T09:25:36.687 INFO:teuthology.orchestra.run.smithi188.stdout: inet 172.21.15.188/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-26T09:25:36.688 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft 42418sec preferred_lft 42418sec 2023-08-26T09:25:36.688 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 fe80::e982:ca66:9cb6:1638/64 scope link noprefixroute 2023-08-26T09:25:36.688 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-08-26T09:25:36.690 INFO:teuthology.orchestra.run.smithi188.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-26T09:25:36.690 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 36:cd:e0:2e:86:a4 brd ff:ff:ff:ff:ff:ff 2023-08-26T09:25:36.690 INFO:teuthology.orchestra.run.smithi188.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-26T09:25:36.691 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-08-26T09:25:36.691 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 fe80::d422:59ff:feee:fa88/64 scope link 2023-08-26T09:25:36.691 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-08-26T09:25:36.691 INFO:teuthology.orchestra.run.smithi188.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-26T09:25:36.691 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 36:cd:e0:2e:86:a4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-26T09:25:36.692 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 fe80::34cd:e0ff:fe2e:86a4/64 scope link tentative 2023-08-26T09:25:36.692 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-08-26T09:25:36.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:36.693 DEBUG:teuthology.orchestra.run.smithi188:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-26T09:25:36.751 INFO:teuthology.orchestra.run.smithi188.stdout:1 2023-08-26T09:25:36.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:36.753 DEBUG:teuthology.orchestra.run.smithi188:> route 2023-08-26T09:25:36.813 INFO:teuthology.orchestra.run.smithi188.stdout:Kernel IP routing table 2023-08-26T09:25:36.813 INFO:teuthology.orchestra.run.smithi188.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-26T09:25:36.813 INFO:teuthology.orchestra.run.smithi188.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-26T09:25:36.814 INFO:teuthology.orchestra.run.smithi188.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-26T09:25:36.814 INFO:teuthology.orchestra.run.smithi188.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-26T09:25:36.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:36.815 DEBUG:teuthology.orchestra.run.smithi188:> (cd / && exec bash -c ' 2023-08-26T09:25:36.815 DEBUG:teuthology.orchestra.run.smithi188:> set -e 2023-08-26T09:25:36.815 DEBUG:teuthology.orchestra.run.smithi188:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-26T09:25:36.816 DEBUG:teuthology.orchestra.run.smithi188:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-26T09:25:36.816 DEBUG:teuthology.orchestra.run.smithi188:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-26T09:25:36.816 DEBUG:teuthology.orchestra.run.smithi188:> ') 2023-08-26T09:25:36.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:36.919 DEBUG:teuthology.orchestra.run.smithi188:> ip netns list 2023-08-26T09:25:36.935 INFO:teuthology.orchestra.run.smithi188.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-26T09:25:36.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:36.936 DEBUG:teuthology.orchestra.run.smithi188:> ip netns list-id 2023-08-26T09:25:36.992 INFO:teuthology.orchestra.run.smithi188.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-08-26T09:25:36.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:36.993 DEBUG:teuthology.orchestra.run.smithi188:> (cd / && exec bash -c ' 2023-08-26T09:25:36.993 DEBUG:teuthology.orchestra.run.smithi188:> set -e 2023-08-26T09:25:36.994 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-08-26T09:25:36.994 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-08-26T09:25:36.994 DEBUG:teuthology.orchestra.run.smithi188:> ') 2023-08-26T09:25:37.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:37.086 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-08-26T09:25:37.122 INFO:teuthology.orchestra.run.smithi188.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-26T09:25:37.123 INFO:teuthology.orchestra.run.smithi188.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-26T09:25:37.123 INFO:teuthology.orchestra.run.smithi188.stdout: inet 127.0.0.1/8 scope host lo 2023-08-26T09:25:37.123 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-08-26T09:25:37.123 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 ::1/128 scope host 2023-08-26T09:25:37.124 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-08-26T09:25:37.124 INFO:teuthology.orchestra.run.smithi188.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-26T09:25:37.124 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 8a:59:f4:ef:25:aa brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-26T09:25:37.124 INFO:teuthology.orchestra.run.smithi188.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-26T09:25:37.124 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-08-26T09:25:37.125 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 fe80::8859:f4ff:feef:25aa/64 scope link 2023-08-26T09:25:37.125 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-08-26T09:25:37.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:37.139 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-08-26T09:25:37.220 INFO:teuthology.orchestra.run.smithi188.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-26T09:25:37.221 INFO:teuthology.orchestra.run.smithi188.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-26T09:25:37.221 INFO:teuthology.orchestra.run.smithi188.stdout: inet 127.0.0.1/8 scope host lo 2023-08-26T09:25:37.221 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-08-26T09:25:37.222 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 ::1/128 scope host 2023-08-26T09:25:37.222 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-08-26T09:25:37.222 INFO:teuthology.orchestra.run.smithi188.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-26T09:25:37.222 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 8a:59:f4:ef:25:aa brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-26T09:25:37.223 INFO:teuthology.orchestra.run.smithi188.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-26T09:25:37.223 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-08-26T09:25:37.223 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 fe80::8859:f4ff:feef:25aa/64 scope link 2023-08-26T09:25:37.223 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-08-26T09:25:37.238 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-08-26T09:25:37.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:37.239 DEBUG:teuthology.orchestra.run.smithi188:> (cd / && exec bash -c ' 2023-08-26T09:25:37.240 DEBUG:teuthology.orchestra.run.smithi188:> set -e 2023-08-26T09:25:37.240 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-08-26T09:25:37.240 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-08-26T09:25:37.241 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-08-26T09:25:37.241 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-08-26T09:25:37.241 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-08-26T09:25:37.242 DEBUG:teuthology.orchestra.run.smithi188:> ') 2023-08-26T09:25:37.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:37.475 DEBUG:teuthology.orchestra.run.smithi188:> (cd / && exec bash -c ' 2023-08-26T09:25:37.476 DEBUG:teuthology.orchestra.run.smithi188:> set -e 2023-08-26T09:25:37.476 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip link set brx.1 up 2023-08-26T09:25:37.476 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip link set dev brx.1 master ceph-brx 2023-08-26T09:25:37.477 DEBUG:teuthology.orchestra.run.smithi188:> ') 2023-08-26T09:25:37.600 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-08-26T09:25:37.600 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-26T09:25:37.601 DEBUG:teuthology.orchestra.run.smithi188:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-08-26T09:25:37.620 INFO:teuthology.orchestra.run.smithi188.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-08-26T09:25:37.621 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-26T09:25:37.621 DEBUG:teuthology.orchestra.run.smithi188:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-08-26T09:25:37.676 DEBUG:teuthology.orchestra.run.smithi188:> sudo modprobe fuse 2023-08-26T09:25:37.744 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-26T09:25:37.744 DEBUG:teuthology.orchestra.run.smithi188:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-26T09:25:37.810 INFO:teuthology.orchestra.run.smithi188.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-26T09:25:37.811 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-26T09:25:37.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:37.812 DEBUG:teuthology.orchestra.run.smithi188:> ls /sys/fs/fuse/connections 2023-08-26T09:25:37.869 INFO:teuthology.orchestra.run.smithi188.stdout:47 2023-08-26T09:25:37.870 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [47] 2023-08-26T09:25:37.870 DEBUG:teuthology.orchestra.run.smithi188:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-08-26T09:25:37.912 DEBUG:teuthology.orchestra.run.smithi188:> sudo modprobe fuse 2023-08-26T09:25:37.937 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-26T09:25:37.938 DEBUG:teuthology.orchestra.run.smithi188:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-26T09:25:37.999 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi188.stderr:2023-08-26T09:25:37.994+0000 7fbb3a9c05c0 -1 init, newargv = 0x56155419b880 newargc=15 2023-08-26T09:25:37.999 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi188.stderr:ceph-fuse[110512]: starting ceph client 2023-08-26T09:25:38.004 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi188.stderr:ceph-fuse[110512]: starting fuse 2023-08-26T09:25:38.006 INFO:teuthology.orchestra.run.smithi188.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-26T09:25:38.007 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-26T09:25:38.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:38.008 DEBUG:teuthology.orchestra.run.smithi188:> ls /sys/fs/fuse/connections 2023-08-26T09:25:38.064 INFO:teuthology.orchestra.run.smithi188.stdout:47 2023-08-26T09:25:38.065 INFO:teuthology.orchestra.run.smithi188.stdout:48 2023-08-26T09:25:38.065 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47, 48] 2023-08-26T09:25:38.065 DEBUG:teuthology.orchestra.run.smithi188:> sudo stdin-killer -- python3 -c ' 2023-08-26T09:25:38.066 DEBUG:teuthology.orchestra.run.smithi188:> import glob 2023-08-26T09:25:38.066 DEBUG:teuthology.orchestra.run.smithi188:> import re 2023-08-26T09:25:38.066 DEBUG:teuthology.orchestra.run.smithi188:> import os 2023-08-26T09:25:38.067 DEBUG:teuthology.orchestra.run.smithi188:> import subprocess 2023-08-26T09:25:38.067 DEBUG:teuthology.orchestra.run.smithi188:> 2023-08-26T09:25:38.067 DEBUG:teuthology.orchestra.run.smithi188:> def _find_admin_socket(client_name): 2023-08-26T09:25:38.068 DEBUG:teuthology.orchestra.run.smithi188:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-08-26T09:25:38.068 DEBUG:teuthology.orchestra.run.smithi188:> files = glob.glob(asok_path) 2023-08-26T09:25:38.068 DEBUG:teuthology.orchestra.run.smithi188:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-08-26T09:25:38.068 DEBUG:teuthology.orchestra.run.smithi188:> 2023-08-26T09:25:38.069 DEBUG:teuthology.orchestra.run.smithi188:> # Given a non-glob path, it better be there 2023-08-26T09:25:38.069 DEBUG:teuthology.orchestra.run.smithi188:> if "*" not in asok_path: 2023-08-26T09:25:38.069 DEBUG:teuthology.orchestra.run.smithi188:> assert(len(files) == 1) 2023-08-26T09:25:38.070 DEBUG:teuthology.orchestra.run.smithi188:> return files[0] 2023-08-26T09:25:38.070 DEBUG:teuthology.orchestra.run.smithi188:> 2023-08-26T09:25:38.070 DEBUG:teuthology.orchestra.run.smithi188:> for f in files: 2023-08-26T09:25:38.071 DEBUG:teuthology.orchestra.run.smithi188:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-08-26T09:25:38.071 DEBUG:teuthology.orchestra.run.smithi188:> if os.path.exists("/proc/{0}".format(pid)): 2023-08-26T09:25:38.071 DEBUG:teuthology.orchestra.run.smithi188:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-08-26T09:25:38.071 DEBUG:teuthology.orchestra.run.smithi188:> contents = proc_f.read() 2023-08-26T09:25:38.072 DEBUG:teuthology.orchestra.run.smithi188:> if mountpoint in contents: 2023-08-26T09:25:38.072 DEBUG:teuthology.orchestra.run.smithi188:> return f 2023-08-26T09:25:38.072 DEBUG:teuthology.orchestra.run.smithi188:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-08-26T09:25:38.073 DEBUG:teuthology.orchestra.run.smithi188:> 2023-08-26T09:25:38.073 DEBUG:teuthology.orchestra.run.smithi188:> print(_find_admin_socket("client.3")) 2023-08-26T09:25:38.073 DEBUG:teuthology.orchestra.run.smithi188:> ' 2023-08-26T09:25:38.189 INFO:teuthology.orchestra.run.smithi188.stdout:/var/run/ceph/ceph-client.3.110512.asok 2023-08-26T09:25:38.192 INFO:teuthology.orchestra.run.smithi188.stderr:2023-08-26T09:25:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-08-26T09:25:38.198 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.110512.asok 2023-08-26T09:25:38.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:38.199 DEBUG:teuthology.orchestra.run.smithi188:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.110512.asok status 2023-08-26T09:25:38.354 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2023-08-26T09:25:38.356 INFO:teuthology.orchestra.run.smithi188.stdout: "metadata": { 2023-08-26T09:25:38.356 INFO:teuthology.orchestra.run.smithi188.stdout: "ceph_sha1": "e7eb9853fddaf661c68f207346131a7e00d8ed2f", 2023-08-26T09:25:38.356 INFO:teuthology.orchestra.run.smithi188.stdout: "ceph_version": "ceph version 18.0.0-5706-ge7eb9853 (e7eb9853fddaf661c68f207346131a7e00d8ed2f) reef (dev)", 2023-08-26T09:25:38.356 INFO:teuthology.orchestra.run.smithi188.stdout: "entity_id": "3", 2023-08-26T09:25:38.357 INFO:teuthology.orchestra.run.smithi188.stdout: "hostname": "smithi188", 2023-08-26T09:25:38.357 INFO:teuthology.orchestra.run.smithi188.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-08-26T09:25:38.357 INFO:teuthology.orchestra.run.smithi188.stdout: "pid": "110512", 2023-08-26T09:25:38.357 INFO:teuthology.orchestra.run.smithi188.stdout: "root": "/" 2023-08-26T09:25:38.357 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2023-08-26T09:25:38.358 INFO:teuthology.orchestra.run.smithi188.stdout: "dentry_count": 0, 2023-08-26T09:25:38.358 INFO:teuthology.orchestra.run.smithi188.stdout: "dentry_pinned_count": 0, 2023-08-26T09:25:38.358 INFO:teuthology.orchestra.run.smithi188.stdout: "id": 4511, 2023-08-26T09:25:38.358 INFO:teuthology.orchestra.run.smithi188.stdout: "inst": { 2023-08-26T09:25:38.358 INFO:teuthology.orchestra.run.smithi188.stdout: "name": { 2023-08-26T09:25:38.359 INFO:teuthology.orchestra.run.smithi188.stdout: "type": "client", 2023-08-26T09:25:38.359 INFO:teuthology.orchestra.run.smithi188.stdout: "num": 4511 2023-08-26T09:25:38.359 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2023-08-26T09:25:38.359 INFO:teuthology.orchestra.run.smithi188.stdout: "addr": { 2023-08-26T09:25:38.359 INFO:teuthology.orchestra.run.smithi188.stdout: "type": "v1", 2023-08-26T09:25:38.360 INFO:teuthology.orchestra.run.smithi188.stdout: "addr": "192.168.0.2:0", 2023-08-26T09:25:38.360 INFO:teuthology.orchestra.run.smithi188.stdout: "nonce": 1641432142 2023-08-26T09:25:38.360 INFO:teuthology.orchestra.run.smithi188.stdout: } 2023-08-26T09:25:38.360 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2023-08-26T09:25:38.361 INFO:teuthology.orchestra.run.smithi188.stdout: "addr": { 2023-08-26T09:25:38.361 INFO:teuthology.orchestra.run.smithi188.stdout: "type": "v1", 2023-08-26T09:25:38.361 INFO:teuthology.orchestra.run.smithi188.stdout: "addr": "192.168.0.2:0", 2023-08-26T09:25:38.361 INFO:teuthology.orchestra.run.smithi188.stdout: "nonce": 1641432142 2023-08-26T09:25:38.361 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2023-08-26T09:25:38.362 INFO:teuthology.orchestra.run.smithi188.stdout: "inst_str": "client.4511 192.168.0.2:0/1641432142", 2023-08-26T09:25:38.362 INFO:teuthology.orchestra.run.smithi188.stdout: "addr_str": "192.168.0.2:0/1641432142", 2023-08-26T09:25:38.362 INFO:teuthology.orchestra.run.smithi188.stdout: "inode_count": 1, 2023-08-26T09:25:38.362 INFO:teuthology.orchestra.run.smithi188.stdout: "mds_epoch": 7, 2023-08-26T09:25:38.362 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_epoch": 20, 2023-08-26T09:25:38.363 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_epoch_barrier": 0, 2023-08-26T09:25:38.363 INFO:teuthology.orchestra.run.smithi188.stdout: "blocklisted": false, 2023-08-26T09:25:38.363 INFO:teuthology.orchestra.run.smithi188.stdout: "fs_name": "cephfs" 2023-08-26T09:25:38.363 INFO:teuthology.orchestra.run.smithi188.stdout:} 2023-08-26T09:25:38.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:38.365 DEBUG:teuthology.orchestra.run.smithi092:> stat --file-system '--printf=%T 2023-08-26T09:25:38.365 DEBUG:teuthology.orchestra.run.smithi092:> ' -- /home/ubuntu/cephtest/mnt.0 2023-08-26T09:25:38.386 INFO:teuthology.orchestra.run.smithi092.stdout:fuseblk 2023-08-26T09:25:38.387 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-08-26T09:25:38.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:38.387 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-26T09:25:38.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:38.461 DEBUG:teuthology.orchestra.run.smithi092:> stat --file-system '--printf=%T 2023-08-26T09:25:38.461 DEBUG:teuthology.orchestra.run.smithi092:> ' -- /home/ubuntu/cephtest/mnt.2 2023-08-26T09:25:38.520 INFO:teuthology.orchestra.run.smithi092.stdout:fuseblk 2023-08-26T09:25:38.520 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-08-26T09:25:38.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:38.521 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-08-26T09:25:38.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:38.591 DEBUG:teuthology.orchestra.run.smithi188:> stat --file-system '--printf=%T 2023-08-26T09:25:38.591 DEBUG:teuthology.orchestra.run.smithi188:> ' -- /home/ubuntu/cephtest/mnt.1 2023-08-26T09:25:38.609 INFO:teuthology.orchestra.run.smithi188.stdout:fuseblk 2023-08-26T09:25:38.609 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-08-26T09:25:38.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:38.610 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-08-26T09:25:38.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:38.676 DEBUG:teuthology.orchestra.run.smithi188:> stat --file-system '--printf=%T 2023-08-26T09:25:38.676 DEBUG:teuthology.orchestra.run.smithi188:> ' -- /home/ubuntu/cephtest/mnt.3 2023-08-26T09:25:38.732 INFO:teuthology.orchestra.run.smithi188.stdout:fuseblk 2023-08-26T09:25:38.733 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-08-26T09:25:38.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:38.733 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-08-26T09:25:38.798 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-08-26T09:25:38.813 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-26T09:25:38.951 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.947+0000 7f155680f700 1 Processor -- start 2023-08-26T09:25:39.112 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.947+0000 7f155680f700 1 -- start start 2023-08-26T09:25:39.118 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.948+0000 7f155680f700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f15500d1a60 0x7f15500c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:39.118 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.948+0000 7f155680f700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15500cbb50 con 0x7f155015eae0 2023-08-26T09:25:39.118 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.948+0000 7f155680f700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15500cffb0 con 0x7f15500cd8e0 2023-08-26T09:25:39.118 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.948+0000 7f155680f700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15500cbe10 con 0x7f15500d1a60 2023-08-26T09:25:39.118 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.948+0000 7f1554dac700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f155015eae0 0x7f15500cc2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:57288/0 (socket says 172.21.15.92:57288) 2023-08-26T09:25:39.119 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.948+0000 7f1554dac700 1 -- 172.21.15.92:0/799013415 learned_addr learned my addr 172.21.15.92:0/799013415 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:39.119 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.948+0000 7f154f7fe700 1 --2- 172.21.15.92:0/799013415 >> v2:172.21.15.188:3300/0 conn(0x7f15500d1a60 0x7f15500c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:39.119 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.948+0000 7f154effd700 1 -- 172.21.15.92:0/799013415 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1689834100 0 0) 0x7f15500cbb50 con 0x7f155015eae0 2023-08-26T09:25:39.119 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.948+0000 7f154effd700 1 -- 172.21.15.92:0/799013415 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f153c0035b0 con 0x7f155015eae0 2023-08-26T09:25:39.119 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.948+0000 7f154effd700 1 -- 172.21.15.92:0/799013415 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 230698924 0 0) 0x7f15500cffb0 con 0x7f15500cd8e0 2023-08-26T09:25:39.120 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.948+0000 7f154effd700 1 -- 172.21.15.92:0/799013415 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15500cbb50 con 0x7f15500cd8e0 2023-08-26T09:25:39.120 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.948+0000 7f154effd700 1 -- 172.21.15.92:0/799013415 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4216649078 0 0) 0x7f153c0035b0 con 0x7f155015eae0 2023-08-26T09:25:39.120 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.948+0000 7f154effd700 1 -- 172.21.15.92:0/799013415 >> v2:172.21.15.188:3300/0 conn(0x7f15500d1a60 msgr2=0x7f15500c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:39.120 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.948+0000 7f154effd700 1 --2- 172.21.15.92:0/799013415 >> v2:172.21.15.188:3300/0 conn(0x7f15500d1a60 0x7f15500c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:39.120 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.948+0000 7f154effd700 1 -- 172.21.15.92:0/799013415 >> v1:172.21.15.188:6789/0 conn(0x7f15500cd8e0 legacy=0x7f155015e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:39.121 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.948+0000 7f154effd700 1 -- 172.21.15.92:0/799013415 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15500cf730 con 0x7f155015eae0 2023-08-26T09:25:39.121 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.948+0000 7f154effd700 1 -- 172.21.15.92:0/799013415 <== mon.0 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1019361464 0 0) 0x7f15480019f0 con 0x7f155015eae0 2023-08-26T09:25:39.121 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.948+0000 7f154effd700 1 -- 172.21.15.92:0/799013415 >> v1:172.21.15.92:6789/0 conn(0x7f155015eae0 legacy=0x7f15500cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:39.121 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.949+0000 7f154effd700 1 --2- 172.21.15.92:0/799013415 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f153c003b90 0x7f153c003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:39.121 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.949+0000 7f154effd700 1 --2- 172.21.15.92:0/799013415 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f153c004850 0x7f153c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:39.122 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.949+0000 7f154effd700 1 --2- 172.21.15.92:0/799013415 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f153c005210 0x7f153c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:39.122 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.949+0000 7f154effd700 1 -- 172.21.15.92:0/799013415 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15500cbe10 con 0x7f153c003b90 2023-08-26T09:25:39.122 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.949+0000 7f154effd700 1 -- 172.21.15.92:0/799013415 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f153c00c090 con 0x7f153c005210 2023-08-26T09:25:39.122 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.949+0000 7f154effd700 1 -- 172.21.15.92:0/799013415 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f153c00c250 con 0x7f153c004850 2023-08-26T09:25:39.122 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.949+0000 7f154ffff700 1 --2- 172.21.15.92:0/799013415 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f153c003b90 0x7f153c003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:39.122 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.949+0000 7f1554dac700 1 --2- 172.21.15.92:0/799013415 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f153c005210 0x7f153c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:39.123 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.949+0000 7f154f7fe700 1 --2- 172.21.15.92:0/799013415 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f153c004850 0x7f153c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:39.123 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.949+0000 7f154ffff700 1 -- 172.21.15.92:0/799013415 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f153c004850 msgr2=0x7f153c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:39.123 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.949+0000 7f154ffff700 1 --2- 172.21.15.92:0/799013415 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f153c004850 0x7f153c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:39.123 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.949+0000 7f154ffff700 1 -- 172.21.15.92:0/799013415 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f153c005210 msgr2=0x7f153c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:39.123 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.949+0000 7f154ffff700 1 --2- 172.21.15.92:0/799013415 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f153c005210 0x7f153c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:39.124 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.949+0000 7f154ffff700 1 -- 172.21.15.92:0/799013415 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f153c0035b0 con 0x7f153c003b90 2023-08-26T09:25:39.124 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.949+0000 7f1554dac700 1 -- 172.21.15.92:0/799013415 reap_dead start 2023-08-26T09:25:39.124 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.949+0000 7f154ffff700 1 --2- 172.21.15.92:0/799013415 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f153c003b90 0x7f153c003f90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f15400019a0 tx=0x7f153c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ce7d9267f25e51e server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:39.124 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.949+0000 7f154effd700 1 -- 172.21.15.92:0/799013415 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1540001dd0 con 0x7f153c003b90 2023-08-26T09:25:39.124 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.949+0000 7f154effd700 1 -- 172.21.15.92:0/799013415 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15400052f0 con 0x7f153c003b90 2023-08-26T09:25:39.125 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.949+0000 7f154effd700 1 -- 172.21.15.92:0/799013415 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1540001460 con 0x7f153c003b90 2023-08-26T09:25:39.125 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.950+0000 7f155680f700 1 -- 172.21.15.92:0/799013415 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f153c003b90 msgr2=0x7f153c003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:39.125 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.950+0000 7f155680f700 1 --2- 172.21.15.92:0/799013415 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f153c003b90 0x7f153c003f90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f15400019a0 tx=0x7f153c005880 comp rx=0 tx=0).stop 2023-08-26T09:25:39.125 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.950+0000 7f155680f700 1 -- 172.21.15.92:0/799013415 shutdown_connections 2023-08-26T09:25:39.125 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.950+0000 7f155680f700 1 --2- 172.21.15.92:0/799013415 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f153c003b90 0x7f153c003f90 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:39.126 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.950+0000 7f155680f700 1 -- 172.21.15.92:0/799013415 >> 172.21.15.92:0/799013415 conn(0x7f15500d0f40 msgr2=0x7f15500d1350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:39.126 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.950+0000 7f155680f700 1 -- 172.21.15.92:0/799013415 shutdown_connections 2023-08-26T09:25:39.126 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.950+0000 7f155680f700 1 -- 172.21.15.92:0/799013415 wait complete. 2023-08-26T09:25:39.126 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.951+0000 7f155680f700 1 Processor -- start 2023-08-26T09:25:39.126 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.951+0000 7f155680f700 1 -- start start 2023-08-26T09:25:39.127 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.952+0000 7f155680f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f153c003b90 0x7f1550153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:39.127 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.952+0000 7f155680f700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1550154630 0x7f15501589d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:39.127 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.952+0000 7f155680f700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1550158f10 0x7f15501520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:39.127 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.952+0000 7f155680f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15501593c0 con 0x7f153c003b90 2023-08-26T09:25:39.127 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.952+0000 7f155680f700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15501543b0 con 0x7f1550154630 2023-08-26T09:25:39.128 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.952+0000 7f155680f700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15500cafc0 con 0x7f1550158f10 2023-08-26T09:25:39.128 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.952+0000 7f154ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f153c003b90 0x7f1550153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:39.128 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.952+0000 7f154ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f153c003b90 0x7f1550153e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45282/0 (socket says 172.21.15.92:45282) 2023-08-26T09:25:39.128 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.952+0000 7f154ffff700 1 -- 172.21.15.92:0/1660658836 learned_addr learned my addr 172.21.15.92:0/1660658836 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:39.128 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.952+0000 7f154f7fe700 1 --2- 172.21.15.92:0/1660658836 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1550154630 0x7f15501589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:39.128 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.952+0000 7f1554dac700 1 --2- 172.21.15.92:0/1660658836 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1550158f10 0x7f15501520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:39.129 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.953+0000 7f154ffff700 1 -- 172.21.15.92:0/1660658836 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1550158f10 msgr2=0x7f15501520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:39.129 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.953+0000 7f154ffff700 1 --2- 172.21.15.92:0/1660658836 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1550158f10 0x7f15501520e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:39.129 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.953+0000 7f154ffff700 1 -- 172.21.15.92:0/1660658836 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1550154630 msgr2=0x7f15501589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:39.129 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.953+0000 7f154ffff700 1 --2- 172.21.15.92:0/1660658836 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1550154630 0x7f15501589d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:39.129 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.953+0000 7f154ffff700 1 -- 172.21.15.92:0/1660658836 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f155015aeb0 con 0x7f153c003b90 2023-08-26T09:25:39.130 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.953+0000 7f154ffff700 1 --2- 172.21.15.92:0/1660658836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f153c003b90 0x7f1550153e70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f15400011c0 tx=0x7f1540001320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:39.130 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.953+0000 7f154cff9700 1 -- 172.21.15.92:0/1660658836 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1540006cc0 con 0x7f153c003b90 2023-08-26T09:25:39.130 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.953+0000 7f154cff9700 1 -- 172.21.15.92:0/1660658836 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1540006e20 con 0x7f153c003b90 2023-08-26T09:25:39.130 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.953+0000 7f154cff9700 1 -- 172.21.15.92:0/1660658836 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1540007270 con 0x7f153c003b90 2023-08-26T09:25:39.130 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.953+0000 7f155680f700 1 -- 172.21.15.92:0/1660658836 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15500ca690 con 0x7f153c003b90 2023-08-26T09:25:39.131 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.953+0000 7f155680f700 1 -- 172.21.15.92:0/1660658836 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15500cac50 con 0x7f153c003b90 2023-08-26T09:25:39.131 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.954+0000 7f155680f700 1 -- 172.21.15.92:0/1660658836 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15500cae10 con 0x7f153c003b90 2023-08-26T09:25:39.131 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.954+0000 7f154cff9700 1 -- 172.21.15.92:0/1660658836 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f15400073d0 con 0x7f153c003b90 2023-08-26T09:25:39.131 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.955+0000 7f154cff9700 1 --2- 172.21.15.92:0/1660658836 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f153006a0e0 0x7f153006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:39.131 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.955+0000 7f154f7fe700 1 --2- 172.21.15.92:0/1660658836 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f153006a0e0 0x7f153006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:39.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.955+0000 7f154cff9700 1 -- 172.21.15.92:0/1660658836 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1540089120 con 0x7f153c003b90 2023-08-26T09:25:39.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.955+0000 7f154f7fe700 1 --2- 172.21.15.92:0/1660658836 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f153006a0e0 0x7f153006c5a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1550158790 tx=0x7f1538008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:39.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:38.959+0000 7f154cff9700 1 -- 172.21.15.92:0/1660658836 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1540058330 con 0x7f153c003b90 2023-08-26T09:25:39.155 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.151+0000 7f155680f700 1 -- 172.21.15.92:0/1660658836 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1550159320 con 0x7f153c003b90 2023-08-26T09:25:39.156 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.152+0000 7f154cff9700 1 -- 172.21.15.92:0/1660658836 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+18209 (secure 0 0 0) 0x7f1540057ec0 con 0x7f153c003b90 2023-08-26T09:25:39.156 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:25:39.157 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":20,"fsid":"254a2d31-bd41-4507-8326-1b205ac24377","created":"2023-08-26T09:24:55.352131+0000","modified":"2023-08-26T09:25:15.447635+0000","last_up_change":"2023-08-26T09:25:06.124496+0000","last_in_change":"2023-08-26T09:24:57.840725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-26T09:25:06.650431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-26T09:25:06.973382+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-26T09:25:11.584141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-26T09:25:12.814990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e9e7638-4459-4d8d-8e40-130bcf48df66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6819","nonce":382827192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6824","nonce":382827192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6831","nonce":382827192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6827","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6829","nonce":382827192}]},"public_addr":"172.21.15.92:6819/382827192","cluster_addr":"172.21.15.92:6824/382827192","heartbeat_back_addr":"172.21.15.92:6831/382827192","heartbeat_front_addr":"172.21.15.92:6829/382827192","state":["exists","up"]},{"osd":1,"uuid":"164e68c9-aedd-4df5-9b70-f4b1ec3bda13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6809","nonce":618773438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6811","nonce":618773438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6815","nonce":618773438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6813","nonce":618773438}]},"public_addr":"172.21.15.92:6809/618773438","cluster_addr":"172.21.15.92:6811/618773438","heartbeat_back_addr":"172.21.15.92:6815/618773438","heartbeat_front_addr":"172.21.15.92:6813/618773438","state":["exists","up"]},{"osd":2,"uuid":"8701dfee-629a-4d30-82e4-b8fac340303f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6818","nonce":3697397687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6821","nonce":3697397687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6828","nonce":3697397687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6823","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6825","nonce":3697397687}]},"public_addr":"172.21.15.92:6818/3697397687","cluster_addr":"172.21.15.92:6821/3697397687","heartbeat_back_addr":"172.21.15.92:6828/3697397687","heartbeat_front_addr":"172.21.15.92:6825/3697397687","state":["exists","up"]},{"osd":3,"uuid":"93bdc94d-dc07-495f-995a-a6ad072f0247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6801","nonce":3579846453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6803","nonce":3579846453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6807","nonce":3579846453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6805","nonce":3579846453}]},"public_addr":"172.21.15.92:6801/3579846453","cluster_addr":"172.21.15.92:6803/3579846453","heartbeat_back_addr":"172.21.15.92:6807/3579846453","heartbeat_front_addr":"172.21.15.92:6805/3579846453","state":["exists","up"]},{"osd":4,"uuid":"d9d0ea80-8481-46a7-9677-c338d32cf1d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6809","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6811","nonce":3228383424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6813","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6815","nonce":3228383424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6821","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6823","nonce":3228383424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6817","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6819","nonce":3228383424}]},"public_addr":"172.21.15.188:6811/3228383424","cluster_addr":"172.21.15.188:6815/3228383424","heartbeat_back_addr":"172.21.15.188:6823/3228383424","heartbeat_front_addr":"172.21.15.188:6819/3228383424","state":["exists","up"]},{"osd":5,"uuid":"38d03253-467a-456f-bd5e-5a46532a0b18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6801","nonce":1655821054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6803","nonce":1655821054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6807","nonce":1655821054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6805","nonce":1655821054}]},"public_addr":"172.21.15.188:6801/1655821054","cluster_addr":"172.21.15.188:6803/1655821054","heartbeat_back_addr":"172.21.15.188:6807/1655821054","heartbeat_front_addr":"172.21.15.188:6805/1655821054","state":["exists","up"]},{"osd":6,"uuid":"d61564b5-136f-42e5-a843-626c2017cc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6810","nonce":2069976891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6814","nonce":2069976891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6822","nonce":2069976891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6818","nonce":2069976891}]},"public_addr":"172.21.15.188:6810/2069976891","cluster_addr":"172.21.15.188:6814/2069976891","heartbeat_back_addr":"172.21.15.188:6822/2069976891","heartbeat_front_addr":"172.21.15.188:6818/2069976891","state":["exists","up"]},{"osd":7,"uuid":"fae2949e-0d62-42cd-ba72-08f516084b20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6825","nonce":1882888860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6827","nonce":1882888860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6831","nonce":1882888860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6829","nonce":1882888860}]},"public_addr":"172.21.15.188:6825/1882888860","cluster_addr":"172.21.15.188:6827/1882888860","heartbeat_back_addr":"172.21.15.188:6831/1882888860","heartbeat_front_addr":"172.21.15.188:6829/1882888860","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.038523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.063160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.000857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.975572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.023848+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.765194+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.081365+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:05.110745+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-26T09:25:39.159 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.154+0000 7f155680f700 1 -- 172.21.15.92:0/1660658836 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f153006a0e0 msgr2=0x7f153006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:39.159 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.154+0000 7f155680f700 1 --2- 172.21.15.92:0/1660658836 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f153006a0e0 0x7f153006c5a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1550158790 tx=0x7f1538008040 comp rx=0 tx=0).stop 2023-08-26T09:25:39.159 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.154+0000 7f155680f700 1 -- 172.21.15.92:0/1660658836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f153c003b90 msgr2=0x7f1550153e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:39.159 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.154+0000 7f155680f700 1 --2- 172.21.15.92:0/1660658836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f153c003b90 0x7f1550153e70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f15400011c0 tx=0x7f1540001320 comp rx=0 tx=0).stop 2023-08-26T09:25:39.159 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.154+0000 7f155680f700 1 -- 172.21.15.92:0/1660658836 shutdown_connections 2023-08-26T09:25:39.160 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.154+0000 7f155680f700 1 --2- 172.21.15.92:0/1660658836 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1550158f10 0x7f15501520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:39.160 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.154+0000 7f155680f700 1 --2- 172.21.15.92:0/1660658836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f153c003b90 0x7f1550153e70 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:39.160 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.154+0000 7f155680f700 1 --2- 172.21.15.92:0/1660658836 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f153006a0e0 0x7f153006c5a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:39.160 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.154+0000 7f155680f700 1 --2- 172.21.15.92:0/1660658836 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1550154630 0x7f15501589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:39.160 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.154+0000 7f155680f700 1 -- 172.21.15.92:0/1660658836 >> 172.21.15.92:0/1660658836 conn(0x7f15500d0f40 msgr2=0x7f15500b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:39.161 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.155+0000 7f155680f700 1 -- 172.21.15.92:0/1660658836 shutdown_connections 2023-08-26T09:25:39.161 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.155+0000 7f155680f700 1 -- 172.21.15.92:0/1660658836 wait complete. 2023-08-26T09:25:39.171 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-26T09:25:06.650431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-26T09:25:06.973382+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-26T09:25:11.584141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-26T09:25:12.814990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-26T09:25:39.173 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-26T09:25:39.295 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.291+0000 7f08b2908700 1 Processor -- start 2023-08-26T09:25:39.296 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.292+0000 7f08b2908700 1 -- start start 2023-08-26T09:25:39.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.292+0000 7f08b2908700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f08ac144ae0 0x7f08ac0c6500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:39.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.292+0000 7f08b2908700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f08ac06aa30 0x7f08ac0ca3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:39.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.292+0000 7f08b2908700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08ac06b1a0 con 0x7f08ac0c4c10 2023-08-26T09:25:39.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.292+0000 7f08b2908700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08ac144ec0 con 0x7f08ac144ae0 2023-08-26T09:25:39.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.292+0000 7f08b2908700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08ac06ea00 con 0x7f08ac06aa30 2023-08-26T09:25:39.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.292+0000 7f08ab7fe700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f08ac0c4c10 0x7f08ac06a320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:57306/0 (socket says 172.21.15.92:57306) 2023-08-26T09:25:39.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.292+0000 7f08ab7fe700 1 -- 172.21.15.92:0/3427150473 learned_addr learned my addr 172.21.15.92:0/3427150473 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:39.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.293+0000 7f08aaffd700 1 -- 172.21.15.92:0/3427150473 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3450942625 0 0) 0x7f08ac06b1a0 con 0x7f08ac0c4c10 2023-08-26T09:25:39.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.293+0000 7f08aaffd700 1 -- 172.21.15.92:0/3427150473 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08980035b0 con 0x7f08ac0c4c10 2023-08-26T09:25:39.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.293+0000 7f08b0ea5700 1 --2- 172.21.15.92:0/3427150473 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f08ac06aa30 0x7f08ac0ca3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:39.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.293+0000 7f08abfff700 1 --2- 172.21.15.92:0/3427150473 >> v2:172.21.15.188:3300/0 conn(0x7f08ac144ae0 0x7f08ac0c6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:39.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.293+0000 7f08aaffd700 1 -- 172.21.15.92:0/3427150473 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 657230359 0 0) 0x7f08980035b0 con 0x7f08ac0c4c10 2023-08-26T09:25:39.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.293+0000 7f08aaffd700 1 -- 172.21.15.92:0/3427150473 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f08ac06aa30 msgr2=0x7f08ac0ca3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:39.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.293+0000 7f08aaffd700 1 --2- 172.21.15.92:0/3427150473 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f08ac06aa30 0x7f08ac0ca3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:39.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.293+0000 7f08aaffd700 1 -- 172.21.15.92:0/3427150473 >> v2:172.21.15.188:3300/0 conn(0x7f08ac144ae0 msgr2=0x7f08ac0c6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:39.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.293+0000 7f08aaffd700 1 --2- 172.21.15.92:0/3427150473 >> v2:172.21.15.188:3300/0 conn(0x7f08ac144ae0 0x7f08ac0c6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:39.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.293+0000 7f08aaffd700 1 -- 172.21.15.92:0/3427150473 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08ac06dbe0 con 0x7f08ac0c4c10 2023-08-26T09:25:39.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.293+0000 7f08aaffd700 1 -- 172.21.15.92:0/3427150473 <== mon.0 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1019361464 0 0) 0x7f089c001670 con 0x7f08ac0c4c10 2023-08-26T09:25:39.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.293+0000 7f08aaffd700 1 -- 172.21.15.92:0/3427150473 >> v1:172.21.15.92:6789/0 conn(0x7f08ac0c4c10 legacy=0x7f08ac06a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:39.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.293+0000 7f08aaffd700 1 --2- 172.21.15.92:0/3427150473 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0898003a00 0x7f0898003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:39.304 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.293+0000 7f08aaffd700 1 --2- 172.21.15.92:0/3427150473 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0898004850 0x7f0898004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:39.304 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.293+0000 7f08aaffd700 1 --2- 172.21.15.92:0/3427150473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0898005210 0x7f089800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:39.304 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.293+0000 7f08aaffd700 1 -- 172.21.15.92:0/3427150473 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ac144ec0 con 0x7f0898005210 2023-08-26T09:25:39.304 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.293+0000 7f08aaffd700 1 -- 172.21.15.92:0/3427150473 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ac06ea00 con 0x7f0898004850 2023-08-26T09:25:39.304 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.293+0000 7f08aaffd700 1 -- 172.21.15.92:0/3427150473 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f089800c050 con 0x7f0898003a00 2023-08-26T09:25:39.305 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.293+0000 7f08abfff700 1 --2- 172.21.15.92:0/3427150473 >> v2:172.21.15.188:3300/0 conn(0x7f08ac144ae0 0x7f08ac0c6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:39.305 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.293+0000 7f08b0ea5700 1 --2- 172.21.15.92:0/3427150473 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f08ac06aa30 0x7f08ac0ca3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:39.305 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.293+0000 7f08b0ea5700 1 --2- 172.21.15.92:0/3427150473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0898005210 0x7f089800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:39.305 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.293+0000 7f08ab7fe700 1 --2- 172.21.15.92:0/3427150473 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0898004850 0x7f0898004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:39.305 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.293+0000 7f08abfff700 1 --2- 172.21.15.92:0/3427150473 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0898003a00 0x7f0898003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:39.305 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.294+0000 7f08b0ea5700 1 -- 172.21.15.92:0/3427150473 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0898003a00 msgr2=0x7f0898003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:39.306 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.294+0000 7f08b0ea5700 1 --2- 172.21.15.92:0/3427150473 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0898003a00 0x7f0898003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:39.306 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.294+0000 7f08b0ea5700 1 -- 172.21.15.92:0/3427150473 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0898004850 msgr2=0x7f0898004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:39.306 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.294+0000 7f08b0ea5700 1 --2- 172.21.15.92:0/3427150473 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0898004850 0x7f0898004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:39.306 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.294+0000 7f08b0ea5700 1 -- 172.21.15.92:0/3427150473 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08980035b0 con 0x7f0898005210 2023-08-26T09:25:39.306 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.294+0000 7f08b0ea5700 1 --2- 172.21.15.92:0/3427150473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0898005210 0x7f089800ba10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f08a4009f30 tx=0x7f0898005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=144388c36a81e973 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:39.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.294+0000 7f08aaffd700 1 -- 172.21.15.92:0/3427150473 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a4007dc0 con 0x7f0898005210 2023-08-26T09:25:39.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.294+0000 7f08aaffd700 1 -- 172.21.15.92:0/3427150473 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a400f040 con 0x7f0898005210 2023-08-26T09:25:39.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.294+0000 7f08aaffd700 1 -- 172.21.15.92:0/3427150473 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a4003c60 con 0x7f0898005210 2023-08-26T09:25:39.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.294+0000 7f08b2908700 1 -- 172.21.15.92:0/3427150473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0898005210 msgr2=0x7f089800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:39.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.294+0000 7f08b2908700 1 --2- 172.21.15.92:0/3427150473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0898005210 0x7f089800ba10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f08a4009f30 tx=0x7f0898005880 comp rx=0 tx=0).stop 2023-08-26T09:25:39.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.294+0000 7f08b0ea5700 1 -- 172.21.15.92:0/3427150473 reap_dead start 2023-08-26T09:25:39.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.294+0000 7f08b2908700 1 -- 172.21.15.92:0/3427150473 shutdown_connections 2023-08-26T09:25:39.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.294+0000 7f08b2908700 1 -- 172.21.15.92:0/3427150473 >> 172.21.15.92:0/3427150473 conn(0x7f08ac06b430 msgr2=0x7f08ac06b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:39.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.294+0000 7f08b2908700 1 -- 172.21.15.92:0/3427150473 shutdown_connections 2023-08-26T09:25:39.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.294+0000 7f08b2908700 1 -- 172.21.15.92:0/3427150473 wait complete. 2023-08-26T09:25:39.309 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.296+0000 7f08b2908700 1 Processor -- start 2023-08-26T09:25:39.311 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.296+0000 7f08b2908700 1 -- start start 2023-08-26T09:25:39.311 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.297+0000 7f08b2908700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f08ac0b5440 0x7f08ac0c77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:39.311 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.297+0000 7f08b2908700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f08ac0b5820 0x7f08ac130c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:39.312 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.297+0000 7f08b2908700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08ac0af910 0x7f08ac0c93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:39.312 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.297+0000 7f08b2908700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ac131140 con 0x7f08ac0af910 2023-08-26T09:25:39.312 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.297+0000 7f08b2908700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ac0c86a0 con 0x7f08ac0b5440 2023-08-26T09:25:39.312 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.297+0000 7f08b2908700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08ac0c7ea0 con 0x7f08ac0b5820 2023-08-26T09:25:39.312 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.297+0000 7f08b0ea5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08ac0af910 0x7f08ac0c93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:39.313 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.297+0000 7f08b0ea5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08ac0af910 0x7f08ac0c93d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45304/0 (socket says 172.21.15.92:45304) 2023-08-26T09:25:39.313 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.297+0000 7f08b0ea5700 1 -- 172.21.15.92:0/2516299457 learned_addr learned my addr 172.21.15.92:0/2516299457 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:39.313 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.297+0000 7f08ab7fe700 1 --2- 172.21.15.92:0/2516299457 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f08ac0b5820 0x7f08ac130c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:39.313 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.297+0000 7f08abfff700 1 --2- 172.21.15.92:0/2516299457 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f08ac0b5440 0x7f08ac0c77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:39.313 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.297+0000 7f08b0ea5700 1 -- 172.21.15.92:0/2516299457 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f08ac0b5820 msgr2=0x7f08ac130c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:39.313 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.297+0000 7f08b0ea5700 1 --2- 172.21.15.92:0/2516299457 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f08ac0b5820 0x7f08ac130c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:39.314 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.297+0000 7f08b0ea5700 1 -- 172.21.15.92:0/2516299457 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f08ac0b5440 msgr2=0x7f08ac0c77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:39.314 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.297+0000 7f08b0ea5700 1 --2- 172.21.15.92:0/2516299457 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f08ac0b5440 0x7f08ac0c77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:39.314 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.297+0000 7f08b0ea5700 1 -- 172.21.15.92:0/2516299457 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08ac0c88f0 con 0x7f08ac0af910 2023-08-26T09:25:39.314 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.298+0000 7f08b0ea5700 1 --2- 172.21.15.92:0/2516299457 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08ac0af910 0x7f08ac0c93d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f08a4016040 tx=0x7f08a4004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:39.314 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.298+0000 7f08a8ff9700 1 -- 172.21.15.92:0/2516299457 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a4004450 con 0x7f08ac0af910 2023-08-26T09:25:39.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.298+0000 7f08a8ff9700 1 -- 172.21.15.92:0/2516299457 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a40045d0 con 0x7f08ac0af910 2023-08-26T09:25:39.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.298+0000 7f08a8ff9700 1 -- 172.21.15.92:0/2516299457 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a4009450 con 0x7f08ac0af910 2023-08-26T09:25:39.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.298+0000 7f08b2908700 1 -- 172.21.15.92:0/2516299457 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08ac0c8bd0 con 0x7f08ac0af910 2023-08-26T09:25:39.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.298+0000 7f08b2908700 1 -- 172.21.15.92:0/2516299457 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08ac0afdc0 con 0x7f08ac0af910 2023-08-26T09:25:39.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.299+0000 7f08b2908700 1 -- 172.21.15.92:0/2516299457 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08ac0c90f0 con 0x7f08ac0af910 2023-08-26T09:25:39.316 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.299+0000 7f08a8ff9700 1 -- 172.21.15.92:0/2516299457 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f08a401a040 con 0x7f08ac0af910 2023-08-26T09:25:39.316 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.299+0000 7f08a8ff9700 1 --2- 172.21.15.92:0/2516299457 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f088c06a0e0 0x7f088c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:39.316 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.300+0000 7f08a8ff9700 1 -- 172.21.15.92:0/2516299457 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f08a4089280 con 0x7f08ac0af910 2023-08-26T09:25:39.316 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.300+0000 7f08abfff700 1 --2- 172.21.15.92:0/2516299457 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f088c06a0e0 0x7f088c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:39.316 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.300+0000 7f08abfff700 1 --2- 172.21.15.92:0/2516299457 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f088c06a0e0 0x7f088c06c5a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f08940099d0 tx=0x7f0894008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:39.317 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.304+0000 7f08a8ff9700 1 -- 172.21.15.92:0/2516299457 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f08ac0c90f0 con 0x7f08ac0af910 2023-08-26T09:25:39.496 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.492+0000 7f08b2908700 1 -- 172.21.15.92:0/2516299457 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f08ac0c90f0 con 0x7f08ac0af910 2023-08-26T09:25:39.497 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.493+0000 7f08a8ff9700 1 -- 172.21.15.92:0/2516299457 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f08ac0c90f0 con 0x7f08ac0af910 2023-08-26T09:25:39.497 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 8 2023-08-26T09:25:39.499 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.495+0000 7f08b2908700 1 -- 172.21.15.92:0/2516299457 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f088c06a0e0 msgr2=0x7f088c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:39.499 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.495+0000 7f08b2908700 1 --2- 172.21.15.92:0/2516299457 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f088c06a0e0 0x7f088c06c5a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f08940099d0 tx=0x7f0894008040 comp rx=0 tx=0).stop 2023-08-26T09:25:39.499 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.495+0000 7f08b2908700 1 -- 172.21.15.92:0/2516299457 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08ac0af910 msgr2=0x7f08ac0c93d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:39.500 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.495+0000 7f08b2908700 1 --2- 172.21.15.92:0/2516299457 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08ac0af910 0x7f08ac0c93d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f08a4016040 tx=0x7f08a4004b40 comp rx=0 tx=0).stop 2023-08-26T09:25:39.500 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.495+0000 7f08b2908700 1 -- 172.21.15.92:0/2516299457 shutdown_connections 2023-08-26T09:25:39.500 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.495+0000 7f08b2908700 1 --2- 172.21.15.92:0/2516299457 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f088c06a0e0 0x7f088c06c5a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:39.500 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.495+0000 7f08b2908700 1 --2- 172.21.15.92:0/2516299457 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f08ac0b5440 0x7f08ac0c77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:39.500 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.495+0000 7f08b2908700 1 --2- 172.21.15.92:0/2516299457 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08ac0af910 0x7f08ac0c93d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:39.501 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.495+0000 7f08b2908700 1 --2- 172.21.15.92:0/2516299457 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f08ac0b5820 0x7f08ac130c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:39.501 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.495+0000 7f08b2908700 1 -- 172.21.15.92:0/2516299457 >> 172.21.15.92:0/2516299457 conn(0x7f08ac06b430 msgr2=0x7f08ac141e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:39.501 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.495+0000 7f08b2908700 1 -- 172.21.15.92:0/2516299457 shutdown_connections 2023-08-26T09:25:39.501 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.495+0000 7f08b2908700 1 -- 172.21.15.92:0/2516299457 wait complete. 2023-08-26T09:25:39.511 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-26T09:25:39.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.630+0000 7f7601da7700 1 Processor -- start 2023-08-26T09:25:39.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.630+0000 7f7601da7700 1 -- start start 2023-08-26T09:25:39.636 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.631+0000 7f7601da7700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f75fc0ce6b0 0x7f75fc165340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:39.637 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.631+0000 7f7601da7700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75fc0724a0 con 0x7f75fc15a550 2023-08-26T09:25:39.637 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.631+0000 7f7601da7700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75fc072720 con 0x7f75fc06b430 2023-08-26T09:25:39.637 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.631+0000 7f7601da7700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75fc072a00 con 0x7f75fc0ce6b0 2023-08-26T09:25:39.637 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.631+0000 7f75fb7fe700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f75fc15a550 0x7f75fc0c9aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:57324/0 (socket says 172.21.15.92:57324) 2023-08-26T09:25:39.638 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.631+0000 7f75fb7fe700 1 -- 172.21.15.92:0/4283404270 learned_addr learned my addr 172.21.15.92:0/4283404270 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:39.638 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.631+0000 7f75fbfff700 1 --2- 172.21.15.92:0/4283404270 >> v2:172.21.15.188:3300/0 conn(0x7f75fc0ce6b0 0x7f75fc165340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:39.638 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.631+0000 7f75fa7fc700 1 -- 172.21.15.92:0/4283404270 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2876946259 0 0) 0x7f75fc0724a0 con 0x7f75fc15a550 2023-08-26T09:25:39.638 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.631+0000 7f75fa7fc700 1 -- 172.21.15.92:0/4283404270 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75e40057c0 con 0x7f75fc15a550 2023-08-26T09:25:39.638 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.631+0000 7f75fa7fc700 1 -- 172.21.15.92:0/4283404270 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 552266049 0 0) 0x7f75fc072720 con 0x7f75fc06b430 2023-08-26T09:25:39.639 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.631+0000 7f75fa7fc700 1 -- 172.21.15.92:0/4283404270 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75fc0724a0 con 0x7f75fc06b430 2023-08-26T09:25:39.639 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.631+0000 7f75fbfff700 1 -- 172.21.15.92:0/4283404270 >> v1:172.21.15.188:6789/0 conn(0x7f75fc06b430 legacy=0x7f75fc0ca1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:39.639 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.631+0000 7f75fbfff700 1 -- 172.21.15.92:0/4283404270 >> v1:172.21.15.92:6789/0 conn(0x7f75fc15a550 legacy=0x7f75fc0c9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:39.639 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.631+0000 7f75fa7fc700 1 -- 172.21.15.92:0/4283404270 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4103098127 0 0) 0x7f75e40057c0 con 0x7f75fc15a550 2023-08-26T09:25:39.639 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.631+0000 7f75fbfff700 1 -- 172.21.15.92:0/4283404270 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75fc0cdbd0 con 0x7f75fc0ce6b0 2023-08-26T09:25:39.640 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.632+0000 7f75fbfff700 1 --2- 172.21.15.92:0/4283404270 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f75fc0ce6b0 0x7f75fc165340 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f75f4009d90 tx=0x7f75f400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96d246f2b319417e server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:39.640 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.632+0000 7f75fa7fc700 1 -- 172.21.15.92:0/4283404270 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f400e070 con 0x7f75fc0ce6b0 2023-08-26T09:25:39.640 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.632+0000 7f75fa7fc700 1 -- 172.21.15.92:0/4283404270 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f4003a20 con 0x7f75fc0ce6b0 2023-08-26T09:25:39.640 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.632+0000 7f75fa7fc700 1 -- 172.21.15.92:0/4283404270 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec001670 con 0x7f75fc0ce6b0 2023-08-26T09:25:39.640 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.632+0000 7f7601da7700 1 -- 172.21.15.92:0/4283404270 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f75fc0ce6b0 msgr2=0x7f75fc165340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:39.641 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.632+0000 7f7601da7700 1 --2- 172.21.15.92:0/4283404270 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f75fc0ce6b0 0x7f75fc165340 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f75f4009d90 tx=0x7f75f400b330 comp rx=0 tx=0).stop 2023-08-26T09:25:39.641 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.632+0000 7f7601da7700 1 -- 172.21.15.92:0/4283404270 shutdown_connections 2023-08-26T09:25:39.641 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.632+0000 7f7601da7700 1 --2- 172.21.15.92:0/4283404270 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f75fc0ce6b0 0x7f75fc165340 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:39.641 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.632+0000 7f7601da7700 1 -- 172.21.15.92:0/4283404270 >> 172.21.15.92:0/4283404270 conn(0x7f75fc0cf450 msgr2=0x7f75fc0cf860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:39.641 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.632+0000 7f7601da7700 1 -- 172.21.15.92:0/4283404270 shutdown_connections 2023-08-26T09:25:39.641 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.632+0000 7f7601da7700 1 -- 172.21.15.92:0/4283404270 wait complete. 2023-08-26T09:25:39.644 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.633+0000 7f7601da7700 1 Processor -- start 2023-08-26T09:25:39.644 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.634+0000 7f7601da7700 1 -- start start 2023-08-26T09:25:39.644 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.634+0000 7f7601da7700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f75fc06b430 0x7f75fc1f0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:39.645 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.634+0000 7f7601da7700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f75fc0ce6b0 0x7f75fc1f39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:39.645 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.634+0000 7f7601da7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75fc15a550 0x7f75fc15cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:39.645 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.634+0000 7f7601da7700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75fc1f3f10 con 0x7f75fc15a550 2023-08-26T09:25:39.645 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.634+0000 7f7601da7700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75fc0c7c90 con 0x7f75fc0ce6b0 2023-08-26T09:25:39.645 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.634+0000 7f7601da7700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75fc0c7f70 con 0x7f75fc06b430 2023-08-26T09:25:39.646 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.634+0000 7f75fbfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75fc15a550 0x7f75fc15cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:39.646 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.634+0000 7f75fbfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75fc15a550 0x7f75fc15cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45320/0 (socket says 172.21.15.92:45320) 2023-08-26T09:25:39.646 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.634+0000 7f75fbfff700 1 -- 172.21.15.92:0/264384432 learned_addr learned my addr 172.21.15.92:0/264384432 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:39.646 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.635+0000 7f75fb7fe700 1 --2- 172.21.15.92:0/264384432 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f75fc06b430 0x7f75fc1f0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:39.646 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.635+0000 7f75faffd700 1 --2- 172.21.15.92:0/264384432 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f75fc0ce6b0 0x7f75fc1f39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:39.647 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.635+0000 7f75fbfff700 1 -- 172.21.15.92:0/264384432 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f75fc06b430 msgr2=0x7f75fc1f0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:39.647 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.635+0000 7f75fbfff700 1 --2- 172.21.15.92:0/264384432 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f75fc06b430 0x7f75fc1f0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:39.647 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.635+0000 7f75fbfff700 1 -- 172.21.15.92:0/264384432 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f75fc0ce6b0 msgr2=0x7f75fc1f39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:39.647 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.635+0000 7f75fbfff700 1 --2- 172.21.15.92:0/264384432 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f75fc0ce6b0 0x7f75fc1f39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:39.647 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.635+0000 7f75fbfff700 1 -- 172.21.15.92:0/264384432 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f4009a70 con 0x7f75fc15a550 2023-08-26T09:25:39.648 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.635+0000 7f75faffd700 1 --2- 172.21.15.92:0/264384432 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f75fc0ce6b0 0x7f75fc1f39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:39.648 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.635+0000 7f75fbfff700 1 --2- 172.21.15.92:0/264384432 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75fc15a550 0x7f75fc15cc80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f75fc073ce0 tx=0x7f75f4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:39.648 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.635+0000 7f75e3fff700 1 -- 172.21.15.92:0/264384432 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f4004540 con 0x7f75fc15a550 2023-08-26T09:25:39.648 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.635+0000 7f75e3fff700 1 -- 172.21.15.92:0/264384432 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f40046a0 con 0x7f75fc15a550 2023-08-26T09:25:39.648 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.635+0000 7f7601da7700 1 -- 172.21.15.92:0/264384432 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75fc15a9d0 con 0x7f75fc15a550 2023-08-26T09:25:39.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.635+0000 7f75e3fff700 1 -- 172.21.15.92:0/264384432 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f401d470 con 0x7f75fc15a550 2023-08-26T09:25:39.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.635+0000 7f7601da7700 1 -- 172.21.15.92:0/264384432 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75fc15af90 con 0x7f75fc15a550 2023-08-26T09:25:39.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.636+0000 7f7601da7700 1 -- 172.21.15.92:0/264384432 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75fc04eeb0 con 0x7f75fc15a550 2023-08-26T09:25:39.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.636+0000 7f75e3fff700 1 -- 172.21.15.92:0/264384432 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f75f401d5d0 con 0x7f75fc15a550 2023-08-26T09:25:39.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.637+0000 7f75e3fff700 1 --2- 172.21.15.92:0/264384432 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f75e806a0e0 0x7f75e806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:39.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.637+0000 7f75e3fff700 1 -- 172.21.15.92:0/264384432 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f75f4089d30 con 0x7f75fc15a550 2023-08-26T09:25:39.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.637+0000 7f75fb7fe700 1 --2- 172.21.15.92:0/264384432 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f75e806a0e0 0x7f75e806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:39.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.637+0000 7f75fb7fe700 1 --2- 172.21.15.92:0/264384432 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f75e806a0e0 0x7f75e806c5a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f75ec000fd0 tx=0x7f75ec001690 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:39.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.641+0000 7f75e3fff700 1 -- 172.21.15.92:0/264384432 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f75f4058fe0 con 0x7f75fc15a550 2023-08-26T09:25:39.835 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.831+0000 7f7601da7700 1 -- 172.21.15.92:0/264384432 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f75fc0c2d60 con 0x7f75fc15a550 2023-08-26T09:25:39.836 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.832+0000 7f75e3fff700 1 -- 172.21.15.92:0/264384432 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f75f4021020 con 0x7f75fc15a550 2023-08-26T09:25:39.836 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 1 2023-08-26T09:25:39.838 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.833+0000 7f7601da7700 1 -- 172.21.15.92:0/264384432 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f75e806a0e0 msgr2=0x7f75e806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:39.838 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.833+0000 7f7601da7700 1 --2- 172.21.15.92:0/264384432 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f75e806a0e0 0x7f75e806c5a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f75ec000fd0 tx=0x7f75ec001690 comp rx=0 tx=0).stop 2023-08-26T09:25:39.838 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.833+0000 7f7601da7700 1 -- 172.21.15.92:0/264384432 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75fc15a550 msgr2=0x7f75fc15cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:39.838 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.833+0000 7f7601da7700 1 --2- 172.21.15.92:0/264384432 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75fc15a550 0x7f75fc15cc80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f75fc073ce0 tx=0x7f75f4004ad0 comp rx=0 tx=0).stop 2023-08-26T09:25:39.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.834+0000 7f7601da7700 1 -- 172.21.15.92:0/264384432 shutdown_connections 2023-08-26T09:25:39.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.834+0000 7f7601da7700 1 --2- 172.21.15.92:0/264384432 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75fc15a550 0x7f75fc15cc80 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:39.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.834+0000 7f7601da7700 1 --2- 172.21.15.92:0/264384432 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f75fc06b430 0x7f75fc1f0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:39.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.834+0000 7f7601da7700 1 --2- 172.21.15.92:0/264384432 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f75e806a0e0 0x7f75e806c5a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:39.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.834+0000 7f7601da7700 1 --2- 172.21.15.92:0/264384432 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f75fc0ce6b0 0x7f75fc1f39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:39.840 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.834+0000 7f7601da7700 1 -- 172.21.15.92:0/264384432 >> 172.21.15.92:0/264384432 conn(0x7f75fc0cf450 msgr2=0x7f75fc0c9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:39.840 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.834+0000 7f7601da7700 1 -- 172.21.15.92:0/264384432 shutdown_connections 2023-08-26T09:25:39.840 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.834+0000 7f7601da7700 1 -- 172.21.15.92:0/264384432 wait complete. 2023-08-26T09:25:39.849 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-26T09:25:39.973 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.969+0000 7fbc870b0700 1 Processor -- start 2023-08-26T09:25:39.973 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.969+0000 7fbc870b0700 1 -- start start 2023-08-26T09:25:39.975 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.970+0000 7fbc870b0700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc80159dd0 0x7fbc800cf220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:39.976 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.970+0000 7fbc870b0700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fbc8006e110 0x7fbc8006e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:39.976 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.970+0000 7fbc870b0700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc8006eab0 con 0x7fbc80070d20 2023-08-26T09:25:39.976 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.970+0000 7fbc870b0700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc800c6200 con 0x7fbc8006e110 2023-08-26T09:25:39.976 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.970+0000 7fbc870b0700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc800ce740 con 0x7fbc80159dd0 2023-08-26T09:25:39.976 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.970+0000 7fbc7ffff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fbc8006e110 0x7fbc8006e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:39.977 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.970+0000 7fbc7ffff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fbc8006e110 0x7fbc8006e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45326/0 (socket says 172.21.15.92:45326) 2023-08-26T09:25:39.977 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.970+0000 7fbc7ffff700 1 -- 172.21.15.92:0/1852908290 learned_addr learned my addr 172.21.15.92:0/1852908290 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:39.977 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.970+0000 7fbc84e4c700 1 --2- 172.21.15.92:0/1852908290 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc80159dd0 0x7fbc800cf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:39.977 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.970+0000 7fbc7ffff700 1 -- 172.21.15.92:0/1852908290 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc80159dd0 msgr2=0x7fbc800cf220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:39.977 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.970+0000 7fbc7ffff700 1 --2- 172.21.15.92:0/1852908290 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc80159dd0 0x7fbc800cf220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:39.978 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.970+0000 7fbc7ffff700 1 -- 172.21.15.92:0/1852908290 >> v1:172.21.15.188:6789/0 conn(0x7fbc80070d20 legacy=0x7fbc800711b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:39.978 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.970+0000 7fbc7ffff700 1 -- 172.21.15.92:0/1852908290 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc800cea20 con 0x7fbc8006e110 2023-08-26T09:25:39.978 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.970+0000 7fbc84e4c700 1 --2- 172.21.15.92:0/1852908290 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc80159dd0 0x7fbc800cf220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:39.978 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.971+0000 7fbc7ffff700 1 --2- 172.21.15.92:0/1852908290 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc8006e110 0x7fbc8006e570 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c0098f0 tx=0x7fbc6c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba9b222c535772f7 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:39.978 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.971+0000 7fbc7f7fe700 1 -- 172.21.15.92:0/1852908290 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c00b8a0 con 0x7fbc8006e110 2023-08-26T09:25:39.979 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.971+0000 7fbc7f7fe700 1 -- 172.21.15.92:0/1852908290 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc6c00ba00 con 0x7fbc8006e110 2023-08-26T09:25:39.979 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.971+0000 7fbc7f7fe700 1 -- 172.21.15.92:0/1852908290 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c00bd90 con 0x7fbc8006e110 2023-08-26T09:25:39.979 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.971+0000 7fbc870b0700 1 -- 172.21.15.92:0/1852908290 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc8006e110 msgr2=0x7fbc8006e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:39.979 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.971+0000 7fbc870b0700 1 --2- 172.21.15.92:0/1852908290 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc8006e110 0x7fbc8006e570 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c0098f0 tx=0x7fbc6c009c00 comp rx=0 tx=0).stop 2023-08-26T09:25:39.979 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.971+0000 7fbc870b0700 1 -- 172.21.15.92:0/1852908290 shutdown_connections 2023-08-26T09:25:39.980 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.971+0000 7fbc870b0700 1 --2- 172.21.15.92:0/1852908290 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc80159dd0 0x7fbc800cf220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:39.980 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.971+0000 7fbc870b0700 1 --2- 172.21.15.92:0/1852908290 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc8006e110 0x7fbc8006e570 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:39.980 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.971+0000 7fbc870b0700 1 -- 172.21.15.92:0/1852908290 >> 172.21.15.92:0/1852908290 conn(0x7fbc8006b430 msgr2=0x7fbc8006b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:39.980 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.971+0000 7fbc870b0700 1 -- 172.21.15.92:0/1852908290 shutdown_connections 2023-08-26T09:25:39.980 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.971+0000 7fbc870b0700 1 -- 172.21.15.92:0/1852908290 wait complete. 2023-08-26T09:25:39.983 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.973+0000 7fbc870b0700 1 Processor -- start 2023-08-26T09:25:39.983 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.973+0000 7fbc870b0700 1 -- start start 2023-08-26T09:25:39.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.974+0000 7fbc870b0700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc8006e110 0x7fbc80145230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:39.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.974+0000 7fbc870b0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc80070d20 0x7fbc801efd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:39.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.974+0000 7fbc870b0700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbc80159dd0 0x7fbc801eebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:39.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.974+0000 7fbc870b0700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc801f02c0 con 0x7fbc80070d20 2023-08-26T09:25:39.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.974+0000 7fbc870b0700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc80146190 con 0x7fbc80159dd0 2023-08-26T09:25:39.985 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.974+0000 7fbc870b0700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc801458f0 con 0x7fbc8006e110 2023-08-26T09:25:39.985 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.974+0000 7fbc7ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc80070d20 0x7fbc801efd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:39.985 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.974+0000 7fbc7ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc80070d20 0x7fbc801efd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45332/0 (socket says 172.21.15.92:45332) 2023-08-26T09:25:39.985 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.974+0000 7fbc7ffff700 1 -- 172.21.15.92:0/1103235632 learned_addr learned my addr 172.21.15.92:0/1103235632 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:39.985 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.974+0000 7fbc8564d700 1 --2- 172.21.15.92:0/1103235632 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbc80159dd0 0x7fbc801eebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:39.985 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.974+0000 7fbc84e4c700 1 --2- 172.21.15.92:0/1103235632 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc8006e110 0x7fbc80145230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:39.986 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.974+0000 7fbc7ffff700 1 -- 172.21.15.92:0/1103235632 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc8006e110 msgr2=0x7fbc80145230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:39.986 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.974+0000 7fbc7ffff700 1 --2- 172.21.15.92:0/1103235632 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc8006e110 0x7fbc80145230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:39.986 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.974+0000 7fbc7ffff700 1 -- 172.21.15.92:0/1103235632 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbc80159dd0 msgr2=0x7fbc801eebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:39.986 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.974+0000 7fbc7ffff700 1 --2- 172.21.15.92:0/1103235632 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbc80159dd0 0x7fbc801eebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:39.986 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.974+0000 7fbc7ffff700 1 -- 172.21.15.92:0/1103235632 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc6c009550 con 0x7fbc80070d20 2023-08-26T09:25:39.987 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.974+0000 7fbc8564d700 1 --2- 172.21.15.92:0/1103235632 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbc80159dd0 0x7fbc801eebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:25:39.987 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.974+0000 7fbc84e4c700 1 --2- 172.21.15.92:0/1103235632 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc8006e110 0x7fbc80145230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:25:39.987 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.975+0000 7fbc7ffff700 1 --2- 172.21.15.92:0/1103235632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc80070d20 0x7fbc801efd80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c009c40 tx=0x7fbc6c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:39.987 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.975+0000 7fbc7d7fa700 1 -- 172.21.15.92:0/1103235632 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c0036a0 con 0x7fbc80070d20 2023-08-26T09:25:39.987 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.975+0000 7fbc7d7fa700 1 -- 172.21.15.92:0/1103235632 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc6c01e070 con 0x7fbc80070d20 2023-08-26T09:25:39.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.975+0000 7fbc870b0700 1 -- 172.21.15.92:0/1103235632 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc80145bd0 con 0x7fbc80070d20 2023-08-26T09:25:39.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.975+0000 7fbc7d7fa700 1 -- 172.21.15.92:0/1103235632 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c003a40 con 0x7fbc80070d20 2023-08-26T09:25:39.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.975+0000 7fbc870b0700 1 -- 172.21.15.92:0/1103235632 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc80143300 con 0x7fbc80070d20 2023-08-26T09:25:39.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.976+0000 7fbc870b0700 1 -- 172.21.15.92:0/1103235632 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc8004eeb0 con 0x7fbc80070d20 2023-08-26T09:25:39.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.976+0000 7fbc7d7fa700 1 -- 172.21.15.92:0/1103235632 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbc6c003ba0 con 0x7fbc80070d20 2023-08-26T09:25:39.989 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.976+0000 7fbc7d7fa700 1 --2- 172.21.15.92:0/1103235632 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fbc6406a0e0 0x7fbc6406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:39.989 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.976+0000 7fbc7d7fa700 1 -- 172.21.15.92:0/1103235632 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbc6c020070 con 0x7fbc80070d20 2023-08-26T09:25:39.989 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.977+0000 7fbc84e4c700 1 --2- 172.21.15.92:0/1103235632 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fbc6406a0e0 0x7fbc6406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:39.989 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.977+0000 7fbc84e4c700 1 --2- 172.21.15.92:0/1103235632 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fbc6406a0e0 0x7fbc6406c5a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbc80153430 tx=0x7fbc74008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:39.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:39.981+0000 7fbc7d7fa700 1 -- 172.21.15.92:0/1103235632 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fbc6c055220 con 0x7fbc80070d20 2023-08-26T09:25:40.177 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.173+0000 7fbc870b0700 1 -- 172.21.15.92:0/1103235632 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbc8006c290 con 0x7fbc80070d20 2023-08-26T09:25:40.177 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.173+0000 7fbc7d7fa700 1 -- 172.21.15.92:0/1103235632 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbc6c058840 con 0x7fbc80070d20 2023-08-26T09:25:40.178 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 32 2023-08-26T09:25:40.180 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.175+0000 7fbc870b0700 1 -- 172.21.15.92:0/1103235632 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fbc6406a0e0 msgr2=0x7fbc6406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:40.180 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.175+0000 7fbc870b0700 1 --2- 172.21.15.92:0/1103235632 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fbc6406a0e0 0x7fbc6406c5a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbc80153430 tx=0x7fbc74008040 comp rx=0 tx=0).stop 2023-08-26T09:25:40.180 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.175+0000 7fbc870b0700 1 -- 172.21.15.92:0/1103235632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc80070d20 msgr2=0x7fbc801efd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:40.180 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.175+0000 7fbc870b0700 1 --2- 172.21.15.92:0/1103235632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc80070d20 0x7fbc801efd80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c009c40 tx=0x7fbc6c004750 comp rx=0 tx=0).stop 2023-08-26T09:25:40.180 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.175+0000 7fbc870b0700 1 -- 172.21.15.92:0/1103235632 shutdown_connections 2023-08-26T09:25:40.181 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.175+0000 7fbc870b0700 1 --2- 172.21.15.92:0/1103235632 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fbc6406a0e0 0x7fbc6406c5a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:40.181 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.175+0000 7fbc870b0700 1 --2- 172.21.15.92:0/1103235632 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbc80159dd0 0x7fbc801eebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:40.181 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.175+0000 7fbc870b0700 1 --2- 172.21.15.92:0/1103235632 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc8006e110 0x7fbc80145230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:40.181 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.175+0000 7fbc870b0700 1 --2- 172.21.15.92:0/1103235632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc80070d20 0x7fbc801efd80 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:40.181 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.175+0000 7fbc870b0700 1 -- 172.21.15.92:0/1103235632 >> 172.21.15.92:0/1103235632 conn(0x7fbc8006b430 msgr2=0x7fbc8015ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:40.182 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.175+0000 7fbc870b0700 1 -- 172.21.15.92:0/1103235632 shutdown_connections 2023-08-26T09:25:40.182 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.176+0000 7fbc870b0700 1 -- 172.21.15.92:0/1103235632 wait complete. 2023-08-26T09:25:40.191 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-26T09:25:40.314 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.309+0000 7f1a1a632700 1 Processor -- start 2023-08-26T09:25:40.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.310+0000 7f1a1a632700 1 -- start start 2023-08-26T09:25:40.317 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.310+0000 7f1a1a632700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a1415d490 0x7f1a1406b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:40.317 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.310+0000 7f1a1a632700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f1a140b6250 0x7f1a140b66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:40.318 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.310+0000 7f1a1a632700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a140d25d0 con 0x7f1a140b1eb0 2023-08-26T09:25:40.318 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.310+0000 7f1a1a632700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a140cdc70 con 0x7f1a140b6250 2023-08-26T09:25:40.318 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.310+0000 7f1a1a632700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1415d870 con 0x7f1a1415d490 2023-08-26T09:25:40.318 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.310+0000 7f1a18bcf700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f1a140b6250 0x7f1a140b66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:40.318 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.311+0000 7f1a137fe700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f1a140b1eb0 0x7f1a140ce0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:57354/0 (socket says 172.21.15.92:57354) 2023-08-26T09:25:40.319 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.311+0000 7f1a137fe700 1 -- 172.21.15.92:0/1920923621 learned_addr learned my addr 172.21.15.92:0/1920923621 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:40.319 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.311+0000 7f1a13fff700 1 --2- 172.21.15.92:0/1920923621 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a1415d490 0x7f1a1406b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:40.319 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.311+0000 7f1a18bcf700 1 -- 172.21.15.92:0/1920923621 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a1415d490 msgr2=0x7f1a1406b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:40.319 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.311+0000 7f1a18bcf700 1 --2- 172.21.15.92:0/1920923621 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a1415d490 0x7f1a1406b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:40.319 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.311+0000 7f1a18bcf700 1 -- 172.21.15.92:0/1920923621 >> v1:172.21.15.92:6789/0 conn(0x7f1a140b1eb0 legacy=0x7f1a140ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:40.320 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.311+0000 7f1a12ffd700 1 -- 172.21.15.92:0/1920923621 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1317842643 0 0) 0x7f1a140d25d0 con 0x7f1a140b1eb0 2023-08-26T09:25:40.320 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.311+0000 7f1a18bcf700 1 -- 172.21.15.92:0/1920923621 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a140b57e0 con 0x7f1a140b6250 2023-08-26T09:25:40.320 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.311+0000 7f1a18bcf700 1 --2- 172.21.15.92:0/1920923621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a140b6250 0x7f1a140b66e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c009d90 tx=0x7f1a0c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61138cdb90bcb5c5 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:40.320 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.311+0000 7f1a12ffd700 1 -- 172.21.15.92:0/1920923621 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c00e070 con 0x7f1a140b6250 2023-08-26T09:25:40.320 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.311+0000 7f1a12ffd700 1 -- 172.21.15.92:0/1920923621 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a0c00bbd0 con 0x7f1a140b6250 2023-08-26T09:25:40.320 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.311+0000 7f1a12ffd700 1 -- 172.21.15.92:0/1920923621 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c012430 con 0x7f1a140b6250 2023-08-26T09:25:40.321 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.312+0000 7f1a1a632700 1 -- 172.21.15.92:0/1920923621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a140b6250 msgr2=0x7f1a140b66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:40.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.312+0000 7f1a1a632700 1 --2- 172.21.15.92:0/1920923621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a140b6250 0x7f1a140b66e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c009d90 tx=0x7f1a0c00b330 comp rx=0 tx=0).stop 2023-08-26T09:25:40.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.312+0000 7f1a1a632700 1 -- 172.21.15.92:0/1920923621 shutdown_connections 2023-08-26T09:25:40.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.312+0000 7f1a1a632700 1 --2- 172.21.15.92:0/1920923621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a140b6250 0x7f1a140b66e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:40.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.312+0000 7f1a1a632700 1 --2- 172.21.15.92:0/1920923621 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a1415d490 0x7f1a1406b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:40.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.312+0000 7f1a1a632700 1 -- 172.21.15.92:0/1920923621 >> 172.21.15.92:0/1920923621 conn(0x7f1a1406aac0 msgr2=0x7f1a1406aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:40.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.312+0000 7f1a1a632700 1 -- 172.21.15.92:0/1920923621 shutdown_connections 2023-08-26T09:25:40.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.312+0000 7f1a1a632700 1 -- 172.21.15.92:0/1920923621 wait complete. 2023-08-26T09:25:40.326 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.313+0000 7f1a1a632700 1 Processor -- start 2023-08-26T09:25:40.326 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.313+0000 7f1a1a632700 1 -- start start 2023-08-26T09:25:40.326 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.314+0000 7f1a1a632700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1a140b1eb0 0x7f1a140cc500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:40.326 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.314+0000 7f1a1a632700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a140b6250 0x7f1a140c94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:40.326 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.314+0000 7f1a1a632700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a1415d490 0x7f1a140b0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:40.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.314+0000 7f1a1a632700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a140cd180 con 0x7f1a1415d490 2023-08-26T09:25:40.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.314+0000 7f1a1a632700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a140c7fb0 con 0x7f1a140b1eb0 2023-08-26T09:25:40.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.314+0000 7f1a1a632700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a140c99f0 con 0x7f1a140b6250 2023-08-26T09:25:40.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.314+0000 7f1a18bcf700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a1415d490 0x7f1a140b0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:40.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.314+0000 7f1a18bcf700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a1415d490 0x7f1a140b0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45348/0 (socket says 172.21.15.92:45348) 2023-08-26T09:25:40.328 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.314+0000 7f1a18bcf700 1 -- 172.21.15.92:0/2724120893 learned_addr learned my addr 172.21.15.92:0/2724120893 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:40.328 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.314+0000 7f1a137fe700 1 --2- 172.21.15.92:0/2724120893 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a140b6250 0x7f1a140c94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:40.328 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.314+0000 7f1a18bcf700 1 -- 172.21.15.92:0/2724120893 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a140b6250 msgr2=0x7f1a140c94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:40.328 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.314+0000 7f1a18bcf700 1 --2- 172.21.15.92:0/2724120893 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a140b6250 0x7f1a140c94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:40.328 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.314+0000 7f1a18bcf700 1 -- 172.21.15.92:0/2724120893 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1a140b1eb0 msgr2=0x7f1a140cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:40.329 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.314+0000 7f1a18bcf700 1 --2- 172.21.15.92:0/2724120893 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1a140b1eb0 0x7f1a140cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:40.329 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.314+0000 7f1a18bcf700 1 -- 172.21.15.92:0/2724120893 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a0c009a70 con 0x7f1a1415d490 2023-08-26T09:25:40.329 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.314+0000 7f1a137fe700 1 --2- 172.21.15.92:0/2724120893 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a140b6250 0x7f1a140c94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:25:40.329 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.314+0000 7f1a18bcf700 1 --2- 172.21.15.92:0/2724120893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a1415d490 0x7f1a140b0ef0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1a140d0b60 tx=0x7f1a0c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:40.329 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.314+0000 7f1a10ff9700 1 -- 172.21.15.92:0/2724120893 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c012430 con 0x7f1a1415d490 2023-08-26T09:25:40.330 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.315+0000 7f1a10ff9700 1 -- 172.21.15.92:0/2724120893 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a0c020070 con 0x7f1a1415d490 2023-08-26T09:25:40.330 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.315+0000 7f1a1a632700 1 -- 172.21.15.92:0/2724120893 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a140b1430 con 0x7f1a1415d490 2023-08-26T09:25:40.330 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.315+0000 7f1a10ff9700 1 -- 172.21.15.92:0/2724120893 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c004280 con 0x7f1a1415d490 2023-08-26T09:25:40.330 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.315+0000 7f1a1a632700 1 -- 172.21.15.92:0/2724120893 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a140ccea0 con 0x7f1a1415d490 2023-08-26T09:25:40.330 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.316+0000 7f1a1a632700 1 -- 172.21.15.92:0/2724120893 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a140c7e10 con 0x7f1a1415d490 2023-08-26T09:25:40.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.316+0000 7f1a10ff9700 1 -- 172.21.15.92:0/2724120893 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1a0c0043e0 con 0x7f1a1415d490 2023-08-26T09:25:40.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.316+0000 7f1a10ff9700 1 --2- 172.21.15.92:0/2724120893 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f1a0006a0e0 0x7f1a0006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:40.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.317+0000 7f1a10ff9700 1 -- 172.21.15.92:0/2724120893 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1a0c022070 con 0x7f1a1415d490 2023-08-26T09:25:40.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.317+0000 7f1a13fff700 1 --2- 172.21.15.92:0/2724120893 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f1a0006a0e0 0x7f1a0006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:40.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.317+0000 7f1a13fff700 1 --2- 172.21.15.92:0/2724120893 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f1a0006a0e0 0x7f1a0006c5a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1a080097f0 tx=0x7f1a08008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:40.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.321+0000 7f1a10ff9700 1 -- 172.21.15.92:0/2724120893 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1a140c7e10 con 0x7f1a1415d490 2023-08-26T09:25:40.519 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.513+0000 7f1a1a632700 1 -- 172.21.15.92:0/2724120893 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1a140c7e10 con 0x7f1a1415d490 2023-08-26T09:25:40.519 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.514+0000 7f1a10ff9700 1 -- 172.21.15.92:0/2724120893 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1a140c7e10 con 0x7f1a1415d490 2023-08-26T09:25:40.519 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 64 2023-08-26T09:25:40.521 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.516+0000 7f1a1a632700 1 -- 172.21.15.92:0/2724120893 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f1a0006a0e0 msgr2=0x7f1a0006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:40.522 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.516+0000 7f1a1a632700 1 --2- 172.21.15.92:0/2724120893 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f1a0006a0e0 0x7f1a0006c5a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1a080097f0 tx=0x7f1a08008040 comp rx=0 tx=0).stop 2023-08-26T09:25:40.522 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.516+0000 7f1a1a632700 1 -- 172.21.15.92:0/2724120893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a1415d490 msgr2=0x7f1a140b0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:40.522 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.516+0000 7f1a1a632700 1 --2- 172.21.15.92:0/2724120893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a1415d490 0x7f1a140b0ef0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1a140d0b60 tx=0x7f1a0c004ad0 comp rx=0 tx=0).stop 2023-08-26T09:25:40.522 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.516+0000 7f1a1a632700 1 -- 172.21.15.92:0/2724120893 shutdown_connections 2023-08-26T09:25:40.523 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.516+0000 7f1a1a632700 1 --2- 172.21.15.92:0/2724120893 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f1a0006a0e0 0x7f1a0006c5a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:40.523 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.516+0000 7f1a1a632700 1 --2- 172.21.15.92:0/2724120893 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1a140b1eb0 0x7f1a140cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:40.523 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.516+0000 7f1a1a632700 1 --2- 172.21.15.92:0/2724120893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a1415d490 0x7f1a140b0ef0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:40.523 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.516+0000 7f1a1a632700 1 --2- 172.21.15.92:0/2724120893 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a140b6250 0x7f1a140c94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:40.524 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.516+0000 7f1a1a632700 1 -- 172.21.15.92:0/2724120893 >> 172.21.15.92:0/2724120893 conn(0x7f1a1406aac0 msgr2=0x7f1a140b2ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:40.524 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.516+0000 7f1a1a632700 1 -- 172.21.15.92:0/2724120893 shutdown_connections 2023-08-26T09:25:40.524 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.516+0000 7f1a1a632700 1 -- 172.21.15.92:0/2724120893 wait complete. 2023-08-26T09:25:40.533 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-26T09:25:40.654 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.649+0000 7fdb8225b700 1 Processor -- start 2023-08-26T09:25:40.654 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.649+0000 7fdb8225b700 1 -- start start 2023-08-26T09:25:40.656 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.650+0000 7fdb8225b700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdb7c0c3b60 0x7fdb7c0ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:40.657 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.650+0000 7fdb8225b700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fdb7c0b0430 0x7fdb7c0cd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:40.657 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.650+0000 7fdb8225b700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb7c0cd040 con 0x7fdb7c15d9d0 2023-08-26T09:25:40.657 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.650+0000 7fdb8225b700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb7c0cb4e0 con 0x7fdb7c0b0430 2023-08-26T09:25:40.657 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.650+0000 7fdb8225b700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c0cb200 con 0x7fdb7c0c3b60 2023-08-26T09:25:40.657 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.650+0000 7fdb7bfff700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fdb7c0b0430 0x7fdb7c0cd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:40.658 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.650+0000 7fdb7affd700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdb7c0c3b60 0x7fdb7c0ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:40.658 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.650+0000 7fdb7b7fe700 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7fdb7c15d9d0 0x7fdb7c15ddb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.92:52476/0 (socket says 172.21.15.92:52476) 2023-08-26T09:25:40.658 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.650+0000 7fdb7affd700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdb7c0c3b60 0x7fdb7c0ca9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.92:44018/0 (socket says 172.21.15.92:44018) 2023-08-26T09:25:40.658 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.650+0000 7fdb7bfff700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fdb7c0b0430 0x7fdb7c0cd4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.92:34164/0 (socket says 172.21.15.92:34164) 2023-08-26T09:25:40.658 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.650+0000 7fdb7b7fe700 1 -- 172.21.15.92:0/3442229908 learned_addr learned my addr 172.21.15.92:0/3442229908 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:40.659 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.650+0000 7fdb7a7fc700 1 -- 172.21.15.92:0/3442229908 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 663786250 0 0) 0x7fdb7c0cd040 con 0x7fdb7c15d9d0 2023-08-26T09:25:40.659 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.650+0000 7fdb7a7fc700 1 -- 172.21.15.92:0/3442229908 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb640035b0 con 0x7fdb7c15d9d0 2023-08-26T09:25:40.659 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.650+0000 7fdb7bfff700 1 -- 172.21.15.92:0/3442229908 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdb7c0c3b60 msgr2=0x7fdb7c0ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:40.659 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.650+0000 7fdb7bfff700 1 --2- 172.21.15.92:0/3442229908 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdb7c0c3b60 0x7fdb7c0ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:40.659 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.650+0000 7fdb7bfff700 1 -- 172.21.15.92:0/3442229908 >> v1:172.21.15.188:6789/0 conn(0x7fdb7c15d9d0 legacy=0x7fdb7c15ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:40.660 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.650+0000 7fdb7bfff700 1 -- 172.21.15.92:0/3442229908 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb7c0cc9f0 con 0x7fdb7c0b0430 2023-08-26T09:25:40.660 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.650+0000 7fdb7affd700 1 --2- 172.21.15.92:0/3442229908 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdb7c0c3b60 0x7fdb7c0ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-26T09:25:40.660 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.650+0000 7fdb7bfff700 1 --2- 172.21.15.92:0/3442229908 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdb7c0b0430 0x7fdb7c0cd4d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdb74009d90 tx=0x7fdb7400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0aae573e4d42679 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:40.660 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.651+0000 7fdb7a7fc700 1 -- 172.21.15.92:0/3442229908 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7400e070 con 0x7fdb7c0b0430 2023-08-26T09:25:40.661 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.651+0000 7fdb7a7fc700 1 -- 172.21.15.92:0/3442229908 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb7400bb20 con 0x7fdb7c0b0430 2023-08-26T09:25:40.661 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.651+0000 7fdb7a7fc700 1 -- 172.21.15.92:0/3442229908 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb74012430 con 0x7fdb7c0b0430 2023-08-26T09:25:40.661 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.651+0000 7fdb8225b700 1 -- 172.21.15.92:0/3442229908 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdb7c0b0430 msgr2=0x7fdb7c0cd4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:40.661 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.651+0000 7fdb8225b700 1 --2- 172.21.15.92:0/3442229908 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdb7c0b0430 0x7fdb7c0cd4d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdb74009d90 tx=0x7fdb7400b330 comp rx=0 tx=0).stop 2023-08-26T09:25:40.661 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.651+0000 7fdb8225b700 1 -- 172.21.15.92:0/3442229908 shutdown_connections 2023-08-26T09:25:40.662 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.651+0000 7fdb8225b700 1 --2- 172.21.15.92:0/3442229908 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdb7c0b0430 0x7fdb7c0cd4d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:40.662 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.651+0000 7fdb8225b700 1 --2- 172.21.15.92:0/3442229908 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdb7c0c3b60 0x7fdb7c0ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:40.662 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.651+0000 7fdb8225b700 1 -- 172.21.15.92:0/3442229908 >> 172.21.15.92:0/3442229908 conn(0x7fdb7c0cec80 msgr2=0x7fdb7c0cf090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:40.662 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.651+0000 7fdb8225b700 1 -- 172.21.15.92:0/3442229908 shutdown_connections 2023-08-26T09:25:40.663 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.651+0000 7fdb8225b700 1 -- 172.21.15.92:0/3442229908 wait complete. 2023-08-26T09:25:40.666 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.652+0000 7fdb8225b700 1 Processor -- start 2023-08-26T09:25:40.666 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.653+0000 7fdb8225b700 1 -- start start 2023-08-26T09:25:40.666 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.653+0000 7fdb8225b700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdb7c0b0430 0x7fdb7c148960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:40.667 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.653+0000 7fdb8225b700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdb7c0c3b60 0x7fdb7c150950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:40.667 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.653+0000 7fdb8225b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb7c15d9d0 0x7fdb7c158fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:40.667 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.653+0000 7fdb8225b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c15c580 con 0x7fdb7c15d9d0 2023-08-26T09:25:40.667 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.653+0000 7fdb8225b700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c150e90 con 0x7fdb7c0c3b60 2023-08-26T09:25:40.667 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.653+0000 7fdb8225b700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c15b970 con 0x7fdb7c0b0430 2023-08-26T09:25:40.668 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.653+0000 7fdb7bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb7c15d9d0 0x7fdb7c158fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:40.668 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.654+0000 7fdb7bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb7c15d9d0 0x7fdb7c158fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45362/0 (socket says 172.21.15.92:45362) 2023-08-26T09:25:40.668 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.654+0000 7fdb7bfff700 1 -- 172.21.15.92:0/2941278983 learned_addr learned my addr 172.21.15.92:0/2941278983 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:40.668 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.654+0000 7fdb7b7fe700 1 --2- 172.21.15.92:0/2941278983 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdb7c0b0430 0x7fdb7c148960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:40.668 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.654+0000 7fdb7affd700 1 --2- 172.21.15.92:0/2941278983 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdb7c0c3b60 0x7fdb7c150950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:40.669 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.654+0000 7fdb7bfff700 1 -- 172.21.15.92:0/2941278983 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdb7c0b0430 msgr2=0x7fdb7c148960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:40.669 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.654+0000 7fdb7bfff700 1 --2- 172.21.15.92:0/2941278983 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdb7c0b0430 0x7fdb7c148960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:40.669 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.654+0000 7fdb7bfff700 1 -- 172.21.15.92:0/2941278983 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdb7c0c3b60 msgr2=0x7fdb7c150950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:40.669 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.654+0000 7fdb7bfff700 1 --2- 172.21.15.92:0/2941278983 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdb7c0c3b60 0x7fdb7c150950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:40.669 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.654+0000 7fdb7bfff700 1 -- 172.21.15.92:0/2941278983 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb700094a0 con 0x7fdb7c15d9d0 2023-08-26T09:25:40.669 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.654+0000 7fdb7bfff700 1 --2- 172.21.15.92:0/2941278983 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb7c15d9d0 0x7fdb7c158fe0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdb7400b370 tx=0x7fdb74004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:40.670 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.654+0000 7fdb63fff700 1 -- 172.21.15.92:0/2941278983 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb74012430 con 0x7fdb7c15d9d0 2023-08-26T09:25:40.670 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.654+0000 7fdb63fff700 1 -- 172.21.15.92:0/2941278983 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb74020070 con 0x7fdb7c15d9d0 2023-08-26T09:25:40.670 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.654+0000 7fdb8225b700 1 -- 172.21.15.92:0/2941278983 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb74009a70 con 0x7fdb7c15d9d0 2023-08-26T09:25:40.670 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.654+0000 7fdb63fff700 1 -- 172.21.15.92:0/2941278983 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb740098f0 con 0x7fdb7c15d9d0 2023-08-26T09:25:40.670 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.654+0000 7fdb8225b700 1 -- 172.21.15.92:0/2941278983 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb7c15bf30 con 0x7fdb7c15d9d0 2023-08-26T09:25:40.671 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.655+0000 7fdb8225b700 1 -- 172.21.15.92:0/2941278983 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb7c15c6f0 con 0x7fdb7c15d9d0 2023-08-26T09:25:40.671 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.655+0000 7fdb63fff700 1 -- 172.21.15.92:0/2941278983 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdb74004040 con 0x7fdb7c15d9d0 2023-08-26T09:25:40.671 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.656+0000 7fdb63fff700 1 --2- 172.21.15.92:0/2941278983 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fdb6806a0e0 0x7fdb6806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:40.671 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.656+0000 7fdb63fff700 1 -- 172.21.15.92:0/2941278983 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdb74022070 con 0x7fdb7c15d9d0 2023-08-26T09:25:40.671 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.656+0000 7fdb7b7fe700 1 --2- 172.21.15.92:0/2941278983 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fdb6806a0e0 0x7fdb6806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:40.672 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.656+0000 7fdb7b7fe700 1 --2- 172.21.15.92:0/2941278983 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fdb6806a0e0 0x7fdb6806c5a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c007fd0 tx=0x7fdb6c007dc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:40.672 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.660+0000 7fdb63fff700 1 -- 172.21.15.92:0/2941278983 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fdb74059710 con 0x7fdb7c15d9d0 2023-08-26T09:25:40.856 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.851+0000 7fdb8225b700 1 -- 172.21.15.92:0/2941278983 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdb7c04e660 con 0x7fdb7c15d9d0 2023-08-26T09:25:40.857 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.852+0000 7fdb63fff700 1 -- 172.21.15.92:0/2941278983 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+18209 (secure 0 0 0) 0x7fdb740592a0 con 0x7fdb7c15d9d0 2023-08-26T09:25:40.858 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:25:40.858 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":20,"fsid":"254a2d31-bd41-4507-8326-1b205ac24377","created":"2023-08-26T09:24:55.352131+0000","modified":"2023-08-26T09:25:15.447635+0000","last_up_change":"2023-08-26T09:25:06.124496+0000","last_in_change":"2023-08-26T09:24:57.840725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-26T09:25:06.650431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-26T09:25:06.973382+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-26T09:25:11.584141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-26T09:25:12.814990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e9e7638-4459-4d8d-8e40-130bcf48df66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6819","nonce":382827192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6824","nonce":382827192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6831","nonce":382827192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6827","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6829","nonce":382827192}]},"public_addr":"172.21.15.92:6819/382827192","cluster_addr":"172.21.15.92:6824/382827192","heartbeat_back_addr":"172.21.15.92:6831/382827192","heartbeat_front_addr":"172.21.15.92:6829/382827192","state":["exists","up"]},{"osd":1,"uuid":"164e68c9-aedd-4df5-9b70-f4b1ec3bda13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6809","nonce":618773438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6811","nonce":618773438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6815","nonce":618773438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6813","nonce":618773438}]},"public_addr":"172.21.15.92:6809/618773438","cluster_addr":"172.21.15.92:6811/618773438","heartbeat_back_addr":"172.21.15.92:6815/618773438","heartbeat_front_addr":"172.21.15.92:6813/618773438","state":["exists","up"]},{"osd":2,"uuid":"8701dfee-629a-4d30-82e4-b8fac340303f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6818","nonce":3697397687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6821","nonce":3697397687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6828","nonce":3697397687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6823","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6825","nonce":3697397687}]},"public_addr":"172.21.15.92:6818/3697397687","cluster_addr":"172.21.15.92:6821/3697397687","heartbeat_back_addr":"172.21.15.92:6828/3697397687","heartbeat_front_addr":"172.21.15.92:6825/3697397687","state":["exists","up"]},{"osd":3,"uuid":"93bdc94d-dc07-495f-995a-a6ad072f0247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6801","nonce":3579846453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6803","nonce":3579846453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6807","nonce":3579846453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6805","nonce":3579846453}]},"public_addr":"172.21.15.92:6801/3579846453","cluster_addr":"172.21.15.92:6803/3579846453","heartbeat_back_addr":"172.21.15.92:6807/3579846453","heartbeat_front_addr":"172.21.15.92:6805/3579846453","state":["exists","up"]},{"osd":4,"uuid":"d9d0ea80-8481-46a7-9677-c338d32cf1d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6809","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6811","nonce":3228383424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6813","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6815","nonce":3228383424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6821","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6823","nonce":3228383424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6817","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6819","nonce":3228383424}]},"public_addr":"172.21.15.188:6811/3228383424","cluster_addr":"172.21.15.188:6815/3228383424","heartbeat_back_addr":"172.21.15.188:6823/3228383424","heartbeat_front_addr":"172.21.15.188:6819/3228383424","state":["exists","up"]},{"osd":5,"uuid":"38d03253-467a-456f-bd5e-5a46532a0b18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6801","nonce":1655821054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6803","nonce":1655821054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6807","nonce":1655821054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6805","nonce":1655821054}]},"public_addr":"172.21.15.188:6801/1655821054","cluster_addr":"172.21.15.188:6803/1655821054","heartbeat_back_addr":"172.21.15.188:6807/1655821054","heartbeat_front_addr":"172.21.15.188:6805/1655821054","state":["exists","up"]},{"osd":6,"uuid":"d61564b5-136f-42e5-a843-626c2017cc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6810","nonce":2069976891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6814","nonce":2069976891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6822","nonce":2069976891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6818","nonce":2069976891}]},"public_addr":"172.21.15.188:6810/2069976891","cluster_addr":"172.21.15.188:6814/2069976891","heartbeat_back_addr":"172.21.15.188:6822/2069976891","heartbeat_front_addr":"172.21.15.188:6818/2069976891","state":["exists","up"]},{"osd":7,"uuid":"fae2949e-0d62-42cd-ba72-08f516084b20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6825","nonce":1882888860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6827","nonce":1882888860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6831","nonce":1882888860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6829","nonce":1882888860}]},"public_addr":"172.21.15.188:6825/1882888860","cluster_addr":"172.21.15.188:6827/1882888860","heartbeat_back_addr":"172.21.15.188:6831/1882888860","heartbeat_front_addr":"172.21.15.188:6829/1882888860","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.038523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.063160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.000857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.975572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.023848+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.765194+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.081365+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:05.110745+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-26T09:25:40.860 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.855+0000 7fdb8225b700 1 -- 172.21.15.92:0/2941278983 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fdb6806a0e0 msgr2=0x7fdb6806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:40.860 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.855+0000 7fdb8225b700 1 --2- 172.21.15.92:0/2941278983 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fdb6806a0e0 0x7fdb6806c5a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c007fd0 tx=0x7fdb6c007dc0 comp rx=0 tx=0).stop 2023-08-26T09:25:40.860 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.855+0000 7fdb8225b700 1 -- 172.21.15.92:0/2941278983 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb7c15d9d0 msgr2=0x7fdb7c158fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:40.861 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.855+0000 7fdb8225b700 1 --2- 172.21.15.92:0/2941278983 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb7c15d9d0 0x7fdb7c158fe0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdb7400b370 tx=0x7fdb74004ad0 comp rx=0 tx=0).stop 2023-08-26T09:25:40.861 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.855+0000 7fdb8225b700 1 -- 172.21.15.92:0/2941278983 shutdown_connections 2023-08-26T09:25:40.861 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.855+0000 7fdb8225b700 1 --2- 172.21.15.92:0/2941278983 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb7c15d9d0 0x7fdb7c158fe0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:40.861 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.855+0000 7fdb8225b700 1 --2- 172.21.15.92:0/2941278983 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdb7c0b0430 0x7fdb7c148960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:40.861 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.855+0000 7fdb8225b700 1 --2- 172.21.15.92:0/2941278983 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fdb6806a0e0 0x7fdb6806c5a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:40.862 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.855+0000 7fdb8225b700 1 --2- 172.21.15.92:0/2941278983 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdb7c0c3b60 0x7fdb7c150950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:40.862 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.855+0000 7fdb8225b700 1 -- 172.21.15.92:0/2941278983 >> 172.21.15.92:0/2941278983 conn(0x7fdb7c0cec80 msgr2=0x7fdb7c0c9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:40.862 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.855+0000 7fdb8225b700 1 -- 172.21.15.92:0/2941278983 shutdown_connections 2023-08-26T09:25:40.862 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.855+0000 7fdb8225b700 1 -- 172.21.15.92:0/2941278983 wait complete. 2023-08-26T09:25:40.872 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-26T09:25:06.650431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-26T09:25:06.973382+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-26T09:25:11.584141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-26T09:25:12.814990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-26T09:25:40.872 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-26T09:25:40.996 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.991+0000 7fc6bf457700 1 Processor -- start 2023-08-26T09:25:40.996 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.991+0000 7fc6bf457700 1 -- start start 2023-08-26T09:25:40.998 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.992+0000 7fc6bf457700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fc6b815d490 0x7fc6b806b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:40.999 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.992+0000 7fc6bf457700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc6b80b6250 0x7fc6b80b66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:40.999 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.992+0000 7fc6bf457700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6b80d25d0 con 0x7fc6b80b1eb0 2023-08-26T09:25:40.999 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.992+0000 7fc6bf457700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6b80cdc70 con 0x7fc6b80b6250 2023-08-26T09:25:40.999 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.992+0000 7fc6bf457700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6b815d870 con 0x7fc6b815d490 2023-08-26T09:25:40.999 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.992+0000 7fc6bd9f4700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc6b80b6250 0x7fc6b80b66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:41.000 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.992+0000 7fc6bd9f4700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc6b80b6250 0x7fc6b80b66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45370/0 (socket says 172.21.15.92:45370) 2023-08-26T09:25:41.000 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.992+0000 7fc6bd9f4700 1 -- 172.21.15.92:0/1360139965 learned_addr learned my addr 172.21.15.92:0/1360139965 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:41.000 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.992+0000 7fc6bd1f3700 1 --2- 172.21.15.92:0/1360139965 >> v2:172.21.15.188:3300/0 conn(0x7fc6b815d490 0x7fc6b806b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:41.000 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.992+0000 7fc6bd9f4700 1 -- 172.21.15.92:0/1360139965 >> v2:172.21.15.188:3300/0 conn(0x7fc6b815d490 msgr2=0x7fc6b806b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:41.000 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.992+0000 7fc6bd9f4700 1 --2- 172.21.15.92:0/1360139965 >> v2:172.21.15.188:3300/0 conn(0x7fc6b815d490 0x7fc6b806b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:41.001 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.992+0000 7fc6bd9f4700 1 -- 172.21.15.92:0/1360139965 >> v1:172.21.15.188:6789/0 conn(0x7fc6b80b1eb0 legacy=0x7fc6b80ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:41.001 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.992+0000 7fc6bd9f4700 1 -- 172.21.15.92:0/1360139965 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b80b57e0 con 0x7fc6b80b6250 2023-08-26T09:25:41.001 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.993+0000 7fc6bd9f4700 1 --2- 172.21.15.92:0/1360139965 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6b80b6250 0x7fc6b80b66e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8073f00 tx=0x7fc6b000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8999f822907dba29 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:41.001 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.993+0000 7fc6affff700 1 -- 172.21.15.92:0/1360139965 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b000e070 con 0x7fc6b80b6250 2023-08-26T09:25:41.001 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.993+0000 7fc6affff700 1 -- 172.21.15.92:0/1360139965 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b000b9c0 con 0x7fc6b80b6250 2023-08-26T09:25:41.002 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.993+0000 7fc6affff700 1 -- 172.21.15.92:0/1360139965 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b000bd70 con 0x7fc6b80b6250 2023-08-26T09:25:41.002 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.993+0000 7fc6bf457700 1 -- 172.21.15.92:0/1360139965 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6b80b6250 msgr2=0x7fc6b80b66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:41.002 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.993+0000 7fc6bf457700 1 --2- 172.21.15.92:0/1360139965 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6b80b6250 0x7fc6b80b66e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8073f00 tx=0x7fc6b000b330 comp rx=0 tx=0).stop 2023-08-26T09:25:41.002 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.993+0000 7fc6bf457700 1 -- 172.21.15.92:0/1360139965 shutdown_connections 2023-08-26T09:25:41.002 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.993+0000 7fc6bf457700 1 --2- 172.21.15.92:0/1360139965 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6b80b6250 0x7fc6b80b66e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:41.003 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.993+0000 7fc6bf457700 1 --2- 172.21.15.92:0/1360139965 >> v2:172.21.15.188:3300/0 conn(0x7fc6b815d490 0x7fc6b806b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:41.003 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.993+0000 7fc6bf457700 1 -- 172.21.15.92:0/1360139965 >> 172.21.15.92:0/1360139965 conn(0x7fc6b806aac0 msgr2=0x7fc6b806aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:41.003 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.993+0000 7fc6bf457700 1 -- 172.21.15.92:0/1360139965 shutdown_connections 2023-08-26T09:25:41.003 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.993+0000 7fc6bf457700 1 -- 172.21.15.92:0/1360139965 wait complete. 2023-08-26T09:25:41.006 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.995+0000 7fc6bf457700 1 Processor -- start 2023-08-26T09:25:41.006 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.995+0000 7fc6bf457700 1 -- start start 2023-08-26T09:25:41.006 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.995+0000 7fc6bf457700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6b80b1eb0 0x7fc6b80b1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:41.006 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.995+0000 7fc6bf457700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc6b80b6250 0x7fc6b80b3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:41.007 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.995+0000 7fc6bf457700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6b815d490 0x7fc6b80b3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:41.007 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.995+0000 7fc6bf457700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b80b15c0 con 0x7fc6b80b1eb0 2023-08-26T09:25:41.007 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.995+0000 7fc6bf457700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b814dda0 con 0x7fc6b80b6250 2023-08-26T09:25:41.007 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.995+0000 7fc6bf457700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b814cef0 con 0x7fc6b815d490 2023-08-26T09:25:41.007 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.995+0000 7fc6bd1f3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6b80b1eb0 0x7fc6b80b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:41.008 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.996+0000 7fc6bd1f3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6b80b1eb0 0x7fc6b80b1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45372/0 (socket says 172.21.15.92:45372) 2023-08-26T09:25:41.008 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.996+0000 7fc6bd1f3700 1 -- 172.21.15.92:0/1297863908 learned_addr learned my addr 172.21.15.92:0/1297863908 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:41.008 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.996+0000 7fc6bc9f2700 1 --2- 172.21.15.92:0/1297863908 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc6b80b6250 0x7fc6b80b3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:41.008 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.996+0000 7fc6bd9f4700 1 --2- 172.21.15.92:0/1297863908 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6b815d490 0x7fc6b80b3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:41.008 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.996+0000 7fc6bd1f3700 1 -- 172.21.15.92:0/1297863908 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6b815d490 msgr2=0x7fc6b80b3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:41.009 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.996+0000 7fc6bd1f3700 1 --2- 172.21.15.92:0/1297863908 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6b815d490 0x7fc6b80b3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:41.009 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.996+0000 7fc6bd1f3700 1 -- 172.21.15.92:0/1297863908 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc6b80b6250 msgr2=0x7fc6b80b3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:41.009 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.996+0000 7fc6bd1f3700 1 --2- 172.21.15.92:0/1297863908 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc6b80b6250 0x7fc6b80b3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:41.009 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.996+0000 7fc6bd1f3700 1 -- 172.21.15.92:0/1297863908 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b0009b30 con 0x7fc6b80b1eb0 2023-08-26T09:25:41.010 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.996+0000 7fc6bd9f4700 1 --2- 172.21.15.92:0/1297863908 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6b815d490 0x7fc6b80b3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:41.010 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.996+0000 7fc6bd1f3700 1 --2- 172.21.15.92:0/1297863908 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6b80b1eb0 0x7fc6b80b1080 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc6a800e810 tx=0x7fc6a800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:41.010 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.996+0000 7fc6adffb700 1 -- 172.21.15.92:0/1297863908 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a8013610 con 0x7fc6b80b1eb0 2023-08-26T09:25:41.010 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.996+0000 7fc6adffb700 1 -- 172.21.15.92:0/1297863908 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a8013770 con 0x7fc6b80b1eb0 2023-08-26T09:25:41.010 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.996+0000 7fc6bf457700 1 -- 172.21.15.92:0/1297863908 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6b814d190 con 0x7fc6b80b1eb0 2023-08-26T09:25:41.011 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.996+0000 7fc6adffb700 1 -- 172.21.15.92:0/1297863908 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a8013b20 con 0x7fc6b80b1eb0 2023-08-26T09:25:41.011 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.996+0000 7fc6bf457700 1 -- 172.21.15.92:0/1297863908 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6b814d750 con 0x7fc6b80b1eb0 2023-08-26T09:25:41.011 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.997+0000 7fc6bf457700 1 -- 172.21.15.92:0/1297863908 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6b804eeb0 con 0x7fc6b80b1eb0 2023-08-26T09:25:41.011 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.998+0000 7fc6adffb700 1 -- 172.21.15.92:0/1297863908 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc6a8013c80 con 0x7fc6b80b1eb0 2023-08-26T09:25:41.011 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.998+0000 7fc6adffb700 1 --2- 172.21.15.92:0/1297863908 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fc69c06a0e0 0x7fc69c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:41.012 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.998+0000 7fc6adffb700 1 -- 172.21.15.92:0/1297863908 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc6a8088170 con 0x7fc6b80b1eb0 2023-08-26T09:25:41.012 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.998+0000 7fc6bc9f2700 1 --2- 172.21.15.92:0/1297863908 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fc69c06a0e0 0x7fc69c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:41.012 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:40.999+0000 7fc6bc9f2700 1 --2- 172.21.15.92:0/1297863908 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fc69c06a0e0 0x7fc69c06c5a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc6b4007fd0 tx=0x7fc6b4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:41.012 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.002+0000 7fc6adffb700 1 -- 172.21.15.92:0/1297863908 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc6a8057300 con 0x7fc6b80b1eb0 2023-08-26T09:25:41.202 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.197+0000 7fc6bf457700 1 -- 172.21.15.92:0/1297863908 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc6b80b83e0 con 0x7fc6b80b1eb0 2023-08-26T09:25:41.202 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.197+0000 7fc6adffb700 1 -- 172.21.15.92:0/1297863908 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc6a8056e90 con 0x7fc6b80b1eb0 2023-08-26T09:25:41.202 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 8 2023-08-26T09:25:41.204 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.199+0000 7fc6bf457700 1 -- 172.21.15.92:0/1297863908 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fc69c06a0e0 msgr2=0x7fc69c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:41.204 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.199+0000 7fc6bf457700 1 --2- 172.21.15.92:0/1297863908 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fc69c06a0e0 0x7fc69c06c5a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc6b4007fd0 tx=0x7fc6b4009040 comp rx=0 tx=0).stop 2023-08-26T09:25:41.205 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.199+0000 7fc6bf457700 1 -- 172.21.15.92:0/1297863908 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6b80b1eb0 msgr2=0x7fc6b80b1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:41.205 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.199+0000 7fc6bf457700 1 --2- 172.21.15.92:0/1297863908 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6b80b1eb0 0x7fc6b80b1080 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc6a800e810 tx=0x7fc6a800eb20 comp rx=0 tx=0).stop 2023-08-26T09:25:41.205 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.199+0000 7fc6bf457700 1 -- 172.21.15.92:0/1297863908 shutdown_connections 2023-08-26T09:25:41.205 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.199+0000 7fc6bf457700 1 --2- 172.21.15.92:0/1297863908 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6b815d490 0x7fc6b80b3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:41.205 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.199+0000 7fc6bf457700 1 --2- 172.21.15.92:0/1297863908 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6b80b1eb0 0x7fc6b80b1080 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:41.206 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.199+0000 7fc6bf457700 1 --2- 172.21.15.92:0/1297863908 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fc69c06a0e0 0x7fc69c06c5a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:41.206 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.199+0000 7fc6bf457700 1 --2- 172.21.15.92:0/1297863908 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc6b80b6250 0x7fc6b80b3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:41.206 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.199+0000 7fc6bf457700 1 -- 172.21.15.92:0/1297863908 >> 172.21.15.92:0/1297863908 conn(0x7fc6b806aac0 msgr2=0x7fc6b80ce040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:41.206 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.199+0000 7fc6bf457700 1 -- 172.21.15.92:0/1297863908 shutdown_connections 2023-08-26T09:25:41.206 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.199+0000 7fc6bf457700 1 -- 172.21.15.92:0/1297863908 wait complete. 2023-08-26T09:25:41.216 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-26T09:25:41.341 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.336+0000 7f493e626700 1 Processor -- start 2023-08-26T09:25:41.342 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.336+0000 7f493e626700 1 -- start start 2023-08-26T09:25:41.344 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.337+0000 7f493e626700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f4938144ae0 0x7f49380c6500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:41.344 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.337+0000 7f493e626700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f49380c4c10 0x7f493806a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:41.344 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.337+0000 7f493e626700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f493806b1a0 con 0x7f493806a860 2023-08-26T09:25:41.344 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.337+0000 7f493e626700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f493806ad10 con 0x7f49380c4c10 2023-08-26T09:25:41.344 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.337+0000 7f493e626700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4938144ec0 con 0x7f4938144ae0 2023-08-26T09:25:41.345 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.337+0000 7f49377fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f49380c4c10 0x7f493806a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:41.346 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.337+0000 7f49377fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f49380c4c10 0x7f493806a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45380/0 (socket says 172.21.15.92:45380) 2023-08-26T09:25:41.346 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.337+0000 7f49377fe700 1 -- 172.21.15.92:0/2422503039 learned_addr learned my addr 172.21.15.92:0/2422503039 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:41.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.337+0000 7f49377fe700 1 -- 172.21.15.92:0/2422503039 >> v2:172.21.15.188:3300/0 conn(0x7f4938144ae0 msgr2=0x7f49380c6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:41.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.337+0000 7f49377fe700 1 --2- 172.21.15.92:0/2422503039 >> v2:172.21.15.188:3300/0 conn(0x7f4938144ae0 0x7f49380c6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:41.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.337+0000 7f49377fe700 1 -- 172.21.15.92:0/2422503039 >> v1:172.21.15.188:6789/0 conn(0x7f493806a860 legacy=0x7f4938070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:41.348 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.338+0000 7f49377fe700 1 -- 172.21.15.92:0/2422503039 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f493806ea00 con 0x7f49380c4c10 2023-08-26T09:25:41.348 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.338+0000 7f49377fe700 1 --2- 172.21.15.92:0/2422503039 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49380c4c10 0x7f493806a320 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4938067d70 tx=0x7f4928009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92d3d998d9989361 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:41.348 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.338+0000 7f4936ffd700 1 -- 172.21.15.92:0/2422503039 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4928004230 con 0x7f49380c4c10 2023-08-26T09:25:41.348 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.338+0000 7f4936ffd700 1 -- 172.21.15.92:0/2422503039 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4928004390 con 0x7f49380c4c10 2023-08-26T09:25:41.348 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.338+0000 7f4936ffd700 1 -- 172.21.15.92:0/2422503039 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49280036a0 con 0x7f49380c4c10 2023-08-26T09:25:41.349 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.338+0000 7f493e626700 1 -- 172.21.15.92:0/2422503039 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49380c4c10 msgr2=0x7f493806a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:41.349 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.338+0000 7f493e626700 1 --2- 172.21.15.92:0/2422503039 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49380c4c10 0x7f493806a320 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4938067d70 tx=0x7f4928009bd0 comp rx=0 tx=0).stop 2023-08-26T09:25:41.349 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.338+0000 7f493e626700 1 -- 172.21.15.92:0/2422503039 shutdown_connections 2023-08-26T09:25:41.349 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.338+0000 7f493e626700 1 --2- 172.21.15.92:0/2422503039 >> v2:172.21.15.188:3300/0 conn(0x7f4938144ae0 0x7f49380c6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:41.350 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.338+0000 7f493e626700 1 --2- 172.21.15.92:0/2422503039 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49380c4c10 0x7f493806a320 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:41.350 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.338+0000 7f493e626700 1 -- 172.21.15.92:0/2422503039 >> 172.21.15.92:0/2422503039 conn(0x7f493806b430 msgr2=0x7f493806b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:41.350 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.338+0000 7f493e626700 1 -- 172.21.15.92:0/2422503039 shutdown_connections 2023-08-26T09:25:41.350 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.338+0000 7f493e626700 1 -- 172.21.15.92:0/2422503039 wait complete. 2023-08-26T09:25:41.353 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.339+0000 7f493e626700 1 Processor -- start 2023-08-26T09:25:41.353 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.340+0000 7f493e626700 1 -- start start 2023-08-26T09:25:41.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.340+0000 7f493e626700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f493806a860 0x7f49380c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:41.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.340+0000 7f493e626700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49380c4c10 0x7f49380cf440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:41.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.340+0000 7f493e626700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4938144ae0 0x7f49380cd890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:41.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.340+0000 7f493e626700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49380b4e40 con 0x7f49380c4c10 2023-08-26T09:25:41.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.340+0000 7f493e626700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49380c70e0 con 0x7f4938144ae0 2023-08-26T09:25:41.355 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.340+0000 7f493e626700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49380b5090 con 0x7f493806a860 2023-08-26T09:25:41.355 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.341+0000 7f49377fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49380c4c10 0x7f49380cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:41.355 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.341+0000 7f49377fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49380c4c10 0x7f49380cf440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45388/0 (socket says 172.21.15.92:45388) 2023-08-26T09:25:41.355 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.341+0000 7f49377fe700 1 -- 172.21.15.92:0/1553849673 learned_addr learned my addr 172.21.15.92:0/1553849673 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:41.355 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.341+0000 7f493cbc3700 1 --2- 172.21.15.92:0/1553849673 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4938144ae0 0x7f49380cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:41.356 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.341+0000 7f4937fff700 1 --2- 172.21.15.92:0/1553849673 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f493806a860 0x7f49380c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:41.356 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.341+0000 7f49377fe700 1 -- 172.21.15.92:0/1553849673 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f493806a860 msgr2=0x7f49380c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:41.356 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.341+0000 7f49377fe700 1 --2- 172.21.15.92:0/1553849673 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f493806a860 0x7f49380c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:41.356 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.341+0000 7f49377fe700 1 -- 172.21.15.92:0/1553849673 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4938144ae0 msgr2=0x7f49380cd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:41.356 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.341+0000 7f49377fe700 1 --2- 172.21.15.92:0/1553849673 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4938144ae0 0x7f49380cd890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:41.357 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.341+0000 7f49377fe700 1 -- 172.21.15.92:0/1553849673 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4928009550 con 0x7f49380c4c10 2023-08-26T09:25:41.357 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.341+0000 7f493cbc3700 1 --2- 172.21.15.92:0/1553849673 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4938144ae0 0x7f49380cd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:25:41.357 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.341+0000 7f4937fff700 1 --2- 172.21.15.92:0/1553849673 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f493806a860 0x7f49380c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:25:41.357 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.341+0000 7f49377fe700 1 --2- 172.21.15.92:0/1553849673 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49380c4c10 0x7f49380cf440 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4928004000 tx=0x7f4928004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:41.358 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.341+0000 7f4934ff9700 1 -- 172.21.15.92:0/1553849673 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4928003dc0 con 0x7f49380c4c10 2023-08-26T09:25:41.358 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.341+0000 7f4934ff9700 1 -- 172.21.15.92:0/1553849673 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f492801f070 con 0x7f49380c4c10 2023-08-26T09:25:41.358 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.341+0000 7f493e626700 1 -- 172.21.15.92:0/1553849673 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49380b5370 con 0x7f49380c4c10 2023-08-26T09:25:41.358 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.341+0000 7f4934ff9700 1 -- 172.21.15.92:0/1553849673 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4928011870 con 0x7f49380c4c10 2023-08-26T09:25:41.358 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.341+0000 7f493e626700 1 -- 172.21.15.92:0/1553849673 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f493813faf0 con 0x7f49380c4c10 2023-08-26T09:25:41.359 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.342+0000 7f493e626700 1 -- 172.21.15.92:0/1553849673 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49380c9a20 con 0x7f49380c4c10 2023-08-26T09:25:41.359 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.343+0000 7f4934ff9700 1 -- 172.21.15.92:0/1553849673 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4928021030 con 0x7f49380c4c10 2023-08-26T09:25:41.359 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.343+0000 7f4934ff9700 1 --2- 172.21.15.92:0/1553849673 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f491806a0e0 0x7f491806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:41.359 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.343+0000 7f4937fff700 1 --2- 172.21.15.92:0/1553849673 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f491806a0e0 0x7f491806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:41.360 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.343+0000 7f4934ff9700 1 -- 172.21.15.92:0/1553849673 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4928089b20 con 0x7f49380c4c10 2023-08-26T09:25:41.360 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.343+0000 7f4937fff700 1 --2- 172.21.15.92:0/1553849673 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f491806a0e0 0x7f491806c5a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f492000a8f0 tx=0x7f4920008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:41.360 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.347+0000 7f4934ff9700 1 -- 172.21.15.92:0/1553849673 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f49380c9a20 con 0x7f49380c4c10 2023-08-26T09:25:41.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.537+0000 7f493e626700 1 -- 172.21.15.92:0/1553849673 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f49380c9a20 con 0x7f49380c4c10 2023-08-26T09:25:41.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.538+0000 7f4934ff9700 1 -- 172.21.15.92:0/1553849673 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f49380c9a20 con 0x7f49380c4c10 2023-08-26T09:25:41.543 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 1 2023-08-26T09:25:41.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.540+0000 7f493e626700 1 -- 172.21.15.92:0/1553849673 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f491806a0e0 msgr2=0x7f491806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:41.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.540+0000 7f493e626700 1 --2- 172.21.15.92:0/1553849673 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f491806a0e0 0x7f491806c5a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f492000a8f0 tx=0x7f4920008040 comp rx=0 tx=0).stop 2023-08-26T09:25:41.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.540+0000 7f493e626700 1 -- 172.21.15.92:0/1553849673 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49380c4c10 msgr2=0x7f49380cf440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:41.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.540+0000 7f493e626700 1 --2- 172.21.15.92:0/1553849673 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49380c4c10 0x7f49380cf440 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4928004000 tx=0x7f4928004750 comp rx=0 tx=0).stop 2023-08-26T09:25:41.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.540+0000 7f493e626700 1 -- 172.21.15.92:0/1553849673 shutdown_connections 2023-08-26T09:25:41.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.540+0000 7f493e626700 1 --2- 172.21.15.92:0/1553849673 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f491806a0e0 0x7f491806c5a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:41.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.540+0000 7f493e626700 1 --2- 172.21.15.92:0/1553849673 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4938144ae0 0x7f49380cd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:41.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.540+0000 7f493e626700 1 --2- 172.21.15.92:0/1553849673 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f493806a860 0x7f49380c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:41.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.540+0000 7f493e626700 1 --2- 172.21.15.92:0/1553849673 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49380c4c10 0x7f49380cf440 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:41.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.540+0000 7f493e626700 1 -- 172.21.15.92:0/1553849673 >> 172.21.15.92:0/1553849673 conn(0x7f493806b430 msgr2=0x7f493815d910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:41.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.540+0000 7f493e626700 1 -- 172.21.15.92:0/1553849673 shutdown_connections 2023-08-26T09:25:41.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.540+0000 7f493e626700 1 -- 172.21.15.92:0/1553849673 wait complete. 2023-08-26T09:25:41.557 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-26T09:25:41.679 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.674+0000 7fba2799a700 1 Processor -- start 2023-08-26T09:25:41.680 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.674+0000 7fba2799a700 1 -- start start 2023-08-26T09:25:41.682 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.676+0000 7fba2799a700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fba200b2d70 0x7fba2015edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:41.682 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.676+0000 7fba2799a700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fba200cb4a0 0x7fba200cb930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:41.682 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.676+0000 7fba2799a700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba2006de90 con 0x7fba200d0320 2023-08-26T09:25:41.683 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.676+0000 7fba2799a700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba2006eb10 con 0x7fba200cb4a0 2023-08-26T09:25:41.683 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.676+0000 7fba2799a700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba2006e170 con 0x7fba200b2d70 2023-08-26T09:25:41.683 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.676+0000 7fba24f35700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fba200cb4a0 0x7fba200cb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:41.683 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.676+0000 7fba24f35700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fba200cb4a0 0x7fba200cb930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45396/0 (socket says 172.21.15.92:45396) 2023-08-26T09:25:41.684 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.676+0000 7fba24f35700 1 -- 172.21.15.92:0/4090282753 learned_addr learned my addr 172.21.15.92:0/4090282753 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:41.684 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.676+0000 7fba25736700 1 --2- 172.21.15.92:0/4090282753 >> v2:172.21.15.188:3300/0 conn(0x7fba200b2d70 0x7fba2015edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:41.684 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.676+0000 7fba24f35700 1 -- 172.21.15.92:0/4090282753 >> v2:172.21.15.188:3300/0 conn(0x7fba200b2d70 msgr2=0x7fba2015edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:41.684 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.676+0000 7fba24f35700 1 --2- 172.21.15.92:0/4090282753 >> v2:172.21.15.188:3300/0 conn(0x7fba200b2d70 0x7fba2015edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:41.684 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.676+0000 7fba24f35700 1 -- 172.21.15.92:0/4090282753 >> v1:172.21.15.188:6789/0 conn(0x7fba200d0320 legacy=0x7fba2015ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:41.684 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.676+0000 7fba24f35700 1 -- 172.21.15.92:0/4090282753 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba2006e450 con 0x7fba200cb4a0 2023-08-26T09:25:41.685 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.676+0000 7fba24f35700 1 --2- 172.21.15.92:0/4090282753 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba200cb4a0 0x7fba200cb930 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fba200b3520 tx=0x7fba1c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf93d00d0433de1b server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:41.685 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.676+0000 7fba17fff700 1 -- 172.21.15.92:0/4090282753 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1c00b870 con 0x7fba200cb4a0 2023-08-26T09:25:41.685 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.676+0000 7fba17fff700 1 -- 172.21.15.92:0/4090282753 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba1c00b9d0 con 0x7fba200cb4a0 2023-08-26T09:25:41.685 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.676+0000 7fba17fff700 1 -- 172.21.15.92:0/4090282753 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1c00bd60 con 0x7fba200cb4a0 2023-08-26T09:25:41.686 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.677+0000 7fba2799a700 1 -- 172.21.15.92:0/4090282753 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba200cb4a0 msgr2=0x7fba200cb930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:41.686 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.677+0000 7fba2799a700 1 --2- 172.21.15.92:0/4090282753 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba200cb4a0 0x7fba200cb930 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fba200b3520 tx=0x7fba1c009bd0 comp rx=0 tx=0).stop 2023-08-26T09:25:41.686 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.677+0000 7fba2799a700 1 -- 172.21.15.92:0/4090282753 shutdown_connections 2023-08-26T09:25:41.686 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.677+0000 7fba2799a700 1 --2- 172.21.15.92:0/4090282753 >> v2:172.21.15.188:3300/0 conn(0x7fba200b2d70 0x7fba2015edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:41.686 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.677+0000 7fba2799a700 1 --2- 172.21.15.92:0/4090282753 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba200cb4a0 0x7fba200cb930 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:41.686 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.677+0000 7fba2799a700 1 -- 172.21.15.92:0/4090282753 >> 172.21.15.92:0/4090282753 conn(0x7fba200cd8d0 msgr2=0x7fba200cdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:41.687 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.677+0000 7fba2799a700 1 -- 172.21.15.92:0/4090282753 shutdown_connections 2023-08-26T09:25:41.687 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.677+0000 7fba2799a700 1 -- 172.21.15.92:0/4090282753 wait complete. 2023-08-26T09:25:41.689 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.678+0000 7fba2799a700 1 Processor -- start 2023-08-26T09:25:41.690 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.678+0000 7fba2799a700 1 -- start start 2023-08-26T09:25:41.690 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.679+0000 7fba2799a700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fba200b2d70 0x7fba2006b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:41.690 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.679+0000 7fba2799a700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fba200cb4a0 0x7fba201517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:41.690 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.679+0000 7fba2799a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba200d0320 0x7fba200c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:41.690 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.679+0000 7fba2799a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba20152140 con 0x7fba200d0320 2023-08-26T09:25:41.691 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.679+0000 7fba2799a700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba20151d10 con 0x7fba200cb4a0 2023-08-26T09:25:41.691 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.679+0000 7fba2799a700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba200ca940 con 0x7fba200b2d70 2023-08-26T09:25:41.691 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.679+0000 7fba25f37700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba200d0320 0x7fba200c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:41.691 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.679+0000 7fba25f37700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba200d0320 0x7fba200c9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45404/0 (socket says 172.21.15.92:45404) 2023-08-26T09:25:41.691 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.679+0000 7fba25f37700 1 -- 172.21.15.92:0/820529127 learned_addr learned my addr 172.21.15.92:0/820529127 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:41.692 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.679+0000 7fba24f35700 1 --2- 172.21.15.92:0/820529127 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fba200cb4a0 0x7fba201517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:41.692 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.679+0000 7fba25736700 1 --2- 172.21.15.92:0/820529127 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fba200b2d70 0x7fba2006b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:41.692 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.679+0000 7fba25f37700 1 -- 172.21.15.92:0/820529127 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fba200b2d70 msgr2=0x7fba2006b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:41.692 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.679+0000 7fba25f37700 1 --2- 172.21.15.92:0/820529127 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fba200b2d70 0x7fba2006b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:41.692 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.679+0000 7fba25f37700 1 -- 172.21.15.92:0/820529127 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fba200cb4a0 msgr2=0x7fba201517d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:41.693 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.679+0000 7fba25f37700 1 --2- 172.21.15.92:0/820529127 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fba200cb4a0 0x7fba201517d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:41.693 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.679+0000 7fba25f37700 1 -- 172.21.15.92:0/820529127 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba1c009550 con 0x7fba200d0320 2023-08-26T09:25:41.693 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.679+0000 7fba25f37700 1 --2- 172.21.15.92:0/820529127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba200d0320 0x7fba200c9ed0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fba1800cb50 tx=0x7fba1800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:41.693 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.679+0000 7fba15ffb700 1 -- 172.21.15.92:0/820529127 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba18003c00 con 0x7fba200d0320 2023-08-26T09:25:41.693 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.680+0000 7fba15ffb700 1 -- 172.21.15.92:0/820529127 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba18003d60 con 0x7fba200d0320 2023-08-26T09:25:41.694 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.680+0000 7fba2799a700 1 -- 172.21.15.92:0/820529127 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba200cac20 con 0x7fba200d0320 2023-08-26T09:25:41.694 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.680+0000 7fba15ffb700 1 -- 172.21.15.92:0/820529127 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1800aa20 con 0x7fba200d0320 2023-08-26T09:25:41.694 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.680+0000 7fba2799a700 1 -- 172.21.15.92:0/820529127 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba200b65b0 con 0x7fba200d0320 2023-08-26T09:25:41.694 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.681+0000 7fba2799a700 1 -- 172.21.15.92:0/820529127 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba200cb140 con 0x7fba200d0320 2023-08-26T09:25:41.694 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.681+0000 7fba15ffb700 1 -- 172.21.15.92:0/820529127 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fba1800ab80 con 0x7fba200d0320 2023-08-26T09:25:41.695 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.681+0000 7fba15ffb700 1 --2- 172.21.15.92:0/820529127 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fba0406a0e0 0x7fba0406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:41.695 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.681+0000 7fba15ffb700 1 -- 172.21.15.92:0/820529127 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fba18088570 con 0x7fba200d0320 2023-08-26T09:25:41.695 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.681+0000 7fba25736700 1 --2- 172.21.15.92:0/820529127 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fba0406a0e0 0x7fba0406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:41.695 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.682+0000 7fba25736700 1 --2- 172.21.15.92:0/820529127 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fba0406a0e0 0x7fba0406c5a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fba100099d0 tx=0x7fba10008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:41.696 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.686+0000 7fba15ffb700 1 -- 172.21.15.92:0/820529127 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fba200cb140 con 0x7fba200d0320 2023-08-26T09:25:41.879 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.874+0000 7fba2799a700 1 -- 172.21.15.92:0/820529127 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fba20151ea0 con 0x7fba200d0320 2023-08-26T09:25:41.880 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.875+0000 7fba15ffb700 1 -- 172.21.15.92:0/820529127 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fba20151ea0 con 0x7fba200d0320 2023-08-26T09:25:41.880 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 32 2023-08-26T09:25:41.882 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.877+0000 7fba2799a700 1 -- 172.21.15.92:0/820529127 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fba0406a0e0 msgr2=0x7fba0406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:41.882 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.877+0000 7fba2799a700 1 --2- 172.21.15.92:0/820529127 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fba0406a0e0 0x7fba0406c5a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fba100099d0 tx=0x7fba10008040 comp rx=0 tx=0).stop 2023-08-26T09:25:41.882 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.877+0000 7fba2799a700 1 -- 172.21.15.92:0/820529127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba200d0320 msgr2=0x7fba200c9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:41.883 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.877+0000 7fba2799a700 1 --2- 172.21.15.92:0/820529127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba200d0320 0x7fba200c9ed0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fba1800cb50 tx=0x7fba1800ce60 comp rx=0 tx=0).stop 2023-08-26T09:25:41.883 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.877+0000 7fba2799a700 1 -- 172.21.15.92:0/820529127 shutdown_connections 2023-08-26T09:25:41.883 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.877+0000 7fba2799a700 1 --2- 172.21.15.92:0/820529127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba200d0320 0x7fba200c9ed0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:41.883 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.877+0000 7fba2799a700 1 --2- 172.21.15.92:0/820529127 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fba200b2d70 0x7fba2006b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:41.883 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.877+0000 7fba2799a700 1 --2- 172.21.15.92:0/820529127 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fba0406a0e0 0x7fba0406c5a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:41.884 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.877+0000 7fba2799a700 1 --2- 172.21.15.92:0/820529127 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fba200cb4a0 0x7fba201517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:41.884 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.877+0000 7fba2799a700 1 -- 172.21.15.92:0/820529127 >> 172.21.15.92:0/820529127 conn(0x7fba200cd8d0 msgr2=0x7fba2015bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:41.884 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.877+0000 7fba2799a700 1 -- 172.21.15.92:0/820529127 shutdown_connections 2023-08-26T09:25:41.884 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:41.877+0000 7fba2799a700 1 -- 172.21.15.92:0/820529127 wait complete. 2023-08-26T09:25:41.894 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-26T09:25:42.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.012+0000 7faab1f62700 1 Processor -- start 2023-08-26T09:25:42.024 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.012+0000 7faab1f62700 1 -- start start 2023-08-26T09:25:42.024 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.013+0000 7faab1f62700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faaac159dd0 0x7faaac0cf220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:42.024 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.013+0000 7faab1f62700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7faaac071430 0x7faaac06e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:42.024 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.013+0000 7faab1f62700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaac06eab0 con 0x7faaac06e110 2023-08-26T09:25:42.025 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.013+0000 7faab1f62700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaac0c6200 con 0x7faaac071430 2023-08-26T09:25:42.025 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.013+0000 7faab1f62700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaac0ce740 con 0x7faaac159dd0 2023-08-26T09:25:42.025 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.013+0000 7faaabfff700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7faaac071430 0x7faaac06e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:42.025 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.013+0000 7faaab7fe700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faaac159dd0 0x7faaac0cf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:42.025 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.013+0000 7faaab7fe700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faaac159dd0 0x7faaac0cf220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.92:44072/0 (socket says 172.21.15.92:44072) 2023-08-26T09:25:42.026 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.013+0000 7faaaaffd700 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7faaac06e110 0x7faaac070d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.92:52534/0 (socket says 172.21.15.92:52534) 2023-08-26T09:25:42.026 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.013+0000 7faaabfff700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7faaac071430 0x7faaac06e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.92:34220/0 (socket says 172.21.15.92:34220) 2023-08-26T09:25:42.026 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.013+0000 7faaab7fe700 1 -- 172.21.15.92:0/756753080 learned_addr learned my addr 172.21.15.92:0/756753080 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:42.026 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.013+0000 7faaab7fe700 1 -- 172.21.15.92:0/756753080 >> v2:172.21.15.188:3300/0 conn(0x7faaac071430 msgr2=0x7faaac06e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:42.026 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.013+0000 7faaab7fe700 1 --2- 172.21.15.92:0/756753080 >> v2:172.21.15.188:3300/0 conn(0x7faaac071430 0x7faaac06e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:42.027 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.013+0000 7faaab7fe700 1 -- 172.21.15.92:0/756753080 >> v1:172.21.15.188:6789/0 conn(0x7faaac06e110 legacy=0x7faaac070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:42.027 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.013+0000 7faaab7fe700 1 -- 172.21.15.92:0/756753080 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaac0cea20 con 0x7faaac159dd0 2023-08-26T09:25:42.027 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.014+0000 7faaab7fe700 1 --2- 172.21.15.92:0/756753080 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faaac159dd0 0x7faaac0cf220 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7faaa00098f0 tx=0x7faaa0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d93159df094486bc server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:42.027 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.014+0000 7faaaa7fc700 1 -- 172.21.15.92:0/756753080 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa0011830 con 0x7faaac159dd0 2023-08-26T09:25:42.027 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.014+0000 7faaaa7fc700 1 -- 172.21.15.92:0/756753080 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaa0011990 con 0x7faaac159dd0 2023-08-26T09:25:42.027 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.014+0000 7faaaa7fc700 1 -- 172.21.15.92:0/756753080 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa0011d20 con 0x7faaac159dd0 2023-08-26T09:25:42.028 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.014+0000 7faab1f62700 1 -- 172.21.15.92:0/756753080 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faaac159dd0 msgr2=0x7faaac0cf220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:42.028 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.014+0000 7faab1f62700 1 --2- 172.21.15.92:0/756753080 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faaac159dd0 0x7faaac0cf220 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7faaa00098f0 tx=0x7faaa0009c00 comp rx=0 tx=0).stop 2023-08-26T09:25:42.028 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.014+0000 7faab1f62700 1 -- 172.21.15.92:0/756753080 shutdown_connections 2023-08-26T09:25:42.028 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.014+0000 7faab1f62700 1 --2- 172.21.15.92:0/756753080 >> v2:172.21.15.188:3300/0 conn(0x7faaac071430 0x7faaac06e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:42.028 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.014+0000 7faab1f62700 1 --2- 172.21.15.92:0/756753080 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faaac159dd0 0x7faaac0cf220 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:42.029 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.014+0000 7faab1f62700 1 -- 172.21.15.92:0/756753080 >> 172.21.15.92:0/756753080 conn(0x7faaac06b430 msgr2=0x7faaac06b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:42.029 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.014+0000 7faab1f62700 1 -- 172.21.15.92:0/756753080 shutdown_connections 2023-08-26T09:25:42.029 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.014+0000 7faab1f62700 1 -- 172.21.15.92:0/756753080 wait complete. 2023-08-26T09:25:42.029 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.016+0000 7faab1f62700 1 Processor -- start 2023-08-26T09:25:42.029 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.016+0000 7faab1f62700 1 -- start start 2023-08-26T09:25:42.030 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.017+0000 7faab1f62700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faaac06e110 0x7faaac147dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:42.030 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.017+0000 7faab1f62700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faaac071430 0x7faaac14f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:42.030 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.017+0000 7faab1f62700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faaac159dd0 0x7faaac14f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:42.030 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.017+0000 7faab1f62700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaac1485e0 con 0x7faaac071430 2023-08-26T09:25:42.030 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.017+0000 7faab1f62700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaac14c6c0 con 0x7faaac159dd0 2023-08-26T09:25:42.030 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.017+0000 7faab1f62700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaac148830 con 0x7faaac06e110 2023-08-26T09:25:42.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.017+0000 7faaaaffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faaac071430 0x7faaac14f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:42.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.017+0000 7faaaaffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faaac071430 0x7faaac14f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45418/0 (socket says 172.21.15.92:45418) 2023-08-26T09:25:42.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.017+0000 7faaaaffd700 1 -- 172.21.15.92:0/696371209 learned_addr learned my addr 172.21.15.92:0/696371209 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:42.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.017+0000 7faaab7fe700 1 --2- 172.21.15.92:0/696371209 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faaac06e110 0x7faaac147dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:42.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.017+0000 7faaabfff700 1 --2- 172.21.15.92:0/696371209 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faaac159dd0 0x7faaac14f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:42.032 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.017+0000 7faaaaffd700 1 -- 172.21.15.92:0/696371209 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faaac06e110 msgr2=0x7faaac147dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:42.032 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.017+0000 7faaaaffd700 1 --2- 172.21.15.92:0/696371209 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faaac06e110 0x7faaac147dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:42.032 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.017+0000 7faaaaffd700 1 -- 172.21.15.92:0/696371209 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faaac159dd0 msgr2=0x7faaac14f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:42.032 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.017+0000 7faaaaffd700 1 --2- 172.21.15.92:0/696371209 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faaac159dd0 0x7faaac14f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:42.032 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.017+0000 7faaaaffd700 1 -- 172.21.15.92:0/696371209 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa0009550 con 0x7faaac071430 2023-08-26T09:25:42.032 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.018+0000 7faaabfff700 1 --2- 172.21.15.92:0/696371209 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faaac159dd0 0x7faaac14f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:25:42.033 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.018+0000 7faaaaffd700 1 --2- 172.21.15.92:0/696371209 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faaac071430 0x7faaac14f230 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7faa9c00c500 tx=0x7faa9c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:42.033 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.018+0000 7faa93fff700 1 -- 172.21.15.92:0/696371209 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9c005cb0 con 0x7faaac071430 2023-08-26T09:25:42.033 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.018+0000 7faa93fff700 1 -- 172.21.15.92:0/696371209 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa9c005e10 con 0x7faaac071430 2023-08-26T09:25:42.033 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.018+0000 7faab1f62700 1 -- 172.21.15.92:0/696371209 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaac15a1b0 con 0x7faaac071430 2023-08-26T09:25:42.033 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.018+0000 7faa93fff700 1 -- 172.21.15.92:0/696371209 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9c0072d0 con 0x7faaac071430 2023-08-26T09:25:42.034 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.018+0000 7faab1f62700 1 -- 172.21.15.92:0/696371209 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaac15a770 con 0x7faaac071430 2023-08-26T09:25:42.034 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.019+0000 7faab1f62700 1 -- 172.21.15.92:0/696371209 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaac04eeb0 con 0x7faaac071430 2023-08-26T09:25:42.035 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.019+0000 7faa93fff700 1 -- 172.21.15.92:0/696371209 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7faa9c007430 con 0x7faaac071430 2023-08-26T09:25:42.035 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.020+0000 7faa93fff700 1 --2- 172.21.15.92:0/696371209 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7faa9806a110 0x7faa9806c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:42.035 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.020+0000 7faa93fff700 1 -- 172.21.15.92:0/696371209 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faa9c087880 con 0x7faaac071430 2023-08-26T09:25:42.035 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.020+0000 7faaab7fe700 1 --2- 172.21.15.92:0/696371209 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7faa9806a110 0x7faa9806c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:42.036 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.020+0000 7faaab7fe700 1 --2- 172.21.15.92:0/696371209 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7faa9806a110 0x7faa9806c5d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7faaa0009c40 tx=0x7faaa0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:42.036 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.024+0000 7faa93fff700 1 -- 172.21.15.92:0/696371209 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7faa9c053020 con 0x7faaac071430 2023-08-26T09:25:42.218 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.213+0000 7faab1f62700 1 -- 172.21.15.92:0/696371209 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faaac06c290 con 0x7faaac071430 2023-08-26T09:25:42.219 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.214+0000 7faa93fff700 1 -- 172.21.15.92:0/696371209 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7faa9c056640 con 0x7faaac071430 2023-08-26T09:25:42.219 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 64 2023-08-26T09:25:42.221 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.216+0000 7faab1f62700 1 -- 172.21.15.92:0/696371209 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7faa9806a110 msgr2=0x7faa9806c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:42.221 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.216+0000 7faab1f62700 1 --2- 172.21.15.92:0/696371209 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7faa9806a110 0x7faa9806c5d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7faaa0009c40 tx=0x7faaa0008030 comp rx=0 tx=0).stop 2023-08-26T09:25:42.222 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.216+0000 7faab1f62700 1 -- 172.21.15.92:0/696371209 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faaac071430 msgr2=0x7faaac14f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:42.222 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.216+0000 7faab1f62700 1 --2- 172.21.15.92:0/696371209 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faaac071430 0x7faaac14f230 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7faa9c00c500 tx=0x7faa9c00c8c0 comp rx=0 tx=0).stop 2023-08-26T09:25:42.222 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.216+0000 7faab1f62700 1 -- 172.21.15.92:0/696371209 shutdown_connections 2023-08-26T09:25:42.222 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.216+0000 7faab1f62700 1 --2- 172.21.15.92:0/696371209 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7faa9806a110 0x7faa9806c5d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:42.222 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.216+0000 7faab1f62700 1 --2- 172.21.15.92:0/696371209 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faaac159dd0 0x7faaac14f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:42.223 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.216+0000 7faab1f62700 1 --2- 172.21.15.92:0/696371209 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faaac06e110 0x7faaac147dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:42.224 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.216+0000 7faab1f62700 1 --2- 172.21.15.92:0/696371209 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faaac071430 0x7faaac14f230 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:42.224 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.216+0000 7faab1f62700 1 -- 172.21.15.92:0/696371209 >> 172.21.15.92:0/696371209 conn(0x7faaac06b430 msgr2=0x7faaac0cbd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:42.224 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.216+0000 7faab1f62700 1 -- 172.21.15.92:0/696371209 shutdown_connections 2023-08-26T09:25:42.224 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.216+0000 7faab1f62700 1 -- 172.21.15.92:0/696371209 wait complete. 2023-08-26T09:25:42.233 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-26T09:25:42.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.349+0000 7f03a01f6700 1 Processor -- start 2023-08-26T09:25:42.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.349+0000 7f03a01f6700 1 -- start start 2023-08-26T09:25:42.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.350+0000 7f03a01f6700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f03980d1a60 0x7f03980c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:42.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.350+0000 7f03a01f6700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f039815eae0 0x7f03980cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:42.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.350+0000 7f03a01f6700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03980cbb50 con 0x7f03980cd8e0 2023-08-26T09:25:42.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.350+0000 7f03a01f6700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03980cffb0 con 0x7f03980d1a60 2023-08-26T09:25:42.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.350+0000 7f03a01f6700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03980cbe10 con 0x7f039815eae0 2023-08-26T09:25:42.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.350+0000 7f039df92700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f03980cd8e0 0x7f039815e3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:57436/0 (socket says 172.21.15.92:57436) 2023-08-26T09:25:42.370 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.350+0000 7f039df92700 1 -- 172.21.15.92:0/26152681 learned_addr learned my addr 172.21.15.92:0/26152681 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:42.370 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.350+0000 7f039cf90700 1 -- 172.21.15.92:0/26152681 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2741608067 0 0) 0x7f03980cbb50 con 0x7f03980cd8e0 2023-08-26T09:25:42.370 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.350+0000 7f039cf90700 1 -- 172.21.15.92:0/26152681 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03840035b0 con 0x7f03980cd8e0 2023-08-26T09:25:42.371 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.350+0000 7f039e793700 1 --2- 172.21.15.92:0/26152681 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f039815eae0 0x7f03980cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:42.371 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.350+0000 7f039d791700 1 --2- 172.21.15.92:0/26152681 >> v2:172.21.15.188:3300/0 conn(0x7f03980d1a60 0x7f03980c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:42.371 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.350+0000 7f039cf90700 1 -- 172.21.15.92:0/26152681 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1019649242 0 0) 0x7f03840035b0 con 0x7f03980cd8e0 2023-08-26T09:25:42.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.350+0000 7f039cf90700 1 -- 172.21.15.92:0/26152681 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f039815eae0 msgr2=0x7f03980cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:42.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.350+0000 7f039cf90700 1 --2- 172.21.15.92:0/26152681 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f039815eae0 0x7f03980cc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:42.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.350+0000 7f039cf90700 1 -- 172.21.15.92:0/26152681 >> v2:172.21.15.188:3300/0 conn(0x7f03980d1a60 msgr2=0x7f03980c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:42.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.350+0000 7f039cf90700 1 --2- 172.21.15.92:0/26152681 >> v2:172.21.15.188:3300/0 conn(0x7f03980d1a60 0x7f03980c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:42.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.350+0000 7f039cf90700 1 -- 172.21.15.92:0/26152681 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03980cf730 con 0x7f03980cd8e0 2023-08-26T09:25:42.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.350+0000 7f039cf90700 1 -- 172.21.15.92:0/26152681 <== mon.0 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1019361464 0 0) 0x7f03940017f0 con 0x7f03980cd8e0 2023-08-26T09:25:42.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.350+0000 7f039cf90700 1 -- 172.21.15.92:0/26152681 >> v1:172.21.15.92:6789/0 conn(0x7f03980cd8e0 legacy=0x7f039815e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:42.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.350+0000 7f039cf90700 1 --2- 172.21.15.92:0/26152681 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f039815eae0 0x7f0384003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:42.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.351+0000 7f039cf90700 1 --2- 172.21.15.92:0/26152681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0384003f80 0x7f0384004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:42.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.351+0000 7f039cf90700 1 --2- 172.21.15.92:0/26152681 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0384004d90 0x7f0384005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:42.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.351+0000 7f039cf90700 1 -- 172.21.15.92:0/26152681 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03980cffb0 con 0x7f0384003f80 2023-08-26T09:25:42.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.351+0000 7f039cf90700 1 -- 172.21.15.92:0/26152681 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03980cbe10 con 0x7f0384004d90 2023-08-26T09:25:42.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.351+0000 7f039cf90700 1 -- 172.21.15.92:0/26152681 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f038400ba10 con 0x7f039815eae0 2023-08-26T09:25:42.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.351+0000 7f039d791700 1 --2- 172.21.15.92:0/26152681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0384003f80 0x7f0384004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:42.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.351+0000 7f039df92700 1 --2- 172.21.15.92:0/26152681 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f039815eae0 0x7f0384003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:42.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.351+0000 7f039e793700 1 --2- 172.21.15.92:0/26152681 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0384004d90 0x7f0384005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:42.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.351+0000 7f039d791700 1 -- 172.21.15.92:0/26152681 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f039815eae0 msgr2=0x7f0384003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:42.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.351+0000 7f039d791700 1 --2- 172.21.15.92:0/26152681 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f039815eae0 0x7f0384003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:42.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.351+0000 7f039d791700 1 -- 172.21.15.92:0/26152681 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0384004d90 msgr2=0x7f0384005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:42.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.351+0000 7f039d791700 1 --2- 172.21.15.92:0/26152681 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0384004d90 0x7f0384005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:42.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.351+0000 7f039d791700 1 -- 172.21.15.92:0/26152681 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03840035b0 con 0x7f0384003f80 2023-08-26T09:25:42.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.351+0000 7f039df92700 1 --2- 172.21.15.92:0/26152681 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f039815eae0 0x7f0384003a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:42.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.351+0000 7f039d791700 1 --2- 172.21.15.92:0/26152681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0384003f80 0x7f0384004850 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0388009b60 tx=0x7f0384005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dafdaec31ddc4f9 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:42.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.351+0000 7f039cf90700 1 -- 172.21.15.92:0/26152681 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038800e660 con 0x7f0384003f80 2023-08-26T09:25:42.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.351+0000 7f039cf90700 1 -- 172.21.15.92:0/26152681 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f038800e7c0 con 0x7f0384003f80 2023-08-26T09:25:42.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.351+0000 7f039cf90700 1 -- 172.21.15.92:0/26152681 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038800eb30 con 0x7f0384003f80 2023-08-26T09:25:42.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.352+0000 7f03a01f6700 1 -- 172.21.15.92:0/26152681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0384003f80 msgr2=0x7f0384004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:42.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.352+0000 7f03a01f6700 1 --2- 172.21.15.92:0/26152681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0384003f80 0x7f0384004850 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0388009b60 tx=0x7f0384005880 comp rx=0 tx=0).stop 2023-08-26T09:25:42.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.352+0000 7f039e793700 1 -- 172.21.15.92:0/26152681 reap_dead start 2023-08-26T09:25:42.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.352+0000 7f03a01f6700 1 -- 172.21.15.92:0/26152681 shutdown_connections 2023-08-26T09:25:42.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.352+0000 7f03a01f6700 1 -- 172.21.15.92:0/26152681 >> 172.21.15.92:0/26152681 conn(0x7f03980d0f40 msgr2=0x7f03980d1350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:42.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.352+0000 7f03a01f6700 1 -- 172.21.15.92:0/26152681 shutdown_connections 2023-08-26T09:25:42.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.352+0000 7f03a01f6700 1 -- 172.21.15.92:0/26152681 wait complete. 2023-08-26T09:25:42.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.353+0000 7f03a01f6700 1 Processor -- start 2023-08-26T09:25:42.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.353+0000 7f03a01f6700 1 -- start start 2023-08-26T09:25:42.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.354+0000 7f03a01f6700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0384003f80 0x7f03980b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:42.385 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.354+0000 7f03a01f6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03980b11e0 0x7f039806f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:42.385 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.354+0000 7f03a01f6700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f039806f800 0x7f039809bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:42.385 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.354+0000 7f03a01f6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039806fc80 con 0x7f03980b11e0 2023-08-26T09:25:42.386 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.354+0000 7f03a01f6700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039809e090 con 0x7f0384003f80 2023-08-26T09:25:42.386 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.354+0000 7f03a01f6700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f039809e370 con 0x7f039806f800 2023-08-26T09:25:42.386 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.354+0000 7f039d791700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03980b11e0 0x7f039806f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:42.387 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.354+0000 7f039d791700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03980b11e0 0x7f039806f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45436/0 (socket says 172.21.15.92:45436) 2023-08-26T09:25:42.387 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.354+0000 7f039d791700 1 -- 172.21.15.92:0/2475664308 learned_addr learned my addr 172.21.15.92:0/2475664308 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:42.387 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.354+0000 7f039d791700 1 -- 172.21.15.92:0/2475664308 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f039806f800 msgr2=0x7f039809bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:42.388 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.354+0000 7f039e793700 1 --2- 172.21.15.92:0/2475664308 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f039806f800 0x7f039809bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:42.388 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.354+0000 7f039d791700 1 --2- 172.21.15.92:0/2475664308 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f039806f800 0x7f039809bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:42.388 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.354+0000 7f039df92700 1 --2- 172.21.15.92:0/2475664308 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0384003f80 0x7f03980b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:42.388 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.354+0000 7f039d791700 1 -- 172.21.15.92:0/2475664308 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0384003f80 msgr2=0x7f03980b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:42.389 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.354+0000 7f039d791700 1 --2- 172.21.15.92:0/2475664308 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0384003f80 0x7f03980b0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:42.389 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.354+0000 7f039d791700 1 -- 172.21.15.92:0/2475664308 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f039809e650 con 0x7f03980b11e0 2023-08-26T09:25:42.389 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.354+0000 7f039e793700 1 --2- 172.21.15.92:0/2475664308 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f039806f800 0x7f039809bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:25:42.390 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.354+0000 7f039df92700 1 --2- 172.21.15.92:0/2475664308 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0384003f80 0x7f03980b0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:25:42.390 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.354+0000 7f039d791700 1 --2- 172.21.15.92:0/2475664308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03980b11e0 0x7f039806f2c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f03840046f0 tx=0x7f03880047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:42.390 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.354+0000 7f038e7fc700 1 -- 172.21.15.92:0/2475664308 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0388021070 con 0x7f03980b11e0 2023-08-26T09:25:42.390 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.354+0000 7f038e7fc700 1 -- 172.21.15.92:0/2475664308 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03880045d0 con 0x7f03980b11e0 2023-08-26T09:25:42.391 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.354+0000 7f03a01f6700 1 -- 172.21.15.92:0/2475664308 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f039809e930 con 0x7f03980b11e0 2023-08-26T09:25:42.391 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.354+0000 7f038e7fc700 1 -- 172.21.15.92:0/2475664308 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038800e660 con 0x7f03980b11e0 2023-08-26T09:25:42.391 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.355+0000 7f03a01f6700 1 -- 172.21.15.92:0/2475664308 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f039809c3e0 con 0x7f03980b11e0 2023-08-26T09:25:42.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.355+0000 7f03a01f6700 1 -- 172.21.15.92:0/2475664308 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f039806e760 con 0x7f03980b11e0 2023-08-26T09:25:42.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.356+0000 7f038e7fc700 1 -- 172.21.15.92:0/2475664308 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0388025070 con 0x7f03980b11e0 2023-08-26T09:25:42.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.356+0000 7f038e7fc700 1 --2- 172.21.15.92:0/2475664308 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f037c06a0e0 0x7f037c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:42.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.356+0000 7f039df92700 1 --2- 172.21.15.92:0/2475664308 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f037c06a0e0 0x7f037c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:42.393 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.356+0000 7f038e7fc700 1 -- 172.21.15.92:0/2475664308 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0388089760 con 0x7f03980b11e0 2023-08-26T09:25:42.393 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.357+0000 7f039df92700 1 --2- 172.21.15.92:0/2475664308 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f037c06a0e0 0x7f037c06c5a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0394000c00 tx=0x7f0394009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:42.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.360+0000 7f038e7fc700 1 -- 172.21.15.92:0/2475664308 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0388054f60 con 0x7f03980b11e0 2023-08-26T09:25:42.556 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.551+0000 7f03a01f6700 1 -- 172.21.15.92:0/2475664308 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03980b3ba0 con 0x7f03980b11e0 2023-08-26T09:25:42.557 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.553+0000 7f038e7fc700 1 -- 172.21.15.92:0/2475664308 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+18209 (secure 0 0 0) 0x7f0388058580 con 0x7f03980b11e0 2023-08-26T09:25:42.558 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:25:42.558 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":20,"fsid":"254a2d31-bd41-4507-8326-1b205ac24377","created":"2023-08-26T09:24:55.352131+0000","modified":"2023-08-26T09:25:15.447635+0000","last_up_change":"2023-08-26T09:25:06.124496+0000","last_in_change":"2023-08-26T09:24:57.840725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-26T09:25:06.650431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-26T09:25:06.973382+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-26T09:25:11.584141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-26T09:25:12.814990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e9e7638-4459-4d8d-8e40-130bcf48df66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6819","nonce":382827192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6824","nonce":382827192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6831","nonce":382827192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6827","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6829","nonce":382827192}]},"public_addr":"172.21.15.92:6819/382827192","cluster_addr":"172.21.15.92:6824/382827192","heartbeat_back_addr":"172.21.15.92:6831/382827192","heartbeat_front_addr":"172.21.15.92:6829/382827192","state":["exists","up"]},{"osd":1,"uuid":"164e68c9-aedd-4df5-9b70-f4b1ec3bda13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6809","nonce":618773438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6811","nonce":618773438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6815","nonce":618773438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6813","nonce":618773438}]},"public_addr":"172.21.15.92:6809/618773438","cluster_addr":"172.21.15.92:6811/618773438","heartbeat_back_addr":"172.21.15.92:6815/618773438","heartbeat_front_addr":"172.21.15.92:6813/618773438","state":["exists","up"]},{"osd":2,"uuid":"8701dfee-629a-4d30-82e4-b8fac340303f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6818","nonce":3697397687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6821","nonce":3697397687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6828","nonce":3697397687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6823","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6825","nonce":3697397687}]},"public_addr":"172.21.15.92:6818/3697397687","cluster_addr":"172.21.15.92:6821/3697397687","heartbeat_back_addr":"172.21.15.92:6828/3697397687","heartbeat_front_addr":"172.21.15.92:6825/3697397687","state":["exists","up"]},{"osd":3,"uuid":"93bdc94d-dc07-495f-995a-a6ad072f0247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6801","nonce":3579846453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6803","nonce":3579846453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6807","nonce":3579846453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6805","nonce":3579846453}]},"public_addr":"172.21.15.92:6801/3579846453","cluster_addr":"172.21.15.92:6803/3579846453","heartbeat_back_addr":"172.21.15.92:6807/3579846453","heartbeat_front_addr":"172.21.15.92:6805/3579846453","state":["exists","up"]},{"osd":4,"uuid":"d9d0ea80-8481-46a7-9677-c338d32cf1d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6809","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6811","nonce":3228383424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6813","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6815","nonce":3228383424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6821","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6823","nonce":3228383424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6817","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6819","nonce":3228383424}]},"public_addr":"172.21.15.188:6811/3228383424","cluster_addr":"172.21.15.188:6815/3228383424","heartbeat_back_addr":"172.21.15.188:6823/3228383424","heartbeat_front_addr":"172.21.15.188:6819/3228383424","state":["exists","up"]},{"osd":5,"uuid":"38d03253-467a-456f-bd5e-5a46532a0b18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6801","nonce":1655821054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6803","nonce":1655821054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6807","nonce":1655821054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6805","nonce":1655821054}]},"public_addr":"172.21.15.188:6801/1655821054","cluster_addr":"172.21.15.188:6803/1655821054","heartbeat_back_addr":"172.21.15.188:6807/1655821054","heartbeat_front_addr":"172.21.15.188:6805/1655821054","state":["exists","up"]},{"osd":6,"uuid":"d61564b5-136f-42e5-a843-626c2017cc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6810","nonce":2069976891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6814","nonce":2069976891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6822","nonce":2069976891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6818","nonce":2069976891}]},"public_addr":"172.21.15.188:6810/2069976891","cluster_addr":"172.21.15.188:6814/2069976891","heartbeat_back_addr":"172.21.15.188:6822/2069976891","heartbeat_front_addr":"172.21.15.188:6818/2069976891","state":["exists","up"]},{"osd":7,"uuid":"fae2949e-0d62-42cd-ba72-08f516084b20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6825","nonce":1882888860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6827","nonce":1882888860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6831","nonce":1882888860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6829","nonce":1882888860}]},"public_addr":"172.21.15.188:6825/1882888860","cluster_addr":"172.21.15.188:6827/1882888860","heartbeat_back_addr":"172.21.15.188:6831/1882888860","heartbeat_front_addr":"172.21.15.188:6829/1882888860","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.038523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.063160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.000857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.975572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.023848+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.765194+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.081365+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:05.110745+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-26T09:25:42.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.554+0000 7f03a01f6700 1 -- 172.21.15.92:0/2475664308 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f037c06a0e0 msgr2=0x7f037c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:42.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.554+0000 7f03a01f6700 1 --2- 172.21.15.92:0/2475664308 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f037c06a0e0 0x7f037c06c5a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0394000c00 tx=0x7f0394009040 comp rx=0 tx=0).stop 2023-08-26T09:25:42.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.554+0000 7f03a01f6700 1 -- 172.21.15.92:0/2475664308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03980b11e0 msgr2=0x7f039806f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:42.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.554+0000 7f03a01f6700 1 --2- 172.21.15.92:0/2475664308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03980b11e0 0x7f039806f2c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f03840046f0 tx=0x7f03880047c0 comp rx=0 tx=0).stop 2023-08-26T09:25:42.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.555+0000 7f03a01f6700 1 -- 172.21.15.92:0/2475664308 shutdown_connections 2023-08-26T09:25:42.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.555+0000 7f03a01f6700 1 --2- 172.21.15.92:0/2475664308 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f037c06a0e0 0x7f037c06c5a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:42.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.555+0000 7f03a01f6700 1 --2- 172.21.15.92:0/2475664308 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0384003f80 0x7f03980b0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:42.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.555+0000 7f03a01f6700 1 --2- 172.21.15.92:0/2475664308 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f039806f800 0x7f039809bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:42.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.555+0000 7f03a01f6700 1 --2- 172.21.15.92:0/2475664308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03980b11e0 0x7f039806f2c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:42.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.555+0000 7f03a01f6700 1 -- 172.21.15.92:0/2475664308 >> 172.21.15.92:0/2475664308 conn(0x7f03980d0f40 msgr2=0x7f039806e050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:42.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.555+0000 7f03a01f6700 1 -- 172.21.15.92:0/2475664308 shutdown_connections 2023-08-26T09:25:42.562 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.555+0000 7f03a01f6700 1 -- 172.21.15.92:0/2475664308 wait complete. 2023-08-26T09:25:42.572 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-26T09:25:06.650431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-26T09:25:06.973382+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-26T09:25:11.584141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-26T09:25:12.814990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-26T09:25:42.572 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-26T09:25:42.695 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.690+0000 7f998a1d4700 1 Processor -- start 2023-08-26T09:25:42.696 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.691+0000 7f998a1d4700 1 -- start start 2023-08-26T09:25:42.698 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.691+0000 7f998a1d4700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f9984159dd0 0x7f99840cf220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:42.698 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.691+0000 7f998a1d4700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f9984071430 0x7f998406e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:42.698 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.691+0000 7f998a1d4700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99840c6200 con 0x7f998406e110 2023-08-26T09:25:42.699 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.691+0000 7f998a1d4700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f998406eae0 con 0x7f9984071430 2023-08-26T09:25:42.699 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.691+0000 7f998a1d4700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99840ce740 con 0x7f9984159dd0 2023-08-26T09:25:42.699 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.691+0000 7f9983fff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f9984071430 0x7f998406e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:42.699 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.691+0000 7f9982ffd700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f998406e110 0x7f9984070d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:57456/0 (socket says 172.21.15.92:57456) 2023-08-26T09:25:42.699 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.692+0000 7f9982ffd700 1 -- 172.21.15.92:0/1185252026 learned_addr learned my addr 172.21.15.92:0/1185252026 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:42.700 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.692+0000 7f99837fe700 1 --2- 172.21.15.92:0/1185252026 >> v2:172.21.15.188:3300/0 conn(0x7f9984159dd0 0x7f99840cf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:42.700 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.692+0000 7f9983fff700 1 -- 172.21.15.92:0/1185252026 >> v2:172.21.15.188:3300/0 conn(0x7f9984159dd0 msgr2=0x7f99840cf220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:42.700 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.692+0000 7f9983fff700 1 --2- 172.21.15.92:0/1185252026 >> v2:172.21.15.188:3300/0 conn(0x7f9984159dd0 0x7f99840cf220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:42.700 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.692+0000 7f9983fff700 1 -- 172.21.15.92:0/1185252026 >> v1:172.21.15.92:6789/0 conn(0x7f998406e110 legacy=0x7f9984070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:42.701 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.692+0000 7f9983fff700 1 -- 172.21.15.92:0/1185252026 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99840cea20 con 0x7f9984071430 2023-08-26T09:25:42.701 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.692+0000 7f99837fe700 1 --2- 172.21.15.92:0/1185252026 >> v2:172.21.15.188:3300/0 conn(0x7f9984159dd0 0x7f99840cf220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:42.701 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.692+0000 7f99827fc700 1 -- 172.21.15.92:0/1185252026 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2608908916 0 0) 0x7f99840c6200 con 0x7f998406e110 2023-08-26T09:25:42.701 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.692+0000 7f9983fff700 1 --2- 172.21.15.92:0/1185252026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9984071430 0x7f998406e5a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f99840d0d50 tx=0x7f997c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=584c74d425e3e419 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:42.701 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.692+0000 7f99827fc700 1 -- 172.21.15.92:0/1185252026 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997c00e070 con 0x7f9984071430 2023-08-26T09:25:42.702 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.692+0000 7f99827fc700 1 -- 172.21.15.92:0/1185252026 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f997c00bbd0 con 0x7f9984071430 2023-08-26T09:25:42.702 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.692+0000 7f99827fc700 1 -- 172.21.15.92:0/1185252026 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997c012430 con 0x7f9984071430 2023-08-26T09:25:42.702 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.693+0000 7f998a1d4700 1 -- 172.21.15.92:0/1185252026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9984071430 msgr2=0x7f998406e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:42.702 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.693+0000 7f998a1d4700 1 --2- 172.21.15.92:0/1185252026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9984071430 0x7f998406e5a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f99840d0d50 tx=0x7f997c00b330 comp rx=0 tx=0).stop 2023-08-26T09:25:42.703 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.693+0000 7f998a1d4700 1 -- 172.21.15.92:0/1185252026 shutdown_connections 2023-08-26T09:25:42.703 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.693+0000 7f998a1d4700 1 --2- 172.21.15.92:0/1185252026 >> v2:172.21.15.188:3300/0 conn(0x7f9984159dd0 0x7f99840cf220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:42.703 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.693+0000 7f998a1d4700 1 --2- 172.21.15.92:0/1185252026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9984071430 0x7f998406e5a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:42.703 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.693+0000 7f998a1d4700 1 -- 172.21.15.92:0/1185252026 >> 172.21.15.92:0/1185252026 conn(0x7f998406b430 msgr2=0x7f998406b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:42.703 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.693+0000 7f998a1d4700 1 -- 172.21.15.92:0/1185252026 shutdown_connections 2023-08-26T09:25:42.704 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.693+0000 7f998a1d4700 1 -- 172.21.15.92:0/1185252026 wait complete. 2023-08-26T09:25:42.706 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.694+0000 7f998a1d4700 1 Processor -- start 2023-08-26T09:25:42.707 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.694+0000 7f998a1d4700 1 -- start start 2023-08-26T09:25:42.707 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.695+0000 7f998a1d4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f998406e110 0x7f998414abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:42.707 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.695+0000 7f998a1d4700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9984071430 0x7f9984158c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:42.707 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.695+0000 7f998a1d4700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9984159dd0 0x7f9984154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:42.707 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.695+0000 7f998a1d4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99840c70e0 con 0x7f998406e110 2023-08-26T09:25:42.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.695+0000 7f998a1d4700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9984151910 con 0x7f9984159dd0 2023-08-26T09:25:42.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.695+0000 7f998a1d4700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9984152770 con 0x7f9984071430 2023-08-26T09:25:42.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.695+0000 7f99837fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f998406e110 0x7f998414abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:42.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.695+0000 7f99837fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f998406e110 0x7f998414abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45448/0 (socket says 172.21.15.92:45448) 2023-08-26T09:25:42.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.695+0000 7f99837fe700 1 -- 172.21.15.92:0/879547866 learned_addr learned my addr 172.21.15.92:0/879547866 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:42.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.695+0000 7f9983fff700 1 --2- 172.21.15.92:0/879547866 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9984159dd0 0x7f9984154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:42.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.695+0000 7f9982ffd700 1 --2- 172.21.15.92:0/879547866 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9984071430 0x7f9984158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:42.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.695+0000 7f99837fe700 1 -- 172.21.15.92:0/879547866 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9984071430 msgr2=0x7f9984158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:42.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.695+0000 7f99837fe700 1 --2- 172.21.15.92:0/879547866 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9984071430 0x7f9984158c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:42.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.695+0000 7f99837fe700 1 -- 172.21.15.92:0/879547866 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9984159dd0 msgr2=0x7f9984154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:42.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.695+0000 7f99837fe700 1 --2- 172.21.15.92:0/879547866 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9984159dd0 0x7f9984154830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:42.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.695+0000 7f99837fe700 1 -- 172.21.15.92:0/879547866 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f997c009a70 con 0x7f998406e110 2023-08-26T09:25:42.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.695+0000 7f9983fff700 1 --2- 172.21.15.92:0/879547866 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9984159dd0 0x7f9984154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:42.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.695+0000 7f99837fe700 1 --2- 172.21.15.92:0/879547866 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f998406e110 0x7f998414abb0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f997400e790 tx=0x7f997400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:42.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.696+0000 7f996bfff700 1 -- 172.21.15.92:0/879547866 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9974013610 con 0x7f998406e110 2023-08-26T09:25:42.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.696+0000 7f996bfff700 1 -- 172.21.15.92:0/879547866 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9974013770 con 0x7f998406e110 2023-08-26T09:25:42.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.696+0000 7f998a1d4700 1 -- 172.21.15.92:0/879547866 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f998414b0f0 con 0x7f998406e110 2023-08-26T09:25:42.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.696+0000 7f996bfff700 1 -- 172.21.15.92:0/879547866 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9974013b20 con 0x7f998406e110 2023-08-26T09:25:42.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.696+0000 7f998a1d4700 1 -- 172.21.15.92:0/879547866 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9984151e40 con 0x7f998406e110 2023-08-26T09:25:42.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.696+0000 7f998a1d4700 1 -- 172.21.15.92:0/879547866 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99841528b0 con 0x7f998406e110 2023-08-26T09:25:42.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.697+0000 7f996bfff700 1 -- 172.21.15.92:0/879547866 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9974013c80 con 0x7f998406e110 2023-08-26T09:25:42.712 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.697+0000 7f996bfff700 1 --2- 172.21.15.92:0/879547866 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f997006a0e0 0x7f997006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:42.712 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.697+0000 7f996bfff700 1 -- 172.21.15.92:0/879547866 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9974088120 con 0x7f998406e110 2023-08-26T09:25:42.712 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.697+0000 7f9982ffd700 1 --2- 172.21.15.92:0/879547866 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f997006a0e0 0x7f997006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:42.712 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.698+0000 7f9982ffd700 1 --2- 172.21.15.92:0/879547866 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f997006a0e0 0x7f997006c5a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9984071070 tx=0x7f9978007be0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:42.712 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.701+0000 7f996bfff700 1 -- 172.21.15.92:0/879547866 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9974057290 con 0x7f998406e110 2023-08-26T09:25:42.894 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.889+0000 7f998a1d4700 1 -- 172.21.15.92:0/879547866 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f998404eeb0 con 0x7f998406e110 2023-08-26T09:25:42.895 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.890+0000 7f996bfff700 1 -- 172.21.15.92:0/879547866 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9974056e20 con 0x7f998406e110 2023-08-26T09:25:42.895 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 8 2023-08-26T09:25:42.897 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.892+0000 7f998a1d4700 1 -- 172.21.15.92:0/879547866 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f997006a0e0 msgr2=0x7f997006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:42.897 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.892+0000 7f998a1d4700 1 --2- 172.21.15.92:0/879547866 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f997006a0e0 0x7f997006c5a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9984071070 tx=0x7f9978007be0 comp rx=0 tx=0).stop 2023-08-26T09:25:42.897 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.892+0000 7f998a1d4700 1 -- 172.21.15.92:0/879547866 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f998406e110 msgr2=0x7f998414abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:42.898 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.892+0000 7f998a1d4700 1 --2- 172.21.15.92:0/879547866 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f998406e110 0x7f998414abb0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f997400e790 tx=0x7f997400eb50 comp rx=0 tx=0).stop 2023-08-26T09:25:42.898 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.892+0000 7f998a1d4700 1 -- 172.21.15.92:0/879547866 shutdown_connections 2023-08-26T09:25:42.898 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.892+0000 7f998a1d4700 1 --2- 172.21.15.92:0/879547866 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f997006a0e0 0x7f997006c5a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:42.898 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.892+0000 7f998a1d4700 1 --2- 172.21.15.92:0/879547866 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9984159dd0 0x7f9984154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:42.898 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.892+0000 7f998a1d4700 1 --2- 172.21.15.92:0/879547866 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f998406e110 0x7f998414abb0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:42.899 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.892+0000 7f998a1d4700 1 --2- 172.21.15.92:0/879547866 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9984071430 0x7f9984158c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:42.899 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.892+0000 7f998a1d4700 1 -- 172.21.15.92:0/879547866 >> 172.21.15.92:0/879547866 conn(0x7f998406b430 msgr2=0x7f998415d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:42.899 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.892+0000 7f998a1d4700 1 -- 172.21.15.92:0/879547866 shutdown_connections 2023-08-26T09:25:42.899 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:42.892+0000 7f998a1d4700 1 -- 172.21.15.92:0/879547866 wait complete. 2023-08-26T09:25:42.909 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-26T09:25:43.033 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.028+0000 7ff2a8018700 1 Processor -- start 2023-08-26T09:25:43.033 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.028+0000 7ff2a8018700 1 -- start start 2023-08-26T09:25:43.035 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.029+0000 7ff2a8018700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff2a0071430 0x7ff2a0167ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:43.036 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.029+0000 7ff2a8018700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2a00718c0 con 0x7ff2a015d220 2023-08-26T09:25:43.036 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.029+0000 7ff2a8018700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2a00aee50 con 0x7ff2a00af390 2023-08-26T09:25:43.036 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.029+0000 7ff2a8018700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a00af130 con 0x7ff2a0071430 2023-08-26T09:25:43.036 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.029+0000 7ff2a5db4700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7ff2a015d220 0x7ff2a006db70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:57470/0 (socket says 172.21.15.92:57470) 2023-08-26T09:25:43.036 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.029+0000 7ff2a5db4700 1 -- 172.21.15.92:0/3369329807 learned_addr learned my addr 172.21.15.92:0/3369329807 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:43.037 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.029+0000 7ff2a65b5700 1 --2- 172.21.15.92:0/3369329807 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff2a0071430 0x7ff2a0167ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:43.037 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.029+0000 7ff2a4db2700 1 -- 172.21.15.92:0/3369329807 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 824566037 0 0) 0x7ff2a00718c0 con 0x7ff2a015d220 2023-08-26T09:25:43.037 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.029+0000 7ff2a4db2700 1 -- 172.21.15.92:0/3369329807 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff28c0035b0 con 0x7ff2a015d220 2023-08-26T09:25:43.037 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.029+0000 7ff2a4db2700 1 -- 172.21.15.92:0/3369329807 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1275610878 0 0) 0x7ff2a00aee50 con 0x7ff2a00af390 2023-08-26T09:25:43.037 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.029+0000 7ff2a4db2700 1 -- 172.21.15.92:0/3369329807 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2a00718c0 con 0x7ff2a00af390 2023-08-26T09:25:43.038 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.029+0000 7ff2a4db2700 1 -- 172.21.15.92:0/3369329807 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1600498733 0 0) 0x7ff28c0035b0 con 0x7ff2a015d220 2023-08-26T09:25:43.038 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.029+0000 7ff2a65b5700 1 -- 172.21.15.92:0/3369329807 >> v1:172.21.15.188:6789/0 conn(0x7ff2a00af390 legacy=0x7ff2a0070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:43.038 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.029+0000 7ff2a65b5700 1 -- 172.21.15.92:0/3369329807 >> v1:172.21.15.92:6789/0 conn(0x7ff2a015d220 legacy=0x7ff2a006db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:43.038 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.029+0000 7ff2a65b5700 1 -- 172.21.15.92:0/3369329807 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a00c4cb0 con 0x7ff2a0071430 2023-08-26T09:25:43.038 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.030+0000 7ff2a65b5700 1 --2- 172.21.15.92:0/3369329807 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff2a0071430 0x7ff2a0167ee0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff298009dc0 tx=0x7ff29800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15a00eb6a7cbfc16 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:43.039 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.030+0000 7ff2a4db2700 1 -- 172.21.15.92:0/3369329807 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29800e070 con 0x7ff2a0071430 2023-08-26T09:25:43.039 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.030+0000 7ff2a4db2700 1 -- 172.21.15.92:0/3369329807 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff298003a20 con 0x7ff2a0071430 2023-08-26T09:25:43.039 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.030+0000 7ff2a4db2700 1 -- 172.21.15.92:0/3369329807 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29c001670 con 0x7ff2a0071430 2023-08-26T09:25:43.039 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.030+0000 7ff2a8018700 1 -- 172.21.15.92:0/3369329807 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff2a0071430 msgr2=0x7ff2a0167ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:43.039 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.030+0000 7ff2a8018700 1 --2- 172.21.15.92:0/3369329807 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff2a0071430 0x7ff2a0167ee0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff298009dc0 tx=0x7ff29800b330 comp rx=0 tx=0).stop 2023-08-26T09:25:43.040 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.030+0000 7ff2a8018700 1 -- 172.21.15.92:0/3369329807 shutdown_connections 2023-08-26T09:25:43.040 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.030+0000 7ff2a8018700 1 --2- 172.21.15.92:0/3369329807 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff2a0071430 0x7ff2a0167ee0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:43.040 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.030+0000 7ff2a8018700 1 -- 172.21.15.92:0/3369329807 >> 172.21.15.92:0/3369329807 conn(0x7ff2a006b430 msgr2=0x7ff2a006b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:43.040 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.030+0000 7ff2a8018700 1 -- 172.21.15.92:0/3369329807 shutdown_connections 2023-08-26T09:25:43.040 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.030+0000 7ff2a8018700 1 -- 172.21.15.92:0/3369329807 wait complete. 2023-08-26T09:25:43.043 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.031+0000 7ff2a8018700 1 Processor -- start 2023-08-26T09:25:43.043 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.031+0000 7ff2a8018700 1 -- start start 2023-08-26T09:25:43.043 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.032+0000 7ff2a8018700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff2a0071430 0x7ff2a0154350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:43.044 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.032+0000 7ff2a8018700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2a00af390 0x7ff2a00b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:43.044 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.032+0000 7ff2a8018700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff2a015d220 0x7ff2a00b5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:43.044 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.032+0000 7ff2a8018700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a01582e0 con 0x7ff2a00af390 2023-08-26T09:25:43.044 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.032+0000 7ff2a8018700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a0155270 con 0x7ff2a015d220 2023-08-26T09:25:43.044 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.032+0000 7ff2a8018700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a0158530 con 0x7ff2a0071430 2023-08-26T09:25:43.045 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.032+0000 7ff2a55b3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2a00af390 0x7ff2a00b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:43.045 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.032+0000 7ff2a55b3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2a00af390 0x7ff2a00b4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45464/0 (socket says 172.21.15.92:45464) 2023-08-26T09:25:43.045 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.032+0000 7ff2a55b3700 1 -- 172.21.15.92:0/2812943663 learned_addr learned my addr 172.21.15.92:0/2812943663 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:43.045 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.032+0000 7ff2a5db4700 1 --2- 172.21.15.92:0/2812943663 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff2a0071430 0x7ff2a0154350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:43.045 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.032+0000 7ff2a65b5700 1 --2- 172.21.15.92:0/2812943663 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff2a015d220 0x7ff2a00b5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:43.046 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.033+0000 7ff2a55b3700 1 -- 172.21.15.92:0/2812943663 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff2a0071430 msgr2=0x7ff2a0154350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:43.046 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.033+0000 7ff2a55b3700 1 --2- 172.21.15.92:0/2812943663 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff2a0071430 0x7ff2a0154350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:43.046 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.033+0000 7ff2a55b3700 1 -- 172.21.15.92:0/2812943663 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff2a015d220 msgr2=0x7ff2a00b5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:43.046 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.033+0000 7ff2a55b3700 1 --2- 172.21.15.92:0/2812943663 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff2a015d220 0x7ff2a00b5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:43.046 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.033+0000 7ff2a55b3700 1 -- 172.21.15.92:0/2812943663 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff298009a70 con 0x7ff2a00af390 2023-08-26T09:25:43.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.033+0000 7ff2a55b3700 1 --2- 172.21.15.92:0/2812943663 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2a00af390 0x7ff2a00b4dc0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff29000c520 tx=0x7ff29000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:43.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.033+0000 7ff2967fc700 1 -- 172.21.15.92:0/2812943663 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2900052d0 con 0x7ff2a00af390 2023-08-26T09:25:43.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.033+0000 7ff2967fc700 1 -- 172.21.15.92:0/2812943663 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff290005430 con 0x7ff2a00af390 2023-08-26T09:25:43.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.033+0000 7ff2a8018700 1 -- 172.21.15.92:0/2812943663 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2a0158810 con 0x7ff2a00af390 2023-08-26T09:25:43.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.033+0000 7ff2967fc700 1 -- 172.21.15.92:0/2812943663 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2900038c0 con 0x7ff2a00af390 2023-08-26T09:25:43.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.033+0000 7ff2a8018700 1 -- 172.21.15.92:0/2812943663 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2a0158dd0 con 0x7ff2a00af390 2023-08-26T09:25:43.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.034+0000 7ff2a8018700 1 -- 172.21.15.92:0/2812943663 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2a004eeb0 con 0x7ff2a00af390 2023-08-26T09:25:43.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.034+0000 7ff2967fc700 1 -- 172.21.15.92:0/2812943663 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff290003a20 con 0x7ff2a00af390 2023-08-26T09:25:43.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.035+0000 7ff2967fc700 1 --2- 172.21.15.92:0/2812943663 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7ff28406a0e0 0x7ff28406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:43.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.035+0000 7ff2967fc700 1 -- 172.21.15.92:0/2812943663 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff290087990 con 0x7ff2a00af390 2023-08-26T09:25:43.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.035+0000 7ff2a5db4700 1 --2- 172.21.15.92:0/2812943663 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7ff28406a0e0 0x7ff28406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:43.049 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.035+0000 7ff2a5db4700 1 --2- 172.21.15.92:0/2812943663 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7ff28406a0e0 0x7ff28406c5a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff29c004a60 tx=0x7ff29c000bc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:43.049 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.039+0000 7ff2967fc700 1 -- 172.21.15.92:0/2812943663 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff290053080 con 0x7ff2a00af390 2023-08-26T09:25:43.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.230+0000 7ff2a8018700 1 -- 172.21.15.92:0/2812943663 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff2a0154890 con 0x7ff2a00af390 2023-08-26T09:25:43.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.231+0000 7ff2967fc700 1 -- 172.21.15.92:0/2812943663 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff290017020 con 0x7ff2a00af390 2023-08-26T09:25:43.236 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 1 2023-08-26T09:25:43.238 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.232+0000 7ff2a8018700 1 -- 172.21.15.92:0/2812943663 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7ff28406a0e0 msgr2=0x7ff28406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:43.238 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.232+0000 7ff2a8018700 1 --2- 172.21.15.92:0/2812943663 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7ff28406a0e0 0x7ff28406c5a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff29c004a60 tx=0x7ff29c000bc0 comp rx=0 tx=0).stop 2023-08-26T09:25:43.238 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.233+0000 7ff2a8018700 1 -- 172.21.15.92:0/2812943663 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2a00af390 msgr2=0x7ff2a00b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:43.238 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.233+0000 7ff2a8018700 1 --2- 172.21.15.92:0/2812943663 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2a00af390 0x7ff2a00b4dc0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff29000c520 tx=0x7ff29000c830 comp rx=0 tx=0).stop 2023-08-26T09:25:43.239 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.233+0000 7ff2a8018700 1 -- 172.21.15.92:0/2812943663 shutdown_connections 2023-08-26T09:25:43.239 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.233+0000 7ff2a8018700 1 --2- 172.21.15.92:0/2812943663 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7ff28406a0e0 0x7ff28406c5a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:43.239 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.233+0000 7ff2a8018700 1 --2- 172.21.15.92:0/2812943663 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff2a015d220 0x7ff2a00b5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:43.239 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.233+0000 7ff2a8018700 1 --2- 172.21.15.92:0/2812943663 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff2a0071430 0x7ff2a0154350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:43.239 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.233+0000 7ff2a8018700 1 --2- 172.21.15.92:0/2812943663 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2a00af390 0x7ff2a00b4dc0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:43.240 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.233+0000 7ff2a8018700 1 -- 172.21.15.92:0/2812943663 >> 172.21.15.92:0/2812943663 conn(0x7ff2a006b430 msgr2=0x7ff2a006e730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:43.240 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.233+0000 7ff2a8018700 1 -- 172.21.15.92:0/2812943663 shutdown_connections 2023-08-26T09:25:43.240 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.233+0000 7ff2a8018700 1 -- 172.21.15.92:0/2812943663 wait complete. 2023-08-26T09:25:43.249 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-26T09:25:43.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.369+0000 7f66e3206700 1 Processor -- start 2023-08-26T09:25:43.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.369+0000 7f66e3206700 1 -- start start 2023-08-26T09:25:43.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.370+0000 7f66e3206700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f66dc0b2d70 0x7f66dc15edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:43.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.370+0000 7f66e3206700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66dc06de90 con 0x7f66dc0d0a30 2023-08-26T09:25:43.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.370+0000 7f66e3206700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66dc06e170 con 0x7f66dc0cb4a0 2023-08-26T09:25:43.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.370+0000 7f66e3206700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66dc06eb10 con 0x7f66dc0b2d70 2023-08-26T09:25:43.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.370+0000 7f66e17a3700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f66dc0d0a30 0x7f66dc15ba00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:57488/0 (socket says 172.21.15.92:57488) 2023-08-26T09:25:43.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.370+0000 7f66e17a3700 1 -- 172.21.15.92:0/2734633173 learned_addr learned my addr 172.21.15.92:0/2734633173 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:43.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.370+0000 7f66e0fa2700 1 --2- 172.21.15.92:0/2734633173 >> v2:172.21.15.188:3300/0 conn(0x7f66dc0b2d70 0x7f66dc15edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:43.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.370+0000 7f66db7fe700 1 -- 172.21.15.92:0/2734633173 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1018151352 0 0) 0x7f66dc06de90 con 0x7f66dc0d0a30 2023-08-26T09:25:43.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.370+0000 7f66db7fe700 1 -- 172.21.15.92:0/2734633173 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66cc0035b0 con 0x7f66dc0d0a30 2023-08-26T09:25:43.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.370+0000 7f66db7fe700 1 -- 172.21.15.92:0/2734633173 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1679072324 0 0) 0x7f66dc06e170 con 0x7f66dc0cb4a0 2023-08-26T09:25:43.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.370+0000 7f66db7fe700 1 -- 172.21.15.92:0/2734633173 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66dc06de90 con 0x7f66dc0cb4a0 2023-08-26T09:25:43.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.370+0000 7f66db7fe700 1 -- 172.21.15.92:0/2734633173 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 963689620 0 0) 0x7f66cc0035b0 con 0x7f66dc0d0a30 2023-08-26T09:25:43.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.370+0000 7f66db7fe700 1 -- 172.21.15.92:0/2734633173 >> v2:172.21.15.188:3300/0 conn(0x7f66dc0b2d70 msgr2=0x7f66dc15edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:43.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.370+0000 7f66db7fe700 1 --2- 172.21.15.92:0/2734633173 >> v2:172.21.15.188:3300/0 conn(0x7f66dc0b2d70 0x7f66dc15edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:43.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.370+0000 7f66db7fe700 1 -- 172.21.15.92:0/2734633173 >> v1:172.21.15.188:6789/0 conn(0x7f66dc0cb4a0 legacy=0x7f66dc0d0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:43.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.370+0000 7f66db7fe700 1 -- 172.21.15.92:0/2734633173 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66dc06e450 con 0x7f66dc0d0a30 2023-08-26T09:25:43.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.370+0000 7f66db7fe700 1 -- 172.21.15.92:0/2734633173 <== mon.0 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1019361464 0 0) 0x7f66d40019f0 con 0x7f66dc0d0a30 2023-08-26T09:25:43.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.370+0000 7f66db7fe700 1 -- 172.21.15.92:0/2734633173 >> v1:172.21.15.92:6789/0 conn(0x7f66dc0d0a30 legacy=0x7f66dc15ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:43.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.370+0000 7f66db7fe700 1 --2- 172.21.15.92:0/2734633173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66cc003b90 0x7f66cc003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:43.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.370+0000 7f66db7fe700 1 --2- 172.21.15.92:0/2734633173 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f66cc004850 0x7f66cc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:43.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.370+0000 7f66db7fe700 1 --2- 172.21.15.92:0/2734633173 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f66cc005210 0x7f66cc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:43.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.370+0000 7f66db7fe700 1 -- 172.21.15.92:0/2734633173 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc06eb10 con 0x7f66cc003b90 2023-08-26T09:25:43.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.370+0000 7f66db7fe700 1 -- 172.21.15.92:0/2734633173 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66cc00c090 con 0x7f66cc005210 2023-08-26T09:25:43.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.370+0000 7f66db7fe700 1 -- 172.21.15.92:0/2734633173 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66cc00c250 con 0x7f66cc004850 2023-08-26T09:25:43.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.370+0000 7f66e0fa2700 1 --2- 172.21.15.92:0/2734633173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66cc003b90 0x7f66cc003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:43.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.371+0000 7f66e17a3700 1 --2- 172.21.15.92:0/2734633173 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f66cc005210 0x7f66cc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:43.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.371+0000 7f66dbfff700 1 --2- 172.21.15.92:0/2734633173 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f66cc004850 0x7f66cc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:43.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.371+0000 7f66e0fa2700 1 -- 172.21.15.92:0/2734633173 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f66cc004850 msgr2=0x7f66cc004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:43.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.371+0000 7f66e0fa2700 1 --2- 172.21.15.92:0/2734633173 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f66cc004850 0x7f66cc004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:43.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.371+0000 7f66e0fa2700 1 -- 172.21.15.92:0/2734633173 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f66cc005210 msgr2=0x7f66cc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:43.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.371+0000 7f66e0fa2700 1 --2- 172.21.15.92:0/2734633173 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f66cc005210 0x7f66cc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:43.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.371+0000 7f66e0fa2700 1 -- 172.21.15.92:0/2734633173 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66cc0035b0 con 0x7f66cc003b90 2023-08-26T09:25:43.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.371+0000 7f66e17a3700 1 --2- 172.21.15.92:0/2734633173 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f66cc005210 0x7f66cc00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:43.385 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.371+0000 7f66dbfff700 1 --2- 172.21.15.92:0/2734633173 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f66cc004850 0x7f66cc004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:43.385 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.371+0000 7f66e17a3700 1 -- 172.21.15.92:0/2734633173 reap_dead start 2023-08-26T09:25:43.385 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.371+0000 7f66e0fa2700 1 --2- 172.21.15.92:0/2734633173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66cc003b90 0x7f66cc003f90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f66d0009b60 tx=0x7f66cc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b76213eb328e0ddf server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:43.385 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.371+0000 7f66db7fe700 1 -- 172.21.15.92:0/2734633173 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d000e6c0 con 0x7f66cc003b90 2023-08-26T09:25:43.386 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.371+0000 7f66db7fe700 1 -- 172.21.15.92:0/2734633173 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d000e820 con 0x7f66cc003b90 2023-08-26T09:25:43.386 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.371+0000 7f66db7fe700 1 -- 172.21.15.92:0/2734633173 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d000eb90 con 0x7f66cc003b90 2023-08-26T09:25:43.386 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.371+0000 7f66e3206700 1 -- 172.21.15.92:0/2734633173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66cc003b90 msgr2=0x7f66cc003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:43.386 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.371+0000 7f66e3206700 1 --2- 172.21.15.92:0/2734633173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66cc003b90 0x7f66cc003f90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f66d0009b60 tx=0x7f66cc005880 comp rx=0 tx=0).stop 2023-08-26T09:25:43.386 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.371+0000 7f66e3206700 1 -- 172.21.15.92:0/2734633173 shutdown_connections 2023-08-26T09:25:43.387 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.371+0000 7f66e3206700 1 --2- 172.21.15.92:0/2734633173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66cc003b90 0x7f66cc003f90 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:43.387 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.371+0000 7f66e3206700 1 -- 172.21.15.92:0/2734633173 >> 172.21.15.92:0/2734633173 conn(0x7f66dc0cd8d0 msgr2=0x7f66dc0cdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:43.387 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.372+0000 7f66e3206700 1 -- 172.21.15.92:0/2734633173 shutdown_connections 2023-08-26T09:25:43.387 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.372+0000 7f66e3206700 1 -- 172.21.15.92:0/2734633173 wait complete. 2023-08-26T09:25:43.387 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.373+0000 7f66e3206700 1 Processor -- start 2023-08-26T09:25:43.388 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.373+0000 7f66e3206700 1 -- start start 2023-08-26T09:25:43.390 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.374+0000 7f66e3206700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f66cc003b90 0x7f66dc0b60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:43.390 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.374+0000 7f66e3206700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66dc0c7120 0x7f66dc1f0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:43.390 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.374+0000 7f66e3206700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f66dc1f0c40 0x7f66dc15a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:43.391 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.374+0000 7f66e3206700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc0b1250 con 0x7f66dc0c7120 2023-08-26T09:25:43.391 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.374+0000 7f66e3206700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc0c69e0 con 0x7f66dc1f0c40 2023-08-26T09:25:43.391 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.374+0000 7f66e3206700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc0b0920 con 0x7f66cc003b90 2023-08-26T09:25:43.391 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.374+0000 7f66dbfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66dc0c7120 0x7f66dc1f0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:43.391 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.374+0000 7f66dbfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66dc0c7120 0x7f66dc1f0700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45482/0 (socket says 172.21.15.92:45482) 2023-08-26T09:25:43.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.374+0000 7f66dbfff700 1 -- 172.21.15.92:0/984046792 learned_addr learned my addr 172.21.15.92:0/984046792 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:43.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.375+0000 7f66e17a3700 1 --2- 172.21.15.92:0/984046792 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f66dc1f0c40 0x7f66dc15a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:43.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.375+0000 7f66e0fa2700 1 --2- 172.21.15.92:0/984046792 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f66cc003b90 0x7f66dc0b60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:43.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.375+0000 7f66dbfff700 1 -- 172.21.15.92:0/984046792 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f66cc003b90 msgr2=0x7f66dc0b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:43.393 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.375+0000 7f66dbfff700 1 --2- 172.21.15.92:0/984046792 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f66cc003b90 0x7f66dc0b60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:43.393 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.375+0000 7f66dbfff700 1 -- 172.21.15.92:0/984046792 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f66dc1f0c40 msgr2=0x7f66dc15a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:43.393 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.375+0000 7f66dbfff700 1 --2- 172.21.15.92:0/984046792 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f66dc1f0c40 0x7f66dc15a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:43.393 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.375+0000 7f66dbfff700 1 -- 172.21.15.92:0/984046792 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66dc0b0c00 con 0x7f66dc0c7120 2023-08-26T09:25:43.393 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.375+0000 7f66e17a3700 1 --2- 172.21.15.92:0/984046792 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f66dc1f0c40 0x7f66dc15a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:25:43.393 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.375+0000 7f66dbfff700 1 --2- 172.21.15.92:0/984046792 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66dc0c7120 0x7f66dc1f0700 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f66c800e570 tx=0x7f66c800e930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:43.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.375+0000 7f66d97fa700 1 -- 172.21.15.92:0/984046792 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c80052e0 con 0x7f66dc0c7120 2023-08-26T09:25:43.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.375+0000 7f66d97fa700 1 -- 172.21.15.92:0/984046792 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c8005440 con 0x7f66dc0c7120 2023-08-26T09:25:43.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.375+0000 7f66e3206700 1 -- 172.21.15.92:0/984046792 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66dc0b0ee0 con 0x7f66dc0c7120 2023-08-26T09:25:43.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.375+0000 7f66d97fa700 1 -- 172.21.15.92:0/984046792 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c80038a0 con 0x7f66dc0c7120 2023-08-26T09:25:43.395 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.375+0000 7f66e3206700 1 -- 172.21.15.92:0/984046792 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66dc0b6810 con 0x7f66dc0c7120 2023-08-26T09:25:43.395 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.376+0000 7f66e3206700 1 -- 172.21.15.92:0/984046792 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66dc04eeb0 con 0x7f66dc0c7120 2023-08-26T09:25:43.395 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.376+0000 7f66d97fa700 1 -- 172.21.15.92:0/984046792 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f66c8003a00 con 0x7f66dc0c7120 2023-08-26T09:25:43.395 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.376+0000 7f66d97fa700 1 --2- 172.21.15.92:0/984046792 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f66c006a0e0 0x7f66c006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:43.395 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.377+0000 7f66d97fa700 1 -- 172.21.15.92:0/984046792 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f66c8087ad0 con 0x7f66dc0c7120 2023-08-26T09:25:43.396 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.377+0000 7f66e0fa2700 1 --2- 172.21.15.92:0/984046792 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f66c006a0e0 0x7f66c006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:43.396 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.377+0000 7f66e0fa2700 1 --2- 172.21.15.92:0/984046792 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f66c006a0e0 0x7f66c006c5a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f66d00090b0 tx=0x7f66d0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:43.396 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.381+0000 7f66d97fa700 1 -- 172.21.15.92:0/984046792 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f66c8053300 con 0x7f66dc0c7120 2023-08-26T09:25:43.574 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.569+0000 7f66e3206700 1 -- 172.21.15.92:0/984046792 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f66dc0b6810 con 0x7f66dc0c7120 2023-08-26T09:25:43.574 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.569+0000 7f66d97fa700 1 -- 172.21.15.92:0/984046792 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f66dc0b6810 con 0x7f66dc0c7120 2023-08-26T09:25:43.575 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 32 2023-08-26T09:25:43.576 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.571+0000 7f66e3206700 1 -- 172.21.15.92:0/984046792 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f66c006a0e0 msgr2=0x7f66c006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:43.577 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.571+0000 7f66e3206700 1 --2- 172.21.15.92:0/984046792 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f66c006a0e0 0x7f66c006c5a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f66d00090b0 tx=0x7f66d0008030 comp rx=0 tx=0).stop 2023-08-26T09:25:43.577 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.571+0000 7f66e3206700 1 -- 172.21.15.92:0/984046792 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66dc0c7120 msgr2=0x7f66dc1f0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:43.577 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.571+0000 7f66e3206700 1 --2- 172.21.15.92:0/984046792 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66dc0c7120 0x7f66dc1f0700 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f66c800e570 tx=0x7f66c800e930 comp rx=0 tx=0).stop 2023-08-26T09:25:43.577 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.571+0000 7f66e3206700 1 -- 172.21.15.92:0/984046792 shutdown_connections 2023-08-26T09:25:43.577 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.571+0000 7f66e3206700 1 --2- 172.21.15.92:0/984046792 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f66c006a0e0 0x7f66c006c5a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:43.578 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.571+0000 7f66e3206700 1 --2- 172.21.15.92:0/984046792 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f66dc1f0c40 0x7f66dc15a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:43.578 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.571+0000 7f66e3206700 1 --2- 172.21.15.92:0/984046792 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f66cc003b90 0x7f66dc0b60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:43.578 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.571+0000 7f66e3206700 1 --2- 172.21.15.92:0/984046792 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66dc0c7120 0x7f66dc1f0700 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:43.578 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.571+0000 7f66e3206700 1 -- 172.21.15.92:0/984046792 >> 172.21.15.92:0/984046792 conn(0x7f66dc0cd8d0 msgr2=0x7f66dc15bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:43.578 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.571+0000 7f66e3206700 1 -- 172.21.15.92:0/984046792 shutdown_connections 2023-08-26T09:25:43.579 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.571+0000 7f66e3206700 1 -- 172.21.15.92:0/984046792 wait complete. 2023-08-26T09:25:43.588 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-26T09:25:43.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.706+0000 7fe1cde74700 1 Processor -- start 2023-08-26T09:25:43.712 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.706+0000 7fe1cde74700 1 -- start start 2023-08-26T09:25:43.714 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.707+0000 7fe1cde74700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe1c815d220 0x7fe1c80af390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:43.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.707+0000 7fe1cde74700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe1c806db70 0x7fe1c8070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:43.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.707+0000 7fe1cde74700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1c80aee50 con 0x7fe1c8071260 2023-08-26T09:25:43.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.707+0000 7fe1cde74700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1c80af130 con 0x7fe1c806db70 2023-08-26T09:25:43.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.707+0000 7fe1cde74700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c80c4cb0 con 0x7fe1c815d220 2023-08-26T09:25:43.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.707+0000 7fe1c6ffd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe1c806db70 0x7fe1c8070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:43.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.707+0000 7fe1c6ffd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe1c806db70 0x7fe1c8070d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45492/0 (socket says 172.21.15.92:45492) 2023-08-26T09:25:43.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.707+0000 7fe1c6ffd700 1 -- 172.21.15.92:0/2935874478 learned_addr learned my addr 172.21.15.92:0/2935874478 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:43.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.707+0000 7fe1c77fe700 1 --2- 172.21.15.92:0/2935874478 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe1c815d220 0x7fe1c80af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:43.717 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.707+0000 7fe1c6ffd700 1 -- 172.21.15.92:0/2935874478 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe1c815d220 msgr2=0x7fe1c80af390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:43.717 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.707+0000 7fe1c6ffd700 1 --2- 172.21.15.92:0/2935874478 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe1c815d220 0x7fe1c80af390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:43.717 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.707+0000 7fe1c6ffd700 1 -- 172.21.15.92:0/2935874478 >> v1:172.21.15.188:6789/0 conn(0x7fe1c8071260 legacy=0x7fe1c8160d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:43.717 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.707+0000 7fe1c6ffd700 1 -- 172.21.15.92:0/2935874478 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c80c4f90 con 0x7fe1c806db70 2023-08-26T09:25:43.717 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.708+0000 7fe1c6ffd700 1 --2- 172.21.15.92:0/2935874478 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1c806db70 0x7fe1c8070d20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe1b80098f0 tx=0x7fe1b8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f0692a714f2dede server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:43.718 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.708+0000 7fe1c67fc700 1 -- 172.21.15.92:0/2935874478 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b800b8a0 con 0x7fe1c806db70 2023-08-26T09:25:43.718 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.708+0000 7fe1c67fc700 1 -- 172.21.15.92:0/2935874478 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b800ba00 con 0x7fe1c806db70 2023-08-26T09:25:43.718 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.708+0000 7fe1c67fc700 1 -- 172.21.15.92:0/2935874478 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b800bd90 con 0x7fe1c806db70 2023-08-26T09:25:43.718 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.708+0000 7fe1cde74700 1 -- 172.21.15.92:0/2935874478 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1c806db70 msgr2=0x7fe1c8070d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:43.718 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.708+0000 7fe1cde74700 1 --2- 172.21.15.92:0/2935874478 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1c806db70 0x7fe1c8070d20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe1b80098f0 tx=0x7fe1b8009c00 comp rx=0 tx=0).stop 2023-08-26T09:25:43.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.708+0000 7fe1cde74700 1 -- 172.21.15.92:0/2935874478 shutdown_connections 2023-08-26T09:25:43.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.708+0000 7fe1cde74700 1 --2- 172.21.15.92:0/2935874478 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe1c815d220 0x7fe1c80af390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:43.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.708+0000 7fe1cde74700 1 --2- 172.21.15.92:0/2935874478 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1c806db70 0x7fe1c8070d20 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:43.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.708+0000 7fe1cde74700 1 -- 172.21.15.92:0/2935874478 >> 172.21.15.92:0/2935874478 conn(0x7fe1c806b430 msgr2=0x7fe1c806b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:43.720 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.708+0000 7fe1cde74700 1 -- 172.21.15.92:0/2935874478 shutdown_connections 2023-08-26T09:25:43.720 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.708+0000 7fe1cde74700 1 -- 172.21.15.92:0/2935874478 wait complete. 2023-08-26T09:25:43.720 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.709+0000 7fe1cde74700 1 Processor -- start 2023-08-26T09:25:43.720 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.710+0000 7fe1cde74700 1 -- start start 2023-08-26T09:25:43.723 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.710+0000 7fe1cde74700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe1c806db70 0x7fe1c81589b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:43.723 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.710+0000 7fe1cde74700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe1c8071260 0x7fe1c814adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:43.723 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.710+0000 7fe1cde74700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1c815d220 0x7fe1c814b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:43.723 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.710+0000 7fe1cde74700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c81f6b40 con 0x7fe1c815d220 2023-08-26T09:25:43.724 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.710+0000 7fe1cde74700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c8145c70 con 0x7fe1c806db70 2023-08-26T09:25:43.724 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.710+0000 7fe1cde74700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c8145340 con 0x7fe1c8071260 2023-08-26T09:25:43.724 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.711+0000 7fe1c7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1c815d220 0x7fe1c814b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:43.724 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.711+0000 7fe1c7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1c815d220 0x7fe1c814b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45500/0 (socket says 172.21.15.92:45500) 2023-08-26T09:25:43.724 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.711+0000 7fe1c7fff700 1 -- 172.21.15.92:0/3974871344 learned_addr learned my addr 172.21.15.92:0/3974871344 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:43.725 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.711+0000 7fe1c77fe700 1 --2- 172.21.15.92:0/3974871344 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe1c806db70 0x7fe1c81589b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:43.725 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.711+0000 7fe1c6ffd700 1 --2- 172.21.15.92:0/3974871344 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe1c8071260 0x7fe1c814adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:43.725 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.711+0000 7fe1c7fff700 1 -- 172.21.15.92:0/3974871344 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe1c8071260 msgr2=0x7fe1c814adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:43.725 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.711+0000 7fe1c7fff700 1 --2- 172.21.15.92:0/3974871344 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe1c8071260 0x7fe1c814adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:43.725 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.711+0000 7fe1c7fff700 1 -- 172.21.15.92:0/3974871344 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe1c806db70 msgr2=0x7fe1c81589b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:43.726 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.711+0000 7fe1c7fff700 1 --2- 172.21.15.92:0/3974871344 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe1c806db70 0x7fe1c81589b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:43.726 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.711+0000 7fe1c7fff700 1 -- 172.21.15.92:0/3974871344 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b8009550 con 0x7fe1c815d220 2023-08-26T09:25:43.726 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.711+0000 7fe1c7fff700 1 --2- 172.21.15.92:0/3974871344 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1c815d220 0x7fe1c814b330 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe1c000cc50 tx=0x7fe1c000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:43.727 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.711+0000 7fe1bffff700 1 -- 172.21.15.92:0/3974871344 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c0003c00 con 0x7fe1c815d220 2023-08-26T09:25:43.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.711+0000 7fe1bffff700 1 -- 172.21.15.92:0/3974871344 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c0003d60 con 0x7fe1c815d220 2023-08-26T09:25:43.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.711+0000 7fe1bffff700 1 -- 172.21.15.92:0/3974871344 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c000aab0 con 0x7fe1c815d220 2023-08-26T09:25:43.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.711+0000 7fe1cde74700 1 -- 172.21.15.92:0/3974871344 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1c8145620 con 0x7fe1c815d220 2023-08-26T09:25:43.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.711+0000 7fe1cde74700 1 -- 172.21.15.92:0/3974871344 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1c8158ef0 con 0x7fe1c815d220 2023-08-26T09:25:43.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.712+0000 7fe1cde74700 1 -- 172.21.15.92:0/3974871344 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1c81590e0 con 0x7fe1c815d220 2023-08-26T09:25:43.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.713+0000 7fe1bffff700 1 -- 172.21.15.92:0/3974871344 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe1c000ac10 con 0x7fe1c815d220 2023-08-26T09:25:43.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.713+0000 7fe1bffff700 1 --2- 172.21.15.92:0/3974871344 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fe1a806a0e0 0x7fe1a806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:43.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.713+0000 7fe1bffff700 1 -- 172.21.15.92:0/3974871344 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe1c0088470 con 0x7fe1c815d220 2023-08-26T09:25:43.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.713+0000 7fe1c77fe700 1 --2- 172.21.15.92:0/3974871344 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fe1a806a0e0 0x7fe1a806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:43.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.713+0000 7fe1c77fe700 1 --2- 172.21.15.92:0/3974871344 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fe1a806a0e0 0x7fe1a806c5a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0006b20 tx=0x7fe1b0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:43.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.717+0000 7fe1bffff700 1 -- 172.21.15.92:0/3974871344 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe1c0053bf0 con 0x7fe1c815d220 2023-08-26T09:25:43.908 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.903+0000 7fe1cde74700 1 -- 172.21.15.92:0/3974871344 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe1c804eeb0 con 0x7fe1c815d220 2023-08-26T09:25:43.909 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.904+0000 7fe1bffff700 1 -- 172.21.15.92:0/3974871344 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe1c0057210 con 0x7fe1c815d220 2023-08-26T09:25:43.909 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 64 2023-08-26T09:25:43.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.906+0000 7fe1cde74700 1 -- 172.21.15.92:0/3974871344 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fe1a806a0e0 msgr2=0x7fe1a806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:43.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.906+0000 7fe1cde74700 1 --2- 172.21.15.92:0/3974871344 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fe1a806a0e0 0x7fe1a806c5a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0006b20 tx=0x7fe1b0008040 comp rx=0 tx=0).stop 2023-08-26T09:25:43.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.906+0000 7fe1cde74700 1 -- 172.21.15.92:0/3974871344 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1c815d220 msgr2=0x7fe1c814b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:43.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.906+0000 7fe1cde74700 1 --2- 172.21.15.92:0/3974871344 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1c815d220 0x7fe1c814b330 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe1c000cc50 tx=0x7fe1c000cf60 comp rx=0 tx=0).stop 2023-08-26T09:25:43.912 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.906+0000 7fe1cde74700 1 -- 172.21.15.92:0/3974871344 shutdown_connections 2023-08-26T09:25:43.912 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.906+0000 7fe1cde74700 1 --2- 172.21.15.92:0/3974871344 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fe1a806a0e0 0x7fe1a806c5a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:43.912 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.906+0000 7fe1cde74700 1 --2- 172.21.15.92:0/3974871344 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe1c806db70 0x7fe1c81589b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:43.912 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.906+0000 7fe1cde74700 1 --2- 172.21.15.92:0/3974871344 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1c815d220 0x7fe1c814b330 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:43.913 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.906+0000 7fe1cde74700 1 --2- 172.21.15.92:0/3974871344 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe1c8071260 0x7fe1c814adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:43.913 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.906+0000 7fe1cde74700 1 -- 172.21.15.92:0/3974871344 >> 172.21.15.92:0/3974871344 conn(0x7fe1c806b430 msgr2=0x7fe1c8157830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:43.913 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.906+0000 7fe1cde74700 1 -- 172.21.15.92:0/3974871344 shutdown_connections 2023-08-26T09:25:43.913 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:43.906+0000 7fe1cde74700 1 -- 172.21.15.92:0/3974871344 wait complete. 2023-08-26T09:25:43.923 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-26T09:25:44.043 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.038+0000 7f814c8c6700 1 Processor -- start 2023-08-26T09:25:44.043 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.038+0000 7f814c8c6700 1 -- start start 2023-08-26T09:25:44.046 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.039+0000 7f814c8c6700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f814806ce50 0x7f814806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:44.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.039+0000 7f814c8c6700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f81480caf00 0x7f81480cb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:44.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.039+0000 7f814c8c6700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f814806d7f0 con 0x7f814815e770 2023-08-26T09:25:44.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.039+0000 7f814c8c6700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f814815eb50 con 0x7f81480caf00 2023-08-26T09:25:44.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.039+0000 7f814c8c6700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f814806f470 con 0x7f814806ce50 2023-08-26T09:25:44.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.039+0000 7f8146d9d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f81480caf00 0x7f81480cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:44.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.039+0000 7f8146d9d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f81480caf00 0x7f81480cb390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45508/0 (socket says 172.21.15.92:45508) 2023-08-26T09:25:44.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.039+0000 7f8146d9d700 1 -- 172.21.15.92:0/4085388634 learned_addr learned my addr 172.21.15.92:0/4085388634 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:44.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.039+0000 7f8145d9b700 1 --2- 172.21.15.92:0/4085388634 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f814806ce50 0x7f814806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:44.049 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.039+0000 7f8146d9d700 1 -- 172.21.15.92:0/4085388634 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f814806ce50 msgr2=0x7f814806d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:44.049 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.039+0000 7f8146d9d700 1 --2- 172.21.15.92:0/4085388634 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f814806ce50 0x7f814806d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:44.049 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.039+0000 7f8146d9d700 1 -- 172.21.15.92:0/4085388634 >> v1:172.21.15.188:6789/0 conn(0x7f814815e770 legacy=0x7f814806ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:44.050 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.039+0000 7f8146d9d700 1 -- 172.21.15.92:0/4085388634 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f814806f750 con 0x7f81480caf00 2023-08-26T09:25:44.050 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.039+0000 7f8145d9b700 1 --2- 172.21.15.92:0/4085388634 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f814806ce50 0x7f814806d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:44.050 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.039+0000 7f8146d9d700 1 --2- 172.21.15.92:0/4085388634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81480caf00 0x7f81480cb390 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8140009e50 tx=0x7f814000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a877f2b01406f3 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:44.050 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.040+0000 7f814559a700 1 -- 172.21.15.92:0/4085388634 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814000e070 con 0x7f81480caf00 2023-08-26T09:25:44.051 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.040+0000 7f814559a700 1 -- 172.21.15.92:0/4085388634 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f814000b9c0 con 0x7f81480caf00 2023-08-26T09:25:44.051 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.040+0000 7f814559a700 1 -- 172.21.15.92:0/4085388634 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814000bd70 con 0x7f81480caf00 2023-08-26T09:25:44.051 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.040+0000 7f814c8c6700 1 -- 172.21.15.92:0/4085388634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81480caf00 msgr2=0x7f81480cb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:44.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.040+0000 7f814c8c6700 1 --2- 172.21.15.92:0/4085388634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81480caf00 0x7f81480cb390 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8140009e50 tx=0x7f814000b330 comp rx=0 tx=0).stop 2023-08-26T09:25:44.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.040+0000 7f814c8c6700 1 -- 172.21.15.92:0/4085388634 shutdown_connections 2023-08-26T09:25:44.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.040+0000 7f814c8c6700 1 --2- 172.21.15.92:0/4085388634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81480caf00 0x7f81480cb390 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:44.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.040+0000 7f814c8c6700 1 --2- 172.21.15.92:0/4085388634 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f814806ce50 0x7f814806d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:44.053 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.040+0000 7f814c8c6700 1 -- 172.21.15.92:0/4085388634 >> 172.21.15.92:0/4085388634 conn(0x7f81480cc7b0 msgr2=0x7f81480ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:44.053 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.040+0000 7f814c8c6700 1 -- 172.21.15.92:0/4085388634 shutdown_connections 2023-08-26T09:25:44.053 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.040+0000 7f814c8c6700 1 -- 172.21.15.92:0/4085388634 wait complete. 2023-08-26T09:25:44.057 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.042+0000 7f814c8c6700 1 Processor -- start 2023-08-26T09:25:44.058 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.042+0000 7f814c8c6700 1 -- start start 2023-08-26T09:25:44.058 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.043+0000 7f814c8c6700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f814806ce50 0x7f814814e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:44.058 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.043+0000 7f814c8c6700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f81480caf00 0x7f8148153890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:44.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.043+0000 7f814c8c6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f814815e770 0x7f81480c5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:44.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.043+0000 7f814c8c6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8148155260 con 0x7f814815e770 2023-08-26T09:25:44.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.043+0000 7f814c8c6700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81481540c0 con 0x7f81480caf00 2023-08-26T09:25:44.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.043+0000 7f814c8c6700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81481543a0 con 0x7f814806ce50 2023-08-26T09:25:44.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.043+0000 7f8146d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f814815e770 0x7f81480c5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:44.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.043+0000 7f8146d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f814815e770 0x7f81480c5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45514/0 (socket says 172.21.15.92:45514) 2023-08-26T09:25:44.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.043+0000 7f8146d9d700 1 -- 172.21.15.92:0/2491482104 learned_addr learned my addr 172.21.15.92:0/2491482104 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:44.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.043+0000 7f814659c700 1 --2- 172.21.15.92:0/2491482104 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f814806ce50 0x7f814814e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:44.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.043+0000 7f8145d9b700 1 --2- 172.21.15.92:0/2491482104 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f81480caf00 0x7f8148153890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:44.061 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.043+0000 7f8146d9d700 1 -- 172.21.15.92:0/2491482104 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f814806ce50 msgr2=0x7f814814e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:44.061 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.043+0000 7f8146d9d700 1 --2- 172.21.15.92:0/2491482104 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f814806ce50 0x7f814814e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:44.061 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.043+0000 7f8146d9d700 1 -- 172.21.15.92:0/2491482104 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f81480caf00 msgr2=0x7f8148153890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:44.061 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.043+0000 7f8146d9d700 1 --2- 172.21.15.92:0/2491482104 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f81480caf00 0x7f8148153890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:44.062 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.043+0000 7f8146d9d700 1 -- 172.21.15.92:0/2491482104 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8140009b30 con 0x7f814815e770 2023-08-26T09:25:44.062 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.043+0000 7f8145d9b700 1 --2- 172.21.15.92:0/2491482104 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f81480caf00 0x7f8148153890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:44.062 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.044+0000 7f8146d9d700 1 --2- 172.21.15.92:0/2491482104 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f814815e770 0x7f81480c5380 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8148072af0 tx=0x7f8140004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:44.062 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.044+0000 7f8136ffd700 1 -- 172.21.15.92:0/2491482104 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8140004250 con 0x7f814815e770 2023-08-26T09:25:44.063 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.044+0000 7f8136ffd700 1 -- 172.21.15.92:0/2491482104 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81400043b0 con 0x7f814815e770 2023-08-26T09:25:44.063 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.044+0000 7f814c8c6700 1 -- 172.21.15.92:0/2491482104 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8148154680 con 0x7f814815e770 2023-08-26T09:25:44.063 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.044+0000 7f8136ffd700 1 -- 172.21.15.92:0/2491482104 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8140004760 con 0x7f814815e770 2023-08-26T09:25:44.063 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.044+0000 7f814c8c6700 1 -- 172.21.15.92:0/2491482104 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8148153dd0 con 0x7f814815e770 2023-08-26T09:25:44.064 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.045+0000 7f814c8c6700 1 -- 172.21.15.92:0/2491482104 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f814804e660 con 0x7f814815e770 2023-08-26T09:25:44.064 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.045+0000 7f8136ffd700 1 -- 172.21.15.92:0/2491482104 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f814001c440 con 0x7f814815e770 2023-08-26T09:25:44.064 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.045+0000 7f8136ffd700 1 --2- 172.21.15.92:0/2491482104 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f812806a0e0 0x7f812806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:44.064 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.046+0000 7f8136ffd700 1 -- 172.21.15.92:0/2491482104 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8140089e80 con 0x7f814815e770 2023-08-26T09:25:44.064 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.046+0000 7f814659c700 1 --2- 172.21.15.92:0/2491482104 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f812806a0e0 0x7f812806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:44.065 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.046+0000 7f814659c700 1 --2- 172.21.15.92:0/2491482104 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f812806a0e0 0x7f812806c5a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f814815dec0 tx=0x7f813c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:44.065 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.050+0000 7f8136ffd700 1 -- 172.21.15.92:0/2491482104 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8140055680 con 0x7f814815e770 2023-08-26T09:25:44.247 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.242+0000 7f814c8c6700 1 -- 172.21.15.92:0/2491482104 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8148071f30 con 0x7f814815e770 2023-08-26T09:25:44.248 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.243+0000 7f8136ffd700 1 -- 172.21.15.92:0/2491482104 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+18209 (secure 0 0 0) 0x7f8140058ca0 con 0x7f814815e770 2023-08-26T09:25:44.249 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:25:44.249 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":20,"fsid":"254a2d31-bd41-4507-8326-1b205ac24377","created":"2023-08-26T09:24:55.352131+0000","modified":"2023-08-26T09:25:15.447635+0000","last_up_change":"2023-08-26T09:25:06.124496+0000","last_in_change":"2023-08-26T09:24:57.840725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-26T09:25:06.650431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-26T09:25:06.973382+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-26T09:25:11.584141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-26T09:25:12.814990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e9e7638-4459-4d8d-8e40-130bcf48df66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6819","nonce":382827192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6824","nonce":382827192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6831","nonce":382827192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6827","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6829","nonce":382827192}]},"public_addr":"172.21.15.92:6819/382827192","cluster_addr":"172.21.15.92:6824/382827192","heartbeat_back_addr":"172.21.15.92:6831/382827192","heartbeat_front_addr":"172.21.15.92:6829/382827192","state":["exists","up"]},{"osd":1,"uuid":"164e68c9-aedd-4df5-9b70-f4b1ec3bda13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6809","nonce":618773438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6811","nonce":618773438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6815","nonce":618773438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6813","nonce":618773438}]},"public_addr":"172.21.15.92:6809/618773438","cluster_addr":"172.21.15.92:6811/618773438","heartbeat_back_addr":"172.21.15.92:6815/618773438","heartbeat_front_addr":"172.21.15.92:6813/618773438","state":["exists","up"]},{"osd":2,"uuid":"8701dfee-629a-4d30-82e4-b8fac340303f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6818","nonce":3697397687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6821","nonce":3697397687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6828","nonce":3697397687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6823","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6825","nonce":3697397687}]},"public_addr":"172.21.15.92:6818/3697397687","cluster_addr":"172.21.15.92:6821/3697397687","heartbeat_back_addr":"172.21.15.92:6828/3697397687","heartbeat_front_addr":"172.21.15.92:6825/3697397687","state":["exists","up"]},{"osd":3,"uuid":"93bdc94d-dc07-495f-995a-a6ad072f0247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6801","nonce":3579846453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6803","nonce":3579846453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6807","nonce":3579846453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6805","nonce":3579846453}]},"public_addr":"172.21.15.92:6801/3579846453","cluster_addr":"172.21.15.92:6803/3579846453","heartbeat_back_addr":"172.21.15.92:6807/3579846453","heartbeat_front_addr":"172.21.15.92:6805/3579846453","state":["exists","up"]},{"osd":4,"uuid":"d9d0ea80-8481-46a7-9677-c338d32cf1d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6809","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6811","nonce":3228383424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6813","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6815","nonce":3228383424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6821","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6823","nonce":3228383424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6817","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6819","nonce":3228383424}]},"public_addr":"172.21.15.188:6811/3228383424","cluster_addr":"172.21.15.188:6815/3228383424","heartbeat_back_addr":"172.21.15.188:6823/3228383424","heartbeat_front_addr":"172.21.15.188:6819/3228383424","state":["exists","up"]},{"osd":5,"uuid":"38d03253-467a-456f-bd5e-5a46532a0b18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6801","nonce":1655821054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6803","nonce":1655821054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6807","nonce":1655821054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6805","nonce":1655821054}]},"public_addr":"172.21.15.188:6801/1655821054","cluster_addr":"172.21.15.188:6803/1655821054","heartbeat_back_addr":"172.21.15.188:6807/1655821054","heartbeat_front_addr":"172.21.15.188:6805/1655821054","state":["exists","up"]},{"osd":6,"uuid":"d61564b5-136f-42e5-a843-626c2017cc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6810","nonce":2069976891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6814","nonce":2069976891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6822","nonce":2069976891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6818","nonce":2069976891}]},"public_addr":"172.21.15.188:6810/2069976891","cluster_addr":"172.21.15.188:6814/2069976891","heartbeat_back_addr":"172.21.15.188:6822/2069976891","heartbeat_front_addr":"172.21.15.188:6818/2069976891","state":["exists","up"]},{"osd":7,"uuid":"fae2949e-0d62-42cd-ba72-08f516084b20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6825","nonce":1882888860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6827","nonce":1882888860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6831","nonce":1882888860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6829","nonce":1882888860}]},"public_addr":"172.21.15.188:6825/1882888860","cluster_addr":"172.21.15.188:6827/1882888860","heartbeat_back_addr":"172.21.15.188:6831/1882888860","heartbeat_front_addr":"172.21.15.188:6829/1882888860","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.038523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.063160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.000857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.975572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.023848+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.765194+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.081365+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:05.110745+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-26T09:25:44.251 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.246+0000 7f814c8c6700 1 -- 172.21.15.92:0/2491482104 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f812806a0e0 msgr2=0x7f812806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:44.251 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.246+0000 7f814c8c6700 1 --2- 172.21.15.92:0/2491482104 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f812806a0e0 0x7f812806c5a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f814815dec0 tx=0x7f813c009040 comp rx=0 tx=0).stop 2023-08-26T09:25:44.252 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.246+0000 7f814c8c6700 1 -- 172.21.15.92:0/2491482104 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f814815e770 msgr2=0x7f81480c5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:44.252 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.246+0000 7f814c8c6700 1 --2- 172.21.15.92:0/2491482104 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f814815e770 0x7f81480c5380 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8148072af0 tx=0x7f8140004ad0 comp rx=0 tx=0).stop 2023-08-26T09:25:44.252 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.246+0000 7f814c8c6700 1 -- 172.21.15.92:0/2491482104 shutdown_connections 2023-08-26T09:25:44.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.246+0000 7f814c8c6700 1 --2- 172.21.15.92:0/2491482104 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f814815e770 0x7f81480c5380 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:44.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.246+0000 7f814c8c6700 1 --2- 172.21.15.92:0/2491482104 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f814806ce50 0x7f814814e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:44.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.246+0000 7f814c8c6700 1 --2- 172.21.15.92:0/2491482104 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f812806a0e0 0x7f812806c5a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:44.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.246+0000 7f814c8c6700 1 --2- 172.21.15.92:0/2491482104 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f81480caf00 0x7f8148153890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:44.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.246+0000 7f814c8c6700 1 -- 172.21.15.92:0/2491482104 >> 172.21.15.92:0/2491482104 conn(0x7f81480cc7b0 msgr2=0x7f81480cba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:44.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.246+0000 7f814c8c6700 1 -- 172.21.15.92:0/2491482104 shutdown_connections 2023-08-26T09:25:44.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.246+0000 7f814c8c6700 1 -- 172.21.15.92:0/2491482104 wait complete. 2023-08-26T09:25:44.263 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-26T09:25:06.650431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-26T09:25:06.973382+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-26T09:25:11.584141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-26T09:25:12.814990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-26T09:25:44.264 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-26T09:25:44.388 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.383+0000 7fde06b33700 1 Processor -- start 2023-08-26T09:25:44.388 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.383+0000 7fde06b33700 1 -- start start 2023-08-26T09:25:44.391 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.384+0000 7fde06b33700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fde0015d220 0x7fde000af390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:44.391 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.384+0000 7fde06b33700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde0006db70 0x7fde00070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:44.391 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.384+0000 7fde06b33700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde000aee50 con 0x7fde00071260 2023-08-26T09:25:44.391 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.384+0000 7fde06b33700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde000af130 con 0x7fde0015d220 2023-08-26T09:25:44.391 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.384+0000 7fde06b33700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde000c4cb0 con 0x7fde0006db70 2023-08-26T09:25:44.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.384+0000 7fde048cf700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fde0015d220 0x7fde000af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:44.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.384+0000 7fde050d0700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fde00071260 0x7fde00160d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:57536/0 (socket says 172.21.15.92:57536) 2023-08-26T09:25:44.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.384+0000 7fde050d0700 1 -- 172.21.15.92:0/2476328201 learned_addr learned my addr 172.21.15.92:0/2476328201 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:44.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.384+0000 7fde048cf700 1 -- 172.21.15.92:0/2476328201 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde0006db70 msgr2=0x7fde00070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:44.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.384+0000 7fddfffff700 1 --2- 172.21.15.92:0/2476328201 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde0006db70 0x7fde00070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:44.393 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.384+0000 7fddff7fe700 1 -- 172.21.15.92:0/2476328201 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 858487188 0 0) 0x7fde000aee50 con 0x7fde00071260 2023-08-26T09:25:44.393 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.384+0000 7fde048cf700 1 --2- 172.21.15.92:0/2476328201 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde0006db70 0x7fde00070d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:44.393 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.384+0000 7fde048cf700 1 -- 172.21.15.92:0/2476328201 >> v1:172.21.15.92:6789/0 conn(0x7fde00071260 legacy=0x7fde00160d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:44.393 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.384+0000 7fde048cf700 1 -- 172.21.15.92:0/2476328201 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde000c4f90 con 0x7fde0015d220 2023-08-26T09:25:44.393 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.384+0000 7fde048cf700 1 --2- 172.21.15.92:0/2476328201 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde0015d220 0x7fde000af390 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fddf4009840 tx=0x7fddf4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed1ca32331c5d678 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:44.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.384+0000 7fddff7fe700 1 -- 172.21.15.92:0/2476328201 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf4011830 con 0x7fde0015d220 2023-08-26T09:25:44.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.385+0000 7fddff7fe700 1 -- 172.21.15.92:0/2476328201 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf4011990 con 0x7fde0015d220 2023-08-26T09:25:44.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.385+0000 7fddff7fe700 1 -- 172.21.15.92:0/2476328201 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf4011d20 con 0x7fde0015d220 2023-08-26T09:25:44.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.385+0000 7fde06b33700 1 -- 172.21.15.92:0/2476328201 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde0015d220 msgr2=0x7fde000af390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:44.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.385+0000 7fde06b33700 1 --2- 172.21.15.92:0/2476328201 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde0015d220 0x7fde000af390 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fddf4009840 tx=0x7fddf4009b50 comp rx=0 tx=0).stop 2023-08-26T09:25:44.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.385+0000 7fde06b33700 1 -- 172.21.15.92:0/2476328201 shutdown_connections 2023-08-26T09:25:44.395 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.385+0000 7fde06b33700 1 --2- 172.21.15.92:0/2476328201 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde0015d220 0x7fde000af390 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:44.395 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.385+0000 7fde06b33700 1 --2- 172.21.15.92:0/2476328201 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde0006db70 0x7fde00070d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:44.395 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.385+0000 7fde06b33700 1 -- 172.21.15.92:0/2476328201 >> 172.21.15.92:0/2476328201 conn(0x7fde0006b430 msgr2=0x7fde0006b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:44.395 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.385+0000 7fde06b33700 1 -- 172.21.15.92:0/2476328201 shutdown_connections 2023-08-26T09:25:44.395 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.385+0000 7fde06b33700 1 -- 172.21.15.92:0/2476328201 wait complete. 2023-08-26T09:25:44.398 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.386+0000 7fde06b33700 1 Processor -- start 2023-08-26T09:25:44.398 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.386+0000 7fde06b33700 1 -- start start 2023-08-26T09:25:44.398 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.387+0000 7fde06b33700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde0006db70 0x7fde000b29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:44.399 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.387+0000 7fde06b33700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fde00071260 0x7fde000b4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:44.399 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.387+0000 7fde06b33700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde0015d220 0x7fde001f63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:44.399 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.387+0000 7fde06b33700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde000b4640 con 0x7fde0006db70 2023-08-26T09:25:44.399 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.387+0000 7fde06b33700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde001f68e0 con 0x7fde00071260 2023-08-26T09:25:44.400 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.387+0000 7fde06b33700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde000b3060 con 0x7fde0015d220 2023-08-26T09:25:44.400 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.387+0000 7fde048cf700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde0006db70 0x7fde000b29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:44.400 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.387+0000 7fde048cf700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde0006db70 0x7fde000b29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45524/0 (socket says 172.21.15.92:45524) 2023-08-26T09:25:44.400 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.387+0000 7fde048cf700 1 -- 172.21.15.92:0/3958182101 learned_addr learned my addr 172.21.15.92:0/3958182101 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:44.400 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.387+0000 7fde048cf700 1 -- 172.21.15.92:0/3958182101 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde0015d220 msgr2=0x7fde001f63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:44.401 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.387+0000 7fde050d0700 1 --2- 172.21.15.92:0/3958182101 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde0015d220 0x7fde001f63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:44.401 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.387+0000 7fde048cf700 1 --2- 172.21.15.92:0/3958182101 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde0015d220 0x7fde001f63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:44.401 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.387+0000 7fde048cf700 1 -- 172.21.15.92:0/3958182101 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fde00071260 msgr2=0x7fde000b4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:44.401 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.387+0000 7fddfffff700 1 --2- 172.21.15.92:0/3958182101 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fde00071260 0x7fde000b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:44.401 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.387+0000 7fde048cf700 1 --2- 172.21.15.92:0/3958182101 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fde00071260 0x7fde000b4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:44.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.387+0000 7fde048cf700 1 -- 172.21.15.92:0/3958182101 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf40094a0 con 0x7fde0006db70 2023-08-26T09:25:44.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.387+0000 7fde050d0700 1 --2- 172.21.15.92:0/3958182101 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde0015d220 0x7fde001f63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:25:44.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.387+0000 7fddfffff700 1 --2- 172.21.15.92:0/3958182101 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fde00071260 0x7fde000b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:25:44.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.388+0000 7fde048cf700 1 --2- 172.21.15.92:0/3958182101 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde0006db70 0x7fde000b29d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fddf4014040 tx=0x7fddf4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:44.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.388+0000 7fddfd7fa700 1 -- 172.21.15.92:0/3958182101 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf40045f0 con 0x7fde0006db70 2023-08-26T09:25:44.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.388+0000 7fddfd7fa700 1 -- 172.21.15.92:0/3958182101 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf401e070 con 0x7fde0006db70 2023-08-26T09:25:44.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.388+0000 7fde06b33700 1 -- 172.21.15.92:0/3958182101 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde000b3340 con 0x7fde0006db70 2023-08-26T09:25:44.404 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.388+0000 7fddfd7fa700 1 -- 172.21.15.92:0/3958182101 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf4003ae0 con 0x7fde0006db70 2023-08-26T09:25:44.404 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.388+0000 7fde06b33700 1 -- 172.21.15.92:0/3958182101 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde000b3900 con 0x7fde0006db70 2023-08-26T09:25:44.404 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.389+0000 7fde06b33700 1 -- 172.21.15.92:0/3958182101 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde0004eeb0 con 0x7fde0006db70 2023-08-26T09:25:44.404 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.389+0000 7fddfd7fa700 1 -- 172.21.15.92:0/3958182101 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fddf4003c40 con 0x7fde0006db70 2023-08-26T09:25:44.404 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.389+0000 7fddfd7fa700 1 --2- 172.21.15.92:0/3958182101 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fdde406a0e0 0x7fdde406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:44.405 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.390+0000 7fddfd7fa700 1 -- 172.21.15.92:0/3958182101 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fddf40896a0 con 0x7fde0006db70 2023-08-26T09:25:44.405 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.390+0000 7fddfffff700 1 --2- 172.21.15.92:0/3958182101 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fdde406a0e0 0x7fdde406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:44.405 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.390+0000 7fddfffff700 1 --2- 172.21.15.92:0/3958182101 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fdde406a0e0 0x7fdde406c5a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fddec006fd0 tx=0x7fddec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:44.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.394+0000 7fddfd7fa700 1 -- 172.21.15.92:0/3958182101 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fddf4054e20 con 0x7fde0006db70 2023-08-26T09:25:44.588 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.583+0000 7fde06b33700 1 -- 172.21.15.92:0/3958182101 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fde000cdf80 con 0x7fde0006db70 2023-08-26T09:25:44.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.583+0000 7fddfd7fa700 1 -- 172.21.15.92:0/3958182101 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7fddf4058440 con 0x7fde0006db70 2023-08-26T09:25:44.589 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 8 2023-08-26T09:25:44.591 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.585+0000 7fde06b33700 1 -- 172.21.15.92:0/3958182101 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fdde406a0e0 msgr2=0x7fdde406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:44.592 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.585+0000 7fde06b33700 1 --2- 172.21.15.92:0/3958182101 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fdde406a0e0 0x7fdde406c5a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fddec006fd0 tx=0x7fddec008040 comp rx=0 tx=0).stop 2023-08-26T09:25:44.592 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.586+0000 7fde06b33700 1 -- 172.21.15.92:0/3958182101 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde0006db70 msgr2=0x7fde000b29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:44.592 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.586+0000 7fde06b33700 1 --2- 172.21.15.92:0/3958182101 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde0006db70 0x7fde000b29d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fddf4014040 tx=0x7fddf4004750 comp rx=0 tx=0).stop 2023-08-26T09:25:44.592 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.586+0000 7fde06b33700 1 -- 172.21.15.92:0/3958182101 shutdown_connections 2023-08-26T09:25:44.593 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.586+0000 7fde06b33700 1 --2- 172.21.15.92:0/3958182101 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde0015d220 0x7fde001f63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:44.593 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.586+0000 7fde06b33700 1 --2- 172.21.15.92:0/3958182101 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde0006db70 0x7fde000b29d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:44.593 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.586+0000 7fde06b33700 1 --2- 172.21.15.92:0/3958182101 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fdde406a0e0 0x7fdde406c5a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:44.594 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.586+0000 7fde06b33700 1 --2- 172.21.15.92:0/3958182101 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fde00071260 0x7fde000b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:44.594 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.586+0000 7fde06b33700 1 -- 172.21.15.92:0/3958182101 >> 172.21.15.92:0/3958182101 conn(0x7fde0006b430 msgr2=0x7fde00156b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:44.594 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.586+0000 7fde06b33700 1 -- 172.21.15.92:0/3958182101 shutdown_connections 2023-08-26T09:25:44.595 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.586+0000 7fde06b33700 1 -- 172.21.15.92:0/3958182101 wait complete. 2023-08-26T09:25:44.603 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-26T09:25:44.727 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.722+0000 7f3af511b700 1 Processor -- start 2023-08-26T09:25:44.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.722+0000 7f3af511b700 1 -- start start 2023-08-26T09:25:44.731 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.723+0000 7f3af511b700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f3af0159dd0 0x7f3af00cf220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:44.731 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.723+0000 7f3af511b700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3af006e110 0x7f3af006e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:44.731 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.723+0000 7f3af511b700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3af006eab0 con 0x7f3af0070d20 2023-08-26T09:25:44.732 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.723+0000 7f3af511b700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3af00c6200 con 0x7f3af0159dd0 2023-08-26T09:25:44.732 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.723+0000 7f3af511b700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3af00ce740 con 0x7f3af006e110 2023-08-26T09:25:44.732 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.724+0000 7f3aef59e700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f3af0070d20 0x7f3af00711b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:57548/0 (socket says 172.21.15.92:57548) 2023-08-26T09:25:44.732 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.724+0000 7f3aef59e700 1 -- 172.21.15.92:0/1871043429 learned_addr learned my addr 172.21.15.92:0/1871043429 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:44.732 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.724+0000 7f3aedd9b700 1 -- 172.21.15.92:0/1871043429 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1357692968 0 0) 0x7f3af006eab0 con 0x7f3af0070d20 2023-08-26T09:25:44.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.724+0000 7f3aeed9d700 1 --2- 172.21.15.92:0/1871043429 >> v2:172.21.15.188:3300/0 conn(0x7f3af0159dd0 0x7f3af00cf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:44.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.724+0000 7f3aee59c700 1 --2- 172.21.15.92:0/1871043429 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3af006e110 0x7f3af006e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:44.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.724+0000 7f3aedd9b700 1 -- 172.21.15.92:0/1871043429 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ad80035b0 con 0x7f3af0070d20 2023-08-26T09:25:44.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.724+0000 7f3aedd9b700 1 -- 172.21.15.92:0/1871043429 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 210518943 0 0) 0x7f3ad80035b0 con 0x7f3af0070d20 2023-08-26T09:25:44.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.724+0000 7f3aedd9b700 1 -- 172.21.15.92:0/1871043429 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3af006e110 msgr2=0x7f3af006e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:44.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.724+0000 7f3aedd9b700 1 --2- 172.21.15.92:0/1871043429 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3af006e110 0x7f3af006e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:44.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.724+0000 7f3aedd9b700 1 -- 172.21.15.92:0/1871043429 >> v2:172.21.15.188:3300/0 conn(0x7f3af0159dd0 msgr2=0x7f3af00cf220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:44.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.724+0000 7f3aedd9b700 1 --2- 172.21.15.92:0/1871043429 >> v2:172.21.15.188:3300/0 conn(0x7f3af0159dd0 0x7f3af00cf220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:44.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.724+0000 7f3aedd9b700 1 -- 172.21.15.92:0/1871043429 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af00cea20 con 0x7f3af0070d20 2023-08-26T09:25:44.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.724+0000 7f3aedd9b700 1 -- 172.21.15.92:0/1871043429 <== mon.0 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1019361464 0 0) 0x7f3ae80019f0 con 0x7f3af0070d20 2023-08-26T09:25:44.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.724+0000 7f3aedd9b700 1 -- 172.21.15.92:0/1871043429 >> v1:172.21.15.92:6789/0 conn(0x7f3af0070d20 legacy=0x7f3af00711b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:44.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.724+0000 7f3aedd9b700 1 --2- 172.21.15.92:0/1871043429 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3af006e110 0x7f3ad8003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:44.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.724+0000 7f3aedd9b700 1 --2- 172.21.15.92:0/1871043429 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ad8003f80 0x7f3ad8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:44.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.724+0000 7f3aedd9b700 1 --2- 172.21.15.92:0/1871043429 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3ad8004d90 0x7f3ad8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:44.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.724+0000 7f3aedd9b700 1 -- 172.21.15.92:0/1871043429 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af00c6200 con 0x7f3ad8003f80 2023-08-26T09:25:44.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.724+0000 7f3aedd9b700 1 -- 172.21.15.92:0/1871043429 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af00ce740 con 0x7f3ad8004d90 2023-08-26T09:25:44.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.724+0000 7f3aedd9b700 1 -- 172.21.15.92:0/1871043429 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad800ba60 con 0x7f3af006e110 2023-08-26T09:25:44.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.724+0000 7f3aee59c700 1 --2- 172.21.15.92:0/1871043429 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ad8003f80 0x7f3ad8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:44.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.724+0000 7f3aeed9d700 1 --2- 172.21.15.92:0/1871043429 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3af006e110 0x7f3ad8003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:44.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.724+0000 7f3aef59e700 1 --2- 172.21.15.92:0/1871043429 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3ad8004d90 0x7f3ad8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:44.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.725+0000 7f3aee59c700 1 -- 172.21.15.92:0/1871043429 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3af006e110 msgr2=0x7f3ad8003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:44.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.725+0000 7f3aee59c700 1 --2- 172.21.15.92:0/1871043429 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3af006e110 0x7f3ad8003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:44.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.725+0000 7f3aee59c700 1 -- 172.21.15.92:0/1871043429 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3ad8004d90 msgr2=0x7f3ad8005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:44.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.725+0000 7f3aee59c700 1 --2- 172.21.15.92:0/1871043429 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3ad8004d90 0x7f3ad8005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:44.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.725+0000 7f3aee59c700 1 -- 172.21.15.92:0/1871043429 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad80035b0 con 0x7f3ad8003f80 2023-08-26T09:25:44.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.725+0000 7f3aeed9d700 1 --2- 172.21.15.92:0/1871043429 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3af006e110 0x7f3ad8003a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:44.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.725+0000 7f3aee59c700 1 --2- 172.21.15.92:0/1871043429 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ad8003f80 0x7f3ad8004850 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3ae0009b90 tx=0x7f3ad8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8410154667b59b4 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:44.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.725+0000 7f3aedd9b700 1 -- 172.21.15.92:0/1871043429 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae000e6c0 con 0x7f3ad8003f80 2023-08-26T09:25:44.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.725+0000 7f3aedd9b700 1 -- 172.21.15.92:0/1871043429 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae000e820 con 0x7f3ad8003f80 2023-08-26T09:25:44.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.725+0000 7f3aedd9b700 1 -- 172.21.15.92:0/1871043429 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae000eb90 con 0x7f3ad8003f80 2023-08-26T09:25:44.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.725+0000 7f3af511b700 1 -- 172.21.15.92:0/1871043429 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ad8003f80 msgr2=0x7f3ad8004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:44.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.725+0000 7f3af511b700 1 --2- 172.21.15.92:0/1871043429 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ad8003f80 0x7f3ad8004850 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3ae0009b90 tx=0x7f3ad8005880 comp rx=0 tx=0).stop 2023-08-26T09:25:44.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.725+0000 7f3aef59e700 1 -- 172.21.15.92:0/1871043429 reap_dead start 2023-08-26T09:25:44.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.725+0000 7f3af511b700 1 -- 172.21.15.92:0/1871043429 shutdown_connections 2023-08-26T09:25:44.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.725+0000 7f3af511b700 1 -- 172.21.15.92:0/1871043429 >> 172.21.15.92:0/1871043429 conn(0x7f3af006b430 msgr2=0x7f3af006b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:44.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.725+0000 7f3af511b700 1 -- 172.21.15.92:0/1871043429 shutdown_connections 2023-08-26T09:25:44.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.725+0000 7f3af511b700 1 -- 172.21.15.92:0/1871043429 wait complete. 2023-08-26T09:25:44.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.727+0000 7f3af511b700 1 Processor -- start 2023-08-26T09:25:44.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.727+0000 7f3af511b700 1 -- start start 2023-08-26T09:25:44.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.728+0000 7f3af511b700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3ad8003f80 0x7f3af015b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:44.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.728+0000 7f3af511b700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3af014c130 0x7f3af015b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:44.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.728+0000 7f3af511b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3af015bf20 0x7f3af0151540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:44.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.728+0000 7f3af511b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af015c3a0 con 0x7f3af015bf20 2023-08-26T09:25:44.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.728+0000 7f3af511b700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af00b4ea0 con 0x7f3ad8003f80 2023-08-26T09:25:44.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.728+0000 7f3af511b700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3af014c5b0 con 0x7f3af014c130 2023-08-26T09:25:44.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.728+0000 7f3aef59e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3af015bf20 0x7f3af0151540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:44.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.728+0000 7f3aef59e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3af015bf20 0x7f3af0151540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45546/0 (socket says 172.21.15.92:45546) 2023-08-26T09:25:44.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.728+0000 7f3aef59e700 1 -- 172.21.15.92:0/975798438 learned_addr learned my addr 172.21.15.92:0/975798438 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:44.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.728+0000 7f3aeed9d700 1 --2- 172.21.15.92:0/975798438 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3ad8003f80 0x7f3af015b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:44.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.728+0000 7f3aee59c700 1 --2- 172.21.15.92:0/975798438 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3af014c130 0x7f3af015b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:44.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.728+0000 7f3aef59e700 1 -- 172.21.15.92:0/975798438 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3af014c130 msgr2=0x7f3af015b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:44.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.728+0000 7f3aef59e700 1 --2- 172.21.15.92:0/975798438 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3af014c130 0x7f3af015b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:44.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.728+0000 7f3aef59e700 1 -- 172.21.15.92:0/975798438 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3ad8003f80 msgr2=0x7f3af015b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:44.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.728+0000 7f3aef59e700 1 --2- 172.21.15.92:0/975798438 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3ad8003f80 0x7f3af015b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:44.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.728+0000 7f3aef59e700 1 -- 172.21.15.92:0/975798438 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af0152120 con 0x7f3af015bf20 2023-08-26T09:25:44.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.728+0000 7f3aee59c700 1 --2- 172.21.15.92:0/975798438 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3af014c130 0x7f3af015b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:44.746 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.728+0000 7f3aef59e700 1 --2- 172.21.15.92:0/975798438 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3af015bf20 0x7f3af0151540 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3af00cdea0 tx=0x7f3ae8007c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:44.746 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.728+0000 7f3ad77fe700 1 -- 172.21.15.92:0/975798438 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae8017070 con 0x7f3af015bf20 2023-08-26T09:25:44.746 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.728+0000 7f3ad77fe700 1 -- 172.21.15.92:0/975798438 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae800ec60 con 0x7f3af015bf20 2023-08-26T09:25:44.746 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.728+0000 7f3af511b700 1 -- 172.21.15.92:0/975798438 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3af015a6a0 con 0x7f3af015bf20 2023-08-26T09:25:44.746 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.728+0000 7f3ad77fe700 1 -- 172.21.15.92:0/975798438 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae8001f00 con 0x7f3af015bf20 2023-08-26T09:25:44.747 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.728+0000 7f3af511b700 1 -- 172.21.15.92:0/975798438 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3af015ac60 con 0x7f3af015bf20 2023-08-26T09:25:44.747 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.729+0000 7f3af511b700 1 -- 172.21.15.92:0/975798438 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3af004eeb0 con 0x7f3af015bf20 2023-08-26T09:25:44.747 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.730+0000 7f3ad77fe700 1 -- 172.21.15.92:0/975798438 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3ae8013420 con 0x7f3af015bf20 2023-08-26T09:25:44.747 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.730+0000 7f3ad77fe700 1 --2- 172.21.15.92:0/975798438 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f3adc06a0e0 0x7f3adc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:44.747 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.730+0000 7f3ad77fe700 1 -- 172.21.15.92:0/975798438 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3ae8088250 con 0x7f3af015bf20 2023-08-26T09:25:44.747 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.730+0000 7f3aeed9d700 1 --2- 172.21.15.92:0/975798438 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f3adc06a0e0 0x7f3adc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:44.748 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.731+0000 7f3aeed9d700 1 --2- 172.21.15.92:0/975798438 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f3adc06a0e0 0x7f3adc06c5a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4009c60 tx=0x7f3ae4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:44.748 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.735+0000 7f3ad77fe700 1 -- 172.21.15.92:0/975798438 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3ae8053930 con 0x7f3af015bf20 2023-08-26T09:25:44.927 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.922+0000 7f3af511b700 1 -- 172.21.15.92:0/975798438 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3af006c290 con 0x7f3af015bf20 2023-08-26T09:25:44.927 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.922+0000 7f3ad77fe700 1 -- 172.21.15.92:0/975798438 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3ae8056f50 con 0x7f3af015bf20 2023-08-26T09:25:44.928 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 1 2023-08-26T09:25:44.929 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.924+0000 7f3af511b700 1 -- 172.21.15.92:0/975798438 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f3adc06a0e0 msgr2=0x7f3adc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:44.930 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.924+0000 7f3af511b700 1 --2- 172.21.15.92:0/975798438 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f3adc06a0e0 0x7f3adc06c5a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4009c60 tx=0x7f3ae4008040 comp rx=0 tx=0).stop 2023-08-26T09:25:44.930 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.924+0000 7f3af511b700 1 -- 172.21.15.92:0/975798438 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3af015bf20 msgr2=0x7f3af0151540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:44.930 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.924+0000 7f3af511b700 1 --2- 172.21.15.92:0/975798438 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3af015bf20 0x7f3af0151540 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3af00cdea0 tx=0x7f3ae8007c90 comp rx=0 tx=0).stop 2023-08-26T09:25:44.930 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.924+0000 7f3af511b700 1 -- 172.21.15.92:0/975798438 shutdown_connections 2023-08-26T09:25:44.930 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.924+0000 7f3af511b700 1 --2- 172.21.15.92:0/975798438 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f3adc06a0e0 0x7f3adc06c5a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:44.931 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.924+0000 7f3af511b700 1 --2- 172.21.15.92:0/975798438 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3ad8003f80 0x7f3af015b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:44.931 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.924+0000 7f3af511b700 1 --2- 172.21.15.92:0/975798438 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3af015bf20 0x7f3af0151540 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:44.931 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.924+0000 7f3af511b700 1 --2- 172.21.15.92:0/975798438 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3af014c130 0x7f3af015b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:44.931 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.924+0000 7f3af511b700 1 -- 172.21.15.92:0/975798438 >> 172.21.15.92:0/975798438 conn(0x7f3af006b430 msgr2=0x7f3af006d820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:44.931 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.924+0000 7f3af511b700 1 -- 172.21.15.92:0/975798438 shutdown_connections 2023-08-26T09:25:44.932 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:44.924+0000 7f3af511b700 1 -- 172.21.15.92:0/975798438 wait complete. 2023-08-26T09:25:44.941 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-26T09:25:45.065 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.060+0000 7f476a334700 1 Processor -- start 2023-08-26T09:25:45.065 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.060+0000 7f476a334700 1 -- start start 2023-08-26T09:25:45.067 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.061+0000 7f476a334700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f476415edd0 0x7f47640d0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:45.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.061+0000 7f476a334700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f47640d0860 0x7f476415ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:45.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.061+0000 7f476a334700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47640d0ca0 con 0x7f47640b2d70 2023-08-26T09:25:45.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.061+0000 7f476a334700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f476406eb10 con 0x7f476415edd0 2023-08-26T09:25:45.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.061+0000 7f476a334700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f476406de90 con 0x7f47640d0860 2023-08-26T09:25:45.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.061+0000 7f47637fe700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f476415edd0 0x7f47640d0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:45.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.061+0000 7f47688d1700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f47640d0860 0x7f476415ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:45.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.061+0000 7f4763fff700 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f47640b2d70 0x7f47640cb4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.92:52674/0 (socket says 172.21.15.92:52674) 2023-08-26T09:25:45.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.061+0000 7f4763fff700 1 -- 172.21.15.92:0/685582506 learned_addr learned my addr 172.21.15.92:0/685582506 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:45.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.062+0000 7f47688d1700 1 -- 172.21.15.92:0/685582506 >> v2:172.21.15.188:3300/0 conn(0x7f476415edd0 msgr2=0x7f47640d0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:45.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.062+0000 7f47688d1700 1 --2- 172.21.15.92:0/685582506 >> v2:172.21.15.188:3300/0 conn(0x7f476415edd0 0x7f47640d0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:45.070 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.062+0000 7f47688d1700 1 -- 172.21.15.92:0/685582506 >> v1:172.21.15.188:6789/0 conn(0x7f47640b2d70 legacy=0x7f47640cb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:45.070 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.062+0000 7f47688d1700 1 -- 172.21.15.92:0/685582506 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f476406e170 con 0x7f47640d0860 2023-08-26T09:25:45.070 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.062+0000 7f47637fe700 1 --2- 172.21.15.92:0/685582506 >> v2:172.21.15.188:3300/0 conn(0x7f476415edd0 0x7f47640d0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-26T09:25:45.070 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.062+0000 7f47688d1700 1 --2- 172.21.15.92:0/685582506 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f47640d0860 0x7f476415ba00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f475c009d90 tx=0x7f475c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e30a58afec85893 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:45.070 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.062+0000 7f4762ffd700 1 -- 172.21.15.92:0/685582506 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475c00e070 con 0x7f47640d0860 2023-08-26T09:25:45.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.062+0000 7f4762ffd700 1 -- 172.21.15.92:0/685582506 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f475c00bb20 con 0x7f47640d0860 2023-08-26T09:25:45.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.062+0000 7f4762ffd700 1 -- 172.21.15.92:0/685582506 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475c012430 con 0x7f47640d0860 2023-08-26T09:25:45.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.062+0000 7f476a334700 1 -- 172.21.15.92:0/685582506 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f47640d0860 msgr2=0x7f476415ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:45.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.062+0000 7f476a334700 1 --2- 172.21.15.92:0/685582506 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f47640d0860 0x7f476415ba00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f475c009d90 tx=0x7f475c00b330 comp rx=0 tx=0).stop 2023-08-26T09:25:45.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.062+0000 7f476a334700 1 -- 172.21.15.92:0/685582506 shutdown_connections 2023-08-26T09:25:45.072 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.062+0000 7f476a334700 1 --2- 172.21.15.92:0/685582506 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f47640d0860 0x7f476415ba00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:45.072 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.062+0000 7f476a334700 1 --2- 172.21.15.92:0/685582506 >> v2:172.21.15.188:3300/0 conn(0x7f476415edd0 0x7f47640d0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:45.072 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.062+0000 7f476a334700 1 -- 172.21.15.92:0/685582506 >> 172.21.15.92:0/685582506 conn(0x7f47640cd8d0 msgr2=0x7f47640cdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:45.072 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.063+0000 7f476a334700 1 -- 172.21.15.92:0/685582506 shutdown_connections 2023-08-26T09:25:45.072 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.063+0000 7f476a334700 1 -- 172.21.15.92:0/685582506 wait complete. 2023-08-26T09:25:45.075 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.064+0000 7f476a334700 1 Processor -- start 2023-08-26T09:25:45.075 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.064+0000 7f476a334700 1 -- start start 2023-08-26T09:25:45.075 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.064+0000 7f476a334700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f47640b2d70 0x7f476414d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:45.076 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.065+0000 7f476a334700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f47640d0860 0x7f4764150440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:45.076 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.065+0000 7f476a334700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f476415edd0 0x7f4764150980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:45.076 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.065+0000 7f476a334700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476414c6f0 con 0x7f476415edd0 2023-08-26T09:25:45.076 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.065+0000 7f476a334700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476414d550 con 0x7f47640b2d70 2023-08-26T09:25:45.076 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.065+0000 7f476a334700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f476414ac10 con 0x7f47640d0860 2023-08-26T09:25:45.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.065+0000 7f47688d1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f476415edd0 0x7f4764150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:45.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.065+0000 7f47688d1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f476415edd0 0x7f4764150980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45560/0 (socket says 172.21.15.92:45560) 2023-08-26T09:25:45.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.065+0000 7f47688d1700 1 -- 172.21.15.92:0/1153113685 learned_addr learned my addr 172.21.15.92:0/1153113685 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:45.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.065+0000 7f47637fe700 1 --2- 172.21.15.92:0/1153113685 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f47640d0860 0x7f4764150440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:45.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.065+0000 7f47688d1700 1 -- 172.21.15.92:0/1153113685 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f47640d0860 msgr2=0x7f4764150440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:45.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.065+0000 7f4763fff700 1 --2- 172.21.15.92:0/1153113685 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f47640b2d70 0x7f476414d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:45.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.065+0000 7f47688d1700 1 --2- 172.21.15.92:0/1153113685 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f47640d0860 0x7f4764150440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:45.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.065+0000 7f47688d1700 1 -- 172.21.15.92:0/1153113685 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f47640b2d70 msgr2=0x7f476414d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:45.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.065+0000 7f47688d1700 1 --2- 172.21.15.92:0/1153113685 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f47640b2d70 0x7f476414d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:45.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.065+0000 7f47688d1700 1 -- 172.21.15.92:0/1153113685 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47540094a0 con 0x7f476415edd0 2023-08-26T09:25:45.079 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.065+0000 7f47688d1700 1 --2- 172.21.15.92:0/1153113685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f476415edd0 0x7f4764150980 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f476406dfd0 tx=0x7f475c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:45.079 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.065+0000 7f4760ff9700 1 -- 172.21.15.92:0/1153113685 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475c012430 con 0x7f476415edd0 2023-08-26T09:25:45.079 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.065+0000 7f4760ff9700 1 -- 172.21.15.92:0/1153113685 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f475c020070 con 0x7f476415edd0 2023-08-26T09:25:45.079 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.065+0000 7f476a334700 1 -- 172.21.15.92:0/1153113685 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f475c009a70 con 0x7f476415edd0 2023-08-26T09:25:45.079 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.065+0000 7f4760ff9700 1 -- 172.21.15.92:0/1153113685 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475c003ea0 con 0x7f476415edd0 2023-08-26T09:25:45.080 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.065+0000 7f476a334700 1 -- 172.21.15.92:0/1153113685 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f476414c940 con 0x7f476415edd0 2023-08-26T09:25:45.080 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.066+0000 7f476a334700 1 -- 172.21.15.92:0/1153113685 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f476404eeb0 con 0x7f476415edd0 2023-08-26T09:25:45.080 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.067+0000 7f4760ff9700 1 -- 172.21.15.92:0/1153113685 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f475c004280 con 0x7f476415edd0 2023-08-26T09:25:45.080 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.067+0000 7f4760ff9700 1 --2- 172.21.15.92:0/1153113685 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f475006a0e0 0x7f475006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:45.080 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.067+0000 7f4760ff9700 1 -- 172.21.15.92:0/1153113685 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f475c022070 con 0x7f476415edd0 2023-08-26T09:25:45.081 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.067+0000 7f4763fff700 1 --2- 172.21.15.92:0/1153113685 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f475006a0e0 0x7f475006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:45.081 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.068+0000 7f4763fff700 1 --2- 172.21.15.92:0/1153113685 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f475006a0e0 0x7f475006c5a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4758005910 tx=0x7f4758009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:45.081 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.071+0000 7f4760ff9700 1 -- 172.21.15.92:0/1153113685 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f475c0560c0 con 0x7f476415edd0 2023-08-26T09:25:45.267 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.262+0000 7f476a334700 1 -- 172.21.15.92:0/1153113685 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f476414d690 con 0x7f476415edd0 2023-08-26T09:25:45.267 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.262+0000 7f4760ff9700 1 -- 172.21.15.92:0/1153113685 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f475c02c0a0 con 0x7f476415edd0 2023-08-26T09:25:45.268 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 32 2023-08-26T09:25:45.270 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.265+0000 7f476a334700 1 -- 172.21.15.92:0/1153113685 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f475006a0e0 msgr2=0x7f475006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:45.270 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.265+0000 7f476a334700 1 --2- 172.21.15.92:0/1153113685 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f475006a0e0 0x7f475006c5a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4758005910 tx=0x7f4758009040 comp rx=0 tx=0).stop 2023-08-26T09:25:45.270 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.265+0000 7f476a334700 1 -- 172.21.15.92:0/1153113685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f476415edd0 msgr2=0x7f4764150980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:45.270 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.265+0000 7f476a334700 1 --2- 172.21.15.92:0/1153113685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f476415edd0 0x7f4764150980 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f476406dfd0 tx=0x7f475c004ad0 comp rx=0 tx=0).stop 2023-08-26T09:25:45.271 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.265+0000 7f476a334700 1 -- 172.21.15.92:0/1153113685 shutdown_connections 2023-08-26T09:25:45.271 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.265+0000 7f476a334700 1 --2- 172.21.15.92:0/1153113685 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f475006a0e0 0x7f475006c5a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:45.271 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.265+0000 7f476a334700 1 --2- 172.21.15.92:0/1153113685 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f47640b2d70 0x7f476414d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:45.271 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.265+0000 7f476a334700 1 --2- 172.21.15.92:0/1153113685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f476415edd0 0x7f4764150980 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:45.271 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.265+0000 7f476a334700 1 --2- 172.21.15.92:0/1153113685 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f47640d0860 0x7f4764150440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:45.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.265+0000 7f476a334700 1 -- 172.21.15.92:0/1153113685 >> 172.21.15.92:0/1153113685 conn(0x7f47640cd8d0 msgr2=0x7f476415de40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:45.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.265+0000 7f476a334700 1 -- 172.21.15.92:0/1153113685 shutdown_connections 2023-08-26T09:25:45.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.265+0000 7f476a334700 1 -- 172.21.15.92:0/1153113685 wait complete. 2023-08-26T09:25:45.282 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-26T09:25:45.405 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.400+0000 7f306979f700 1 Processor -- start 2023-08-26T09:25:45.405 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.400+0000 7f306979f700 1 -- start start 2023-08-26T09:25:45.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.401+0000 7f306979f700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f306415d490 0x7f306406b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:45.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.401+0000 7f306979f700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f30640b6250 0x7f30640b66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:45.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.401+0000 7f306979f700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30640d25d0 con 0x7f30640b1eb0 2023-08-26T09:25:45.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.401+0000 7f306979f700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30640cdc70 con 0x7f306415d490 2023-08-26T09:25:45.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.401+0000 7f306979f700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f306415d870 con 0x7f30640b6250 2023-08-26T09:25:45.409 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.401+0000 7f3062ffd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f306415d490 0x7f306406b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:45.409 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.401+0000 7f30627fc700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f30640b1eb0 0x7f30640ce0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:57578/0 (socket says 172.21.15.92:57578) 2023-08-26T09:25:45.409 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.401+0000 7f30627fc700 1 -- 172.21.15.92:0/4098816142 learned_addr learned my addr 172.21.15.92:0/4098816142 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:45.409 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.401+0000 7f3062ffd700 1 -- 172.21.15.92:0/4098816142 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f30640b6250 msgr2=0x7f30640b66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:45.409 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.401+0000 7f30637fe700 1 --2- 172.21.15.92:0/4098816142 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f30640b6250 0x7f30640b66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:45.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.401+0000 7f3062ffd700 1 --2- 172.21.15.92:0/4098816142 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f30640b6250 0x7f30640b66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:45.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.401+0000 7f3062ffd700 1 -- 172.21.15.92:0/4098816142 >> v1:172.21.15.92:6789/0 conn(0x7f30640b1eb0 legacy=0x7f30640ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:45.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.401+0000 7f3062ffd700 1 -- 172.21.15.92:0/4098816142 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30640b57e0 con 0x7f306415d490 2023-08-26T09:25:45.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.401+0000 7f30637fe700 1 --2- 172.21.15.92:0/4098816142 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f30640b6250 0x7f30640b66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:25:45.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.401+0000 7f3062ffd700 1 --2- 172.21.15.92:0/4098816142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f306415d490 0x7f306406b5e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3058009840 tx=0x7f3058009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85e79d6c3a841a1d server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:45.411 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.402+0000 7f3061ffb700 1 -- 172.21.15.92:0/4098816142 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3058011830 con 0x7f306415d490 2023-08-26T09:25:45.411 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.402+0000 7f3061ffb700 1 -- 172.21.15.92:0/4098816142 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3058011990 con 0x7f306415d490 2023-08-26T09:25:45.411 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.402+0000 7f3061ffb700 1 -- 172.21.15.92:0/4098816142 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3058011d20 con 0x7f306415d490 2023-08-26T09:25:45.411 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.402+0000 7f306979f700 1 -- 172.21.15.92:0/4098816142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f306415d490 msgr2=0x7f306406b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:45.411 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.402+0000 7f306979f700 1 --2- 172.21.15.92:0/4098816142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f306415d490 0x7f306406b5e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3058009840 tx=0x7f3058009b50 comp rx=0 tx=0).stop 2023-08-26T09:25:45.412 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.402+0000 7f306979f700 1 -- 172.21.15.92:0/4098816142 shutdown_connections 2023-08-26T09:25:45.412 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.402+0000 7f306979f700 1 --2- 172.21.15.92:0/4098816142 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f30640b6250 0x7f30640b66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:45.412 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.402+0000 7f306979f700 1 --2- 172.21.15.92:0/4098816142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f306415d490 0x7f306406b5e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:45.412 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.402+0000 7f306979f700 1 -- 172.21.15.92:0/4098816142 >> 172.21.15.92:0/4098816142 conn(0x7f306406aac0 msgr2=0x7f306406aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:45.412 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.402+0000 7f306979f700 1 -- 172.21.15.92:0/4098816142 shutdown_connections 2023-08-26T09:25:45.413 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.402+0000 7f306979f700 1 -- 172.21.15.92:0/4098816142 wait complete. 2023-08-26T09:25:45.415 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.404+0000 7f306979f700 1 Processor -- start 2023-08-26T09:25:45.415 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.404+0000 7f306979f700 1 -- start start 2023-08-26T09:25:45.416 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.405+0000 7f306979f700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f30640b1eb0 0x7f30640c9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:45.416 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.405+0000 7f306979f700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f30640b6250 0x7f30640b1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:45.416 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.405+0000 7f306979f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f306415d490 0x7f30640b6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:45.416 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.405+0000 7f306979f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30640b1780 con 0x7f306415d490 2023-08-26T09:25:45.416 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.405+0000 7f306979f700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30640caad0 con 0x7f30640b1eb0 2023-08-26T09:25:45.417 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.405+0000 7f306979f700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30640cad40 con 0x7f30640b6250 2023-08-26T09:25:45.417 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.405+0000 7f30637fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f306415d490 0x7f30640b6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:45.417 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.405+0000 7f30637fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f306415d490 0x7f30640b6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45574/0 (socket says 172.21.15.92:45574) 2023-08-26T09:25:45.417 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.405+0000 7f30637fe700 1 -- 172.21.15.92:0/1131400042 learned_addr learned my addr 172.21.15.92:0/1131400042 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:45.417 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.405+0000 7f30627fc700 1 --2- 172.21.15.92:0/1131400042 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f30640b6250 0x7f30640b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:45.418 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.405+0000 7f3062ffd700 1 --2- 172.21.15.92:0/1131400042 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f30640b1eb0 0x7f30640c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:45.418 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.405+0000 7f30637fe700 1 -- 172.21.15.92:0/1131400042 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f30640b6250 msgr2=0x7f30640b1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:45.418 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.405+0000 7f30637fe700 1 --2- 172.21.15.92:0/1131400042 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f30640b6250 0x7f30640b1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:45.418 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.405+0000 7f30637fe700 1 -- 172.21.15.92:0/1131400042 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f30640b1eb0 msgr2=0x7f30640c9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:45.418 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.405+0000 7f30637fe700 1 --2- 172.21.15.92:0/1131400042 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f30640b1eb0 0x7f30640c9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:45.419 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.405+0000 7f30637fe700 1 -- 172.21.15.92:0/1131400042 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30580094a0 con 0x7f306415d490 2023-08-26T09:25:45.419 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.405+0000 7f30637fe700 1 --2- 172.21.15.92:0/1131400042 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f306415d490 0x7f30640b6ef0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f305c00cef0 tx=0x7f305c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:45.419 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.405+0000 7f304b7fe700 1 -- 172.21.15.92:0/1131400042 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c00ae50 con 0x7f306415d490 2023-08-26T09:25:45.419 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.406+0000 7f304b7fe700 1 -- 172.21.15.92:0/1131400042 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305c015440 con 0x7f306415d490 2023-08-26T09:25:45.419 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.406+0000 7f306979f700 1 -- 172.21.15.92:0/1131400042 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30640cb020 con 0x7f306415d490 2023-08-26T09:25:45.420 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.406+0000 7f304b7fe700 1 -- 172.21.15.92:0/1131400042 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c0157f0 con 0x7f306415d490 2023-08-26T09:25:45.420 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.406+0000 7f306979f700 1 -- 172.21.15.92:0/1131400042 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30640c7cf0 con 0x7f306415d490 2023-08-26T09:25:45.420 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.407+0000 7f306979f700 1 -- 172.21.15.92:0/1131400042 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30640c9380 con 0x7f306415d490 2023-08-26T09:25:45.420 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.407+0000 7f304b7fe700 1 -- 172.21.15.92:0/1131400042 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f305c00d430 con 0x7f306415d490 2023-08-26T09:25:45.420 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.407+0000 7f304b7fe700 1 --2- 172.21.15.92:0/1131400042 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f305006a110 0x7f305006c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:45.421 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.407+0000 7f304b7fe700 1 -- 172.21.15.92:0/1131400042 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f305c088b30 con 0x7f306415d490 2023-08-26T09:25:45.421 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.407+0000 7f3062ffd700 1 --2- 172.21.15.92:0/1131400042 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f305006a110 0x7f305006c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:45.421 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.408+0000 7f3062ffd700 1 --2- 172.21.15.92:0/1131400042 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f305006a110 0x7f305006c5d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f30580090b0 tx=0x7f3058008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:45.421 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.412+0000 7f304b7fe700 1 -- 172.21.15.92:0/1131400042 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f30640c9380 con 0x7f306415d490 2023-08-26T09:25:45.605 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.600+0000 7f306979f700 1 -- 172.21.15.92:0/1131400042 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f30640c9380 con 0x7f306415d490 2023-08-26T09:25:45.606 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.600+0000 7f304b7fe700 1 -- 172.21.15.92:0/1131400042 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f30640c9380 con 0x7f306415d490 2023-08-26T09:25:45.606 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 64 2023-08-26T09:25:45.607 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.602+0000 7f306979f700 1 -- 172.21.15.92:0/1131400042 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f305006a110 msgr2=0x7f305006c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:45.608 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.602+0000 7f306979f700 1 --2- 172.21.15.92:0/1131400042 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f305006a110 0x7f305006c5d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f30580090b0 tx=0x7f3058008030 comp rx=0 tx=0).stop 2023-08-26T09:25:45.608 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.602+0000 7f306979f700 1 -- 172.21.15.92:0/1131400042 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f306415d490 msgr2=0x7f30640b6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:45.608 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.602+0000 7f306979f700 1 --2- 172.21.15.92:0/1131400042 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f306415d490 0x7f30640b6ef0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f305c00cef0 tx=0x7f305c00a340 comp rx=0 tx=0).stop 2023-08-26T09:25:45.608 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.602+0000 7f306979f700 1 -- 172.21.15.92:0/1131400042 shutdown_connections 2023-08-26T09:25:45.608 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.602+0000 7f306979f700 1 --2- 172.21.15.92:0/1131400042 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f305006a110 0x7f305006c5d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:45.609 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.602+0000 7f306979f700 1 --2- 172.21.15.92:0/1131400042 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f30640b1eb0 0x7f30640c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:45.609 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.602+0000 7f306979f700 1 --2- 172.21.15.92:0/1131400042 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f306415d490 0x7f30640b6ef0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:45.609 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.602+0000 7f306979f700 1 --2- 172.21.15.92:0/1131400042 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f30640b6250 0x7f30640b1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:45.609 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.602+0000 7f306979f700 1 -- 172.21.15.92:0/1131400042 >> 172.21.15.92:0/1131400042 conn(0x7f306406aac0 msgr2=0x7f30640d1e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:45.609 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.602+0000 7f306979f700 1 -- 172.21.15.92:0/1131400042 shutdown_connections 2023-08-26T09:25:45.610 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.602+0000 7f306979f700 1 -- 172.21.15.92:0/1131400042 wait complete. 2023-08-26T09:25:45.643 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-08-26T09:25:45.644 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-08-26T09:25:45.765 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.760+0000 7f1709fa0700 1 Processor -- start 2023-08-26T09:25:45.765 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.760+0000 7f1709fa0700 1 -- start start 2023-08-26T09:25:45.767 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.761+0000 7f1709fa0700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f170415d670 0x7f17040cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:45.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.761+0000 7f1709fa0700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1704066230 0x7f170406a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:45.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.761+0000 7f1709fa0700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17040cbcf0 con 0x7f170406a860 2023-08-26T09:25:45.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.761+0000 7f1709fa0700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f170406acf0 con 0x7f170415d670 2023-08-26T09:25:45.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.761+0000 7f1709fa0700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17040cbfd0 con 0x7f1704066230 2023-08-26T09:25:45.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.761+0000 7f17037fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f170415d670 0x7f17040cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:45.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.761+0000 7f1703fff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f170406a860 0x7f17040b0ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:57596/0 (socket says 172.21.15.92:57596) 2023-08-26T09:25:45.769 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.761+0000 7f1703fff700 1 -- 172.21.15.92:0/767331132 learned_addr learned my addr 172.21.15.92:0/767331132 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:45.769 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.761+0000 7f1702ffd700 1 --2- 172.21.15.92:0/767331132 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1704066230 0x7f170406a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:45.769 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.761+0000 7f17037fe700 1 -- 172.21.15.92:0/767331132 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1704066230 msgr2=0x7f170406a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:45.769 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.761+0000 7f17037fe700 1 --2- 172.21.15.92:0/767331132 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1704066230 0x7f170406a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:45.769 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.761+0000 7f17037fe700 1 -- 172.21.15.92:0/767331132 >> v1:172.21.15.92:6789/0 conn(0x7f170406a860 legacy=0x7f17040b0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:45.770 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.761+0000 7f17037fe700 1 -- 172.21.15.92:0/767331132 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17040cc2b0 con 0x7f170415d670 2023-08-26T09:25:45.770 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.761+0000 7f17027fc700 1 -- 172.21.15.92:0/767331132 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3461802285 0 0) 0x7f17040cbcf0 con 0x7f170406a860 2023-08-26T09:25:45.770 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.761+0000 7f1702ffd700 1 --2- 172.21.15.92:0/767331132 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1704066230 0x7f170406a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:45.770 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.761+0000 7f17037fe700 1 --2- 172.21.15.92:0/767331132 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f170415d670 0x7f17040cfc80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f16f8009820 tx=0x7f16f8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a769d0b10a639f14 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:45.770 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.762+0000 7f17027fc700 1 -- 172.21.15.92:0/767331132 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f8005e30 con 0x7f170415d670 2023-08-26T09:25:45.771 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.762+0000 7f17027fc700 1 -- 172.21.15.92:0/767331132 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f8006030 con 0x7f170415d670 2023-08-26T09:25:45.771 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.762+0000 7f17027fc700 1 -- 172.21.15.92:0/767331132 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f80063e0 con 0x7f170415d670 2023-08-26T09:25:45.771 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.762+0000 7f1709fa0700 1 -- 172.21.15.92:0/767331132 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f170415d670 msgr2=0x7f17040cfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:45.771 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.762+0000 7f1709fa0700 1 --2- 172.21.15.92:0/767331132 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f170415d670 0x7f17040cfc80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f16f8009820 tx=0x7f16f8009b30 comp rx=0 tx=0).stop 2023-08-26T09:25:45.771 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.762+0000 7f1709fa0700 1 -- 172.21.15.92:0/767331132 shutdown_connections 2023-08-26T09:25:45.772 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.762+0000 7f1709fa0700 1 --2- 172.21.15.92:0/767331132 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f170415d670 0x7f17040cfc80 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:45.772 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.762+0000 7f1709fa0700 1 --2- 172.21.15.92:0/767331132 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1704066230 0x7f170406a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:45.772 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.762+0000 7f1709fa0700 1 -- 172.21.15.92:0/767331132 >> 172.21.15.92:0/767331132 conn(0x7f17040b23c0 msgr2=0x7f17040b27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:45.772 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.762+0000 7f1709fa0700 1 -- 172.21.15.92:0/767331132 shutdown_connections 2023-08-26T09:25:45.772 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.762+0000 7f1709fa0700 1 -- 172.21.15.92:0/767331132 wait complete. 2023-08-26T09:25:45.775 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.763+0000 7f1709fa0700 1 Processor -- start 2023-08-26T09:25:45.775 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.764+0000 7f1709fa0700 1 -- start start 2023-08-26T09:25:45.775 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.764+0000 7f1709fa0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1704066230 0x7f170409cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:45.775 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.764+0000 7f1709fa0700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f170406a860 0x7f17040c6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:45.775 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.764+0000 7f1709fa0700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f17040ca5e0 0x7f17040b0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:45.776 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.764+0000 7f1709fa0700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17040c6d40 con 0x7f1704066230 2023-08-26T09:25:45.776 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.764+0000 7f1709fa0700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17040c5060 con 0x7f170406a860 2023-08-26T09:25:45.776 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.764+0000 7f1709fa0700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17040cd140 con 0x7f17040ca5e0 2023-08-26T09:25:45.776 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.764+0000 7f17037fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1704066230 0x7f170409cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:45.776 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.764+0000 7f17037fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1704066230 0x7f170409cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45584/0 (socket says 172.21.15.92:45584) 2023-08-26T09:25:45.777 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.764+0000 7f17037fe700 1 -- 172.21.15.92:0/3395359387 learned_addr learned my addr 172.21.15.92:0/3395359387 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:45.777 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.764+0000 7f1703fff700 1 --2- 172.21.15.92:0/3395359387 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f17040ca5e0 0x7f17040b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:45.777 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.764+0000 7f1702ffd700 1 --2- 172.21.15.92:0/3395359387 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f170406a860 0x7f17040c6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:45.777 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.765+0000 7f17037fe700 1 -- 172.21.15.92:0/3395359387 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f17040ca5e0 msgr2=0x7f17040b0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:45.778 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.765+0000 7f17037fe700 1 --2- 172.21.15.92:0/3395359387 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f17040ca5e0 0x7f17040b0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:45.778 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.765+0000 7f17037fe700 1 -- 172.21.15.92:0/3395359387 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f170406a860 msgr2=0x7f17040c6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:45.778 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.765+0000 7f17037fe700 1 --2- 172.21.15.92:0/3395359387 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f170406a860 0x7f17040c6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:45.778 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.765+0000 7f17037fe700 1 -- 172.21.15.92:0/3395359387 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f8009430 con 0x7f1704066230 2023-08-26T09:25:45.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.765+0000 7f1703fff700 1 --2- 172.21.15.92:0/3395359387 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f17040ca5e0 0x7f17040b0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:45.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.765+0000 7f17037fe700 1 --2- 172.21.15.92:0/3395359387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1704066230 0x7f170409cd10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1704070680 tx=0x7f16f8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:45.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.765+0000 7f16ebfff700 1 -- 172.21.15.92:0/3395359387 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f8006950 con 0x7f1704066230 2023-08-26T09:25:45.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.765+0000 7f16ebfff700 1 -- 172.21.15.92:0/3395359387 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f8020070 con 0x7f1704066230 2023-08-26T09:25:45.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.765+0000 7f1709fa0700 1 -- 172.21.15.92:0/3395359387 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17040cd420 con 0x7f1704066230 2023-08-26T09:25:45.780 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.765+0000 7f16ebfff700 1 -- 172.21.15.92:0/3395359387 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f8025670 con 0x7f1704066230 2023-08-26T09:25:45.780 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.765+0000 7f1709fa0700 1 -- 172.21.15.92:0/3395359387 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17040cd9e0 con 0x7f1704066230 2023-08-26T09:25:45.780 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.766+0000 7f1709fa0700 1 -- 172.21.15.92:0/3395359387 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f170404e660 con 0x7f1704066230 2023-08-26T09:25:45.780 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.767+0000 7f16ebfff700 1 -- 172.21.15.92:0/3395359387 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f16f8022030 con 0x7f1704066230 2023-08-26T09:25:45.780 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.767+0000 7f16ebfff700 1 --2- 172.21.15.92:0/3395359387 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f16f006a0e0 0x7f16f006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:45.780 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.767+0000 7f16ebfff700 1 -- 172.21.15.92:0/3395359387 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f16f8089b40 con 0x7f1704066230 2023-08-26T09:25:45.781 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.767+0000 7f1702ffd700 1 --2- 172.21.15.92:0/3395359387 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f16f006a0e0 0x7f16f006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:45.781 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.767+0000 7f1702ffd700 1 --2- 172.21.15.92:0/3395359387 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f16f006a0e0 0x7f16f006c5a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f170409d250 tx=0x7f16f4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:45.781 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:45.771+0000 7f16ebfff700 1 -- 172.21.15.92:0/3395359387 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f16f8055230 con 0x7f1704066230 2023-08-26T09:25:46.045 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.040+0000 7f1709fa0700 1 -- 172.21.15.92:0/3395359387 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f170406b690 con 0x7f1704066230 2023-08-26T09:25:46.161 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.157+0000 7f16ebfff700 1 -- 172.21.15.92:0/3395359387 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v50) v1 ==== 147+0+0 (secure 0 0 0) 0x7f16f8058850 con 0x7f1704066230 2023-08-26T09:25:46.164 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.159+0000 7f1709fa0700 1 -- 172.21.15.92:0/3395359387 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f16f006a0e0 msgr2=0x7f16f006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:46.164 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.159+0000 7f1709fa0700 1 --2- 172.21.15.92:0/3395359387 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f16f006a0e0 0x7f16f006c5a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f170409d250 tx=0x7f16f4008040 comp rx=0 tx=0).stop 2023-08-26T09:25:46.164 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.159+0000 7f1709fa0700 1 -- 172.21.15.92:0/3395359387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1704066230 msgr2=0x7f170409cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:46.165 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.159+0000 7f1709fa0700 1 --2- 172.21.15.92:0/3395359387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1704066230 0x7f170409cd10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1704070680 tx=0x7f16f8004750 comp rx=0 tx=0).stop 2023-08-26T09:25:46.165 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.159+0000 7f1709fa0700 1 -- 172.21.15.92:0/3395359387 shutdown_connections 2023-08-26T09:25:46.165 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.159+0000 7f1709fa0700 1 --2- 172.21.15.92:0/3395359387 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f17040ca5e0 0x7f17040b0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:46.165 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.159+0000 7f1709fa0700 1 --2- 172.21.15.92:0/3395359387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1704066230 0x7f170409cd10 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:46.165 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.159+0000 7f1709fa0700 1 --2- 172.21.15.92:0/3395359387 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f16f006a0e0 0x7f16f006c5a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:46.166 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.159+0000 7f1709fa0700 1 --2- 172.21.15.92:0/3395359387 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f170406a860 0x7f17040c6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:46.166 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.159+0000 7f1709fa0700 1 -- 172.21.15.92:0/3395359387 >> 172.21.15.92:0/3395359387 conn(0x7f17040b23c0 msgr2=0x7f170406d750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:46.166 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.159+0000 7f1709fa0700 1 -- 172.21.15.92:0/3395359387 shutdown_connections 2023-08-26T09:25:46.166 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.159+0000 7f1709fa0700 1 -- 172.21.15.92:0/3395359387 wait complete. 2023-08-26T09:25:46.176 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-26T09:25:46.296 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.291+0000 7f9b8ec5a700 1 Processor -- start 2023-08-26T09:25:46.297 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.292+0000 7f9b8ec5a700 1 -- start start 2023-08-26T09:25:46.299 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.292+0000 7f9b8ec5a700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9b8815d550 0x7f9b880ce050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:46.299 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.292+0000 7f9b8ec5a700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f9b880d1dd0 0x7f9b880b71c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:46.299 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.292+0000 7f9b8ec5a700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b880b64b0 con 0x7f9b880ce590 2023-08-26T09:25:46.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.292+0000 7f9b8ec5a700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b8815d930 con 0x7f9b880d1dd0 2023-08-26T09:25:46.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.292+0000 7f9b8ec5a700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b880cea10 con 0x7f9b8815d550 2023-08-26T09:25:46.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.292+0000 7f9b8d1f7700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f9b880d1dd0 0x7f9b880b71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:46.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.292+0000 7f9b8d1f7700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f9b880d1dd0 0x7f9b880b71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45592/0 (socket says 172.21.15.92:45592) 2023-08-26T09:25:46.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.292+0000 7f9b87fff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f9b880ce590 0x7f9b880d16c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:57606/0 (socket says 172.21.15.92:57606) 2023-08-26T09:25:46.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.292+0000 7f9b8d1f7700 1 -- 172.21.15.92:0/824687853 learned_addr learned my addr 172.21.15.92:0/824687853 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:46.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.293+0000 7f9b8c9f6700 1 --2- 172.21.15.92:0/824687853 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9b8815d550 0x7f9b880ce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:46.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.293+0000 7f9b8d1f7700 1 -- 172.21.15.92:0/824687853 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9b8815d550 msgr2=0x7f9b880ce050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:46.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.293+0000 7f9b8d1f7700 1 --2- 172.21.15.92:0/824687853 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9b8815d550 0x7f9b880ce050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:46.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.293+0000 7f9b8d1f7700 1 -- 172.21.15.92:0/824687853 >> v1:172.21.15.92:6789/0 conn(0x7f9b880ce590 legacy=0x7f9b880d16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:46.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.293+0000 7f9b877fe700 1 -- 172.21.15.92:0/824687853 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3438723108 0 0) 0x7f9b880b64b0 con 0x7f9b880ce590 2023-08-26T09:25:46.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.293+0000 7f9b8d1f7700 1 -- 172.21.15.92:0/824687853 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b880b6d30 con 0x7f9b880d1dd0 2023-08-26T09:25:46.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.293+0000 7f9b8d1f7700 1 --2- 172.21.15.92:0/824687853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b880d1dd0 0x7f9b880b71c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9b80009e50 tx=0x7f9b8000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fb8332a0d6f02fb server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:46.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.293+0000 7f9b877fe700 1 -- 172.21.15.92:0/824687853 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8000e070 con 0x7f9b880d1dd0 2023-08-26T09:25:46.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.293+0000 7f9b877fe700 1 -- 172.21.15.92:0/824687853 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8000b9c0 con 0x7f9b880d1dd0 2023-08-26T09:25:46.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.293+0000 7f9b877fe700 1 -- 172.21.15.92:0/824687853 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8000bd70 con 0x7f9b880d1dd0 2023-08-26T09:25:46.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.294+0000 7f9b8ec5a700 1 -- 172.21.15.92:0/824687853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b880d1dd0 msgr2=0x7f9b880b71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:46.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.294+0000 7f9b8ec5a700 1 --2- 172.21.15.92:0/824687853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b880d1dd0 0x7f9b880b71c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9b80009e50 tx=0x7f9b8000b330 comp rx=0 tx=0).stop 2023-08-26T09:25:46.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.294+0000 7f9b8ec5a700 1 -- 172.21.15.92:0/824687853 shutdown_connections 2023-08-26T09:25:46.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.294+0000 7f9b8ec5a700 1 --2- 172.21.15.92:0/824687853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b880d1dd0 0x7f9b880b71c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:46.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.294+0000 7f9b8ec5a700 1 --2- 172.21.15.92:0/824687853 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9b8815d550 0x7f9b880ce050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:46.304 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.294+0000 7f9b8ec5a700 1 -- 172.21.15.92:0/824687853 >> 172.21.15.92:0/824687853 conn(0x7f9b880cfa90 msgr2=0x7f9b880cfea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:46.304 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.294+0000 7f9b8ec5a700 1 -- 172.21.15.92:0/824687853 shutdown_connections 2023-08-26T09:25:46.304 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.294+0000 7f9b8ec5a700 1 -- 172.21.15.92:0/824687853 wait complete. 2023-08-26T09:25:46.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.295+0000 7f9b8ec5a700 1 Processor -- start 2023-08-26T09:25:46.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.295+0000 7f9b8ec5a700 1 -- start start 2023-08-26T09:25:46.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.296+0000 7f9b8ec5a700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9b880ce590 0x7f9b881f2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:46.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.296+0000 7f9b8ec5a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b880d1dd0 0x7f9b8814fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:46.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.296+0000 7f9b8ec5a700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9b8815d550 0x7f9b880b7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:46.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.296+0000 7f9b8ec5a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b880ab320 con 0x7f9b880d1dd0 2023-08-26T09:25:46.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.296+0000 7f9b8ec5a700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b880aa6a0 con 0x7f9b8815d550 2023-08-26T09:25:46.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.296+0000 7f9b8ec5a700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b880aa980 con 0x7f9b880ce590 2023-08-26T09:25:46.309 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.296+0000 7f9b87fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b880d1dd0 0x7f9b8814fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:46.309 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.296+0000 7f9b87fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b880d1dd0 0x7f9b8814fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45596/0 (socket says 172.21.15.92:45596) 2023-08-26T09:25:46.309 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.296+0000 7f9b87fff700 1 -- 172.21.15.92:0/1260912093 learned_addr learned my addr 172.21.15.92:0/1260912093 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:46.309 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.296+0000 7f9b8c9f6700 1 --2- 172.21.15.92:0/1260912093 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9b880ce590 0x7f9b881f2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:46.309 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.296+0000 7f9b8d1f7700 1 --2- 172.21.15.92:0/1260912093 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9b8815d550 0x7f9b880b7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:46.310 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.296+0000 7f9b87fff700 1 -- 172.21.15.92:0/1260912093 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9b880ce590 msgr2=0x7f9b881f2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:46.310 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.296+0000 7f9b87fff700 1 --2- 172.21.15.92:0/1260912093 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9b880ce590 0x7f9b881f2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:46.310 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.296+0000 7f9b87fff700 1 -- 172.21.15.92:0/1260912093 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9b8815d550 msgr2=0x7f9b880b7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:46.310 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.296+0000 7f9b87fff700 1 --2- 172.21.15.92:0/1260912093 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9b8815d550 0x7f9b880b7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:46.310 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.296+0000 7f9b87fff700 1 -- 172.21.15.92:0/1260912093 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b80009b30 con 0x7f9b880d1dd0 2023-08-26T09:25:46.311 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.296+0000 7f9b8d1f7700 1 --2- 172.21.15.92:0/1260912093 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9b8815d550 0x7f9b880b7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:46.311 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.296+0000 7f9b8c9f6700 1 --2- 172.21.15.92:0/1260912093 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9b880ce590 0x7f9b881f2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:46.311 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.296+0000 7f9b87fff700 1 --2- 172.21.15.92:0/1260912093 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b880d1dd0 0x7f9b8814fc90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9b7400c550 tx=0x7f9b7400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:46.311 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.296+0000 7f9b857fa700 1 -- 172.21.15.92:0/1260912093 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b74004c80 con 0x7f9b880d1dd0 2023-08-26T09:25:46.311 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.296+0000 7f9b857fa700 1 -- 172.21.15.92:0/1260912093 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b74004e00 con 0x7f9b880d1dd0 2023-08-26T09:25:46.312 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.296+0000 7f9b8ec5a700 1 -- 172.21.15.92:0/1260912093 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b880aac60 con 0x7f9b880d1dd0 2023-08-26T09:25:46.312 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.296+0000 7f9b857fa700 1 -- 172.21.15.92:0/1260912093 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b74007310 con 0x7f9b880d1dd0 2023-08-26T09:25:46.312 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.297+0000 7f9b8ec5a700 1 -- 172.21.15.92:0/1260912093 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b881f2850 con 0x7f9b880d1dd0 2023-08-26T09:25:46.312 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.297+0000 7f9b8ec5a700 1 -- 172.21.15.92:0/1260912093 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b8804e660 con 0x7f9b880d1dd0 2023-08-26T09:25:46.312 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.298+0000 7f9b857fa700 1 -- 172.21.15.92:0/1260912093 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9b74007470 con 0x7f9b880d1dd0 2023-08-26T09:25:46.313 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.298+0000 7f9b857fa700 1 --2- 172.21.15.92:0/1260912093 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f9b6c06a0e0 0x7f9b6c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:46.313 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.298+0000 7f9b857fa700 1 -- 172.21.15.92:0/1260912093 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9b740881c0 con 0x7f9b880d1dd0 2023-08-26T09:25:46.313 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.298+0000 7f9b8c9f6700 1 --2- 172.21.15.92:0/1260912093 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f9b6c06a0e0 0x7f9b6c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:46.313 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.299+0000 7f9b8c9f6700 1 --2- 172.21.15.92:0/1260912093 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f9b6c06a0e0 0x7f9b6c06c5a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c00aa50 tx=0x7f9b7c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:46.313 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.302+0000 7f9b857fa700 1 -- 172.21.15.92:0/1260912093 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9b74053940 con 0x7f9b880d1dd0 2023-08-26T09:25:46.501 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.496+0000 7f9b8ec5a700 1 -- 172.21.15.92:0/1260912093 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b880b5330 con 0x7f9b880d1dd0 2023-08-26T09:25:46.502 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.497+0000 7f9b857fa700 1 -- 172.21.15.92:0/1260912093 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+18209 (secure 0 0 0) 0x7f9b74056f60 con 0x7f9b880d1dd0 2023-08-26T09:25:46.503 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:25:46.503 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":20,"fsid":"254a2d31-bd41-4507-8326-1b205ac24377","created":"2023-08-26T09:24:55.352131+0000","modified":"2023-08-26T09:25:15.447635+0000","last_up_change":"2023-08-26T09:25:06.124496+0000","last_in_change":"2023-08-26T09:24:57.840725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-26T09:25:06.650431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-26T09:25:06.973382+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-26T09:25:11.584141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-26T09:25:12.814990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e9e7638-4459-4d8d-8e40-130bcf48df66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6819","nonce":382827192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6824","nonce":382827192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6831","nonce":382827192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6827","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6829","nonce":382827192}]},"public_addr":"172.21.15.92:6819/382827192","cluster_addr":"172.21.15.92:6824/382827192","heartbeat_back_addr":"172.21.15.92:6831/382827192","heartbeat_front_addr":"172.21.15.92:6829/382827192","state":["exists","up"]},{"osd":1,"uuid":"164e68c9-aedd-4df5-9b70-f4b1ec3bda13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6809","nonce":618773438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6811","nonce":618773438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6815","nonce":618773438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6813","nonce":618773438}]},"public_addr":"172.21.15.92:6809/618773438","cluster_addr":"172.21.15.92:6811/618773438","heartbeat_back_addr":"172.21.15.92:6815/618773438","heartbeat_front_addr":"172.21.15.92:6813/618773438","state":["exists","up"]},{"osd":2,"uuid":"8701dfee-629a-4d30-82e4-b8fac340303f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6818","nonce":3697397687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6821","nonce":3697397687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6828","nonce":3697397687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6823","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6825","nonce":3697397687}]},"public_addr":"172.21.15.92:6818/3697397687","cluster_addr":"172.21.15.92:6821/3697397687","heartbeat_back_addr":"172.21.15.92:6828/3697397687","heartbeat_front_addr":"172.21.15.92:6825/3697397687","state":["exists","up"]},{"osd":3,"uuid":"93bdc94d-dc07-495f-995a-a6ad072f0247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6801","nonce":3579846453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6803","nonce":3579846453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6807","nonce":3579846453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6805","nonce":3579846453}]},"public_addr":"172.21.15.92:6801/3579846453","cluster_addr":"172.21.15.92:6803/3579846453","heartbeat_back_addr":"172.21.15.92:6807/3579846453","heartbeat_front_addr":"172.21.15.92:6805/3579846453","state":["exists","up"]},{"osd":4,"uuid":"d9d0ea80-8481-46a7-9677-c338d32cf1d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6809","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6811","nonce":3228383424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6813","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6815","nonce":3228383424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6821","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6823","nonce":3228383424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6817","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6819","nonce":3228383424}]},"public_addr":"172.21.15.188:6811/3228383424","cluster_addr":"172.21.15.188:6815/3228383424","heartbeat_back_addr":"172.21.15.188:6823/3228383424","heartbeat_front_addr":"172.21.15.188:6819/3228383424","state":["exists","up"]},{"osd":5,"uuid":"38d03253-467a-456f-bd5e-5a46532a0b18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6801","nonce":1655821054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6803","nonce":1655821054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6807","nonce":1655821054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6805","nonce":1655821054}]},"public_addr":"172.21.15.188:6801/1655821054","cluster_addr":"172.21.15.188:6803/1655821054","heartbeat_back_addr":"172.21.15.188:6807/1655821054","heartbeat_front_addr":"172.21.15.188:6805/1655821054","state":["exists","up"]},{"osd":6,"uuid":"d61564b5-136f-42e5-a843-626c2017cc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6810","nonce":2069976891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6814","nonce":2069976891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6822","nonce":2069976891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6818","nonce":2069976891}]},"public_addr":"172.21.15.188:6810/2069976891","cluster_addr":"172.21.15.188:6814/2069976891","heartbeat_back_addr":"172.21.15.188:6822/2069976891","heartbeat_front_addr":"172.21.15.188:6818/2069976891","state":["exists","up"]},{"osd":7,"uuid":"fae2949e-0d62-42cd-ba72-08f516084b20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6825","nonce":1882888860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6827","nonce":1882888860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6831","nonce":1882888860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6829","nonce":1882888860}]},"public_addr":"172.21.15.188:6825/1882888860","cluster_addr":"172.21.15.188:6827/1882888860","heartbeat_back_addr":"172.21.15.188:6831/1882888860","heartbeat_front_addr":"172.21.15.188:6829/1882888860","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.038523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.063160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.000857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.975572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.023848+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.765194+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.081365+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:05.110745+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-26T09:25:46.505 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.500+0000 7f9b8ec5a700 1 -- 172.21.15.92:0/1260912093 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f9b6c06a0e0 msgr2=0x7f9b6c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:46.505 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.500+0000 7f9b8ec5a700 1 --2- 172.21.15.92:0/1260912093 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f9b6c06a0e0 0x7f9b6c06c5a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c00aa50 tx=0x7f9b7c008040 comp rx=0 tx=0).stop 2023-08-26T09:25:46.505 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.500+0000 7f9b8ec5a700 1 -- 172.21.15.92:0/1260912093 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b880d1dd0 msgr2=0x7f9b8814fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:46.505 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.500+0000 7f9b8ec5a700 1 --2- 172.21.15.92:0/1260912093 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b880d1dd0 0x7f9b8814fc90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9b7400c550 tx=0x7f9b7400c910 comp rx=0 tx=0).stop 2023-08-26T09:25:46.506 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.500+0000 7f9b8ec5a700 1 -- 172.21.15.92:0/1260912093 shutdown_connections 2023-08-26T09:25:46.506 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.500+0000 7f9b8ec5a700 1 --2- 172.21.15.92:0/1260912093 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f9b6c06a0e0 0x7f9b6c06c5a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:46.506 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.500+0000 7f9b8ec5a700 1 --2- 172.21.15.92:0/1260912093 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9b8815d550 0x7f9b880b7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:46.506 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.500+0000 7f9b8ec5a700 1 --2- 172.21.15.92:0/1260912093 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9b880ce590 0x7f9b881f2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:46.506 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.500+0000 7f9b8ec5a700 1 --2- 172.21.15.92:0/1260912093 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b880d1dd0 0x7f9b8814fc90 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:46.507 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.500+0000 7f9b8ec5a700 1 -- 172.21.15.92:0/1260912093 >> 172.21.15.92:0/1260912093 conn(0x7f9b880cfa90 msgr2=0x7f9b880c8780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:46.507 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.500+0000 7f9b8ec5a700 1 -- 172.21.15.92:0/1260912093 shutdown_connections 2023-08-26T09:25:46.507 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.500+0000 7f9b8ec5a700 1 -- 172.21.15.92:0/1260912093 wait complete. 2023-08-26T09:25:46.517 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-26T09:25:06.650431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-26T09:25:06.973382+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-26T09:25:11.584141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-26T09:25:12.814990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-26T09:25:46.518 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-26T09:25:46.640 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.636+0000 7f34644e0700 1 Processor -- start 2023-08-26T09:25:46.641 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.636+0000 7f34644e0700 1 -- start start 2023-08-26T09:25:46.643 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.636+0000 7f34644e0700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f345c0ce150 0x7f345c0ceb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:46.643 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.637+0000 7f34644e0700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f345c0c9aa0 0x7f345c0c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:46.644 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.637+0000 7f34644e0700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f345c0cd3b0 con 0x7f345c15def0 2023-08-26T09:25:46.644 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.637+0000 7f34644e0700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f345c0ca470 con 0x7f345c0c9aa0 2023-08-26T09:25:46.644 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.637+0000 7f34644e0700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f345c0cd690 con 0x7f345c0ce150 2023-08-26T09:25:46.644 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.637+0000 7f346227c700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f345c15def0 0x7f345c15e2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:57616/0 (socket says 172.21.15.92:57616) 2023-08-26T09:25:46.644 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.637+0000 7f346227c700 1 -- 172.21.15.92:0/3023434708 learned_addr learned my addr 172.21.15.92:0/3023434708 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:46.645 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.637+0000 7f3462a7d700 1 --2- 172.21.15.92:0/3023434708 >> v2:172.21.15.92:3300/0 conn(0x7f345c0c9aa0 0x7f345c0c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:46.645 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.637+0000 7f3461a7b700 1 --2- 172.21.15.92:0/3023434708 >> v2:172.21.15.188:3300/0 conn(0x7f345c0ce150 0x7f345c0ceb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:46.645 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.637+0000 7f346127a700 1 -- 172.21.15.92:0/3023434708 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2956436327 0 0) 0x7f345c0cd3b0 con 0x7f345c15def0 2023-08-26T09:25:46.645 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.637+0000 7f346127a700 1 -- 172.21.15.92:0/3023434708 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34480035b0 con 0x7f345c15def0 2023-08-26T09:25:46.645 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.637+0000 7f3462a7d700 1 -- 172.21.15.92:0/3023434708 >> v2:172.21.15.188:3300/0 conn(0x7f345c0ce150 msgr2=0x7f345c0ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:46.646 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.637+0000 7f3462a7d700 1 --2- 172.21.15.92:0/3023434708 >> v2:172.21.15.188:3300/0 conn(0x7f345c0ce150 0x7f345c0ceb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:46.646 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.637+0000 7f3462a7d700 1 -- 172.21.15.92:0/3023434708 >> v1:172.21.15.92:6789/0 conn(0x7f345c15def0 legacy=0x7f345c15e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:46.646 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.637+0000 7f3462a7d700 1 -- 172.21.15.92:0/3023434708 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f345c0cd970 con 0x7f345c0c9aa0 2023-08-26T09:25:46.646 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.637+0000 7f3462a7d700 1 --2- 172.21.15.92:0/3023434708 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f345c0c9aa0 0x7f345c0c9f30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3454009d90 tx=0x7f345400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=becef9e491b73c1c server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:46.646 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.637+0000 7f346127a700 1 -- 172.21.15.92:0/3023434708 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345400e070 con 0x7f345c0c9aa0 2023-08-26T09:25:46.646 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.637+0000 7f346127a700 1 -- 172.21.15.92:0/3023434708 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f345400bae0 con 0x7f345c0c9aa0 2023-08-26T09:25:46.647 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.637+0000 7f346127a700 1 -- 172.21.15.92:0/3023434708 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345400be90 con 0x7f345c0c9aa0 2023-08-26T09:25:46.647 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.638+0000 7f34644e0700 1 -- 172.21.15.92:0/3023434708 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f345c0c9aa0 msgr2=0x7f345c0c9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:46.647 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.638+0000 7f34644e0700 1 --2- 172.21.15.92:0/3023434708 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f345c0c9aa0 0x7f345c0c9f30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3454009d90 tx=0x7f345400b330 comp rx=0 tx=0).stop 2023-08-26T09:25:46.647 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.638+0000 7f34644e0700 1 -- 172.21.15.92:0/3023434708 shutdown_connections 2023-08-26T09:25:46.647 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.638+0000 7f34644e0700 1 --2- 172.21.15.92:0/3023434708 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f345c0c9aa0 0x7f345c0c9f30 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:46.648 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.638+0000 7f34644e0700 1 --2- 172.21.15.92:0/3023434708 >> v2:172.21.15.188:3300/0 conn(0x7f345c0ce150 0x7f345c0ceb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:46.648 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.638+0000 7f34644e0700 1 -- 172.21.15.92:0/3023434708 >> 172.21.15.92:0/3023434708 conn(0x7f345c0cf450 msgr2=0x7f345c0cf860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:46.648 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.638+0000 7f34644e0700 1 -- 172.21.15.92:0/3023434708 shutdown_connections 2023-08-26T09:25:46.648 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.638+0000 7f34644e0700 1 -- 172.21.15.92:0/3023434708 wait complete. 2023-08-26T09:25:46.651 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.639+0000 7f34644e0700 1 Processor -- start 2023-08-26T09:25:46.651 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.639+0000 7f34644e0700 1 -- start start 2023-08-26T09:25:46.651 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.640+0000 7f34644e0700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f345c0c9aa0 0x7f345c0b4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:46.651 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.640+0000 7f34644e0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f345c15def0 0x7f345c145f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:46.652 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.640+0000 7f34644e0700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f345c1464c0 0x7f345c1437c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:46.652 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.640+0000 7f34644e0700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f345c145850 con 0x7f345c15def0 2023-08-26T09:25:46.652 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.640+0000 7f34644e0700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f345c15b1e0 con 0x7f345c0c9aa0 2023-08-26T09:25:46.652 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.640+0000 7f34644e0700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f345c145af0 con 0x7f345c1464c0 2023-08-26T09:25:46.652 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.640+0000 7f3461a7b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f345c15def0 0x7f345c145f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:46.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.640+0000 7f3461a7b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f345c15def0 0x7f345c145f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45610/0 (socket says 172.21.15.92:45610) 2023-08-26T09:25:46.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.640+0000 7f3461a7b700 1 -- 172.21.15.92:0/778092735 learned_addr learned my addr 172.21.15.92:0/778092735 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:46.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.640+0000 7f3461a7b700 1 -- 172.21.15.92:0/778092735 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f345c1464c0 msgr2=0x7f345c1437c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:46.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.640+0000 7f3461a7b700 1 --2- 172.21.15.92:0/778092735 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f345c1464c0 0x7f345c1437c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:46.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.640+0000 7f3461a7b700 1 -- 172.21.15.92:0/778092735 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f345c0c9aa0 msgr2=0x7f345c0b4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:46.654 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.640+0000 7f3461a7b700 1 --2- 172.21.15.92:0/778092735 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f345c0c9aa0 0x7f345c0b4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:46.654 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.640+0000 7f3461a7b700 1 -- 172.21.15.92:0/778092735 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3454009a70 con 0x7f345c15def0 2023-08-26T09:25:46.654 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.640+0000 7f3461a7b700 1 --2- 172.21.15.92:0/778092735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f345c15def0 0x7f345c145f80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f345800e980 tx=0x7f345800ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:46.654 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.640+0000 7f3452ffd700 1 -- 172.21.15.92:0/778092735 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3458009710 con 0x7f345c15def0 2023-08-26T09:25:46.654 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.640+0000 7f3452ffd700 1 -- 172.21.15.92:0/778092735 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f345800c850 con 0x7f345c15def0 2023-08-26T09:25:46.654 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.640+0000 7f34644e0700 1 -- 172.21.15.92:0/778092735 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f345c0b4c10 con 0x7f345c15def0 2023-08-26T09:25:46.655 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.640+0000 7f3452ffd700 1 -- 172.21.15.92:0/778092735 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345800cc00 con 0x7f345c15def0 2023-08-26T09:25:46.655 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.641+0000 7f34644e0700 1 -- 172.21.15.92:0/778092735 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f345c0b51d0 con 0x7f345c15def0 2023-08-26T09:25:46.655 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.641+0000 7f34644e0700 1 -- 172.21.15.92:0/778092735 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f345c04eeb0 con 0x7f345c15def0 2023-08-26T09:25:46.655 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.642+0000 7f3452ffd700 1 -- 172.21.15.92:0/778092735 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3458013470 con 0x7f345c15def0 2023-08-26T09:25:46.655 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.642+0000 7f3452ffd700 1 --2- 172.21.15.92:0/778092735 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f344006a0e0 0x7f344006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:46.656 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.642+0000 7f3452ffd700 1 -- 172.21.15.92:0/778092735 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3458088680 con 0x7f345c15def0 2023-08-26T09:25:46.656 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.642+0000 7f346227c700 1 --2- 172.21.15.92:0/778092735 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f344006a0e0 0x7f344006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:46.656 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.643+0000 7f346227c700 1 --2- 172.21.15.92:0/778092735 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f344006a0e0 0x7f344006c5a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f344c001610 tx=0x7f344c0079c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:46.657 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.647+0000 7f3452ffd700 1 -- 172.21.15.92:0/778092735 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f34580578c0 con 0x7f345c15def0 2023-08-26T09:25:46.841 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.836+0000 7f34644e0700 1 -- 172.21.15.92:0/778092735 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f345c145c30 con 0x7f345c15def0 2023-08-26T09:25:46.841 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.836+0000 7f3452ffd700 1 -- 172.21.15.92:0/778092735 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3458057450 con 0x7f345c15def0 2023-08-26T09:25:46.842 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 8 2023-08-26T09:25:46.844 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.839+0000 7f34644e0700 1 -- 172.21.15.92:0/778092735 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f344006a0e0 msgr2=0x7f344006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:46.844 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.839+0000 7f34644e0700 1 --2- 172.21.15.92:0/778092735 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f344006a0e0 0x7f344006c5a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f344c001610 tx=0x7f344c0079c0 comp rx=0 tx=0).stop 2023-08-26T09:25:46.844 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.839+0000 7f34644e0700 1 -- 172.21.15.92:0/778092735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f345c15def0 msgr2=0x7f345c145f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:46.845 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.839+0000 7f34644e0700 1 --2- 172.21.15.92:0/778092735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f345c15def0 0x7f345c145f80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f345800e980 tx=0x7f345800ed40 comp rx=0 tx=0).stop 2023-08-26T09:25:46.845 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.839+0000 7f34644e0700 1 -- 172.21.15.92:0/778092735 shutdown_connections 2023-08-26T09:25:46.845 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.839+0000 7f34644e0700 1 --2- 172.21.15.92:0/778092735 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f344006a0e0 0x7f344006c5a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:46.845 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.839+0000 7f34644e0700 1 --2- 172.21.15.92:0/778092735 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f345c0c9aa0 0x7f345c0b4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:46.845 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.839+0000 7f34644e0700 1 --2- 172.21.15.92:0/778092735 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f345c1464c0 0x7f345c1437c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:46.845 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.839+0000 7f34644e0700 1 --2- 172.21.15.92:0/778092735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f345c15def0 0x7f345c145f80 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:46.846 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.839+0000 7f34644e0700 1 -- 172.21.15.92:0/778092735 >> 172.21.15.92:0/778092735 conn(0x7f345c0cf450 msgr2=0x7f345c0ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:46.846 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.839+0000 7f34644e0700 1 -- 172.21.15.92:0/778092735 shutdown_connections 2023-08-26T09:25:46.846 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.839+0000 7f34644e0700 1 -- 172.21.15.92:0/778092735 wait complete. 2023-08-26T09:25:46.855 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-26T09:25:46.980 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.975+0000 7f2431336700 1 Processor -- start 2023-08-26T09:25:46.980 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.975+0000 7f2431336700 1 -- start start 2023-08-26T09:25:46.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.976+0000 7f2431336700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f242c0b6960 0x7f242c06b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:46.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.976+0000 7f2431336700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f242c0d25d0 con 0x7f242c15d490 2023-08-26T09:25:46.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.976+0000 7f2431336700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f242c0b57e0 con 0x7f242c0b1eb0 2023-08-26T09:25:46.985 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.976+0000 7f2431336700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f242c0cdc70 con 0x7f242c0b6960 2023-08-26T09:25:46.985 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.976+0000 7f242affd700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f242c15d490 0x7f242c0ce0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:57630/0 (socket says 172.21.15.92:57630) 2023-08-26T09:25:46.985 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.976+0000 7f242affd700 1 -- 172.21.15.92:0/831964834 learned_addr learned my addr 172.21.15.92:0/831964834 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:46.985 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.976+0000 7f242b7fe700 1 --2- 172.21.15.92:0/831964834 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f242c0b6960 0x7f242c06b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:46.985 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.976+0000 7f2429ffb700 1 -- 172.21.15.92:0/831964834 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1165422594 0 0) 0x7f242c0d25d0 con 0x7f242c15d490 2023-08-26T09:25:46.986 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.976+0000 7f2429ffb700 1 -- 172.21.15.92:0/831964834 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24140035b0 con 0x7f242c15d490 2023-08-26T09:25:46.986 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.976+0000 7f2429ffb700 1 -- 172.21.15.92:0/831964834 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2855875300 0 0) 0x7f242c0b57e0 con 0x7f242c0b1eb0 2023-08-26T09:25:46.986 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.976+0000 7f2429ffb700 1 -- 172.21.15.92:0/831964834 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f242c0d25d0 con 0x7f242c0b1eb0 2023-08-26T09:25:46.986 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.976+0000 7f2429ffb700 1 -- 172.21.15.92:0/831964834 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3823045774 0 0) 0x7f24140035b0 con 0x7f242c15d490 2023-08-26T09:25:46.987 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.976+0000 7f2429ffb700 1 -- 172.21.15.92:0/831964834 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f242c0b6960 msgr2=0x7f242c06b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:46.987 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.976+0000 7f2429ffb700 1 --2- 172.21.15.92:0/831964834 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f242c0b6960 0x7f242c06b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:46.987 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.976+0000 7f2429ffb700 1 -- 172.21.15.92:0/831964834 >> v1:172.21.15.188:6789/0 conn(0x7f242c0b1eb0 legacy=0x7f242c0b6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:46.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.976+0000 7f2429ffb700 1 -- 172.21.15.92:0/831964834 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f242c0d2820 con 0x7f242c15d490 2023-08-26T09:25:46.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.976+0000 7f2429ffb700 1 -- 172.21.15.92:0/831964834 <== mon.0 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1019361464 0 0) 0x7f2420001670 con 0x7f242c15d490 2023-08-26T09:25:46.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.977+0000 7f2429ffb700 1 -- 172.21.15.92:0/831964834 >> v1:172.21.15.92:6789/0 conn(0x7f242c15d490 legacy=0x7f242c0ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:46.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.977+0000 7f2429ffb700 1 --2- 172.21.15.92:0/831964834 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2414003bc0 0x7f2414003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:46.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.977+0000 7f2429ffb700 1 --2- 172.21.15.92:0/831964834 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f242c0b6960 0x7f2414004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:46.989 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.977+0000 7f2429ffb700 1 --2- 172.21.15.92:0/831964834 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2414004d90 0x7f2414005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:46.989 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.977+0000 7f2429ffb700 1 -- 172.21.15.92:0/831964834 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f242c0cdc70 con 0x7f2414004d90 2023-08-26T09:25:46.989 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.977+0000 7f2429ffb700 1 -- 172.21.15.92:0/831964834 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f241400bb40 con 0x7f2414003bc0 2023-08-26T09:25:46.989 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.977+0000 7f2429ffb700 1 -- 172.21.15.92:0/831964834 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f241400bd00 con 0x7f242c0b6960 2023-08-26T09:25:46.989 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.977+0000 7f242b7fe700 1 --2- 172.21.15.92:0/831964834 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2414004d90 0x7f2414005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:46.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.977+0000 7f242affd700 1 --2- 172.21.15.92:0/831964834 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2414003bc0 0x7f2414003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:46.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.977+0000 7f242a7fc700 1 --2- 172.21.15.92:0/831964834 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f242c0b6960 0x7f2414004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:46.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.977+0000 7f242b7fe700 1 -- 172.21.15.92:0/831964834 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f242c0b6960 msgr2=0x7f2414004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:46.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.977+0000 7f242b7fe700 1 --2- 172.21.15.92:0/831964834 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f242c0b6960 0x7f2414004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:46.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.977+0000 7f242b7fe700 1 -- 172.21.15.92:0/831964834 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2414003bc0 msgr2=0x7f2414003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:46.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.977+0000 7f242b7fe700 1 --2- 172.21.15.92:0/831964834 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2414003bc0 0x7f2414003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:46.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.977+0000 7f242b7fe700 1 -- 172.21.15.92:0/831964834 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24140035b0 con 0x7f2414004d90 2023-08-26T09:25:46.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.977+0000 7f242a7fc700 1 --2- 172.21.15.92:0/831964834 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f242c0b6960 0x7f2414004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:46.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.977+0000 7f242b7fe700 1 --2- 172.21.15.92:0/831964834 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2414004d90 0x7f2414005210 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2424009fc0 tx=0x7f2414005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d72517042b8361fa server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:46.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.977+0000 7f2429ffb700 1 -- 172.21.15.92:0/831964834 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242400ec30 con 0x7f2414004d90 2023-08-26T09:25:46.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.977+0000 7f2429ffb700 1 -- 172.21.15.92:0/831964834 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f242400f040 con 0x7f2414004d90 2023-08-26T09:25:46.992 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.977+0000 7f2429ffb700 1 -- 172.21.15.92:0/831964834 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2424014480 con 0x7f2414004d90 2023-08-26T09:25:46.992 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.978+0000 7f2431336700 1 -- 172.21.15.92:0/831964834 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2414004d90 msgr2=0x7f2414005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:46.992 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.978+0000 7f2431336700 1 --2- 172.21.15.92:0/831964834 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2414004d90 0x7f2414005210 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2424009fc0 tx=0x7f2414005880 comp rx=0 tx=0).stop 2023-08-26T09:25:46.992 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.978+0000 7f242b7fe700 1 -- 172.21.15.92:0/831964834 reap_dead start 2023-08-26T09:25:46.992 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.978+0000 7f2431336700 1 -- 172.21.15.92:0/831964834 shutdown_connections 2023-08-26T09:25:46.993 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.978+0000 7f2431336700 1 -- 172.21.15.92:0/831964834 >> 172.21.15.92:0/831964834 conn(0x7f242c06aac0 msgr2=0x7f242c06aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:46.993 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.978+0000 7f2431336700 1 -- 172.21.15.92:0/831964834 shutdown_connections 2023-08-26T09:25:46.993 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.978+0000 7f2431336700 1 -- 172.21.15.92:0/831964834 wait complete. 2023-08-26T09:25:46.993 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.979+0000 7f2431336700 1 Processor -- start 2023-08-26T09:25:46.993 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.979+0000 7f2431336700 1 -- start start 2023-08-26T09:25:46.996 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.980+0000 7f2431336700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f242c15ae80 0x7f242c15e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:46.997 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.980+0000 7f2431336700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f242c15ea00 0x7f242c1f2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:46.997 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.980+0000 7f2431336700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f242c1f2f80 0x7f242c1f3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:46.997 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.980+0000 7f2431336700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f242c1f2630 con 0x7f242c1f2f80 2023-08-26T09:25:46.997 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.980+0000 7f2431336700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f242c15fe10 con 0x7f242c15ae80 2023-08-26T09:25:46.997 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.980+0000 7f2431336700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f242c15f290 con 0x7f242c15ea00 2023-08-26T09:25:46.998 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.980+0000 7f242b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f242c1f2f80 0x7f242c1f3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:46.998 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.980+0000 7f242b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f242c1f2f80 0x7f242c1f3400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45632/0 (socket says 172.21.15.92:45632) 2023-08-26T09:25:46.998 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.980+0000 7f242b7fe700 1 -- 172.21.15.92:0/3541328181 learned_addr learned my addr 172.21.15.92:0/3541328181 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:46.998 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.980+0000 7f242a7fc700 1 --2- 172.21.15.92:0/3541328181 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f242c15ea00 0x7f242c1f2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:46.998 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.980+0000 7f242affd700 1 --2- 172.21.15.92:0/3541328181 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f242c15ae80 0x7f242c15e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:46.998 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.980+0000 7f242b7fe700 1 -- 172.21.15.92:0/3541328181 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f242c15ea00 msgr2=0x7f242c1f2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:46.999 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.980+0000 7f242b7fe700 1 --2- 172.21.15.92:0/3541328181 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f242c15ea00 0x7f242c1f2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:46.999 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.980+0000 7f242b7fe700 1 -- 172.21.15.92:0/3541328181 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f242c15ae80 msgr2=0x7f242c15e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:46.999 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.980+0000 7f242b7fe700 1 --2- 172.21.15.92:0/3541328181 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f242c15ae80 0x7f242c15e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:46.999 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.980+0000 7f242b7fe700 1 -- 172.21.15.92:0/3541328181 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f242c15f570 con 0x7f242c1f2f80 2023-08-26T09:25:46.999 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.980+0000 7f242affd700 1 --2- 172.21.15.92:0/3541328181 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f242c15ae80 0x7f242c15e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:47.000 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.980+0000 7f242b7fe700 1 --2- 172.21.15.92:0/3541328181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f242c1f2f80 0x7f242c1f3400 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f241400bb10 tx=0x7f2424009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:47.000 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.980+0000 7f24137fe700 1 -- 172.21.15.92:0/3541328181 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2424007000 con 0x7f242c1f2f80 2023-08-26T09:25:47.000 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.981+0000 7f24137fe700 1 -- 172.21.15.92:0/3541328181 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2424022070 con 0x7f242c1f2f80 2023-08-26T09:25:47.000 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.981+0000 7f2431336700 1 -- 172.21.15.92:0/3541328181 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f242c15f850 con 0x7f242c1f2f80 2023-08-26T09:25:47.000 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.981+0000 7f24137fe700 1 -- 172.21.15.92:0/3541328181 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2424029480 con 0x7f242c1f2f80 2023-08-26T09:25:47.001 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.981+0000 7f2431336700 1 -- 172.21.15.92:0/3541328181 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f242c15b260 con 0x7f242c1f2f80 2023-08-26T09:25:47.001 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.981+0000 7f2431336700 1 -- 172.21.15.92:0/3541328181 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f242c04eeb0 con 0x7f242c1f2f80 2023-08-26T09:25:47.001 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.982+0000 7f24137fe700 1 -- 172.21.15.92:0/3541328181 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f242401e430 con 0x7f242c1f2f80 2023-08-26T09:25:47.001 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.982+0000 7f24137fe700 1 --2- 172.21.15.92:0/3541328181 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f241806a0e0 0x7f241806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:47.001 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.982+0000 7f24137fe700 1 -- 172.21.15.92:0/3541328181 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2424024070 con 0x7f242c1f2f80 2023-08-26T09:25:47.002 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.982+0000 7f242affd700 1 --2- 172.21.15.92:0/3541328181 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f241806a0e0 0x7f241806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:47.002 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.983+0000 7f242affd700 1 --2- 172.21.15.92:0/3541328181 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f241806a0e0 0x7f241806c5a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2420000c00 tx=0x7f2420009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:47.002 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:46.987+0000 7f24137fe700 1 -- 172.21.15.92:0/3541328181 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2424055840 con 0x7f242c1f2f80 2023-08-26T09:25:47.181 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.176+0000 7f2431336700 1 -- 172.21.15.92:0/3541328181 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f242c0b8210 con 0x7f242c1f2f80 2023-08-26T09:25:47.181 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.176+0000 7f24137fe700 1 -- 172.21.15.92:0/3541328181 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2424058e60 con 0x7f242c1f2f80 2023-08-26T09:25:47.181 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 1 2023-08-26T09:25:47.184 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.178+0000 7f2431336700 1 -- 172.21.15.92:0/3541328181 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f241806a0e0 msgr2=0x7f241806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:47.184 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.178+0000 7f2431336700 1 --2- 172.21.15.92:0/3541328181 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f241806a0e0 0x7f241806c5a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2420000c00 tx=0x7f2420009040 comp rx=0 tx=0).stop 2023-08-26T09:25:47.184 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.178+0000 7f2431336700 1 -- 172.21.15.92:0/3541328181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f242c1f2f80 msgr2=0x7f242c1f3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:47.184 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.178+0000 7f2431336700 1 --2- 172.21.15.92:0/3541328181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f242c1f2f80 0x7f242c1f3400 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f241400bb10 tx=0x7f2424009750 comp rx=0 tx=0).stop 2023-08-26T09:25:47.185 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.178+0000 7f2431336700 1 -- 172.21.15.92:0/3541328181 shutdown_connections 2023-08-26T09:25:47.185 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.178+0000 7f2431336700 1 --2- 172.21.15.92:0/3541328181 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f241806a0e0 0x7f241806c5a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:47.185 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.178+0000 7f2431336700 1 --2- 172.21.15.92:0/3541328181 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f242c15ae80 0x7f242c15e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:47.185 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.178+0000 7f2431336700 1 --2- 172.21.15.92:0/3541328181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f242c1f2f80 0x7f242c1f3400 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:47.185 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.178+0000 7f2431336700 1 --2- 172.21.15.92:0/3541328181 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f242c15ea00 0x7f242c1f2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:47.186 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.178+0000 7f2431336700 1 -- 172.21.15.92:0/3541328181 >> 172.21.15.92:0/3541328181 conn(0x7f242c06aac0 msgr2=0x7f242c0ce040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:47.186 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.178+0000 7f2431336700 1 -- 172.21.15.92:0/3541328181 shutdown_connections 2023-08-26T09:25:47.186 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.178+0000 7f2431336700 1 -- 172.21.15.92:0/3541328181 wait complete. 2023-08-26T09:25:47.196 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-26T09:25:47.319 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.315+0000 7f23b2034700 1 Processor -- start 2023-08-26T09:25:47.320 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.315+0000 7f23b2034700 1 -- start start 2023-08-26T09:25:47.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.316+0000 7f23b2034700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f23ac06e110 0x7f23ac06e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:47.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.316+0000 7f23b2034700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23ac0c6200 con 0x7f23ac159dd0 2023-08-26T09:25:47.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.316+0000 7f23b2034700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23ac0ce740 con 0x7f23ac070d20 2023-08-26T09:25:47.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.316+0000 7f23b2034700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23ac06eae0 con 0x7f23ac06e110 2023-08-26T09:25:47.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.316+0000 7f23ab7fe700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f23ac159dd0 0x7f23ac0cf220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:57650/0 (socket says 172.21.15.92:57650) 2023-08-26T09:25:47.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.316+0000 7f23ab7fe700 1 -- 172.21.15.92:0/2586998932 learned_addr learned my addr 172.21.15.92:0/2586998932 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:47.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.316+0000 7f23aaffd700 1 --2- 172.21.15.92:0/2586998932 >> v2:172.21.15.92:3300/0 conn(0x7f23ac06e110 0x7f23ac06e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:47.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.316+0000 7f23aa7fc700 1 -- 172.21.15.92:0/2586998932 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 687544689 0 0) 0x7f23ac0c6200 con 0x7f23ac159dd0 2023-08-26T09:25:47.324 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.316+0000 7f23aa7fc700 1 -- 172.21.15.92:0/2586998932 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23940035b0 con 0x7f23ac159dd0 2023-08-26T09:25:47.324 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.316+0000 7f23aaffd700 1 -- 172.21.15.92:0/2586998932 >> v1:172.21.15.188:6789/0 conn(0x7f23ac070d20 legacy=0x7f23ac071170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:47.324 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.316+0000 7f23aaffd700 1 -- 172.21.15.92:0/2586998932 >> v1:172.21.15.92:6789/0 conn(0x7f23ac159dd0 legacy=0x7f23ac0cf220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:47.324 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.316+0000 7f23aaffd700 1 -- 172.21.15.92:0/2586998932 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23ac0cea20 con 0x7f23ac06e110 2023-08-26T09:25:47.325 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.316+0000 7f23aaffd700 1 --2- 172.21.15.92:0/2586998932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f23ac06e110 0x7f23ac06e5a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f23a0009840 tx=0x7f23a0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=110bec3d0755d3c5 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:47.325 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.316+0000 7f23aa7fc700 1 -- 172.21.15.92:0/2586998932 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a0004230 con 0x7f23ac06e110 2023-08-26T09:25:47.325 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.317+0000 7f23aa7fc700 1 -- 172.21.15.92:0/2586998932 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a0004390 con 0x7f23ac06e110 2023-08-26T09:25:47.325 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.317+0000 7f23aa7fc700 1 -- 172.21.15.92:0/2586998932 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a00036c0 con 0x7f23ac06e110 2023-08-26T09:25:47.325 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.317+0000 7f23b2034700 1 -- 172.21.15.92:0/2586998932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f23ac06e110 msgr2=0x7f23ac06e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:47.326 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.317+0000 7f23b2034700 1 --2- 172.21.15.92:0/2586998932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f23ac06e110 0x7f23ac06e5a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f23a0009840 tx=0x7f23a0009b50 comp rx=0 tx=0).stop 2023-08-26T09:25:47.326 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.317+0000 7f23b2034700 1 -- 172.21.15.92:0/2586998932 shutdown_connections 2023-08-26T09:25:47.326 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.317+0000 7f23b2034700 1 --2- 172.21.15.92:0/2586998932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f23ac06e110 0x7f23ac06e5a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:47.326 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.317+0000 7f23b2034700 1 -- 172.21.15.92:0/2586998932 >> 172.21.15.92:0/2586998932 conn(0x7f23ac06b430 msgr2=0x7f23ac06b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:47.326 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.317+0000 7f23b2034700 1 -- 172.21.15.92:0/2586998932 shutdown_connections 2023-08-26T09:25:47.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.317+0000 7f23b2034700 1 -- 172.21.15.92:0/2586998932 wait complete. 2023-08-26T09:25:47.329 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.318+0000 7f23b2034700 1 Processor -- start 2023-08-26T09:25:47.329 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.318+0000 7f23b2034700 1 -- start start 2023-08-26T09:25:47.330 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.319+0000 7f23b2034700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f23ac06e110 0x7f23ac1f6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:47.330 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.319+0000 7f23b2034700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f23ac070d20 0x7f23ac15ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:47.330 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.319+0000 7f23b2034700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f23ac159dd0 0x7f23ac1576a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:47.330 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.319+0000 7f23b2034700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac15ba20 con 0x7f23ac159dd0 2023-08-26T09:25:47.330 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.319+0000 7f23b2034700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac1f6060 con 0x7f23ac06e110 2023-08-26T09:25:47.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.319+0000 7f23b2034700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac1f6620 con 0x7f23ac070d20 2023-08-26T09:25:47.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.319+0000 7f23abfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f23ac159dd0 0x7f23ac1576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:47.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.319+0000 7f23abfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f23ac159dd0 0x7f23ac1576a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45646/0 (socket says 172.21.15.92:45646) 2023-08-26T09:25:47.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.319+0000 7f23abfff700 1 -- 172.21.15.92:0/473323256 learned_addr learned my addr 172.21.15.92:0/473323256 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:47.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.320+0000 7f23ab7fe700 1 --2- 172.21.15.92:0/473323256 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f23ac06e110 0x7f23ac1f6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:47.332 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.320+0000 7f23aaffd700 1 --2- 172.21.15.92:0/473323256 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f23ac070d20 0x7f23ac15ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:47.332 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.320+0000 7f23abfff700 1 -- 172.21.15.92:0/473323256 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f23ac070d20 msgr2=0x7f23ac15ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:47.332 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.320+0000 7f23abfff700 1 --2- 172.21.15.92:0/473323256 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f23ac070d20 0x7f23ac15ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:47.332 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.320+0000 7f23abfff700 1 -- 172.21.15.92:0/473323256 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f23ac06e110 msgr2=0x7f23ac1f6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:47.332 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.320+0000 7f23abfff700 1 --2- 172.21.15.92:0/473323256 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f23ac06e110 0x7f23ac1f6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:47.332 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.320+0000 7f23abfff700 1 -- 172.21.15.92:0/473323256 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a00094a0 con 0x7f23ac159dd0 2023-08-26T09:25:47.333 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.320+0000 7f23ab7fe700 1 --2- 172.21.15.92:0/473323256 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f23ac06e110 0x7f23ac1f6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:25:47.333 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.320+0000 7f23abfff700 1 --2- 172.21.15.92:0/473323256 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f23ac159dd0 0x7f23ac1576a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f23a400c7d0 tx=0x7f23a400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:47.333 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.320+0000 7f2393fff700 1 -- 172.21.15.92:0/473323256 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a4003e10 con 0x7f23ac159dd0 2023-08-26T09:25:47.333 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.320+0000 7f23b2034700 1 -- 172.21.15.92:0/473323256 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23ac15b460 con 0x7f23ac159dd0 2023-08-26T09:25:47.334 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.320+0000 7f23b2034700 1 -- 172.21.15.92:0/473323256 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23ac1f62b0 con 0x7f23ac159dd0 2023-08-26T09:25:47.334 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.320+0000 7f2393fff700 1 -- 172.21.15.92:0/473323256 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a4005070 con 0x7f23ac159dd0 2023-08-26T09:25:47.334 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.320+0000 7f2393fff700 1 -- 172.21.15.92:0/473323256 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a40053e0 con 0x7f23ac159dd0 2023-08-26T09:25:47.334 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.321+0000 7f23b2034700 1 -- 172.21.15.92:0/473323256 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f238c0052f0 con 0x7f23ac159dd0 2023-08-26T09:25:47.334 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.321+0000 7f2393fff700 1 -- 172.21.15.92:0/473323256 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f23a4005540 con 0x7f23ac159dd0 2023-08-26T09:25:47.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.322+0000 7f2393fff700 1 --2- 172.21.15.92:0/473323256 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f239806a0e0 0x7f239806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:47.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.322+0000 7f2393fff700 1 -- 172.21.15.92:0/473323256 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f23a4087cb0 con 0x7f23ac159dd0 2023-08-26T09:25:47.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.322+0000 7f23ab7fe700 1 --2- 172.21.15.92:0/473323256 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f239806a0e0 0x7f239806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:47.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.322+0000 7f23ab7fe700 1 --2- 172.21.15.92:0/473323256 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f239806a0e0 0x7f239806c5a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f239c005910 tx=0x7f239c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:47.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.326+0000 7f2393fff700 1 -- 172.21.15.92:0/473323256 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f23a40533b0 con 0x7f23ac159dd0 2023-08-26T09:25:47.521 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.517+0000 7f23b2034700 1 -- 172.21.15.92:0/473323256 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f238c005b20 con 0x7f23ac159dd0 2023-08-26T09:25:47.522 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.517+0000 7f2393fff700 1 -- 172.21.15.92:0/473323256 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f23a40569d0 con 0x7f23ac159dd0 2023-08-26T09:25:47.522 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 32 2023-08-26T09:25:47.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.519+0000 7f23b2034700 1 -- 172.21.15.92:0/473323256 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f239806a0e0 msgr2=0x7f239806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:47.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.519+0000 7f23b2034700 1 --2- 172.21.15.92:0/473323256 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f239806a0e0 0x7f239806c5a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f239c005910 tx=0x7f239c009040 comp rx=0 tx=0).stop 2023-08-26T09:25:47.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.519+0000 7f23b2034700 1 -- 172.21.15.92:0/473323256 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f23ac159dd0 msgr2=0x7f23ac1576a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:47.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.519+0000 7f23b2034700 1 --2- 172.21.15.92:0/473323256 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f23ac159dd0 0x7f23ac1576a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f23a400c7d0 tx=0x7f23a400cb90 comp rx=0 tx=0).stop 2023-08-26T09:25:47.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.519+0000 7f23b2034700 1 -- 172.21.15.92:0/473323256 shutdown_connections 2023-08-26T09:25:47.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.519+0000 7f23b2034700 1 --2- 172.21.15.92:0/473323256 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f239806a0e0 0x7f239806c5a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:47.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.519+0000 7f23b2034700 1 --2- 172.21.15.92:0/473323256 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f23ac06e110 0x7f23ac1f6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:47.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.519+0000 7f23b2034700 1 --2- 172.21.15.92:0/473323256 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f23ac159dd0 0x7f23ac1576a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:47.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.519+0000 7f23b2034700 1 --2- 172.21.15.92:0/473323256 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f23ac070d20 0x7f23ac15ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:47.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.519+0000 7f23b2034700 1 -- 172.21.15.92:0/473323256 >> 172.21.15.92:0/473323256 conn(0x7f23ac06b430 msgr2=0x7f23ac06cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:47.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.519+0000 7f23b2034700 1 -- 172.21.15.92:0/473323256 shutdown_connections 2023-08-26T09:25:47.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.520+0000 7f23b2034700 1 -- 172.21.15.92:0/473323256 wait complete. 2023-08-26T09:25:47.536 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-26T09:25:47.660 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.655+0000 7fdc02101700 1 Processor -- start 2023-08-26T09:25:47.661 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.655+0000 7fdc02101700 1 -- start start 2023-08-26T09:25:47.663 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.656+0000 7fdc02101700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdbfc0af390 0x7fdbfc070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:47.663 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.656+0000 7fdc02101700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fdbfc071260 0x7fdbfc06a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:47.663 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.656+0000 7fdc02101700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbfc0aee50 con 0x7fdbfc15d220 2023-08-26T09:25:47.664 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.656+0000 7fdc02101700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbfc0af130 con 0x7fdbfc071260 2023-08-26T09:25:47.664 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.656+0000 7fdc02101700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc0c4cb0 con 0x7fdbfc0af390 2023-08-26T09:25:47.664 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.656+0000 7fdbfbfff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fdbfc071260 0x7fdbfc06a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:47.664 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.656+0000 7fdbfb7fe700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fdbfc15d220 0x7fdbfc06db70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:57664/0 (socket says 172.21.15.92:57664) 2023-08-26T09:25:47.664 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.656+0000 7fdbfb7fe700 1 -- 172.21.15.92:0/1611537399 learned_addr learned my addr 172.21.15.92:0/1611537399 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:47.665 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.656+0000 7fdbfaffd700 1 --2- 172.21.15.92:0/1611537399 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdbfc0af390 0x7fdbfc070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:47.665 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.656+0000 7fdbfbfff700 1 -- 172.21.15.92:0/1611537399 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdbfc0af390 msgr2=0x7fdbfc070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:47.665 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.656+0000 7fdbfbfff700 1 --2- 172.21.15.92:0/1611537399 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdbfc0af390 0x7fdbfc070d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:47.665 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.656+0000 7fdbfbfff700 1 -- 172.21.15.92:0/1611537399 >> v1:172.21.15.92:6789/0 conn(0x7fdbfc15d220 legacy=0x7fdbfc06db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:47.665 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.656+0000 7fdbfbfff700 1 -- 172.21.15.92:0/1611537399 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbfc0c4f90 con 0x7fdbfc071260 2023-08-26T09:25:47.666 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.656+0000 7fdbfa7fc700 1 -- 172.21.15.92:0/1611537399 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2407729736 0 0) 0x7fdbfc0aee50 con 0x7fdbfc15d220 2023-08-26T09:25:47.666 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.656+0000 7fdbfbfff700 1 --2- 172.21.15.92:0/1611537399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbfc071260 0x7fdbfc06a320 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdbf4009d90 tx=0x7fdbf400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b62d98507e2200d4 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:47.666 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.657+0000 7fdbfa7fc700 1 -- 172.21.15.92:0/1611537399 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf400e070 con 0x7fdbfc071260 2023-08-26T09:25:47.666 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.657+0000 7fdbfa7fc700 1 -- 172.21.15.92:0/1611537399 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf400bbd0 con 0x7fdbfc071260 2023-08-26T09:25:47.666 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.657+0000 7fdbfa7fc700 1 -- 172.21.15.92:0/1611537399 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf4012430 con 0x7fdbfc071260 2023-08-26T09:25:47.666 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.657+0000 7fdc02101700 1 -- 172.21.15.92:0/1611537399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbfc071260 msgr2=0x7fdbfc06a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:47.667 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.657+0000 7fdc02101700 1 --2- 172.21.15.92:0/1611537399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbfc071260 0x7fdbfc06a320 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdbf4009d90 tx=0x7fdbf400b330 comp rx=0 tx=0).stop 2023-08-26T09:25:47.667 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.657+0000 7fdc02101700 1 -- 172.21.15.92:0/1611537399 shutdown_connections 2023-08-26T09:25:47.667 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.657+0000 7fdc02101700 1 --2- 172.21.15.92:0/1611537399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbfc071260 0x7fdbfc06a320 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:47.667 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.657+0000 7fdc02101700 1 --2- 172.21.15.92:0/1611537399 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdbfc0af390 0x7fdbfc070d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:47.667 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.657+0000 7fdc02101700 1 -- 172.21.15.92:0/1611537399 >> 172.21.15.92:0/1611537399 conn(0x7fdbfc06b430 msgr2=0x7fdbfc06b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:47.668 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.657+0000 7fdc02101700 1 -- 172.21.15.92:0/1611537399 shutdown_connections 2023-08-26T09:25:47.668 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.657+0000 7fdc02101700 1 -- 172.21.15.92:0/1611537399 wait complete. 2023-08-26T09:25:47.668 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.658+0000 7fdc02101700 1 Processor -- start 2023-08-26T09:25:47.670 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.659+0000 7fdc02101700 1 -- start start 2023-08-26T09:25:47.670 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.659+0000 7fdc02101700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbfc071260 0x7fdbfc0cd890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:47.671 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.659+0000 7fdc02101700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdbfc0af390 0x7fdbfc154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:47.671 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.659+0000 7fdc02101700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdbfc15d220 0x7fdbfc15b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:47.671 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.659+0000 7fdc02101700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc1540f0 con 0x7fdbfc071260 2023-08-26T09:25:47.671 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.659+0000 7fdc02101700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc0ce350 con 0x7fdbfc0af390 2023-08-26T09:25:47.671 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.659+0000 7fdc02101700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc0ce630 con 0x7fdbfc15d220 2023-08-26T09:25:47.672 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.659+0000 7fdbfb7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbfc071260 0x7fdbfc0cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:47.672 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.659+0000 7fdbfb7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbfc071260 0x7fdbfc0cd890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45656/0 (socket says 172.21.15.92:45656) 2023-08-26T09:25:47.672 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.659+0000 7fdbfb7fe700 1 -- 172.21.15.92:0/2864581815 learned_addr learned my addr 172.21.15.92:0/2864581815 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:47.672 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.660+0000 7fdbfbfff700 1 --2- 172.21.15.92:0/2864581815 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdbfc15d220 0x7fdbfc15b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:47.672 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.660+0000 7fdbfaffd700 1 --2- 172.21.15.92:0/2864581815 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdbfc0af390 0x7fdbfc154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:47.673 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.660+0000 7fdbfb7fe700 1 -- 172.21.15.92:0/2864581815 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdbfc15d220 msgr2=0x7fdbfc15b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:47.673 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.660+0000 7fdbfb7fe700 1 --2- 172.21.15.92:0/2864581815 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdbfc15d220 0x7fdbfc15b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:47.673 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.660+0000 7fdbfb7fe700 1 -- 172.21.15.92:0/2864581815 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdbfc0af390 msgr2=0x7fdbfc154b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:47.673 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.660+0000 7fdbfb7fe700 1 --2- 172.21.15.92:0/2864581815 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdbfc0af390 0x7fdbfc154b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:47.673 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.660+0000 7fdbfb7fe700 1 -- 172.21.15.92:0/2864581815 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf4009a70 con 0x7fdbfc071260 2023-08-26T09:25:47.674 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.660+0000 7fdbfb7fe700 1 --2- 172.21.15.92:0/2864581815 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbfc071260 0x7fdbfc0cd890 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fdbf000c550 tx=0x7fdbf000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:47.674 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.660+0000 7fdbe3fff700 1 -- 172.21.15.92:0/2864581815 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf0004c80 con 0x7fdbfc071260 2023-08-26T09:25:47.674 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.660+0000 7fdbe3fff700 1 -- 172.21.15.92:0/2864581815 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf0004e00 con 0x7fdbfc071260 2023-08-26T09:25:47.674 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.660+0000 7fdc02101700 1 -- 172.21.15.92:0/2864581815 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbfc154340 con 0x7fdbfc071260 2023-08-26T09:25:47.675 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.660+0000 7fdbe3fff700 1 -- 172.21.15.92:0/2864581815 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf0007310 con 0x7fdbfc071260 2023-08-26T09:25:47.675 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.660+0000 7fdc02101700 1 -- 172.21.15.92:0/2864581815 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbfc0cecc0 con 0x7fdbfc071260 2023-08-26T09:25:47.675 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.661+0000 7fdc02101700 1 -- 172.21.15.92:0/2864581815 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbfc04eeb0 con 0x7fdbfc071260 2023-08-26T09:25:47.675 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.661+0000 7fdbe3fff700 1 -- 172.21.15.92:0/2864581815 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdbf0007470 con 0x7fdbfc071260 2023-08-26T09:25:47.675 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.662+0000 7fdbe3fff700 1 --2- 172.21.15.92:0/2864581815 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fdbe806a0e0 0x7fdbe806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:47.675 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.662+0000 7fdbfaffd700 1 --2- 172.21.15.92:0/2864581815 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fdbe806a0e0 0x7fdbe806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:47.676 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.662+0000 7fdbe3fff700 1 -- 172.21.15.92:0/2864581815 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdbf0088170 con 0x7fdbfc071260 2023-08-26T09:25:47.676 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.662+0000 7fdbfaffd700 1 --2- 172.21.15.92:0/2864581815 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fdbe806a0e0 0x7fdbe806c5a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc0b5da0 tx=0x7fdbec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:47.676 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.666+0000 7fdbe3fff700 1 -- 172.21.15.92:0/2864581815 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fdbf0053870 con 0x7fdbfc071260 2023-08-26T09:25:47.863 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.858+0000 7fdc02101700 1 -- 172.21.15.92:0/2864581815 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdbfc06dc80 con 0x7fdbfc071260 2023-08-26T09:25:47.863 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.858+0000 7fdbe3fff700 1 -- 172.21.15.92:0/2864581815 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdbf0056e90 con 0x7fdbfc071260 2023-08-26T09:25:47.864 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 64 2023-08-26T09:25:47.865 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.860+0000 7fdc02101700 1 -- 172.21.15.92:0/2864581815 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fdbe806a0e0 msgr2=0x7fdbe806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:47.865 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.860+0000 7fdc02101700 1 --2- 172.21.15.92:0/2864581815 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fdbe806a0e0 0x7fdbe806c5a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc0b5da0 tx=0x7fdbec008040 comp rx=0 tx=0).stop 2023-08-26T09:25:47.865 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.860+0000 7fdc02101700 1 -- 172.21.15.92:0/2864581815 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbfc071260 msgr2=0x7fdbfc0cd890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:47.866 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.860+0000 7fdc02101700 1 --2- 172.21.15.92:0/2864581815 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbfc071260 0x7fdbfc0cd890 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fdbf000c550 tx=0x7fdbf000c860 comp rx=0 tx=0).stop 2023-08-26T09:25:47.866 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.860+0000 7fdc02101700 1 -- 172.21.15.92:0/2864581815 shutdown_connections 2023-08-26T09:25:47.866 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.860+0000 7fdc02101700 1 --2- 172.21.15.92:0/2864581815 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdbfc15d220 0x7fdbfc15b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:47.866 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.860+0000 7fdc02101700 1 --2- 172.21.15.92:0/2864581815 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbfc071260 0x7fdbfc0cd890 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:47.866 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.860+0000 7fdc02101700 1 --2- 172.21.15.92:0/2864581815 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fdbe806a0e0 0x7fdbe806c5a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:47.867 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.860+0000 7fdc02101700 1 --2- 172.21.15.92:0/2864581815 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdbfc0af390 0x7fdbfc154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:47.867 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.860+0000 7fdc02101700 1 -- 172.21.15.92:0/2864581815 >> 172.21.15.92:0/2864581815 conn(0x7fdbfc06b430 msgr2=0x7fdbfc071a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:47.867 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.860+0000 7fdc02101700 1 -- 172.21.15.92:0/2864581815 shutdown_connections 2023-08-26T09:25:47.867 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.860+0000 7fdc02101700 1 -- 172.21.15.92:0/2864581815 wait complete. 2023-08-26T09:25:47.877 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-26T09:25:48.001 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.996+0000 7ff23fa92700 1 Processor -- start 2023-08-26T09:25:48.001 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.996+0000 7ff23fa92700 1 -- start start 2023-08-26T09:25:48.003 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.997+0000 7ff23fa92700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff2380b28d0 0x7ff2380b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:48.003 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.997+0000 7ff23fa92700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff2380ce450 0x7ff238161930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:48.004 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.997+0000 7ff23fa92700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7ff23815da10 0x7ff23815ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:48.004 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.997+0000 7ff23fa92700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff23815e9b0 con 0x7ff2380ce450 2023-08-26T09:25:48.004 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.997+0000 7ff23fa92700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2381614a0 con 0x7ff23815da10 2023-08-26T09:25:48.004 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.997+0000 7ff23fa92700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2380b31f0 con 0x7ff2380b28d0 2023-08-26T09:25:48.004 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.997+0000 7ff23d02d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff2380ce450 0x7ff238161930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:48.005 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.997+0000 7ff23d02d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff2380ce450 0x7ff238161930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45664/0 (socket says 172.21.15.92:45664) 2023-08-26T09:25:48.005 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.997+0000 7ff23d02d700 1 -- 172.21.15.92:0/817091793 learned_addr learned my addr 172.21.15.92:0/817091793 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:48.005 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.997+0000 7ff23e02f700 1 --2- 172.21.15.92:0/817091793 >> v2:172.21.15.188:3300/0 conn(0x7ff23815da10 0x7ff23815ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:48.005 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.997+0000 7ff23d82e700 1 --2- 172.21.15.92:0/817091793 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff2380b28d0 0x7ff2380b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:48.006 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.997+0000 7ff23d02d700 1 -- 172.21.15.92:0/817091793 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff2380b28d0 msgr2=0x7ff2380b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:48.006 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.997+0000 7ff23d02d700 1 --2- 172.21.15.92:0/817091793 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff2380b28d0 0x7ff2380b2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:48.006 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.997+0000 7ff23d02d700 1 -- 172.21.15.92:0/817091793 >> v2:172.21.15.188:3300/0 conn(0x7ff23815da10 msgr2=0x7ff23815ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:48.006 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.997+0000 7ff23d02d700 1 --2- 172.21.15.92:0/817091793 >> v2:172.21.15.188:3300/0 conn(0x7ff23815da10 0x7ff23815ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:48.006 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.997+0000 7ff23d02d700 1 -- 172.21.15.92:0/817091793 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff23815e3f0 con 0x7ff2380ce450 2023-08-26T09:25:48.007 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.997+0000 7ff23e02f700 1 --2- 172.21.15.92:0/817091793 >> v2:172.21.15.188:3300/0 conn(0x7ff23815da10 0x7ff23815ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:25:48.007 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.997+0000 7ff23d02d700 1 --2- 172.21.15.92:0/817091793 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2380ce450 0x7ff238161930 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff2380b3500 tx=0x7ff228009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5adda687304add79 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:48.007 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.997+0000 7ff23c82c700 1 -- 172.21.15.92:0/817091793 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22800b870 con 0x7ff2380ce450 2023-08-26T09:25:48.007 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.998+0000 7ff23c82c700 1 -- 172.21.15.92:0/817091793 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff22800b9d0 con 0x7ff2380ce450 2023-08-26T09:25:48.008 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.998+0000 7ff23c82c700 1 -- 172.21.15.92:0/817091793 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22800bd60 con 0x7ff2380ce450 2023-08-26T09:25:48.008 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.998+0000 7ff23fa92700 1 -- 172.21.15.92:0/817091793 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2380ce450 msgr2=0x7ff238161930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:48.008 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.998+0000 7ff23fa92700 1 --2- 172.21.15.92:0/817091793 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2380ce450 0x7ff238161930 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff2380b3500 tx=0x7ff228009bd0 comp rx=0 tx=0).stop 2023-08-26T09:25:48.008 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.998+0000 7ff23fa92700 1 -- 172.21.15.92:0/817091793 shutdown_connections 2023-08-26T09:25:48.008 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.998+0000 7ff23fa92700 1 --2- 172.21.15.92:0/817091793 >> v2:172.21.15.188:3300/0 conn(0x7ff23815da10 0x7ff23815ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:48.009 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.998+0000 7ff23fa92700 1 --2- 172.21.15.92:0/817091793 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff2380b28d0 0x7ff2380b2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:48.009 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.998+0000 7ff23fa92700 1 --2- 172.21.15.92:0/817091793 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2380ce450 0x7ff238161930 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:48.009 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.998+0000 7ff23fa92700 1 -- 172.21.15.92:0/817091793 >> 172.21.15.92:0/817091793 conn(0x7ff2380cd8d0 msgr2=0x7ff2380cdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:48.009 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.998+0000 7ff23fa92700 1 -- 172.21.15.92:0/817091793 shutdown_connections 2023-08-26T09:25:48.009 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.998+0000 7ff23fa92700 1 -- 172.21.15.92:0/817091793 wait complete. 2023-08-26T09:25:48.012 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.999+0000 7ff23fa92700 1 Processor -- start 2023-08-26T09:25:48.012 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:47.999+0000 7ff23fa92700 1 -- start start 2023-08-26T09:25:48.012 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.000+0000 7ff23fa92700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2380b28d0 0x7ff23814a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:48.013 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.000+0000 7ff23fa92700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff2380ce450 0x7ff23814bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:48.013 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.000+0000 7ff23fa92700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff23815da10 0x7ff23814c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:48.014 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.000+0000 7ff23fa92700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2380ae310 con 0x7ff2380b28d0 2023-08-26T09:25:48.014 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.000+0000 7ff23fa92700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2380b6aa0 con 0x7ff23815da10 2023-08-26T09:25:48.014 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.000+0000 7ff23fa92700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2380b3a10 con 0x7ff2380ce450 2023-08-26T09:25:48.014 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.000+0000 7ff23d82e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2380b28d0 0x7ff23814a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:48.015 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.000+0000 7ff23d82e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2380b28d0 0x7ff23814a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45670/0 (socket says 172.21.15.92:45670) 2023-08-26T09:25:48.015 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.000+0000 7ff23d82e700 1 -- 172.21.15.92:0/1625810648 learned_addr learned my addr 172.21.15.92:0/1625810648 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:48.015 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.000+0000 7ff23d02d700 1 --2- 172.21.15.92:0/1625810648 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff2380ce450 0x7ff23814bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:48.015 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.000+0000 7ff23e02f700 1 --2- 172.21.15.92:0/1625810648 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff23815da10 0x7ff23814c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:48.015 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.001+0000 7ff23d82e700 1 -- 172.21.15.92:0/1625810648 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff2380ce450 msgr2=0x7ff23814bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:48.016 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.001+0000 7ff23d82e700 1 --2- 172.21.15.92:0/1625810648 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff2380ce450 0x7ff23814bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:48.016 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.001+0000 7ff23d82e700 1 -- 172.21.15.92:0/1625810648 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff23815da10 msgr2=0x7ff23814c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:48.016 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.001+0000 7ff23d82e700 1 --2- 172.21.15.92:0/1625810648 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff23815da10 0x7ff23814c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:48.016 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.001+0000 7ff23d82e700 1 -- 172.21.15.92:0/1625810648 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff228009550 con 0x7ff2380b28d0 2023-08-26T09:25:48.016 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.001+0000 7ff23d82e700 1 --2- 172.21.15.92:0/1625810648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2380b28d0 0x7ff23814a080 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff23400c7f0 tx=0x7ff23400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:48.017 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.001+0000 7ff22e7fc700 1 -- 172.21.15.92:0/1625810648 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff234011800 con 0x7ff2380b28d0 2023-08-26T09:25:48.017 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.001+0000 7ff22e7fc700 1 -- 172.21.15.92:0/1625810648 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff234011960 con 0x7ff2380b28d0 2023-08-26T09:25:48.017 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.001+0000 7ff23fa92700 1 -- 172.21.15.92:0/1625810648 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2380b3cf0 con 0x7ff2380b28d0 2023-08-26T09:25:48.017 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.001+0000 7ff22e7fc700 1 -- 172.21.15.92:0/1625810648 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff234011d10 con 0x7ff2380b28d0 2023-08-26T09:25:48.017 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.001+0000 7ff23fa92700 1 -- 172.21.15.92:0/1625810648 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff23814a5c0 con 0x7ff2380b28d0 2023-08-26T09:25:48.017 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.002+0000 7ff23fa92700 1 -- 172.21.15.92:0/1625810648 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2380b4210 con 0x7ff2380b28d0 2023-08-26T09:25:48.018 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.002+0000 7ff22e7fc700 1 -- 172.21.15.92:0/1625810648 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff234018360 con 0x7ff2380b28d0 2023-08-26T09:25:48.018 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.003+0000 7ff22e7fc700 1 --2- 172.21.15.92:0/1625810648 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7ff21c06a0e0 0x7ff21c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:48.018 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.003+0000 7ff22e7fc700 1 -- 172.21.15.92:0/1625810648 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff234088100 con 0x7ff2380b28d0 2023-08-26T09:25:48.018 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.003+0000 7ff23d02d700 1 --2- 172.21.15.92:0/1625810648 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7ff21c06a0e0 0x7ff21c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:48.018 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.003+0000 7ff23d02d700 1 --2- 172.21.15.92:0/1625810648 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7ff21c06a0e0 0x7ff21c06c5a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff2380ce870 tx=0x7ff228008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:48.019 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.007+0000 7ff22e7fc700 1 -- 172.21.15.92:0/1625810648 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff2340537f0 con 0x7ff2380b28d0 2023-08-26T09:25:48.204 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.199+0000 7ff23fa92700 1 -- 172.21.15.92:0/1625810648 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff23804eeb0 con 0x7ff2380b28d0 2023-08-26T09:25:48.206 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.202+0000 7ff22e7fc700 1 -- 172.21.15.92:0/1625810648 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff234056e10 con 0x7ff2380b28d0 2023-08-26T09:25:48.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.204+0000 7ff23fa92700 1 -- 172.21.15.92:0/1625810648 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7ff21c06a0e0 msgr2=0x7ff21c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:48.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.204+0000 7ff23fa92700 1 --2- 172.21.15.92:0/1625810648 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7ff21c06a0e0 0x7ff21c06c5a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff2380ce870 tx=0x7ff228008030 comp rx=0 tx=0).stop 2023-08-26T09:25:48.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.204+0000 7ff23fa92700 1 -- 172.21.15.92:0/1625810648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2380b28d0 msgr2=0x7ff23814a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:48.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.204+0000 7ff23fa92700 1 --2- 172.21.15.92:0/1625810648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2380b28d0 0x7ff23814a080 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff23400c7f0 tx=0x7ff23400cbb0 comp rx=0 tx=0).stop 2023-08-26T09:25:48.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.204+0000 7ff23fa92700 1 -- 172.21.15.92:0/1625810648 shutdown_connections 2023-08-26T09:25:48.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.204+0000 7ff23fa92700 1 --2- 172.21.15.92:0/1625810648 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7ff21c06a0e0 0x7ff21c06c5a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:48.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.204+0000 7ff23fa92700 1 --2- 172.21.15.92:0/1625810648 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff23815da10 0x7ff23814c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:48.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.204+0000 7ff23fa92700 1 --2- 172.21.15.92:0/1625810648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2380b28d0 0x7ff23814a080 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:48.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.204+0000 7ff23fa92700 1 --2- 172.21.15.92:0/1625810648 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff2380ce450 0x7ff23814bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:48.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.204+0000 7ff23fa92700 1 -- 172.21.15.92:0/1625810648 >> 172.21.15.92:0/1625810648 conn(0x7ff2380cd8d0 msgr2=0x7ff2380b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:48.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.204+0000 7ff23fa92700 1 -- 172.21.15.92:0/1625810648 shutdown_connections 2023-08-26T09:25:48.213 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.204+0000 7ff23fa92700 1 -- 172.21.15.92:0/1625810648 wait complete. 2023-08-26T09:25:48.220 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-26T09:25:48.221 DEBUG:teuthology.orchestra.run.smithi092:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-26T09:25:48.268 DEBUG:teuthology.orchestra.run.smithi188:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-26T09:25:48.312 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-26T09:25:48.313 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-08-26T09:25:48.314 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-26T09:25:48.332 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-08-26T09:25:48.332 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-26T09:25:48.389 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-26T09:25:48.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.545+0000 7f9cb2d7c700 1 Processor -- start 2023-08-26T09:25:48.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.545+0000 7f9cb2d7c700 1 -- start start 2023-08-26T09:25:48.553 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.546+0000 7f9cb2d7c700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f9cac15d6c0 0x7f9cac0cea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:48.553 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.546+0000 7f9cb2d7c700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9cac0cef70 0x7f9cac06cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:48.553 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.546+0000 7f9cb2d7c700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cac0cf4d0 con 0x7f9cac0ca620 2023-08-26T09:25:48.553 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.546+0000 7f9cb2d7c700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cac0cb4a0 con 0x7f9cac15d6c0 2023-08-26T09:25:48.554 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.546+0000 7f9cb2d7c700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cac0ce3b0 con 0x7f9cac0cef70 2023-08-26T09:25:48.554 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.546+0000 7f9cb1319700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9cac0cef70 0x7f9cac06cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:48.554 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.546+0000 7f9cabfff700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f9cac15d6c0 0x7f9cac0cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:48.554 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.546+0000 7f9cb1319700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9cac0cef70 0x7f9cac06cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.92:44346/0 (socket says 172.21.15.92:44346) 2023-08-26T09:25:48.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.546+0000 7f9cb0b18700 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f9cac0ca620 0x7f9cac0caa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.92:52802/0 (socket says 172.21.15.92:52802) 2023-08-26T09:25:48.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.546+0000 7f9cb1319700 1 -- 172.21.15.92:0/1114598290 learned_addr learned my addr 172.21.15.92:0/1114598290 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:48.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.547+0000 7f9cabfff700 1 -- 172.21.15.92:0/1114598290 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9cac0cef70 msgr2=0x7f9cac06cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:48.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.547+0000 7f9cabfff700 1 --2- 172.21.15.92:0/1114598290 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9cac0cef70 0x7f9cac06cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:48.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.547+0000 7f9cabfff700 1 -- 172.21.15.92:0/1114598290 >> v1:172.21.15.188:6789/0 conn(0x7f9cac0ca620 legacy=0x7f9cac0caa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:48.556 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.547+0000 7f9cabfff700 1 -- 172.21.15.92:0/1114598290 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cac0ce690 con 0x7f9cac15d6c0 2023-08-26T09:25:48.556 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.547+0000 7f9cab7fe700 1 -- 172.21.15.92:0/1114598290 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 714330312 0 0) 0x7f9cac0cf4d0 con 0x7f9cac0ca620 2023-08-26T09:25:48.556 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.547+0000 7f9cb1319700 1 --2- 172.21.15.92:0/1114598290 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9cac0cef70 0x7f9cac06cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-26T09:25:48.556 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.547+0000 7f9cabfff700 1 --2- 172.21.15.92:0/1114598290 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9cac15d6c0 0x7f9cac0cea30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9c98009840 tx=0x7f9c98009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d35542c637d44a25 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:48.556 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.547+0000 7f9cab7fe700 1 -- 172.21.15.92:0/1114598290 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c98011830 con 0x7f9cac15d6c0 2023-08-26T09:25:48.557 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.547+0000 7f9cab7fe700 1 -- 172.21.15.92:0/1114598290 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c98011990 con 0x7f9cac15d6c0 2023-08-26T09:25:48.557 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.547+0000 7f9cab7fe700 1 -- 172.21.15.92:0/1114598290 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c98011d20 con 0x7f9cac15d6c0 2023-08-26T09:25:48.557 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.548+0000 7f9cb2d7c700 1 -- 172.21.15.92:0/1114598290 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9cac15d6c0 msgr2=0x7f9cac0cea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:48.557 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.548+0000 7f9cb2d7c700 1 --2- 172.21.15.92:0/1114598290 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9cac15d6c0 0x7f9cac0cea30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9c98009840 tx=0x7f9c98009b50 comp rx=0 tx=0).stop 2023-08-26T09:25:48.557 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.548+0000 7f9cb2d7c700 1 -- 172.21.15.92:0/1114598290 shutdown_connections 2023-08-26T09:25:48.558 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.548+0000 7f9cb2d7c700 1 --2- 172.21.15.92:0/1114598290 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9cac0cef70 0x7f9cac06cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:48.558 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.548+0000 7f9cb2d7c700 1 --2- 172.21.15.92:0/1114598290 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9cac15d6c0 0x7f9cac0cea30 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:48.558 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.548+0000 7f9cb2d7c700 1 -- 172.21.15.92:0/1114598290 >> 172.21.15.92:0/1114598290 conn(0x7f9cac0cc7b0 msgr2=0x7f9cac0ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:48.558 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.548+0000 7f9cb2d7c700 1 -- 172.21.15.92:0/1114598290 shutdown_connections 2023-08-26T09:25:48.558 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.548+0000 7f9cb2d7c700 1 -- 172.21.15.92:0/1114598290 wait complete. 2023-08-26T09:25:48.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.549+0000 7f9cb2d7c700 1 Processor -- start 2023-08-26T09:25:48.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.549+0000 7f9cb2d7c700 1 -- start start 2023-08-26T09:25:48.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.550+0000 7f9cb2d7c700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9cac0ca620 0x7f9cac06e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:48.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.550+0000 7f9cb2d7c700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9cac0cef70 0x7f9cac0c9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:48.562 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.550+0000 7f9cb2d7c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cac15d6c0 0x7f9cac14f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:48.562 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.550+0000 7f9cb2d7c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cac0acb50 con 0x7f9cac15d6c0 2023-08-26T09:25:48.562 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.550+0000 7f9cb2d7c700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cac06cd60 con 0x7f9cac0ca620 2023-08-26T09:25:48.562 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.550+0000 7f9cb2d7c700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cac06dbc0 con 0x7f9cac0cef70 2023-08-26T09:25:48.562 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.550+0000 7f9cb1319700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cac15d6c0 0x7f9cac14f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:48.563 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.550+0000 7f9cb1319700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cac15d6c0 0x7f9cac14f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45688/0 (socket says 172.21.15.92:45688) 2023-08-26T09:25:48.563 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.550+0000 7f9cb1319700 1 -- 172.21.15.92:0/1073422168 learned_addr learned my addr 172.21.15.92:0/1073422168 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:48.563 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.550+0000 7f9cb0b18700 1 --2- 172.21.15.92:0/1073422168 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9cac0ca620 0x7f9cac06e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:48.563 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.550+0000 7f9cabfff700 1 --2- 172.21.15.92:0/1073422168 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9cac0cef70 0x7f9cac0c9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:48.563 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.550+0000 7f9cb1319700 1 -- 172.21.15.92:0/1073422168 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9cac0cef70 msgr2=0x7f9cac0c9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:48.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.550+0000 7f9cb1319700 1 --2- 172.21.15.92:0/1073422168 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9cac0cef70 0x7f9cac0c9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:48.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.550+0000 7f9cb1319700 1 -- 172.21.15.92:0/1073422168 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9cac0ca620 msgr2=0x7f9cac06e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:48.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.550+0000 7f9cb1319700 1 --2- 172.21.15.92:0/1073422168 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9cac0ca620 0x7f9cac06e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:48.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.550+0000 7f9cb1319700 1 -- 172.21.15.92:0/1073422168 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca4009b30 con 0x7f9cac15d6c0 2023-08-26T09:25:48.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.551+0000 7f9cb1319700 1 --2- 172.21.15.92:0/1073422168 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cac15d6c0 0x7f9cac14f750 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9ca400efc0 tx=0x7f9ca400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:48.565 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.551+0000 7f9ca97fa700 1 -- 172.21.15.92:0/1073422168 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca4018070 con 0x7f9cac15d6c0 2023-08-26T09:25:48.565 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.551+0000 7f9cb2d7c700 1 -- 172.21.15.92:0/1073422168 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c980094a0 con 0x7f9cac15d6c0 2023-08-26T09:25:48.565 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.551+0000 7f9ca97fa700 1 -- 172.21.15.92:0/1073422168 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ca400f040 con 0x7f9cac15d6c0 2023-08-26T09:25:48.565 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.551+0000 7f9ca97fa700 1 -- 172.21.15.92:0/1073422168 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca4003c20 con 0x7f9cac15d6c0 2023-08-26T09:25:48.566 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.551+0000 7f9cb2d7c700 1 -- 172.21.15.92:0/1073422168 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cac06d290 con 0x7f9cac15d6c0 2023-08-26T09:25:48.566 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.552+0000 7f9cb2d7c700 1 -- 172.21.15.92:0/1073422168 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cac06dd30 con 0x7f9cac15d6c0 2023-08-26T09:25:48.566 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.552+0000 7f9ca97fa700 1 -- 172.21.15.92:0/1073422168 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9ca400c880 con 0x7f9cac15d6c0 2023-08-26T09:25:48.566 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.552+0000 7f9ca97fa700 1 --2- 172.21.15.92:0/1073422168 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f9c9006a0b0 0x7f9c9006c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:48.566 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.553+0000 7f9ca97fa700 1 -- 172.21.15.92:0/1073422168 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9ca40886d0 con 0x7f9cac15d6c0 2023-08-26T09:25:48.567 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.553+0000 7f9cb0b18700 1 --2- 172.21.15.92:0/1073422168 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f9c9006a0b0 0x7f9c9006c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:48.567 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.553+0000 7f9cb0b18700 1 --2- 172.21.15.92:0/1073422168 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f9c9006a0b0 0x7f9c9006c570 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0007fd0 tx=0x7f9ca0007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:48.567 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.557+0000 7f9ca97fa700 1 -- 172.21.15.92:0/1073422168 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9ca4053dd0 con 0x7f9cac15d6c0 2023-08-26T09:25:48.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.748+0000 7f9cb2d7c700 1 -- 172.21.15.92:0/1073422168 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9cac04e660 con 0x7f9cac15d6c0 2023-08-26T09:25:48.754 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.749+0000 7f9ca97fa700 1 -- 172.21.15.92:0/1073422168 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+18209 (secure 0 0 0) 0x7f9ca40573f0 con 0x7f9cac15d6c0 2023-08-26T09:25:48.754 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:25:48.755 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":20,"fsid":"254a2d31-bd41-4507-8326-1b205ac24377","created":"2023-08-26T09:24:55.352131+0000","modified":"2023-08-26T09:25:15.447635+0000","last_up_change":"2023-08-26T09:25:06.124496+0000","last_in_change":"2023-08-26T09:24:57.840725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-26T09:25:06.650431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-26T09:25:06.973382+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-26T09:25:11.584141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-26T09:25:12.814990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e9e7638-4459-4d8d-8e40-130bcf48df66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6819","nonce":382827192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6824","nonce":382827192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6831","nonce":382827192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6827","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6829","nonce":382827192}]},"public_addr":"172.21.15.92:6819/382827192","cluster_addr":"172.21.15.92:6824/382827192","heartbeat_back_addr":"172.21.15.92:6831/382827192","heartbeat_front_addr":"172.21.15.92:6829/382827192","state":["exists","up"]},{"osd":1,"uuid":"164e68c9-aedd-4df5-9b70-f4b1ec3bda13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6809","nonce":618773438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6811","nonce":618773438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6815","nonce":618773438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6813","nonce":618773438}]},"public_addr":"172.21.15.92:6809/618773438","cluster_addr":"172.21.15.92:6811/618773438","heartbeat_back_addr":"172.21.15.92:6815/618773438","heartbeat_front_addr":"172.21.15.92:6813/618773438","state":["exists","up"]},{"osd":2,"uuid":"8701dfee-629a-4d30-82e4-b8fac340303f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6818","nonce":3697397687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6821","nonce":3697397687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6828","nonce":3697397687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6823","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6825","nonce":3697397687}]},"public_addr":"172.21.15.92:6818/3697397687","cluster_addr":"172.21.15.92:6821/3697397687","heartbeat_back_addr":"172.21.15.92:6828/3697397687","heartbeat_front_addr":"172.21.15.92:6825/3697397687","state":["exists","up"]},{"osd":3,"uuid":"93bdc94d-dc07-495f-995a-a6ad072f0247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6801","nonce":3579846453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6803","nonce":3579846453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6807","nonce":3579846453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6805","nonce":3579846453}]},"public_addr":"172.21.15.92:6801/3579846453","cluster_addr":"172.21.15.92:6803/3579846453","heartbeat_back_addr":"172.21.15.92:6807/3579846453","heartbeat_front_addr":"172.21.15.92:6805/3579846453","state":["exists","up"]},{"osd":4,"uuid":"d9d0ea80-8481-46a7-9677-c338d32cf1d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6809","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6811","nonce":3228383424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6813","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6815","nonce":3228383424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6821","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6823","nonce":3228383424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6817","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6819","nonce":3228383424}]},"public_addr":"172.21.15.188:6811/3228383424","cluster_addr":"172.21.15.188:6815/3228383424","heartbeat_back_addr":"172.21.15.188:6823/3228383424","heartbeat_front_addr":"172.21.15.188:6819/3228383424","state":["exists","up"]},{"osd":5,"uuid":"38d03253-467a-456f-bd5e-5a46532a0b18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6801","nonce":1655821054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6803","nonce":1655821054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6807","nonce":1655821054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6805","nonce":1655821054}]},"public_addr":"172.21.15.188:6801/1655821054","cluster_addr":"172.21.15.188:6803/1655821054","heartbeat_back_addr":"172.21.15.188:6807/1655821054","heartbeat_front_addr":"172.21.15.188:6805/1655821054","state":["exists","up"]},{"osd":6,"uuid":"d61564b5-136f-42e5-a843-626c2017cc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6810","nonce":2069976891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6814","nonce":2069976891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6822","nonce":2069976891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6818","nonce":2069976891}]},"public_addr":"172.21.15.188:6810/2069976891","cluster_addr":"172.21.15.188:6814/2069976891","heartbeat_back_addr":"172.21.15.188:6822/2069976891","heartbeat_front_addr":"172.21.15.188:6818/2069976891","state":["exists","up"]},{"osd":7,"uuid":"fae2949e-0d62-42cd-ba72-08f516084b20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6825","nonce":1882888860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6827","nonce":1882888860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6831","nonce":1882888860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6829","nonce":1882888860}]},"public_addr":"172.21.15.188:6825/1882888860","cluster_addr":"172.21.15.188:6827/1882888860","heartbeat_back_addr":"172.21.15.188:6831/1882888860","heartbeat_front_addr":"172.21.15.188:6829/1882888860","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.038523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.063160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.000857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.975572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.023848+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.765194+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.081365+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:05.110745+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-26T09:25:48.756 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.751+0000 7f9cb2d7c700 1 -- 172.21.15.92:0/1073422168 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f9c9006a0b0 msgr2=0x7f9c9006c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:48.756 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.751+0000 7f9cb2d7c700 1 --2- 172.21.15.92:0/1073422168 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f9c9006a0b0 0x7f9c9006c570 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0007fd0 tx=0x7f9ca0007de0 comp rx=0 tx=0).stop 2023-08-26T09:25:48.756 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.751+0000 7f9cb2d7c700 1 -- 172.21.15.92:0/1073422168 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cac15d6c0 msgr2=0x7f9cac14f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:48.757 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.751+0000 7f9cb2d7c700 1 --2- 172.21.15.92:0/1073422168 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cac15d6c0 0x7f9cac14f750 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9ca400efc0 tx=0x7f9ca400c3a0 comp rx=0 tx=0).stop 2023-08-26T09:25:48.757 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.751+0000 7f9cb2d7c700 1 -- 172.21.15.92:0/1073422168 shutdown_connections 2023-08-26T09:25:48.757 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.751+0000 7f9cb2d7c700 1 --2- 172.21.15.92:0/1073422168 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f9c9006a0b0 0x7f9c9006c570 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:48.757 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.751+0000 7f9cb2d7c700 1 --2- 172.21.15.92:0/1073422168 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9cac0ca620 0x7f9cac06e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:48.757 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.751+0000 7f9cb2d7c700 1 --2- 172.21.15.92:0/1073422168 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cac15d6c0 0x7f9cac14f750 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:48.758 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.751+0000 7f9cb2d7c700 1 --2- 172.21.15.92:0/1073422168 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9cac0cef70 0x7f9cac0c9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:48.758 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.751+0000 7f9cb2d7c700 1 -- 172.21.15.92:0/1073422168 >> 172.21.15.92:0/1073422168 conn(0x7f9cac0cc7b0 msgr2=0x7f9cac0af870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:48.758 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.751+0000 7f9cb2d7c700 1 -- 172.21.15.92:0/1073422168 shutdown_connections 2023-08-26T09:25:48.758 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.751+0000 7f9cb2d7c700 1 -- 172.21.15.92:0/1073422168 wait complete. 2023-08-26T09:25:48.768 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-26T09:25:06.650431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-26T09:25:06.973382+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-26T09:25:11.584141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-26T09:25:12.814990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-26T09:25:48.769 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-26T09:25:48.822 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:25:48.824 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:25:48.896 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.891+0000 7f12f1a66700 1 Processor -- start 2023-08-26T09:25:48.896 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.891+0000 7f12f1a66700 1 -- start start 2023-08-26T09:25:48.899 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.892+0000 7f12f1a66700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12ec0cbd70 0x7f12ec164df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:48.900 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.892+0000 7f12f1a66700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12ec143c30 con 0x7f12ec06d3b0 2023-08-26T09:25:48.900 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.892+0000 7f12f1a66700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12ec0ca6a0 con 0x7f12ec143850 2023-08-26T09:25:48.900 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.892+0000 7f12f1a66700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec0ca480 con 0x7f12ec0cbd70 2023-08-26T09:25:48.900 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.892+0000 7f12eaffd700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f12ec06d3b0 0x7f12ec0cb660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:57710/0 (socket says 172.21.15.92:57710) 2023-08-26T09:25:48.901 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.892+0000 7f12eaffd700 1 -- 172.21.15.92:0/3526626774 learned_addr learned my addr 172.21.15.92:0/3526626774 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:48.901 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.893+0000 7f12ebfff700 1 --2- 172.21.15.92:0/3526626774 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12ec0cbd70 0x7f12ec164df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:48.901 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.893+0000 7f12ea7fc700 1 -- 172.21.15.92:0/3526626774 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1346240860 0 0) 0x7f12ec143c30 con 0x7f12ec06d3b0 2023-08-26T09:25:48.901 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.893+0000 7f12ea7fc700 1 -- 172.21.15.92:0/3526626774 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12d40035b0 con 0x7f12ec06d3b0 2023-08-26T09:25:48.901 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.893+0000 7f12ea7fc700 1 -- 172.21.15.92:0/3526626774 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1617038270 0 0) 0x7f12d40035b0 con 0x7f12ec06d3b0 2023-08-26T09:25:48.901 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.893+0000 7f12ea7fc700 1 -- 172.21.15.92:0/3526626774 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12ec0cbd70 msgr2=0x7f12ec164df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:48.902 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.893+0000 7f12ea7fc700 1 --2- 172.21.15.92:0/3526626774 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12ec0cbd70 0x7f12ec164df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:48.902 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.893+0000 7f12ea7fc700 1 -- 172.21.15.92:0/3526626774 >> v1:172.21.15.188:6789/0 conn(0x7f12ec143850 legacy=0x7f12ec0c9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:48.902 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.893+0000 7f12ea7fc700 1 -- 172.21.15.92:0/3526626774 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ec0ca980 con 0x7f12ec06d3b0 2023-08-26T09:25:48.902 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.893+0000 7f12ea7fc700 1 -- 172.21.15.92:0/3526626774 <== mon.0 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1019361464 0 0) 0x7f12dc001670 con 0x7f12ec06d3b0 2023-08-26T09:25:48.902 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.893+0000 7f12ea7fc700 1 -- 172.21.15.92:0/3526626774 >> v1:172.21.15.92:6789/0 conn(0x7f12ec06d3b0 legacy=0x7f12ec0cb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:48.903 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.893+0000 7f12ea7fc700 1 --2- 172.21.15.92:0/3526626774 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12d4003a30 0x7f12d4003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:48.903 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.893+0000 7f12ea7fc700 1 --2- 172.21.15.92:0/3526626774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12d4004850 0x7f12d4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:48.903 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.893+0000 7f12ea7fc700 1 --2- 172.21.15.92:0/3526626774 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12ec0cbd70 0x7f12d4005250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:48.903 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.893+0000 7f12ea7fc700 1 -- 172.21.15.92:0/3526626774 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec0ca480 con 0x7f12d4004850 2023-08-26T09:25:48.903 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.893+0000 7f12ea7fc700 1 -- 172.21.15.92:0/3526626774 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d400bb70 con 0x7f12d4003a30 2023-08-26T09:25:48.904 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.893+0000 7f12ea7fc700 1 -- 172.21.15.92:0/3526626774 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12d400bd30 con 0x7f12ec0cbd70 2023-08-26T09:25:48.904 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.893+0000 7f12eaffd700 1 --2- 172.21.15.92:0/3526626774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12d4004850 0x7f12d4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:48.904 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.893+0000 7f12eb7fe700 1 --2- 172.21.15.92:0/3526626774 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12d4003a30 0x7f12d4003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:48.904 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.893+0000 7f12ebfff700 1 --2- 172.21.15.92:0/3526626774 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12ec0cbd70 0x7f12d4005250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:48.904 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.893+0000 7f12eaffd700 1 -- 172.21.15.92:0/3526626774 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12ec0cbd70 msgr2=0x7f12d4005250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:48.905 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.893+0000 7f12eaffd700 1 --2- 172.21.15.92:0/3526626774 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12ec0cbd70 0x7f12d4005250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:48.905 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.893+0000 7f12eaffd700 1 -- 172.21.15.92:0/3526626774 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12d4003a30 msgr2=0x7f12d4003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:48.905 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.893+0000 7f12eaffd700 1 --2- 172.21.15.92:0/3526626774 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12d4003a30 0x7f12d4003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:48.905 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.893+0000 7f12eaffd700 1 -- 172.21.15.92:0/3526626774 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d40035b0 con 0x7f12d4004850 2023-08-26T09:25:48.905 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.894+0000 7f12eaffd700 1 --2- 172.21.15.92:0/3526626774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12d4004850 0x7f12d4004cd0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f12dc00c240 tx=0x7f12d4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e79b12924d57d3e8 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:48.905 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.894+0000 7f12ea7fc700 1 -- 172.21.15.92:0/3526626774 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12dc007c10 con 0x7f12d4004850 2023-08-26T09:25:48.906 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.894+0000 7f12ea7fc700 1 -- 172.21.15.92:0/3526626774 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12dc00cde0 con 0x7f12d4004850 2023-08-26T09:25:48.906 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.894+0000 7f12ea7fc700 1 -- 172.21.15.92:0/3526626774 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12dc005ba0 con 0x7f12d4004850 2023-08-26T09:25:48.906 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.894+0000 7f12f1a66700 1 -- 172.21.15.92:0/3526626774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12d4004850 msgr2=0x7f12d4004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:48.906 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.894+0000 7f12f1a66700 1 --2- 172.21.15.92:0/3526626774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12d4004850 0x7f12d4004cd0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f12dc00c240 tx=0x7f12d4005880 comp rx=0 tx=0).stop 2023-08-26T09:25:48.906 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.894+0000 7f12ebfff700 1 -- 172.21.15.92:0/3526626774 reap_dead start 2023-08-26T09:25:48.907 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.894+0000 7f12f1a66700 1 -- 172.21.15.92:0/3526626774 shutdown_connections 2023-08-26T09:25:48.907 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.894+0000 7f12f1a66700 1 -- 172.21.15.92:0/3526626774 >> 172.21.15.92:0/3526626774 conn(0x7f12ec0b0880 msgr2=0x7f12ec0b0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:48.907 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.894+0000 7f12f1a66700 1 -- 172.21.15.92:0/3526626774 shutdown_connections 2023-08-26T09:25:48.907 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.894+0000 7f12f1a66700 1 -- 172.21.15.92:0/3526626774 wait complete. 2023-08-26T09:25:48.910 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.895+0000 7f12f1a66700 1 Processor -- start 2023-08-26T09:25:48.910 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.896+0000 7f12f1a66700 1 -- start start 2023-08-26T09:25:48.910 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.896+0000 7f12f1a66700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12d4004850 0x7f12ec13b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:48.910 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.896+0000 7f12f1a66700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12ec13d8d0 0x7f12ec0b3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:48.910 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.896+0000 7f12f1a66700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12ec139d40 0x7f12ec13a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:48.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.896+0000 7f12f1a66700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec13e450 con 0x7f12d4004850 2023-08-26T09:25:48.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.896+0000 7f12f1a66700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec0c6a20 con 0x7f12ec139d40 2023-08-26T09:25:48.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.896+0000 7f12f1a66700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec13a700 con 0x7f12ec13d8d0 2023-08-26T09:25:48.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.897+0000 7f12eb7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12d4004850 0x7f12ec13b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:48.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.897+0000 7f12eb7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12d4004850 0x7f12ec13b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45704/0 (socket says 172.21.15.92:45704) 2023-08-26T09:25:48.912 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.897+0000 7f12eb7fe700 1 -- 172.21.15.92:0/3732765460 learned_addr learned my addr 172.21.15.92:0/3732765460 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:48.912 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.897+0000 7f12ebfff700 1 --2- 172.21.15.92:0/3732765460 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12ec139d40 0x7f12ec13a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:48.912 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.897+0000 7f12eaffd700 1 --2- 172.21.15.92:0/3732765460 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12ec13d8d0 0x7f12ec0b3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:48.912 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.897+0000 7f12eb7fe700 1 -- 172.21.15.92:0/3732765460 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12ec13d8d0 msgr2=0x7f12ec0b3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:48.912 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.897+0000 7f12eb7fe700 1 --2- 172.21.15.92:0/3732765460 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12ec13d8d0 0x7f12ec0b3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:48.913 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.897+0000 7f12eb7fe700 1 -- 172.21.15.92:0/3732765460 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12ec139d40 msgr2=0x7f12ec13a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:48.913 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.897+0000 7f12eb7fe700 1 --2- 172.21.15.92:0/3732765460 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12ec139d40 0x7f12ec13a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:48.913 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.897+0000 7f12eb7fe700 1 -- 172.21.15.92:0/3732765460 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ec13de90 con 0x7f12d4004850 2023-08-26T09:25:48.913 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.897+0000 7f12eb7fe700 1 --2- 172.21.15.92:0/3732765460 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12d4004850 0x7f12ec13b340 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f12e000f7f0 tx=0x7f12e000fb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:48.913 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.897+0000 7f12d3fff700 1 -- 172.21.15.92:0/3732765460 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e00052e0 con 0x7f12d4004850 2023-08-26T09:25:48.913 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.897+0000 7f12d3fff700 1 -- 172.21.15.92:0/3732765460 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e0005440 con 0x7f12d4004850 2023-08-26T09:25:48.914 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.897+0000 7f12f1a66700 1 -- 172.21.15.92:0/3732765460 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12ec13e170 con 0x7f12d4004850 2023-08-26T09:25:48.914 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.897+0000 7f12d3fff700 1 -- 172.21.15.92:0/3732765460 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e00038a0 con 0x7f12d4004850 2023-08-26T09:25:48.914 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.897+0000 7f12f1a66700 1 -- 172.21.15.92:0/3732765460 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12ec13b880 con 0x7f12d4004850 2023-08-26T09:25:48.914 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.898+0000 7f12f1a66700 1 -- 172.21.15.92:0/3732765460 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12ec04eeb0 con 0x7f12d4004850 2023-08-26T09:25:48.914 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.898+0000 7f12d3fff700 1 -- 172.21.15.92:0/3732765460 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f12e0003a00 con 0x7f12d4004850 2023-08-26T09:25:48.915 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.899+0000 7f12d3fff700 1 --2- 172.21.15.92:0/3732765460 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f12d806a0e0 0x7f12d806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:48.915 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.899+0000 7f12d3fff700 1 -- 172.21.15.92:0/3732765460 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f12e0088130 con 0x7f12d4004850 2023-08-26T09:25:48.915 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.899+0000 7f12eaffd700 1 --2- 172.21.15.92:0/3732765460 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f12d806a0e0 0x7f12d806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:48.915 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.899+0000 7f12eaffd700 1 --2- 172.21.15.92:0/3732765460 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f12d806a0e0 0x7f12d806c5a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f12ec0c64f0 tx=0x7f12dc007000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:48.915 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:48.903+0000 7f12d3fff700 1 -- 172.21.15.92:0/3732765460 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f12e00538b0 con 0x7f12d4004850 2023-08-26T09:25:49.097 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.092+0000 7f12f1a66700 1 -- 172.21.15.92:0/3732765460 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f12ec0b4bc0 con 0x7f12d4004850 2023-08-26T09:25:49.097 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.092+0000 7f12d3fff700 1 -- 172.21.15.92:0/3732765460 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f12e0003cb0 con 0x7f12d4004850 2023-08-26T09:25:49.097 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 8 2023-08-26T09:25:49.099 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.094+0000 7f12f1a66700 1 -- 172.21.15.92:0/3732765460 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f12d806a0e0 msgr2=0x7f12d806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:49.099 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.094+0000 7f12f1a66700 1 --2- 172.21.15.92:0/3732765460 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f12d806a0e0 0x7f12d806c5a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f12ec0c64f0 tx=0x7f12dc007000 comp rx=0 tx=0).stop 2023-08-26T09:25:49.099 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.094+0000 7f12f1a66700 1 -- 172.21.15.92:0/3732765460 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12d4004850 msgr2=0x7f12ec13b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:49.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.094+0000 7f12f1a66700 1 --2- 172.21.15.92:0/3732765460 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12d4004850 0x7f12ec13b340 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f12e000f7f0 tx=0x7f12e000fb00 comp rx=0 tx=0).stop 2023-08-26T09:25:49.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.094+0000 7f12f1a66700 1 -- 172.21.15.92:0/3732765460 shutdown_connections 2023-08-26T09:25:49.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.094+0000 7f12f1a66700 1 --2- 172.21.15.92:0/3732765460 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f12d806a0e0 0x7f12d806c5a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:49.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.094+0000 7f12f1a66700 1 --2- 172.21.15.92:0/3732765460 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12ec139d40 0x7f12ec13a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:49.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.094+0000 7f12f1a66700 1 --2- 172.21.15.92:0/3732765460 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12d4004850 0x7f12ec13b340 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:49.101 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.094+0000 7f12f1a66700 1 --2- 172.21.15.92:0/3732765460 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12ec13d8d0 0x7f12ec0b3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:49.101 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.094+0000 7f12f1a66700 1 -- 172.21.15.92:0/3732765460 >> 172.21.15.92:0/3732765460 conn(0x7f12ec0b0880 msgr2=0x7f12ec0c52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:49.101 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.094+0000 7f12f1a66700 1 -- 172.21.15.92:0/3732765460 shutdown_connections 2023-08-26T09:25:49.101 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.094+0000 7f12f1a66700 1 -- 172.21.15.92:0/3732765460 wait complete. 2023-08-26T09:25:49.111 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-26T09:25:49.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.272+0000 7f2a9fb4e700 1 Processor -- start 2023-08-26T09:25:49.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.272+0000 7f2a9fb4e700 1 -- start start 2023-08-26T09:25:49.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.273+0000 7f2a9fb4e700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a980b2d70 0x7f2a9815edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:49.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.273+0000 7f2a9fb4e700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f2a980d0a30 0x7f2a980cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:49.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.273+0000 7f2a9fb4e700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a9806de90 con 0x7f2a980cb4a0 2023-08-26T09:25:49.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.273+0000 7f2a9fb4e700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a9806eb10 con 0x7f2a980d0a30 2023-08-26T09:25:49.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.273+0000 7f2a9fb4e700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9806e170 con 0x7f2a980b2d70 2023-08-26T09:25:49.281 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.273+0000 7f2a9e0eb700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f2a980d0a30 0x7f2a980cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:49.281 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.273+0000 7f2a9d8ea700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a980b2d70 0x7f2a9815edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:49.281 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.273+0000 7f2a9d8ea700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a980b2d70 0x7f2a9815edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.92:44376/0 (socket says 172.21.15.92:44376) 2023-08-26T09:25:49.281 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.273+0000 7f2a9d8ea700 1 -- 172.21.15.92:0/4164308388 learned_addr learned my addr 172.21.15.92:0/4164308388 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:49.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.273+0000 7f2a9e0eb700 1 -- 172.21.15.92:0/4164308388 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a980b2d70 msgr2=0x7f2a9815edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:49.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.273+0000 7f2a9e0eb700 1 --2- 172.21.15.92:0/4164308388 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a980b2d70 0x7f2a9815edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:49.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.273+0000 7f2a9e0eb700 1 -- 172.21.15.92:0/4164308388 >> v1:172.21.15.188:6789/0 conn(0x7f2a980cb4a0 legacy=0x7f2a980d0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:49.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.273+0000 7f2a9e0eb700 1 -- 172.21.15.92:0/4164308388 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a9806e450 con 0x7f2a980d0a30 2023-08-26T09:25:49.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.273+0000 7f2a9d8ea700 1 --2- 172.21.15.92:0/4164308388 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a980b2d70 0x7f2a9815edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-26T09:25:49.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.274+0000 7f2a9e0eb700 1 --2- 172.21.15.92:0/4164308388 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2a980d0a30 0x7f2a980cb920 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2a90009d90 tx=0x7f2a9000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d261229904cbb383 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:49.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.274+0000 7f2a9c8e8700 1 -- 172.21.15.92:0/4164308388 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9000e070 con 0x7f2a980d0a30 2023-08-26T09:25:49.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.274+0000 7f2a9c8e8700 1 -- 172.21.15.92:0/4164308388 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a9000bb20 con 0x7f2a980d0a30 2023-08-26T09:25:49.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.274+0000 7f2a9c8e8700 1 -- 172.21.15.92:0/4164308388 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a90012430 con 0x7f2a980d0a30 2023-08-26T09:25:49.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.274+0000 7f2a9fb4e700 1 -- 172.21.15.92:0/4164308388 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2a980d0a30 msgr2=0x7f2a980cb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:49.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.274+0000 7f2a9fb4e700 1 --2- 172.21.15.92:0/4164308388 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2a980d0a30 0x7f2a980cb920 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2a90009d90 tx=0x7f2a9000b330 comp rx=0 tx=0).stop 2023-08-26T09:25:49.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.274+0000 7f2a9fb4e700 1 -- 172.21.15.92:0/4164308388 shutdown_connections 2023-08-26T09:25:49.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.274+0000 7f2a9fb4e700 1 --2- 172.21.15.92:0/4164308388 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2a980d0a30 0x7f2a980cb920 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:49.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.274+0000 7f2a9fb4e700 1 --2- 172.21.15.92:0/4164308388 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a980b2d70 0x7f2a9815edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:49.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.274+0000 7f2a9fb4e700 1 -- 172.21.15.92:0/4164308388 >> 172.21.15.92:0/4164308388 conn(0x7f2a980cd8d0 msgr2=0x7f2a980cdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:49.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.274+0000 7f2a9fb4e700 1 -- 172.21.15.92:0/4164308388 shutdown_connections 2023-08-26T09:25:49.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.274+0000 7f2a9fb4e700 1 -- 172.21.15.92:0/4164308388 wait complete. 2023-08-26T09:25:49.289 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.276+0000 7f2a9fb4e700 1 Processor -- start 2023-08-26T09:25:49.289 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.276+0000 7f2a9fb4e700 1 -- start start 2023-08-26T09:25:49.289 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.276+0000 7f2a9fb4e700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a980b2d70 0x7f2a980b6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:49.289 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.276+0000 7f2a9fb4e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a980cb4a0 0x7f2a981f40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:49.290 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.276+0000 7f2a9fb4e700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2a980d0a30 0x7f2a980b4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:49.290 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.276+0000 7f2a9fb4e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a981f2040 con 0x7f2a980cb4a0 2023-08-26T09:25:49.290 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.276+0000 7f2a9fb4e700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a981f4630 con 0x7f2a980d0a30 2023-08-26T09:25:49.290 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.276+0000 7f2a9fb4e700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a981f4900 con 0x7f2a980b2d70 2023-08-26T09:25:49.290 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.276+0000 7f2a9d0e9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a980cb4a0 0x7f2a981f40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:49.290 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.276+0000 7f2a9d0e9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a980cb4a0 0x7f2a981f40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45720/0 (socket says 172.21.15.92:45720) 2023-08-26T09:25:49.291 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.276+0000 7f2a9d0e9700 1 -- 172.21.15.92:0/459297043 learned_addr learned my addr 172.21.15.92:0/459297043 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:49.291 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.277+0000 7f2a9d8ea700 1 --2- 172.21.15.92:0/459297043 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a980b2d70 0x7f2a980b6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:49.291 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.277+0000 7f2a9e0eb700 1 --2- 172.21.15.92:0/459297043 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2a980d0a30 0x7f2a980b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:49.291 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.277+0000 7f2a9d0e9700 1 -- 172.21.15.92:0/459297043 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a980b2d70 msgr2=0x7f2a980b6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:49.291 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.277+0000 7f2a9d0e9700 1 --2- 172.21.15.92:0/459297043 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a980b2d70 0x7f2a980b6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:49.292 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.277+0000 7f2a9d0e9700 1 -- 172.21.15.92:0/459297043 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2a980d0a30 msgr2=0x7f2a980b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:49.292 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.277+0000 7f2a9d0e9700 1 --2- 172.21.15.92:0/459297043 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2a980d0a30 0x7f2a980b4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:49.292 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.277+0000 7f2a9d0e9700 1 -- 172.21.15.92:0/459297043 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a94009550 con 0x7f2a980cb4a0 2023-08-26T09:25:49.292 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.277+0000 7f2a9d8ea700 1 --2- 172.21.15.92:0/459297043 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a980b2d70 0x7f2a980b6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:49.292 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.277+0000 7f2a9e0eb700 1 --2- 172.21.15.92:0/459297043 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2a980d0a30 0x7f2a980b4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:49.293 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.277+0000 7f2a9d0e9700 1 --2- 172.21.15.92:0/459297043 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a980cb4a0 0x7f2a981f40f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2a8800c4e0 tx=0x7f2a8800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:49.293 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.277+0000 7f2a8e7fc700 1 -- 172.21.15.92:0/459297043 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a880052d0 con 0x7f2a980cb4a0 2023-08-26T09:25:49.293 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.277+0000 7f2a8e7fc700 1 -- 172.21.15.92:0/459297043 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a88005430 con 0x7f2a980cb4a0 2023-08-26T09:25:49.293 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.277+0000 7f2a9fb4e700 1 -- 172.21.15.92:0/459297043 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a90009a70 con 0x7f2a980cb4a0 2023-08-26T09:25:49.293 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.277+0000 7f2a8e7fc700 1 -- 172.21.15.92:0/459297043 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a880038c0 con 0x7f2a980cb4a0 2023-08-26T09:25:49.293 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.277+0000 7f2a9fb4e700 1 -- 172.21.15.92:0/459297043 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a981f4ec0 con 0x7f2a980cb4a0 2023-08-26T09:25:49.294 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.278+0000 7f2a9fb4e700 1 -- 172.21.15.92:0/459297043 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a981f21b0 con 0x7f2a980cb4a0 2023-08-26T09:25:49.294 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.278+0000 7f2a8e7fc700 1 -- 172.21.15.92:0/459297043 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2a88003a20 con 0x7f2a980cb4a0 2023-08-26T09:25:49.294 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.279+0000 7f2a8e7fc700 1 --2- 172.21.15.92:0/459297043 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f2a7c06a0e0 0x7f2a7c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:49.294 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.279+0000 7f2a8e7fc700 1 -- 172.21.15.92:0/459297043 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2a88087a50 con 0x7f2a980cb4a0 2023-08-26T09:25:49.295 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.279+0000 7f2a9d8ea700 1 --2- 172.21.15.92:0/459297043 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f2a7c06a0e0 0x7f2a7c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:49.295 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.279+0000 7f2a9d8ea700 1 --2- 172.21.15.92:0/459297043 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f2a7c06a0e0 0x7f2a7c06c5a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2a94009db0 tx=0x7f2a94008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:49.295 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.283+0000 7f2a8e7fc700 1 -- 172.21.15.92:0/459297043 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2a88053140 con 0x7f2a980cb4a0 2023-08-26T09:25:49.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.471+0000 7f2a9fb4e700 1 -- 172.21.15.92:0/459297043 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2a9804eeb0 con 0x7f2a980cb4a0 2023-08-26T09:25:49.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.471+0000 7f2a8e7fc700 1 -- 172.21.15.92:0/459297043 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2a88017020 con 0x7f2a980cb4a0 2023-08-26T09:25:49.477 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 1 2023-08-26T09:25:49.478 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.473+0000 7f2a9fb4e700 1 -- 172.21.15.92:0/459297043 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f2a7c06a0e0 msgr2=0x7f2a7c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:49.478 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.473+0000 7f2a9fb4e700 1 --2- 172.21.15.92:0/459297043 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f2a7c06a0e0 0x7f2a7c06c5a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2a94009db0 tx=0x7f2a94008040 comp rx=0 tx=0).stop 2023-08-26T09:25:49.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.473+0000 7f2a9fb4e700 1 -- 172.21.15.92:0/459297043 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a980cb4a0 msgr2=0x7f2a981f40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:49.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.473+0000 7f2a9fb4e700 1 --2- 172.21.15.92:0/459297043 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a980cb4a0 0x7f2a981f40f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2a8800c4e0 tx=0x7f2a8800c8a0 comp rx=0 tx=0).stop 2023-08-26T09:25:49.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.473+0000 7f2a9fb4e700 1 -- 172.21.15.92:0/459297043 shutdown_connections 2023-08-26T09:25:49.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.473+0000 7f2a9fb4e700 1 --2- 172.21.15.92:0/459297043 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f2a7c06a0e0 0x7f2a7c06c5a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:49.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.473+0000 7f2a9fb4e700 1 --2- 172.21.15.92:0/459297043 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2a980d0a30 0x7f2a980b4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:49.480 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.473+0000 7f2a9fb4e700 1 --2- 172.21.15.92:0/459297043 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a980b2d70 0x7f2a980b6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:49.480 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.473+0000 7f2a9fb4e700 1 --2- 172.21.15.92:0/459297043 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a980cb4a0 0x7f2a981f40f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:49.480 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.473+0000 7f2a9fb4e700 1 -- 172.21.15.92:0/459297043 >> 172.21.15.92:0/459297043 conn(0x7f2a980cd8d0 msgr2=0x7f2a980b21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:49.480 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.473+0000 7f2a9fb4e700 1 -- 172.21.15.92:0/459297043 shutdown_connections 2023-08-26T09:25:49.480 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.473+0000 7f2a9fb4e700 1 -- 172.21.15.92:0/459297043 wait complete. 2023-08-26T09:25:49.491 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-26T09:25:49.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.609+0000 7f7cd7033700 1 Processor -- start 2023-08-26T09:25:49.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.609+0000 7f7cd7033700 1 -- start start 2023-08-26T09:25:49.623 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.610+0000 7f7cd7033700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f7cd015d220 0x7f7cd00af390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:49.623 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.610+0000 7f7cd7033700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f7cd0071430 0x7f7cd006a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:49.623 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.610+0000 7f7cd7033700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cd00aee50 con 0x7f7cd006db70 2023-08-26T09:25:49.624 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.610+0000 7f7cd7033700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cd00af130 con 0x7f7cd0071430 2023-08-26T09:25:49.624 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.610+0000 7f7cd7033700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cd00c4cb0 con 0x7f7cd015d220 2023-08-26T09:25:49.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.610+0000 7f7cd55d0700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f7cd0071430 0x7f7cd006a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:49.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.610+0000 7f7ccffff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f7cd006db70 0x7f7cd0070d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:57740/0 (socket says 172.21.15.92:57740) 2023-08-26T09:25:49.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.610+0000 7f7cd55d0700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f7cd0071430 0x7f7cd006a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45730/0 (socket says 172.21.15.92:45730) 2023-08-26T09:25:49.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.610+0000 7f7ccffff700 1 -- 172.21.15.92:0/3774017784 learned_addr learned my addr 172.21.15.92:0/3774017784 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:49.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.610+0000 7f7cd55d0700 1 -- 172.21.15.92:0/3774017784 >> v2:172.21.15.188:3300/0 conn(0x7f7cd015d220 msgr2=0x7f7cd00af390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:49.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.610+0000 7f7cd55d0700 1 --2- 172.21.15.92:0/3774017784 >> v2:172.21.15.188:3300/0 conn(0x7f7cd015d220 0x7f7cd00af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:49.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.610+0000 7f7cd55d0700 1 -- 172.21.15.92:0/3774017784 >> v1:172.21.15.92:6789/0 conn(0x7f7cd006db70 legacy=0x7f7cd0070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:49.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.610+0000 7f7cd55d0700 1 -- 172.21.15.92:0/3774017784 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd00c4f90 con 0x7f7cd0071430 2023-08-26T09:25:49.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.610+0000 7f7ccf7fe700 1 -- 172.21.15.92:0/3774017784 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1500416163 0 0) 0x7f7cd00aee50 con 0x7f7cd006db70 2023-08-26T09:25:49.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.610+0000 7f7cd55d0700 1 --2- 172.21.15.92:0/3774017784 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7cd0071430 0x7f7cd006a320 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0072c00 tx=0x7f7cc800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8996f53685201dee server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:49.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.610+0000 7f7ccf7fe700 1 -- 172.21.15.92:0/3774017784 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc800e070 con 0x7f7cd0071430 2023-08-26T09:25:49.627 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.610+0000 7f7ccf7fe700 1 -- 172.21.15.92:0/3774017784 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc800bbd0 con 0x7f7cd0071430 2023-08-26T09:25:49.627 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.611+0000 7f7ccf7fe700 1 -- 172.21.15.92:0/3774017784 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc8012430 con 0x7f7cd0071430 2023-08-26T09:25:49.627 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.611+0000 7f7cd7033700 1 -- 172.21.15.92:0/3774017784 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7cd0071430 msgr2=0x7f7cd006a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:49.627 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.611+0000 7f7cd7033700 1 --2- 172.21.15.92:0/3774017784 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7cd0071430 0x7f7cd006a320 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0072c00 tx=0x7f7cc800b330 comp rx=0 tx=0).stop 2023-08-26T09:25:49.627 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.611+0000 7f7cd7033700 1 -- 172.21.15.92:0/3774017784 shutdown_connections 2023-08-26T09:25:49.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.611+0000 7f7cd7033700 1 --2- 172.21.15.92:0/3774017784 >> v2:172.21.15.188:3300/0 conn(0x7f7cd015d220 0x7f7cd00af390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:49.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.611+0000 7f7cd7033700 1 --2- 172.21.15.92:0/3774017784 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7cd0071430 0x7f7cd006a320 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:49.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.611+0000 7f7cd7033700 1 -- 172.21.15.92:0/3774017784 >> 172.21.15.92:0/3774017784 conn(0x7f7cd006b430 msgr2=0x7f7cd006b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:49.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.611+0000 7f7cd7033700 1 -- 172.21.15.92:0/3774017784 shutdown_connections 2023-08-26T09:25:49.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.611+0000 7f7cd7033700 1 -- 172.21.15.92:0/3774017784 wait complete. 2023-08-26T09:25:49.629 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.612+0000 7f7cd7033700 1 Processor -- start 2023-08-26T09:25:49.629 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.612+0000 7f7cd7033700 1 -- start start 2023-08-26T09:25:49.629 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.613+0000 7f7cd7033700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7cd006db70 0x7f7cd0152a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:49.629 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.613+0000 7f7cd7033700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7cd0071430 0x7f7cd00ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:49.629 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.613+0000 7f7cd7033700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7cd015d220 0x7f7cd006a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:49.630 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.613+0000 7f7cd7033700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd00adfa0 con 0x7f7cd0071430 2023-08-26T09:25:49.630 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.613+0000 7f7cd7033700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd00ad320 con 0x7f7cd006db70 2023-08-26T09:25:49.630 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.613+0000 7f7cd7033700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd00ad600 con 0x7f7cd015d220 2023-08-26T09:25:49.630 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.613+0000 7f7ccffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7cd0071430 0x7f7cd00ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:49.630 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.613+0000 7f7ccffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7cd0071430 0x7f7cd00ac8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45734/0 (socket says 172.21.15.92:45734) 2023-08-26T09:25:49.630 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.613+0000 7f7ccffff700 1 -- 172.21.15.92:0/3348829300 learned_addr learned my addr 172.21.15.92:0/3348829300 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:49.631 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.613+0000 7f7ccffff700 1 -- 172.21.15.92:0/3348829300 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7cd015d220 msgr2=0x7f7cd006a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:49.631 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.613+0000 7f7cd55d0700 1 --2- 172.21.15.92:0/3348829300 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7cd015d220 0x7f7cd006a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:49.631 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.614+0000 7f7cd4dcf700 1 --2- 172.21.15.92:0/3348829300 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7cd006db70 0x7f7cd0152a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:49.631 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.614+0000 7f7ccffff700 1 --2- 172.21.15.92:0/3348829300 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7cd015d220 0x7f7cd006a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:49.631 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.614+0000 7f7ccffff700 1 -- 172.21.15.92:0/3348829300 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7cd006db70 msgr2=0x7f7cd0152a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:49.632 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.614+0000 7f7ccffff700 1 --2- 172.21.15.92:0/3348829300 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7cd006db70 0x7f7cd0152a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:49.632 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.614+0000 7f7ccffff700 1 -- 172.21.15.92:0/3348829300 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc8009a70 con 0x7f7cd0071430 2023-08-26T09:25:49.632 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.614+0000 7f7cd55d0700 1 --2- 172.21.15.92:0/3348829300 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7cd015d220 0x7f7cd006a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:25:49.632 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.614+0000 7f7cd4dcf700 1 --2- 172.21.15.92:0/3348829300 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7cd006db70 0x7f7cd0152a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:25:49.632 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.614+0000 7f7ccffff700 1 --2- 172.21.15.92:0/3348829300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7cd0071430 0x7f7cd00ac8d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc0011e0 tx=0x7f7cbc00cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:49.633 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.614+0000 7f7ccd7fa700 1 -- 172.21.15.92:0/3348829300 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc004c80 con 0x7f7cd0071430 2023-08-26T09:25:49.633 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.614+0000 7f7ccd7fa700 1 -- 172.21.15.92:0/3348829300 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cbc004e00 con 0x7f7cd0071430 2023-08-26T09:25:49.633 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.614+0000 7f7cd7033700 1 -- 172.21.15.92:0/3348829300 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cd00ad8e0 con 0x7f7cd0071430 2023-08-26T09:25:49.633 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.614+0000 7f7ccd7fa700 1 -- 172.21.15.92:0/3348829300 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc007310 con 0x7f7cd0071430 2023-08-26T09:25:49.633 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.614+0000 7f7cd7033700 1 -- 172.21.15.92:0/3348829300 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cd0153e70 con 0x7f7cd0071430 2023-08-26T09:25:49.633 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.615+0000 7f7cd7033700 1 -- 172.21.15.92:0/3348829300 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cd004eeb0 con 0x7f7cd0071430 2023-08-26T09:25:49.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.615+0000 7f7ccd7fa700 1 -- 172.21.15.92:0/3348829300 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7cbc007470 con 0x7f7cd0071430 2023-08-26T09:25:49.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.615+0000 7f7ccd7fa700 1 --2- 172.21.15.92:0/3348829300 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f7cb406a0e0 0x7f7cb406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:49.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.616+0000 7f7ccd7fa700 1 -- 172.21.15.92:0/3348829300 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7cbc0882e0 con 0x7f7cd0071430 2023-08-26T09:25:49.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.616+0000 7f7cd4dcf700 1 --2- 172.21.15.92:0/3348829300 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f7cb406a0e0 0x7f7cb406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:49.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.616+0000 7f7cd4dcf700 1 --2- 172.21.15.92:0/3348829300 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f7cb406a0e0 0x7f7cb406c5a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7cd01f57b0 tx=0x7f7cc4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:49.635 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.620+0000 7f7ccd7fa700 1 -- 172.21.15.92:0/3348829300 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7cbc053a60 con 0x7f7cd0071430 2023-08-26T09:25:49.814 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.809+0000 7f7cd7033700 1 -- 172.21.15.92:0/3348829300 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7cd0073680 con 0x7f7cd0071430 2023-08-26T09:25:49.815 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.810+0000 7f7ccd7fa700 1 -- 172.21.15.92:0/3348829300 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7cbc057080 con 0x7f7cd0071430 2023-08-26T09:25:49.815 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 32 2023-08-26T09:25:49.817 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.812+0000 7f7cd7033700 1 -- 172.21.15.92:0/3348829300 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f7cb406a0e0 msgr2=0x7f7cb406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:49.817 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.812+0000 7f7cd7033700 1 --2- 172.21.15.92:0/3348829300 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f7cb406a0e0 0x7f7cb406c5a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7cd01f57b0 tx=0x7f7cc4008040 comp rx=0 tx=0).stop 2023-08-26T09:25:49.817 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.812+0000 7f7cd7033700 1 -- 172.21.15.92:0/3348829300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7cd0071430 msgr2=0x7f7cd00ac8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:49.818 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.812+0000 7f7cd7033700 1 --2- 172.21.15.92:0/3348829300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7cd0071430 0x7f7cd00ac8d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc0011e0 tx=0x7f7cbc00cae0 comp rx=0 tx=0).stop 2023-08-26T09:25:49.818 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.812+0000 7f7cd7033700 1 -- 172.21.15.92:0/3348829300 shutdown_connections 2023-08-26T09:25:49.818 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.812+0000 7f7cd7033700 1 --2- 172.21.15.92:0/3348829300 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f7cb406a0e0 0x7f7cb406c5a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:49.818 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.812+0000 7f7cd7033700 1 --2- 172.21.15.92:0/3348829300 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7cd006db70 0x7f7cd0152a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:49.819 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.812+0000 7f7cd7033700 1 --2- 172.21.15.92:0/3348829300 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7cd015d220 0x7f7cd006a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:49.819 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.812+0000 7f7cd7033700 1 --2- 172.21.15.92:0/3348829300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7cd0071430 0x7f7cd00ac8d0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:49.819 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.812+0000 7f7cd7033700 1 -- 172.21.15.92:0/3348829300 >> 172.21.15.92:0/3348829300 conn(0x7f7cd006b430 msgr2=0x7f7cd0155d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:49.819 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.812+0000 7f7cd7033700 1 -- 172.21.15.92:0/3348829300 shutdown_connections 2023-08-26T09:25:49.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.812+0000 7f7cd7033700 1 -- 172.21.15.92:0/3348829300 wait complete. 2023-08-26T09:25:49.829 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-26T09:25:49.953 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.948+0000 7f7182784700 1 Processor -- start 2023-08-26T09:25:49.953 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.948+0000 7f7182784700 1 -- start start 2023-08-26T09:25:49.956 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.949+0000 7f7182784700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f717c0b2d70 0x7f717c15edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:49.956 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.949+0000 7f7182784700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f717c0cb4a0 0x7f717c0cb930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:49.956 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.949+0000 7f7182784700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f717c06de90 con 0x7f717c0d0320 2023-08-26T09:25:49.956 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.949+0000 7f7182784700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f717c06eb10 con 0x7f717c0cb4a0 2023-08-26T09:25:49.956 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.949+0000 7f7182784700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f717c06e170 con 0x7f717c0b2d70 2023-08-26T09:25:49.957 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.949+0000 7f717b7fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f717c0cb4a0 0x7f717c0cb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:49.957 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.949+0000 7f7180d21700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f717c0d0320 0x7f717c15ba00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:57758/0 (socket says 172.21.15.92:57758) 2023-08-26T09:25:49.957 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.949+0000 7f717b7fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f717c0cb4a0 0x7f717c0cb930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45740/0 (socket says 172.21.15.92:45740) 2023-08-26T09:25:49.957 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.949+0000 7f7180d21700 1 -- 172.21.15.92:0/945271389 learned_addr learned my addr 172.21.15.92:0/945271389 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:49.958 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.949+0000 7f717bfff700 1 --2- 172.21.15.92:0/945271389 >> v2:172.21.15.188:3300/0 conn(0x7f717c0b2d70 0x7f717c15edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:49.958 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.949+0000 7f717b7fe700 1 -- 172.21.15.92:0/945271389 >> v2:172.21.15.188:3300/0 conn(0x7f717c0b2d70 msgr2=0x7f717c15edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:49.958 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.949+0000 7f717b7fe700 1 --2- 172.21.15.92:0/945271389 >> v2:172.21.15.188:3300/0 conn(0x7f717c0b2d70 0x7f717c15edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:49.958 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.949+0000 7f717b7fe700 1 -- 172.21.15.92:0/945271389 >> v1:172.21.15.92:6789/0 conn(0x7f717c0d0320 legacy=0x7f717c15ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:49.958 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.949+0000 7f717affd700 1 -- 172.21.15.92:0/945271389 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2347945448 0 0) 0x7f717c06de90 con 0x7f717c0d0320 2023-08-26T09:25:49.959 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.949+0000 7f717b7fe700 1 -- 172.21.15.92:0/945271389 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f717c06e450 con 0x7f717c0cb4a0 2023-08-26T09:25:49.959 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.949+0000 7f717b7fe700 1 --2- 172.21.15.92:0/945271389 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f717c0cb4a0 0x7f717c0cb930 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f717c0b3520 tx=0x7f716c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=676baecb7f945ba7 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:49.959 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.950+0000 7f717affd700 1 -- 172.21.15.92:0/945271389 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716c011830 con 0x7f717c0cb4a0 2023-08-26T09:25:49.959 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.950+0000 7f717affd700 1 -- 172.21.15.92:0/945271389 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f716c011990 con 0x7f717c0cb4a0 2023-08-26T09:25:49.959 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.950+0000 7f717affd700 1 -- 172.21.15.92:0/945271389 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716c011d20 con 0x7f717c0cb4a0 2023-08-26T09:25:49.960 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.950+0000 7f7182784700 1 -- 172.21.15.92:0/945271389 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f717c0cb4a0 msgr2=0x7f717c0cb930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:49.960 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.950+0000 7f7182784700 1 --2- 172.21.15.92:0/945271389 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f717c0cb4a0 0x7f717c0cb930 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f717c0b3520 tx=0x7f716c009b20 comp rx=0 tx=0).stop 2023-08-26T09:25:49.960 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.950+0000 7f7182784700 1 -- 172.21.15.92:0/945271389 shutdown_connections 2023-08-26T09:25:49.961 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.950+0000 7f7182784700 1 --2- 172.21.15.92:0/945271389 >> v2:172.21.15.188:3300/0 conn(0x7f717c0b2d70 0x7f717c15edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:49.961 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.950+0000 7f7182784700 1 --2- 172.21.15.92:0/945271389 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f717c0cb4a0 0x7f717c0cb930 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:49.961 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.950+0000 7f7182784700 1 -- 172.21.15.92:0/945271389 >> 172.21.15.92:0/945271389 conn(0x7f717c0cd8d0 msgr2=0x7f717c0cdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:49.961 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.950+0000 7f7182784700 1 -- 172.21.15.92:0/945271389 shutdown_connections 2023-08-26T09:25:49.961 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.950+0000 7f7182784700 1 -- 172.21.15.92:0/945271389 wait complete. 2023-08-26T09:25:49.964 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.951+0000 7f7182784700 1 Processor -- start 2023-08-26T09:25:49.964 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.952+0000 7f7182784700 1 -- start start 2023-08-26T09:25:49.964 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.952+0000 7f7182784700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f717c0b2d70 0x7f717c1f0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:49.965 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.952+0000 7f7182784700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f717c0cb4a0 0x7f717c0c4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:49.965 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.952+0000 7f7182784700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f717c0d0320 0x7f717c0c4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:49.965 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.952+0000 7f7182784700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f717c1f07b0 con 0x7f717c0cb4a0 2023-08-26T09:25:49.965 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.952+0000 7f7182784700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f717c0c6a50 con 0x7f717c0d0320 2023-08-26T09:25:49.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.952+0000 7f7182784700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f717c0c6d30 con 0x7f717c0b2d70 2023-08-26T09:25:49.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.952+0000 7f717b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f717c0cb4a0 0x7f717c0c4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:49.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.952+0000 7f717b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f717c0cb4a0 0x7f717c0c4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45746/0 (socket says 172.21.15.92:45746) 2023-08-26T09:25:49.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.952+0000 7f717b7fe700 1 -- 172.21.15.92:0/2266485598 learned_addr learned my addr 172.21.15.92:0/2266485598 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:49.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.952+0000 7f717bfff700 1 --2- 172.21.15.92:0/2266485598 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f717c0b2d70 0x7f717c1f0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:49.967 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.952+0000 7f7180d21700 1 --2- 172.21.15.92:0/2266485598 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f717c0d0320 0x7f717c0c4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:49.967 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.953+0000 7f717b7fe700 1 -- 172.21.15.92:0/2266485598 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f717c0b2d70 msgr2=0x7f717c1f0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:49.967 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.953+0000 7f717b7fe700 1 --2- 172.21.15.92:0/2266485598 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f717c0b2d70 0x7f717c1f0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:49.967 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.953+0000 7f717b7fe700 1 -- 172.21.15.92:0/2266485598 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f717c0d0320 msgr2=0x7f717c0c4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:49.967 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.953+0000 7f717b7fe700 1 --2- 172.21.15.92:0/2266485598 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f717c0d0320 0x7f717c0c4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:49.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.953+0000 7f717b7fe700 1 -- 172.21.15.92:0/2266485598 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f716c0094a0 con 0x7f717c0cb4a0 2023-08-26T09:25:49.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.953+0000 7f717bfff700 1 --2- 172.21.15.92:0/2266485598 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f717c0b2d70 0x7f717c1f0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:49.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.953+0000 7f717b7fe700 1 --2- 172.21.15.92:0/2266485598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f717c0cb4a0 0x7f717c0c4870 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f716c0090b0 tx=0x7f716c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:49.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.953+0000 7f7178ff9700 1 -- 172.21.15.92:0/2266485598 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716c0038a0 con 0x7f717c0cb4a0 2023-08-26T09:25:49.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.953+0000 7f7178ff9700 1 -- 172.21.15.92:0/2266485598 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f716c01f070 con 0x7f717c0cb4a0 2023-08-26T09:25:49.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.953+0000 7f7182784700 1 -- 172.21.15.92:0/2266485598 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f717c0c7010 con 0x7f717c0cb4a0 2023-08-26T09:25:49.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.953+0000 7f7178ff9700 1 -- 172.21.15.92:0/2266485598 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716c003c20 con 0x7f717c0cb4a0 2023-08-26T09:25:49.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.953+0000 7f7182784700 1 -- 172.21.15.92:0/2266485598 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f717c0c75d0 con 0x7f717c0cb4a0 2023-08-26T09:25:49.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.954+0000 7f7182784700 1 -- 172.21.15.92:0/2266485598 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f717c0c7760 con 0x7f717c0cb4a0 2023-08-26T09:25:49.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.954+0000 7f7178ff9700 1 -- 172.21.15.92:0/2266485598 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f716c01a430 con 0x7f717c0cb4a0 2023-08-26T09:25:49.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.955+0000 7f7178ff9700 1 --2- 172.21.15.92:0/2266485598 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f716806a0e0 0x7f716806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:49.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.955+0000 7f7178ff9700 1 -- 172.21.15.92:0/2266485598 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f716c021070 con 0x7f717c0cb4a0 2023-08-26T09:25:49.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.955+0000 7f717bfff700 1 --2- 172.21.15.92:0/2266485598 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f716806a0e0 0x7f716806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:49.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.955+0000 7f717bfff700 1 --2- 172.21.15.92:0/2266485598 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f716806a0e0 0x7f716806c5a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f71700099f0 tx=0x7f7170008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:49.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:49.959+0000 7f7178ff9700 1 -- 172.21.15.92:0/2266485598 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f716c0556d0 con 0x7f717c0cb4a0 2023-08-26T09:25:50.156 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.151+0000 7f7182784700 1 -- 172.21.15.92:0/2266485598 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f717c04eeb0 con 0x7f717c0cb4a0 2023-08-26T09:25:50.156 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.151+0000 7f7178ff9700 1 -- 172.21.15.92:0/2266485598 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f716c015020 con 0x7f717c0cb4a0 2023-08-26T09:25:50.157 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 64 2023-08-26T09:25:50.158 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.153+0000 7f7182784700 1 -- 172.21.15.92:0/2266485598 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f716806a0e0 msgr2=0x7f716806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:50.159 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.153+0000 7f7182784700 1 --2- 172.21.15.92:0/2266485598 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f716806a0e0 0x7f716806c5a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f71700099f0 tx=0x7f7170008040 comp rx=0 tx=0).stop 2023-08-26T09:25:50.159 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.153+0000 7f7182784700 1 -- 172.21.15.92:0/2266485598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f717c0cb4a0 msgr2=0x7f717c0c4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:50.159 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.153+0000 7f7182784700 1 --2- 172.21.15.92:0/2266485598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f717c0cb4a0 0x7f717c0c4870 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f716c0090b0 tx=0x7f716c004750 comp rx=0 tx=0).stop 2023-08-26T09:25:50.160 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.153+0000 7f7182784700 1 -- 172.21.15.92:0/2266485598 shutdown_connections 2023-08-26T09:25:50.160 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.153+0000 7f7182784700 1 --2- 172.21.15.92:0/2266485598 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f716806a0e0 0x7f716806c5a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:50.160 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.154+0000 7f7182784700 1 --2- 172.21.15.92:0/2266485598 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f717c0d0320 0x7f717c0c4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:50.160 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.154+0000 7f7182784700 1 --2- 172.21.15.92:0/2266485598 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f717c0b2d70 0x7f717c1f0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:50.161 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.154+0000 7f7182784700 1 --2- 172.21.15.92:0/2266485598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f717c0cb4a0 0x7f717c0c4870 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:50.161 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.154+0000 7f7182784700 1 -- 172.21.15.92:0/2266485598 >> 172.21.15.92:0/2266485598 conn(0x7f717c0cd8d0 msgr2=0x7f717c15d400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:50.161 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.154+0000 7f7182784700 1 -- 172.21.15.92:0/2266485598 shutdown_connections 2023-08-26T09:25:50.161 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.154+0000 7f7182784700 1 -- 172.21.15.92:0/2266485598 wait complete. 2023-08-26T09:25:50.171 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-26T09:25:50.292 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.288+0000 7fb8ae002700 1 Processor -- start 2023-08-26T09:25:50.293 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.288+0000 7fb8ae002700 1 -- start start 2023-08-26T09:25:50.294 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.288+0000 7fb8ae002700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb8a80cf690 0x7fb8a80caad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:50.294 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.288+0000 7fb8ae002700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fb8a80cbc30 0x7fb8a80cdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:50.295 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.288+0000 7fb8ae002700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8a806f0d0 con 0x7fb8a80cb850 2023-08-26T09:25:50.295 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.288+0000 7fb8ae002700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8a80cdba0 con 0x7fb8a80cbc30 2023-08-26T09:25:50.295 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.288+0000 7fb8ae002700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a806f3b0 con 0x7fb8a80cf690 2023-08-26T09:25:50.295 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.289+0000 7fb8a7fff700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fb8a80cbc30 0x7fb8a80cdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:50.295 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.289+0000 7fb8a6ffd700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb8a80cf690 0x7fb8a80caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:50.296 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.289+0000 7fb8a77fe700 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7fb8a80cb850 0x7fb8a80ca3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.92:52878/0 (socket says 172.21.15.92:52878) 2023-08-26T09:25:50.296 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.289+0000 7fb8a7fff700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fb8a80cbc30 0x7fb8a80cdfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.92:34566/0 (socket says 172.21.15.92:34566) 2023-08-26T09:25:50.296 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.289+0000 7fb8a6ffd700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb8a80cf690 0x7fb8a80caad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.92:44420/0 (socket says 172.21.15.92:44420) 2023-08-26T09:25:50.296 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.289+0000 7fb8a7fff700 1 -- 172.21.15.92:0/2064321985 learned_addr learned my addr 172.21.15.92:0/2064321985 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:50.296 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.289+0000 7fb8a7fff700 1 -- 172.21.15.92:0/2064321985 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb8a80cf690 msgr2=0x7fb8a80caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:50.297 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.289+0000 7fb8a7fff700 1 --2- 172.21.15.92:0/2064321985 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb8a80cf690 0x7fb8a80caad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:50.297 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.289+0000 7fb8a7fff700 1 -- 172.21.15.92:0/2064321985 >> v1:172.21.15.188:6789/0 conn(0x7fb8a80cb850 legacy=0x7fb8a80ca3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:50.297 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.289+0000 7fb8a7fff700 1 -- 172.21.15.92:0/2064321985 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a806f690 con 0x7fb8a80cbc30 2023-08-26T09:25:50.297 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.289+0000 7fb8a7fff700 1 --2- 172.21.15.92:0/2064321985 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb8a80cbc30 0x7fb8a80cdfc0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0009e50 tx=0x7fb8a000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfa39dc6bf0b945a server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:50.297 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.289+0000 7fb8a67fc700 1 -- 172.21.15.92:0/2064321985 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a000e070 con 0x7fb8a80cbc30 2023-08-26T09:25:50.298 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.290+0000 7fb8a67fc700 1 -- 172.21.15.92:0/2064321985 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a000b910 con 0x7fb8a80cbc30 2023-08-26T09:25:50.298 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.290+0000 7fb8a67fc700 1 -- 172.21.15.92:0/2064321985 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a000bcc0 con 0x7fb8a80cbc30 2023-08-26T09:25:50.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.290+0000 7fb8ae002700 1 -- 172.21.15.92:0/2064321985 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb8a80cbc30 msgr2=0x7fb8a80cdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:50.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.290+0000 7fb8ae002700 1 --2- 172.21.15.92:0/2064321985 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb8a80cbc30 0x7fb8a80cdfc0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0009e50 tx=0x7fb8a000b330 comp rx=0 tx=0).stop 2023-08-26T09:25:50.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.290+0000 7fb8ae002700 1 -- 172.21.15.92:0/2064321985 shutdown_connections 2023-08-26T09:25:50.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.290+0000 7fb8ae002700 1 --2- 172.21.15.92:0/2064321985 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb8a80cbc30 0x7fb8a80cdfc0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:50.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.290+0000 7fb8ae002700 1 --2- 172.21.15.92:0/2064321985 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb8a80cf690 0x7fb8a80caad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:50.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.290+0000 7fb8ae002700 1 -- 172.21.15.92:0/2064321985 >> 172.21.15.92:0/2064321985 conn(0x7fb8a80cc7f0 msgr2=0x7fb8a80ccc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:50.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.290+0000 7fb8ae002700 1 -- 172.21.15.92:0/2064321985 shutdown_connections 2023-08-26T09:25:50.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.290+0000 7fb8ae002700 1 -- 172.21.15.92:0/2064321985 wait complete. 2023-08-26T09:25:50.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.291+0000 7fb8ae002700 1 Processor -- start 2023-08-26T09:25:50.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.292+0000 7fb8ae002700 1 -- start start 2023-08-26T09:25:50.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.292+0000 7fb8ae002700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb8a80cb850 0x7fb8a80c6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:50.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.292+0000 7fb8ae002700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb8a80cbc30 0x7fb8a8156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:50.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.292+0000 7fb8ae002700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8a80cf690 0x7fb8a815b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:50.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.292+0000 7fb8ae002700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a80c6c70 con 0x7fb8a80cf690 2023-08-26T09:25:50.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.292+0000 7fb8ae002700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a81f2c60 con 0x7fb8a80cb850 2023-08-26T09:25:50.304 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.292+0000 7fb8ae002700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a8157430 con 0x7fb8a80cbc30 2023-08-26T09:25:50.304 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.292+0000 7fb8a7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8a80cf690 0x7fb8a815b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:50.304 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.292+0000 7fb8a7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8a80cf690 0x7fb8a815b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45764/0 (socket says 172.21.15.92:45764) 2023-08-26T09:25:50.304 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.292+0000 7fb8a7fff700 1 -- 172.21.15.92:0/2268996051 learned_addr learned my addr 172.21.15.92:0/2268996051 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:50.304 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.293+0000 7fb8a77fe700 1 --2- 172.21.15.92:0/2268996051 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb8a80cb850 0x7fb8a80c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:50.305 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.293+0000 7fb8a6ffd700 1 --2- 172.21.15.92:0/2268996051 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb8a80cbc30 0x7fb8a8156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:50.305 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.293+0000 7fb8a7fff700 1 -- 172.21.15.92:0/2268996051 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb8a80cbc30 msgr2=0x7fb8a8156a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:50.305 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.293+0000 7fb8a7fff700 1 --2- 172.21.15.92:0/2268996051 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb8a80cbc30 0x7fb8a8156a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:50.305 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.293+0000 7fb8a7fff700 1 -- 172.21.15.92:0/2268996051 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb8a80cb850 msgr2=0x7fb8a80c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:50.305 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.293+0000 7fb8a7fff700 1 --2- 172.21.15.92:0/2268996051 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb8a80cb850 0x7fb8a80c6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:50.305 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.293+0000 7fb8a7fff700 1 -- 172.21.15.92:0/2268996051 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a0009b30 con 0x7fb8a80cf690 2023-08-26T09:25:50.306 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.293+0000 7fb8a7fff700 1 --2- 172.21.15.92:0/2268996051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8a80cf690 0x7fb8a815b840 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8067970 tx=0x7fb8a0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:50.306 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.293+0000 7fb88ffff700 1 -- 172.21.15.92:0/2268996051 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a0014dc0 con 0x7fb8a80cf690 2023-08-26T09:25:50.306 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.293+0000 7fb88ffff700 1 -- 172.21.15.92:0/2268996051 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a00099b0 con 0x7fb8a80cf690 2023-08-26T09:25:50.306 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.293+0000 7fb8ae002700 1 -- 172.21.15.92:0/2268996051 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8a80cc3e0 con 0x7fb8a80cf690 2023-08-26T09:25:50.306 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.293+0000 7fb88ffff700 1 -- 172.21.15.92:0/2268996051 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a0004280 con 0x7fb8a80cf690 2023-08-26T09:25:50.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.293+0000 7fb8ae002700 1 -- 172.21.15.92:0/2268996051 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8a81f3190 con 0x7fb8a80cf690 2023-08-26T09:25:50.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.294+0000 7fb8ae002700 1 -- 172.21.15.92:0/2268996051 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8a804e660 con 0x7fb8a80cf690 2023-08-26T09:25:50.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.294+0000 7fb88ffff700 1 -- 172.21.15.92:0/2268996051 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb8a00043e0 con 0x7fb8a80cf690 2023-08-26T09:25:50.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.295+0000 7fb88ffff700 1 --2- 172.21.15.92:0/2268996051 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb89406a0e0 0x7fb89406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:50.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.295+0000 7fb88ffff700 1 -- 172.21.15.92:0/2268996051 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb8a008be50 con 0x7fb8a80cf690 2023-08-26T09:25:50.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.295+0000 7fb8a77fe700 1 --2- 172.21.15.92:0/2268996051 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb89406a0e0 0x7fb89406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:50.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.295+0000 7fb8a77fe700 1 --2- 172.21.15.92:0/2268996051 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb89406a0e0 0x7fb89406c5a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb898000f60 tx=0x7fb898007ed0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:50.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.299+0000 7fb88ffff700 1 -- 172.21.15.92:0/2268996051 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb8a0057550 con 0x7fb8a80cf690 2023-08-26T09:25:50.510 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.505+0000 7fb8ae002700 1 -- 172.21.15.92:0/2268996051 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb8a8071f40 con 0x7fb8a80cf690 2023-08-26T09:25:50.510 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.505+0000 7fb88ffff700 1 -- 172.21.15.92:0/2268996051 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb8a005ab70 con 0x7fb8a80cf690 2023-08-26T09:25:50.512 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.507+0000 7fb8ae002700 1 -- 172.21.15.92:0/2268996051 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb89406a0e0 msgr2=0x7fb89406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:50.512 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.507+0000 7fb8ae002700 1 --2- 172.21.15.92:0/2268996051 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb89406a0e0 0x7fb89406c5a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb898000f60 tx=0x7fb898007ed0 comp rx=0 tx=0).stop 2023-08-26T09:25:50.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.507+0000 7fb8ae002700 1 -- 172.21.15.92:0/2268996051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8a80cf690 msgr2=0x7fb8a815b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:50.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.507+0000 7fb8ae002700 1 --2- 172.21.15.92:0/2268996051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8a80cf690 0x7fb8a815b840 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8067970 tx=0x7fb8a0004ad0 comp rx=0 tx=0).stop 2023-08-26T09:25:50.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.507+0000 7fb8ae002700 1 -- 172.21.15.92:0/2268996051 shutdown_connections 2023-08-26T09:25:50.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.507+0000 7fb8ae002700 1 --2- 172.21.15.92:0/2268996051 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb89406a0e0 0x7fb89406c5a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:50.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.507+0000 7fb8ae002700 1 --2- 172.21.15.92:0/2268996051 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb8a80cb850 0x7fb8a80c6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:50.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.507+0000 7fb8ae002700 1 --2- 172.21.15.92:0/2268996051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8a80cf690 0x7fb8a815b840 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:50.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.507+0000 7fb8ae002700 1 --2- 172.21.15.92:0/2268996051 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb8a80cbc30 0x7fb8a8156a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:50.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.507+0000 7fb8ae002700 1 -- 172.21.15.92:0/2268996051 >> 172.21.15.92:0/2268996051 conn(0x7fb8a80cc7f0 msgr2=0x7fb8a80ccbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:50.515 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.507+0000 7fb8ae002700 1 -- 172.21.15.92:0/2268996051 shutdown_connections 2023-08-26T09:25:50.515 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.507+0000 7fb8ae002700 1 -- 172.21.15.92:0/2268996051 wait complete. 2023-08-26T09:25:50.515 INFO:teuthology.orchestra.run.smithi092.stderr:listed 0 entries 2023-08-26T09:25:50.524 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-08-26T09:25:50.525 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-26T09:25:50.543 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-26T09:25:50.703 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.698+0000 7fd091c4b700 1 Processor -- start 2023-08-26T09:25:50.703 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.698+0000 7fd091c4b700 1 -- start start 2023-08-26T09:25:50.706 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.699+0000 7fd091c4b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fd08c0ca620 0x7fd08c0caa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:50.706 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.699+0000 7fd091c4b700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd08c15d6c0 0x7fd08c0cea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:50.706 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.699+0000 7fd091c4b700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd08c0cf4d0 con 0x7fd08c0cef70 2023-08-26T09:25:50.707 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.699+0000 7fd091c4b700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd08c0cb4a0 con 0x7fd08c0ca620 2023-08-26T09:25:50.707 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.699+0000 7fd091c4b700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd08c0caf40 con 0x7fd08c15d6c0 2023-08-26T09:25:50.707 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.699+0000 7fd08b7fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fd08c0ca620 0x7fd08c0caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:50.707 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.699+0000 7fd08bfff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fd08c0cef70 0x7fd08c06a320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:57784/0 (socket says 172.21.15.92:57784) 2023-08-26T09:25:50.707 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.699+0000 7fd08bfff700 1 -- 172.21.15.92:0/4189679427 learned_addr learned my addr 172.21.15.92:0/4189679427 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:50.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.700+0000 7fd08affd700 1 --2- 172.21.15.92:0/4189679427 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd08c15d6c0 0x7fd08c0cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:50.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.700+0000 7fd08a7fc700 1 -- 172.21.15.92:0/4189679427 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3256873201 0 0) 0x7fd08c0cf4d0 con 0x7fd08c0cef70 2023-08-26T09:25:50.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.700+0000 7fd08a7fc700 1 -- 172.21.15.92:0/4189679427 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0740035b0 con 0x7fd08c0cef70 2023-08-26T09:25:50.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.700+0000 7fd08b7fe700 1 -- 172.21.15.92:0/4189679427 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd08c15d6c0 msgr2=0x7fd08c0cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:50.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.700+0000 7fd08b7fe700 1 --2- 172.21.15.92:0/4189679427 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd08c15d6c0 0x7fd08c0cea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:50.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.700+0000 7fd08b7fe700 1 -- 172.21.15.92:0/4189679427 >> v1:172.21.15.92:6789/0 conn(0x7fd08c0cef70 legacy=0x7fd08c06a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:50.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.700+0000 7fd08b7fe700 1 -- 172.21.15.92:0/4189679427 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd08c0ce3b0 con 0x7fd08c0ca620 2023-08-26T09:25:50.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.700+0000 7fd08affd700 1 --2- 172.21.15.92:0/4189679427 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd08c15d6c0 0x7fd08c0cea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:50.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.700+0000 7fd08b7fe700 1 --2- 172.21.15.92:0/4189679427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd08c0ca620 0x7fd08c0caa00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd080009840 tx=0x7fd080009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=854329efe3e201f7 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:50.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.700+0000 7fd08a7fc700 1 -- 172.21.15.92:0/4189679427 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd080011830 con 0x7fd08c0ca620 2023-08-26T09:25:50.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.700+0000 7fd08a7fc700 1 -- 172.21.15.92:0/4189679427 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd080011990 con 0x7fd08c0ca620 2023-08-26T09:25:50.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.700+0000 7fd08a7fc700 1 -- 172.21.15.92:0/4189679427 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd080011d20 con 0x7fd08c0ca620 2023-08-26T09:25:50.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.700+0000 7fd091c4b700 1 -- 172.21.15.92:0/4189679427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd08c0ca620 msgr2=0x7fd08c0caa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:50.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.701+0000 7fd091c4b700 1 --2- 172.21.15.92:0/4189679427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd08c0ca620 0x7fd08c0caa00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd080009840 tx=0x7fd080009b50 comp rx=0 tx=0).stop 2023-08-26T09:25:50.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.701+0000 7fd091c4b700 1 -- 172.21.15.92:0/4189679427 shutdown_connections 2023-08-26T09:25:50.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.701+0000 7fd091c4b700 1 --2- 172.21.15.92:0/4189679427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd08c0ca620 0x7fd08c0caa00 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:50.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.701+0000 7fd091c4b700 1 --2- 172.21.15.92:0/4189679427 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd08c15d6c0 0x7fd08c0cea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:50.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.701+0000 7fd091c4b700 1 -- 172.21.15.92:0/4189679427 >> 172.21.15.92:0/4189679427 conn(0x7fd08c0cc7b0 msgr2=0x7fd08c0ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:50.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.701+0000 7fd091c4b700 1 -- 172.21.15.92:0/4189679427 shutdown_connections 2023-08-26T09:25:50.712 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.701+0000 7fd091c4b700 1 -- 172.21.15.92:0/4189679427 wait complete. 2023-08-26T09:25:50.714 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.702+0000 7fd091c4b700 1 Processor -- start 2023-08-26T09:25:50.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.702+0000 7fd091c4b700 1 -- start start 2023-08-26T09:25:50.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.703+0000 7fd091c4b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd08c0ca620 0x7fd08c151270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:50.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.703+0000 7fd091c4b700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd08c0cef70 0x7fd08c1560c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:50.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.703+0000 7fd091c4b700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd08c15d6c0 0x7fd08c0c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:50.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.703+0000 7fd091c4b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd08c156600 con 0x7fd08c0ca620 2023-08-26T09:25:50.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.703+0000 7fd091c4b700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd08c0c9ba0 con 0x7fd08c15d6c0 2023-08-26T09:25:50.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.703+0000 7fd091c4b700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd08c155300 con 0x7fd08c0cef70 2023-08-26T09:25:50.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.703+0000 7fd08b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd08c0ca620 0x7fd08c151270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:50.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.703+0000 7fd08b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd08c0ca620 0x7fd08c151270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45774/0 (socket says 172.21.15.92:45774) 2023-08-26T09:25:50.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.703+0000 7fd08b7fe700 1 -- 172.21.15.92:0/2764658892 learned_addr learned my addr 172.21.15.92:0/2764658892 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:50.717 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.703+0000 7fd08affd700 1 --2- 172.21.15.92:0/2764658892 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd08c0cef70 0x7fd08c1560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:50.717 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.703+0000 7fd08bfff700 1 --2- 172.21.15.92:0/2764658892 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd08c15d6c0 0x7fd08c0c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:50.717 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.703+0000 7fd08b7fe700 1 -- 172.21.15.92:0/2764658892 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd08c0cef70 msgr2=0x7fd08c1560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:50.717 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.703+0000 7fd08b7fe700 1 --2- 172.21.15.92:0/2764658892 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd08c0cef70 0x7fd08c1560c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:50.717 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.703+0000 7fd08b7fe700 1 -- 172.21.15.92:0/2764658892 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd08c15d6c0 msgr2=0x7fd08c0c91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:50.718 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.703+0000 7fd08b7fe700 1 --2- 172.21.15.92:0/2764658892 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd08c15d6c0 0x7fd08c0c91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:50.718 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.703+0000 7fd08b7fe700 1 -- 172.21.15.92:0/2764658892 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0800094a0 con 0x7fd08c0ca620 2023-08-26T09:25:50.718 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.703+0000 7fd08affd700 1 --2- 172.21.15.92:0/2764658892 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd08c0cef70 0x7fd08c1560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:50.718 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.703+0000 7fd08b7fe700 1 --2- 172.21.15.92:0/2764658892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd08c0ca620 0x7fd08c151270 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd080009fd0 tx=0x7fd080004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:50.718 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.703+0000 7fd073fff700 1 -- 172.21.15.92:0/2764658892 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0800038a0 con 0x7fd08c0ca620 2023-08-26T09:25:50.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.703+0000 7fd073fff700 1 -- 172.21.15.92:0/2764658892 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd08001e070 con 0x7fd08c0ca620 2023-08-26T09:25:50.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.703+0000 7fd091c4b700 1 -- 172.21.15.92:0/2764658892 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd08c1555e0 con 0x7fd08c0ca620 2023-08-26T09:25:50.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.703+0000 7fd073fff700 1 -- 172.21.15.92:0/2764658892 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd080003c40 con 0x7fd08c0ca620 2023-08-26T09:25:50.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.703+0000 7fd091c4b700 1 -- 172.21.15.92:0/2764658892 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd08c155ba0 con 0x7fd08c0ca620 2023-08-26T09:25:50.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.704+0000 7fd091c4b700 1 -- 172.21.15.92:0/2764658892 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd08c04e660 con 0x7fd08c0ca620 2023-08-26T09:25:50.720 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.705+0000 7fd073fff700 1 -- 172.21.15.92:0/2764658892 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd08002d450 con 0x7fd08c0ca620 2023-08-26T09:25:50.720 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.705+0000 7fd073fff700 1 --2- 172.21.15.92:0/2764658892 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fd07806a0e0 0x7fd07806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:50.720 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.705+0000 7fd073fff700 1 -- 172.21.15.92:0/2764658892 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd0800895b0 con 0x7fd08c0ca620 2023-08-26T09:25:50.720 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.705+0000 7fd08affd700 1 --2- 172.21.15.92:0/2764658892 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fd07806a0e0 0x7fd07806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:50.720 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.706+0000 7fd08affd700 1 --2- 172.21.15.92:0/2764658892 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fd07806a0e0 0x7fd07806c5a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd08c1e72e0 tx=0x7fd07c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:50.721 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.710+0000 7fd073fff700 1 -- 172.21.15.92:0/2764658892 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd080054d30 con 0x7fd08c0ca620 2023-08-26T09:25:50.906 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.900+0000 7fd091c4b700 1 -- 172.21.15.92:0/2764658892 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd08c1e7310 con 0x7fd08c0ca620 2023-08-26T09:25:50.906 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.902+0000 7fd073fff700 1 -- 172.21.15.92:0/2764658892 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+18209 (secure 0 0 0) 0x7fd080058350 con 0x7fd08c0ca620 2023-08-26T09:25:50.907 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:25:50.907 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":20,"fsid":"254a2d31-bd41-4507-8326-1b205ac24377","created":"2023-08-26T09:24:55.352131+0000","modified":"2023-08-26T09:25:15.447635+0000","last_up_change":"2023-08-26T09:25:06.124496+0000","last_in_change":"2023-08-26T09:24:57.840725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-26T09:25:06.650431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-26T09:25:06.973382+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-26T09:25:11.584141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-26T09:25:12.814990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e9e7638-4459-4d8d-8e40-130bcf48df66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6819","nonce":382827192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6824","nonce":382827192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6831","nonce":382827192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6827","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6829","nonce":382827192}]},"public_addr":"172.21.15.92:6819/382827192","cluster_addr":"172.21.15.92:6824/382827192","heartbeat_back_addr":"172.21.15.92:6831/382827192","heartbeat_front_addr":"172.21.15.92:6829/382827192","state":["exists","up"]},{"osd":1,"uuid":"164e68c9-aedd-4df5-9b70-f4b1ec3bda13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6809","nonce":618773438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6811","nonce":618773438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6815","nonce":618773438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6813","nonce":618773438}]},"public_addr":"172.21.15.92:6809/618773438","cluster_addr":"172.21.15.92:6811/618773438","heartbeat_back_addr":"172.21.15.92:6815/618773438","heartbeat_front_addr":"172.21.15.92:6813/618773438","state":["exists","up"]},{"osd":2,"uuid":"8701dfee-629a-4d30-82e4-b8fac340303f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6818","nonce":3697397687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6821","nonce":3697397687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6828","nonce":3697397687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6823","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6825","nonce":3697397687}]},"public_addr":"172.21.15.92:6818/3697397687","cluster_addr":"172.21.15.92:6821/3697397687","heartbeat_back_addr":"172.21.15.92:6828/3697397687","heartbeat_front_addr":"172.21.15.92:6825/3697397687","state":["exists","up"]},{"osd":3,"uuid":"93bdc94d-dc07-495f-995a-a6ad072f0247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6801","nonce":3579846453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6803","nonce":3579846453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6807","nonce":3579846453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6805","nonce":3579846453}]},"public_addr":"172.21.15.92:6801/3579846453","cluster_addr":"172.21.15.92:6803/3579846453","heartbeat_back_addr":"172.21.15.92:6807/3579846453","heartbeat_front_addr":"172.21.15.92:6805/3579846453","state":["exists","up"]},{"osd":4,"uuid":"d9d0ea80-8481-46a7-9677-c338d32cf1d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6809","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6811","nonce":3228383424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6813","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6815","nonce":3228383424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6821","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6823","nonce":3228383424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6817","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6819","nonce":3228383424}]},"public_addr":"172.21.15.188:6811/3228383424","cluster_addr":"172.21.15.188:6815/3228383424","heartbeat_back_addr":"172.21.15.188:6823/3228383424","heartbeat_front_addr":"172.21.15.188:6819/3228383424","state":["exists","up"]},{"osd":5,"uuid":"38d03253-467a-456f-bd5e-5a46532a0b18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6801","nonce":1655821054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6803","nonce":1655821054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6807","nonce":1655821054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6805","nonce":1655821054}]},"public_addr":"172.21.15.188:6801/1655821054","cluster_addr":"172.21.15.188:6803/1655821054","heartbeat_back_addr":"172.21.15.188:6807/1655821054","heartbeat_front_addr":"172.21.15.188:6805/1655821054","state":["exists","up"]},{"osd":6,"uuid":"d61564b5-136f-42e5-a843-626c2017cc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6810","nonce":2069976891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6814","nonce":2069976891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6822","nonce":2069976891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6818","nonce":2069976891}]},"public_addr":"172.21.15.188:6810/2069976891","cluster_addr":"172.21.15.188:6814/2069976891","heartbeat_back_addr":"172.21.15.188:6822/2069976891","heartbeat_front_addr":"172.21.15.188:6818/2069976891","state":["exists","up"]},{"osd":7,"uuid":"fae2949e-0d62-42cd-ba72-08f516084b20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6825","nonce":1882888860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6827","nonce":1882888860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6831","nonce":1882888860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6829","nonce":1882888860}]},"public_addr":"172.21.15.188:6825/1882888860","cluster_addr":"172.21.15.188:6827/1882888860","heartbeat_back_addr":"172.21.15.188:6831/1882888860","heartbeat_front_addr":"172.21.15.188:6829/1882888860","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.038523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.063160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.000857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.975572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.023848+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.765194+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.081365+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:05.110745+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-26T09:25:50.909 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.904+0000 7fd091c4b700 1 -- 172.21.15.92:0/2764658892 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fd07806a0e0 msgr2=0x7fd07806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:50.910 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.904+0000 7fd091c4b700 1 --2- 172.21.15.92:0/2764658892 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fd07806a0e0 0x7fd07806c5a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd08c1e72e0 tx=0x7fd07c008040 comp rx=0 tx=0).stop 2023-08-26T09:25:50.910 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.904+0000 7fd091c4b700 1 -- 172.21.15.92:0/2764658892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd08c0ca620 msgr2=0x7fd08c151270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:50.910 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.904+0000 7fd091c4b700 1 --2- 172.21.15.92:0/2764658892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd08c0ca620 0x7fd08c151270 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd080009fd0 tx=0x7fd080004750 comp rx=0 tx=0).stop 2023-08-26T09:25:50.910 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.904+0000 7fd091c4b700 1 -- 172.21.15.92:0/2764658892 shutdown_connections 2023-08-26T09:25:50.910 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.904+0000 7fd091c4b700 1 --2- 172.21.15.92:0/2764658892 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fd07806a0e0 0x7fd07806c5a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:50.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.904+0000 7fd091c4b700 1 --2- 172.21.15.92:0/2764658892 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd08c15d6c0 0x7fd08c0c91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:50.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.904+0000 7fd091c4b700 1 --2- 172.21.15.92:0/2764658892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd08c0ca620 0x7fd08c151270 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:50.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.904+0000 7fd091c4b700 1 --2- 172.21.15.92:0/2764658892 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd08c0cef70 0x7fd08c1560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:50.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.904+0000 7fd091c4b700 1 -- 172.21.15.92:0/2764658892 >> 172.21.15.92:0/2764658892 conn(0x7fd08c0cc7b0 msgr2=0x7fd08c159840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:50.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.904+0000 7fd091c4b700 1 -- 172.21.15.92:0/2764658892 shutdown_connections 2023-08-26T09:25:50.912 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:50.904+0000 7fd091c4b700 1 -- 172.21.15.92:0/2764658892 wait complete. 2023-08-26T09:25:50.921 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-26T09:25:06.650431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-26T09:25:06.973382+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-26T09:25:11.584141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-26T09:25:12.814990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-26T09:25:50.922 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-26T09:25:51.046 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.041+0000 7fd158bca700 1 Processor -- start 2023-08-26T09:25:51.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.041+0000 7fd158bca700 1 -- start start 2023-08-26T09:25:51.049 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.042+0000 7fd158bca700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd15415d220 0x7fd1540af390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:51.049 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.042+0000 7fd158bca700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fd15406db70 0x7fd154070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:51.050 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.042+0000 7fd158bca700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1540aee50 con 0x7fd154071260 2023-08-26T09:25:51.050 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.042+0000 7fd158bca700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1540af130 con 0x7fd15406db70 2023-08-26T09:25:51.050 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.042+0000 7fd158bca700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1540c4cb0 con 0x7fd15415d220 2023-08-26T09:25:51.050 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.042+0000 7fd151d9b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fd15406db70 0x7fd154070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:51.050 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.042+0000 7fd152d9d700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fd154071260 0x7fd154160d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:57798/0 (socket says 172.21.15.92:57798) 2023-08-26T09:25:51.051 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.042+0000 7fd151d9b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fd15406db70 0x7fd154070d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45786/0 (socket says 172.21.15.92:45786) 2023-08-26T09:25:51.051 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.042+0000 7fd152d9d700 1 -- 172.21.15.92:0/3961240300 learned_addr learned my addr 172.21.15.92:0/3961240300 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:51.051 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.043+0000 7fd15259c700 1 --2- 172.21.15.92:0/3961240300 >> v2:172.21.15.188:3300/0 conn(0x7fd15415d220 0x7fd1540af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:51.051 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.043+0000 7fd151d9b700 1 -- 172.21.15.92:0/3961240300 >> v2:172.21.15.188:3300/0 conn(0x7fd15415d220 msgr2=0x7fd1540af390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:51.051 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.043+0000 7fd151d9b700 1 --2- 172.21.15.92:0/3961240300 >> v2:172.21.15.188:3300/0 conn(0x7fd15415d220 0x7fd1540af390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:51.051 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.043+0000 7fd151d9b700 1 -- 172.21.15.92:0/3961240300 >> v1:172.21.15.92:6789/0 conn(0x7fd154071260 legacy=0x7fd154160d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:51.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.043+0000 7fd15159a700 1 -- 172.21.15.92:0/3961240300 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 821142402 0 0) 0x7fd1540aee50 con 0x7fd154071260 2023-08-26T09:25:51.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.043+0000 7fd151d9b700 1 -- 172.21.15.92:0/3961240300 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1540c4f90 con 0x7fd15406db70 2023-08-26T09:25:51.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.043+0000 7fd15259c700 1 --2- 172.21.15.92:0/3961240300 >> v2:172.21.15.188:3300/0 conn(0x7fd15415d220 0x7fd1540af390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:25:51.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.043+0000 7fd151d9b700 1 --2- 172.21.15.92:0/3961240300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd15406db70 0x7fd154070d20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd154072c00 tx=0x7fd144009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16072f870b662a45 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:51.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.043+0000 7fd15159a700 1 -- 172.21.15.92:0/3961240300 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd144011830 con 0x7fd15406db70 2023-08-26T09:25:51.053 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.043+0000 7fd15159a700 1 -- 172.21.15.92:0/3961240300 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd144011990 con 0x7fd15406db70 2023-08-26T09:25:51.053 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.043+0000 7fd15159a700 1 -- 172.21.15.92:0/3961240300 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd144011d20 con 0x7fd15406db70 2023-08-26T09:25:51.053 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.044+0000 7fd158bca700 1 -- 172.21.15.92:0/3961240300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd15406db70 msgr2=0x7fd154070d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:51.053 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.044+0000 7fd158bca700 1 --2- 172.21.15.92:0/3961240300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd15406db70 0x7fd154070d20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd154072c00 tx=0x7fd144009b20 comp rx=0 tx=0).stop 2023-08-26T09:25:51.053 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.044+0000 7fd158bca700 1 -- 172.21.15.92:0/3961240300 shutdown_connections 2023-08-26T09:25:51.054 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.044+0000 7fd158bca700 1 --2- 172.21.15.92:0/3961240300 >> v2:172.21.15.188:3300/0 conn(0x7fd15415d220 0x7fd1540af390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:51.054 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.044+0000 7fd158bca700 1 --2- 172.21.15.92:0/3961240300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd15406db70 0x7fd154070d20 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:51.054 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.044+0000 7fd158bca700 1 -- 172.21.15.92:0/3961240300 >> 172.21.15.92:0/3961240300 conn(0x7fd15406b430 msgr2=0x7fd15406b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:51.054 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.044+0000 7fd158bca700 1 -- 172.21.15.92:0/3961240300 shutdown_connections 2023-08-26T09:25:51.055 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.044+0000 7fd158bca700 1 -- 172.21.15.92:0/3961240300 wait complete. 2023-08-26T09:25:51.058 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.045+0000 7fd158bca700 1 Processor -- start 2023-08-26T09:25:51.058 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.045+0000 7fd158bca700 1 -- start start 2023-08-26T09:25:51.058 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.046+0000 7fd158bca700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd15406db70 0x7fd1540ae540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:51.058 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.046+0000 7fd158bca700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd154071260 0x7fd1540b1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:51.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.046+0000 7fd158bca700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd15415d220 0x7fd1540b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:51.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.046+0000 7fd158bca700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1540b5250 con 0x7fd15406db70 2023-08-26T09:25:51.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.046+0000 7fd158bca700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1540b4f70 con 0x7fd15415d220 2023-08-26T09:25:51.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.046+0000 7fd158bca700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1540b4640 con 0x7fd154071260 2023-08-26T09:25:51.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.046+0000 7fd15259c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd15406db70 0x7fd1540ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:51.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.046+0000 7fd15259c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd15406db70 0x7fd1540ae540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45788/0 (socket says 172.21.15.92:45788) 2023-08-26T09:25:51.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.046+0000 7fd15259c700 1 -- 172.21.15.92:0/1628760508 learned_addr learned my addr 172.21.15.92:0/1628760508 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:51.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.046+0000 7fd151d9b700 1 --2- 172.21.15.92:0/1628760508 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd154071260 0x7fd1540b1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:51.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.046+0000 7fd152d9d700 1 --2- 172.21.15.92:0/1628760508 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd15415d220 0x7fd1540b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:51.061 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.046+0000 7fd15259c700 1 -- 172.21.15.92:0/1628760508 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd154071260 msgr2=0x7fd1540b1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:51.061 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.046+0000 7fd15259c700 1 --2- 172.21.15.92:0/1628760508 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd154071260 0x7fd1540b1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:51.061 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.046+0000 7fd15259c700 1 -- 172.21.15.92:0/1628760508 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd15415d220 msgr2=0x7fd1540b1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:51.062 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.046+0000 7fd15259c700 1 --2- 172.21.15.92:0/1628760508 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd15415d220 0x7fd1540b1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:51.062 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.046+0000 7fd15259c700 1 -- 172.21.15.92:0/1628760508 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1440094a0 con 0x7fd15406db70 2023-08-26T09:25:51.062 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.046+0000 7fd15259c700 1 --2- 172.21.15.92:0/1628760508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd15406db70 0x7fd1540ae540 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd14800c7f0 tx=0x7fd14800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:51.063 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.046+0000 7fd142ffd700 1 -- 172.21.15.92:0/1628760508 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd148011800 con 0x7fd15406db70 2023-08-26T09:25:51.063 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.046+0000 7fd142ffd700 1 -- 172.21.15.92:0/1628760508 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd148011960 con 0x7fd15406db70 2023-08-26T09:25:51.063 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.046+0000 7fd158bca700 1 -- 172.21.15.92:0/1628760508 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1540b4920 con 0x7fd15406db70 2023-08-26T09:25:51.064 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.047+0000 7fd142ffd700 1 -- 172.21.15.92:0/1628760508 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd148011d10 con 0x7fd15406db70 2023-08-26T09:25:51.064 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.047+0000 7fd158bca700 1 -- 172.21.15.92:0/1628760508 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1540aea80 con 0x7fd15406db70 2023-08-26T09:25:51.064 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.048+0000 7fd158bca700 1 -- 172.21.15.92:0/1628760508 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd15404eeb0 con 0x7fd15406db70 2023-08-26T09:25:51.065 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.048+0000 7fd142ffd700 1 -- 172.21.15.92:0/1628760508 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd148018360 con 0x7fd15406db70 2023-08-26T09:25:51.065 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.048+0000 7fd142ffd700 1 --2- 172.21.15.92:0/1628760508 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fd13406a0e0 0x7fd13406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:51.065 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.048+0000 7fd142ffd700 1 -- 172.21.15.92:0/1628760508 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd1480885f0 con 0x7fd15406db70 2023-08-26T09:25:51.066 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.048+0000 7fd151d9b700 1 --2- 172.21.15.92:0/1628760508 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fd13406a0e0 0x7fd13406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:51.066 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.049+0000 7fd151d9b700 1 --2- 172.21.15.92:0/1628760508 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fd13406a0e0 0x7fd13406c5a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd1440090b0 tx=0x7fd144008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:51.066 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.053+0000 7fd142ffd700 1 -- 172.21.15.92:0/1628760508 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd1480576e0 con 0x7fd15406db70 2023-08-26T09:25:51.248 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.243+0000 7fd158bca700 1 -- 172.21.15.92:0/1628760508 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd15406ac20 con 0x7fd15406db70 2023-08-26T09:25:51.248 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.243+0000 7fd142ffd700 1 -- 172.21.15.92:0/1628760508 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd148057270 con 0x7fd15406db70 2023-08-26T09:25:51.248 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 8 2023-08-26T09:25:51.251 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.245+0000 7fd158bca700 1 -- 172.21.15.92:0/1628760508 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fd13406a0e0 msgr2=0x7fd13406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:51.251 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.245+0000 7fd158bca700 1 --2- 172.21.15.92:0/1628760508 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fd13406a0e0 0x7fd13406c5a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd1440090b0 tx=0x7fd144008030 comp rx=0 tx=0).stop 2023-08-26T09:25:51.251 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.245+0000 7fd158bca700 1 -- 172.21.15.92:0/1628760508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd15406db70 msgr2=0x7fd1540ae540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:51.252 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.245+0000 7fd158bca700 1 --2- 172.21.15.92:0/1628760508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd15406db70 0x7fd1540ae540 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd14800c7f0 tx=0x7fd14800cbb0 comp rx=0 tx=0).stop 2023-08-26T09:25:51.252 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.245+0000 7fd158bca700 1 -- 172.21.15.92:0/1628760508 shutdown_connections 2023-08-26T09:25:51.252 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.245+0000 7fd158bca700 1 --2- 172.21.15.92:0/1628760508 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fd13406a0e0 0x7fd13406c5a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:51.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.245+0000 7fd158bca700 1 --2- 172.21.15.92:0/1628760508 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd15415d220 0x7fd1540b1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:51.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.245+0000 7fd158bca700 1 --2- 172.21.15.92:0/1628760508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd15406db70 0x7fd1540ae540 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:51.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.245+0000 7fd158bca700 1 --2- 172.21.15.92:0/1628760508 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd154071260 0x7fd1540b1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:51.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.245+0000 7fd158bca700 1 -- 172.21.15.92:0/1628760508 >> 172.21.15.92:0/1628760508 conn(0x7fd15406b430 msgr2=0x7fd15415c130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:51.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.245+0000 7fd158bca700 1 -- 172.21.15.92:0/1628760508 shutdown_connections 2023-08-26T09:25:51.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.245+0000 7fd158bca700 1 -- 172.21.15.92:0/1628760508 wait complete. 2023-08-26T09:25:51.263 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-26T09:25:51.387 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.382+0000 7f93b4b39700 1 Processor -- start 2023-08-26T09:25:51.387 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.382+0000 7f93b4b39700 1 -- start start 2023-08-26T09:25:51.389 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.383+0000 7f93b4b39700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f93b015d220 0x7f93b00af390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:51.390 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.383+0000 7f93b4b39700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f93b006db70 0x7f93b0070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:51.390 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.383+0000 7f93b4b39700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93b00aee50 con 0x7f93b0071260 2023-08-26T09:25:51.390 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.383+0000 7f93b4b39700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93b00af130 con 0x7f93b006db70 2023-08-26T09:25:51.390 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.383+0000 7f93b4b39700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93b00c4cb0 con 0x7f93b015d220 2023-08-26T09:25:51.390 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.383+0000 7f93add9b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f93b006db70 0x7f93b0070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:51.391 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.383+0000 7f93aed9d700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f93b0071260 0x7f93b0160d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:57814/0 (socket says 172.21.15.92:57814) 2023-08-26T09:25:51.391 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.383+0000 7f93aed9d700 1 -- 172.21.15.92:0/330370667 learned_addr learned my addr 172.21.15.92:0/330370667 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:51.391 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.383+0000 7f93ae59c700 1 --2- 172.21.15.92:0/330370667 >> v2:172.21.15.188:3300/0 conn(0x7f93b015d220 0x7f93b00af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:51.391 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.383+0000 7f93add9b700 1 -- 172.21.15.92:0/330370667 >> v2:172.21.15.188:3300/0 conn(0x7f93b015d220 msgr2=0x7f93b00af390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:51.391 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.383+0000 7f93add9b700 1 --2- 172.21.15.92:0/330370667 >> v2:172.21.15.188:3300/0 conn(0x7f93b015d220 0x7f93b00af390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:51.391 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.383+0000 7f93add9b700 1 -- 172.21.15.92:0/330370667 >> v1:172.21.15.92:6789/0 conn(0x7f93b0071260 legacy=0x7f93b0160d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:51.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.383+0000 7f93ad59a700 1 -- 172.21.15.92:0/330370667 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2286036125 0 0) 0x7f93b00aee50 con 0x7f93b0071260 2023-08-26T09:25:51.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.383+0000 7f93add9b700 1 -- 172.21.15.92:0/330370667 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b00c4f90 con 0x7f93b006db70 2023-08-26T09:25:51.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.384+0000 7f93add9b700 1 --2- 172.21.15.92:0/330370667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93b006db70 0x7f93b0070d20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f93b0072c00 tx=0x7f93a4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=364b0f029a615936 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:51.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.384+0000 7f93ad59a700 1 -- 172.21.15.92:0/330370667 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a4011830 con 0x7f93b006db70 2023-08-26T09:25:51.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.384+0000 7f93ad59a700 1 -- 172.21.15.92:0/330370667 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a4011990 con 0x7f93b006db70 2023-08-26T09:25:51.393 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.384+0000 7f93ad59a700 1 -- 172.21.15.92:0/330370667 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a4011d20 con 0x7f93b006db70 2023-08-26T09:25:51.393 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.384+0000 7f93b4b39700 1 -- 172.21.15.92:0/330370667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93b006db70 msgr2=0x7f93b0070d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:51.393 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.384+0000 7f93b4b39700 1 --2- 172.21.15.92:0/330370667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93b006db70 0x7f93b0070d20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f93b0072c00 tx=0x7f93a4009b20 comp rx=0 tx=0).stop 2023-08-26T09:25:51.393 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.384+0000 7f93b4b39700 1 -- 172.21.15.92:0/330370667 shutdown_connections 2023-08-26T09:25:51.393 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.384+0000 7f93b4b39700 1 --2- 172.21.15.92:0/330370667 >> v2:172.21.15.188:3300/0 conn(0x7f93b015d220 0x7f93b00af390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:51.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.384+0000 7f93b4b39700 1 --2- 172.21.15.92:0/330370667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93b006db70 0x7f93b0070d20 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:51.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.384+0000 7f93b4b39700 1 -- 172.21.15.92:0/330370667 >> 172.21.15.92:0/330370667 conn(0x7f93b006b430 msgr2=0x7f93b006b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:51.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.384+0000 7f93b4b39700 1 -- 172.21.15.92:0/330370667 shutdown_connections 2023-08-26T09:25:51.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.384+0000 7f93b4b39700 1 -- 172.21.15.92:0/330370667 wait complete. 2023-08-26T09:25:51.397 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.386+0000 7f93b4b39700 1 Processor -- start 2023-08-26T09:25:51.397 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.386+0000 7f93b4b39700 1 -- start start 2023-08-26T09:25:51.398 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.386+0000 7f93b4b39700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93b006db70 0x7f93b01601c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:51.398 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.386+0000 7f93b4b39700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f93b0071260 0x7f93b0155250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:51.398 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.386+0000 7f93b4b39700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f93b015d220 0x7f93b0158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:51.398 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.386+0000 7f93b4b39700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b00b59f0 con 0x7f93b006db70 2023-08-26T09:25:51.398 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.386+0000 7f93b4b39700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b0160700 con 0x7f93b015d220 2023-08-26T09:25:51.399 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.386+0000 7f93b4b39700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93b0155790 con 0x7f93b0071260 2023-08-26T09:25:51.399 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.386+0000 7f93ae59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93b006db70 0x7f93b01601c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:51.399 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.386+0000 7f93ae59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93b006db70 0x7f93b01601c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45802/0 (socket says 172.21.15.92:45802) 2023-08-26T09:25:51.399 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.386+0000 7f93ae59c700 1 -- 172.21.15.92:0/3134153271 learned_addr learned my addr 172.21.15.92:0/3134153271 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:51.399 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.387+0000 7f93add9b700 1 --2- 172.21.15.92:0/3134153271 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f93b0071260 0x7f93b0155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:51.400 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.387+0000 7f93aed9d700 1 --2- 172.21.15.92:0/3134153271 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f93b015d220 0x7f93b0158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:51.400 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.387+0000 7f93ae59c700 1 -- 172.21.15.92:0/3134153271 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f93b0071260 msgr2=0x7f93b0155250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:51.400 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.387+0000 7f93ae59c700 1 --2- 172.21.15.92:0/3134153271 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f93b0071260 0x7f93b0155250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:51.400 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.387+0000 7f93ae59c700 1 -- 172.21.15.92:0/3134153271 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f93b015d220 msgr2=0x7f93b0158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:51.400 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.387+0000 7f93ae59c700 1 --2- 172.21.15.92:0/3134153271 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f93b015d220 0x7f93b0158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:51.401 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.387+0000 7f93ae59c700 1 -- 172.21.15.92:0/3134153271 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a40094a0 con 0x7f93b006db70 2023-08-26T09:25:51.401 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.387+0000 7f93aed9d700 1 --2- 172.21.15.92:0/3134153271 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f93b015d220 0x7f93b0158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:51.401 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.387+0000 7f93ae59c700 1 --2- 172.21.15.92:0/3134153271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93b006db70 0x7f93b01601c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f93a000d800 tx=0x7f93a000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:51.401 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.387+0000 7f939effd700 1 -- 172.21.15.92:0/3134153271 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a00125f0 con 0x7f93b006db70 2023-08-26T09:25:51.401 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.387+0000 7f93b4b39700 1 -- 172.21.15.92:0/3134153271 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93b00b02f0 con 0x7f93b006db70 2023-08-26T09:25:51.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.387+0000 7f939effd700 1 -- 172.21.15.92:0/3134153271 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a0012750 con 0x7f93b006db70 2023-08-26T09:25:51.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.387+0000 7f939effd700 1 -- 172.21.15.92:0/3134153271 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a0012b00 con 0x7f93b006db70 2023-08-26T09:25:51.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.387+0000 7f93b4b39700 1 -- 172.21.15.92:0/3134153271 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93b015f9c0 con 0x7f93b006db70 2023-08-26T09:25:51.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.388+0000 7f93b4b39700 1 -- 172.21.15.92:0/3134153271 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93b004eeb0 con 0x7f93b006db70 2023-08-26T09:25:51.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.388+0000 7f939effd700 1 -- 172.21.15.92:0/3134153271 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f93a0012c60 con 0x7f93b006db70 2023-08-26T09:25:51.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.389+0000 7f939effd700 1 --2- 172.21.15.92:0/3134153271 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f939006a0e0 0x7f939006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:51.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.389+0000 7f939effd700 1 -- 172.21.15.92:0/3134153271 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f93a00886d0 con 0x7f93b006db70 2023-08-26T09:25:51.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.389+0000 7f93add9b700 1 --2- 172.21.15.92:0/3134153271 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f939006a0e0 0x7f939006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:51.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.389+0000 7f93add9b700 1 --2- 172.21.15.92:0/3134153271 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f939006a0e0 0x7f939006c5a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f93a40090b0 tx=0x7f93a4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:51.404 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.393+0000 7f939effd700 1 -- 172.21.15.92:0/3134153271 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f93a0053dd0 con 0x7f93b006db70 2023-08-26T09:25:51.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.582+0000 7f93b4b39700 1 -- 172.21.15.92:0/3134153271 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f93b015b3c0 con 0x7f93b006db70 2023-08-26T09:25:51.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.582+0000 7f939effd700 1 -- 172.21.15.92:0/3134153271 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f93a00573f0 con 0x7f93b006db70 2023-08-26T09:25:51.588 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 1 2023-08-26T09:25:51.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.584+0000 7f93b4b39700 1 -- 172.21.15.92:0/3134153271 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f939006a0e0 msgr2=0x7f939006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:51.590 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.584+0000 7f93b4b39700 1 --2- 172.21.15.92:0/3134153271 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f939006a0e0 0x7f939006c5a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f93a40090b0 tx=0x7f93a4008030 comp rx=0 tx=0).stop 2023-08-26T09:25:51.590 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.584+0000 7f93b4b39700 1 -- 172.21.15.92:0/3134153271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93b006db70 msgr2=0x7f93b01601c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:51.590 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.584+0000 7f93b4b39700 1 --2- 172.21.15.92:0/3134153271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93b006db70 0x7f93b01601c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f93a000d800 tx=0x7f93a000db10 comp rx=0 tx=0).stop 2023-08-26T09:25:51.590 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.584+0000 7f93b4b39700 1 -- 172.21.15.92:0/3134153271 shutdown_connections 2023-08-26T09:25:51.591 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.584+0000 7f93b4b39700 1 --2- 172.21.15.92:0/3134153271 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f939006a0e0 0x7f939006c5a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:51.591 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.584+0000 7f93b4b39700 1 --2- 172.21.15.92:0/3134153271 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f93b015d220 0x7f93b0158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:51.591 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.584+0000 7f93b4b39700 1 --2- 172.21.15.92:0/3134153271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93b006db70 0x7f93b01601c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:51.591 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.584+0000 7f93b4b39700 1 --2- 172.21.15.92:0/3134153271 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f93b0071260 0x7f93b0155250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:51.591 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.584+0000 7f93b4b39700 1 -- 172.21.15.92:0/3134153271 >> 172.21.15.92:0/3134153271 conn(0x7f93b006b430 msgr2=0x7f93b015c230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:51.592 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.584+0000 7f93b4b39700 1 -- 172.21.15.92:0/3134153271 shutdown_connections 2023-08-26T09:25:51.592 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.585+0000 7f93b4b39700 1 -- 172.21.15.92:0/3134153271 wait complete. 2023-08-26T09:25:51.601 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-26T09:25:51.724 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.720+0000 7ff6457e8700 1 Processor -- start 2023-08-26T09:25:51.725 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.720+0000 7ff6457e8700 1 -- start start 2023-08-26T09:25:51.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.720+0000 7ff6457e8700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7ff6400b1eb0 0x7ff64006b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:51.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.720+0000 7ff6457e8700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff6400b6250 0x7ff6400b66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:51.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.720+0000 7ff6457e8700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6400d25d0 con 0x7ff64015d490 2023-08-26T09:25:51.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.720+0000 7ff6457e8700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6400cdc70 con 0x7ff6400b1eb0 2023-08-26T09:25:51.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.720+0000 7ff6457e8700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff64015d870 con 0x7ff6400b6250 2023-08-26T09:25:51.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.721+0000 7ff63effd700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7ff64015d490 0x7ff6400ce0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:57824/0 (socket says 172.21.15.92:57824) 2023-08-26T09:25:51.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.721+0000 7ff63effd700 1 -- 172.21.15.92:0/3553824070 learned_addr learned my addr 172.21.15.92:0/3553824070 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:51.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.721+0000 7ff63f7fe700 1 --2- 172.21.15.92:0/3553824070 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff6400b6250 0x7ff6400b66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:51.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.721+0000 7ff63dffb700 1 -- 172.21.15.92:0/3553824070 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3740596964 0 0) 0x7ff6400d25d0 con 0x7ff64015d490 2023-08-26T09:25:51.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.721+0000 7ff63e7fc700 1 --2- 172.21.15.92:0/3553824070 >> v2:172.21.15.188:3300/0 conn(0x7ff6400b1eb0 0x7ff64006b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:51.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.721+0000 7ff63dffb700 1 -- 172.21.15.92:0/3553824070 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6280035b0 con 0x7ff64015d490 2023-08-26T09:25:51.731 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.721+0000 7ff63dffb700 1 -- 172.21.15.92:0/3553824070 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 887643960 0 0) 0x7ff6280035b0 con 0x7ff64015d490 2023-08-26T09:25:51.731 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.721+0000 7ff63dffb700 1 -- 172.21.15.92:0/3553824070 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff6400b6250 msgr2=0x7ff6400b66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:51.731 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.721+0000 7ff63dffb700 1 --2- 172.21.15.92:0/3553824070 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff6400b6250 0x7ff6400b66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:51.731 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.721+0000 7ff63dffb700 1 -- 172.21.15.92:0/3553824070 >> v2:172.21.15.188:3300/0 conn(0x7ff6400b1eb0 msgr2=0x7ff64006b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:51.731 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.721+0000 7ff63dffb700 1 --2- 172.21.15.92:0/3553824070 >> v2:172.21.15.188:3300/0 conn(0x7ff6400b1eb0 0x7ff64006b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:51.732 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.721+0000 7ff63dffb700 1 -- 172.21.15.92:0/3553824070 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6400b57e0 con 0x7ff64015d490 2023-08-26T09:25:51.732 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.721+0000 7ff63dffb700 1 -- 172.21.15.92:0/3553824070 <== mon.0 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1019361464 0 0) 0x7ff634001670 con 0x7ff64015d490 2023-08-26T09:25:51.732 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.721+0000 7ff63dffb700 1 -- 172.21.15.92:0/3553824070 >> v1:172.21.15.92:6789/0 conn(0x7ff64015d490 legacy=0x7ff6400ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:51.732 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.721+0000 7ff63dffb700 1 --2- 172.21.15.92:0/3553824070 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff628003a00 0x7ff628003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:51.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.721+0000 7ff63dffb700 1 --2- 172.21.15.92:0/3553824070 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff6400b6250 0x7ff628004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:51.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.721+0000 7ff63dffb700 1 --2- 172.21.15.92:0/3553824070 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff628004d90 0x7ff628005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:51.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.721+0000 7ff63dffb700 1 -- 172.21.15.92:0/3553824070 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6400cdc70 con 0x7ff628003a00 2023-08-26T09:25:51.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.721+0000 7ff63dffb700 1 -- 172.21.15.92:0/3553824070 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62800ba70 con 0x7ff628004d90 2023-08-26T09:25:51.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.721+0000 7ff63dffb700 1 -- 172.21.15.92:0/3553824070 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff62800bc30 con 0x7ff6400b6250 2023-08-26T09:25:51.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.721+0000 7ff63e7fc700 1 --2- 172.21.15.92:0/3553824070 >> v2:172.21.15.188:3300/0 conn(0x7ff6400b1eb0 0x7ff64006b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:51.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.721+0000 7ff63effd700 1 --2- 172.21.15.92:0/3553824070 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff628003a00 0x7ff628003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:51.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.721+0000 7ff63f7fe700 1 --2- 172.21.15.92:0/3553824070 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff628004d90 0x7ff628005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:51.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.722+0000 7ff63e7fc700 1 --2- 172.21.15.92:0/3553824070 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff6400b6250 0x7ff628004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:51.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.722+0000 7ff63effd700 1 -- 172.21.15.92:0/3553824070 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff6400b6250 msgr2=0x7ff628004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:51.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.722+0000 7ff63effd700 1 --2- 172.21.15.92:0/3553824070 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff6400b6250 0x7ff628004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:51.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.722+0000 7ff63effd700 1 -- 172.21.15.92:0/3553824070 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff628004d90 msgr2=0x7ff628005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:51.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.722+0000 7ff63effd700 1 --2- 172.21.15.92:0/3553824070 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff628004d90 0x7ff628005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:51.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.722+0000 7ff63effd700 1 -- 172.21.15.92:0/3553824070 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6280035b0 con 0x7ff628003a00 2023-08-26T09:25:51.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.722+0000 7ff63e7fc700 1 --2- 172.21.15.92:0/3553824070 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff6400b6250 0x7ff628004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:25:51.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.722+0000 7ff63effd700 1 --2- 172.21.15.92:0/3553824070 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff628003a00 0x7ff628003e20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff63400c2f0 tx=0x7ff628005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88f3c6d4d5388ef2 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:51.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.722+0000 7ff63dffb700 1 -- 172.21.15.92:0/3553824070 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63400ce30 con 0x7ff628003a00 2023-08-26T09:25:51.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.722+0000 7ff63dffb700 1 -- 172.21.15.92:0/3553824070 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff634005960 con 0x7ff628003a00 2023-08-26T09:25:51.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.722+0000 7ff63dffb700 1 -- 172.21.15.92:0/3553824070 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff634005d10 con 0x7ff628003a00 2023-08-26T09:25:51.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.722+0000 7ff6457e8700 1 -- 172.21.15.92:0/3553824070 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff628003a00 msgr2=0x7ff628003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:51.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.722+0000 7ff6457e8700 1 --2- 172.21.15.92:0/3553824070 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff628003a00 0x7ff628003e20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff63400c2f0 tx=0x7ff628005880 comp rx=0 tx=0).stop 2023-08-26T09:25:51.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.722+0000 7ff63f7fe700 1 -- 172.21.15.92:0/3553824070 reap_dead start 2023-08-26T09:25:51.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.722+0000 7ff6457e8700 1 -- 172.21.15.92:0/3553824070 shutdown_connections 2023-08-26T09:25:51.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.722+0000 7ff6457e8700 1 -- 172.21.15.92:0/3553824070 >> 172.21.15.92:0/3553824070 conn(0x7ff64006aac0 msgr2=0x7ff64006aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:51.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.722+0000 7ff6457e8700 1 -- 172.21.15.92:0/3553824070 shutdown_connections 2023-08-26T09:25:51.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.722+0000 7ff6457e8700 1 -- 172.21.15.92:0/3553824070 wait complete. 2023-08-26T09:25:51.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.724+0000 7ff6457e8700 1 Processor -- start 2023-08-26T09:25:51.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.724+0000 7ff6457e8700 1 -- start start 2023-08-26T09:25:51.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.725+0000 7ff6457e8700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff628003a00 0x7ff6401f4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:51.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.725+0000 7ff6457e8700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff64015b580 0x7ff6400b47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:51.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.725+0000 7ff6457e8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6400b4d30 0x7ff640159770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:51.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.725+0000 7ff6457e8700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6400b51b0 con 0x7ff6400b4d30 2023-08-26T09:25:51.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.725+0000 7ff6457e8700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64015a4e0 con 0x7ff628003a00 2023-08-26T09:25:51.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.725+0000 7ff6457e8700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff64015a7c0 con 0x7ff64015b580 2023-08-26T09:25:51.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.725+0000 7ff63f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6400b4d30 0x7ff640159770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:51.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.725+0000 7ff63f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6400b4d30 0x7ff640159770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45824/0 (socket says 172.21.15.92:45824) 2023-08-26T09:25:51.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.725+0000 7ff63f7fe700 1 -- 172.21.15.92:0/2464402990 learned_addr learned my addr 172.21.15.92:0/2464402990 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:51.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.725+0000 7ff63effd700 1 --2- 172.21.15.92:0/2464402990 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff628003a00 0x7ff6401f4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:51.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.725+0000 7ff63e7fc700 1 --2- 172.21.15.92:0/2464402990 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff64015b580 0x7ff6400b47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:51.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.725+0000 7ff63f7fe700 1 -- 172.21.15.92:0/2464402990 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff64015b580 msgr2=0x7ff6400b47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:51.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.725+0000 7ff63f7fe700 1 --2- 172.21.15.92:0/2464402990 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff64015b580 0x7ff6400b47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:51.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.725+0000 7ff63f7fe700 1 -- 172.21.15.92:0/2464402990 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff628003a00 msgr2=0x7ff6401f4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:51.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.725+0000 7ff63f7fe700 1 --2- 172.21.15.92:0/2464402990 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff628003a00 0x7ff6401f4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:51.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.725+0000 7ff63f7fe700 1 -- 172.21.15.92:0/2464402990 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff64015aaa0 con 0x7ff6400b4d30 2023-08-26T09:25:51.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.726+0000 7ff63f7fe700 1 --2- 172.21.15.92:0/2464402990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6400b4d30 0x7ff640159770 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff6400d0b30 tx=0x7ff6380114b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:51.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.726+0000 7ff6277fe700 1 -- 172.21.15.92:0/2464402990 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63800e070 con 0x7ff6400b4d30 2023-08-26T09:25:51.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.726+0000 7ff6277fe700 1 -- 172.21.15.92:0/2464402990 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff638003c30 con 0x7ff6400b4d30 2023-08-26T09:25:51.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.726+0000 7ff6457e8700 1 -- 172.21.15.92:0/2464402990 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff64015ad80 con 0x7ff6400b4d30 2023-08-26T09:25:51.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.726+0000 7ff6277fe700 1 -- 172.21.15.92:0/2464402990 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff638003e20 con 0x7ff6400b4d30 2023-08-26T09:25:51.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.726+0000 7ff6457e8700 1 -- 172.21.15.92:0/2464402990 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6401f5110 con 0x7ff6400b4d30 2023-08-26T09:25:51.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.727+0000 7ff6457e8700 1 -- 172.21.15.92:0/2464402990 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff64015b2a0 con 0x7ff6400b4d30 2023-08-26T09:25:51.746 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.727+0000 7ff6277fe700 1 -- 172.21.15.92:0/2464402990 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff638011a10 con 0x7ff6400b4d30 2023-08-26T09:25:51.746 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.727+0000 7ff6277fe700 1 --2- 172.21.15.92:0/2464402990 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7ff62c06a110 0x7ff62c06c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:51.746 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.728+0000 7ff6277fe700 1 -- 172.21.15.92:0/2464402990 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff638088b00 con 0x7ff6400b4d30 2023-08-26T09:25:51.746 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.728+0000 7ff63effd700 1 --2- 172.21.15.92:0/2464402990 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7ff62c06a110 0x7ff62c06c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:51.746 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.728+0000 7ff63effd700 1 --2- 172.21.15.92:0/2464402990 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7ff62c06a110 0x7ff62c06c5d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff634008fd0 tx=0x7ff634007000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:51.747 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.732+0000 7ff6277fe700 1 -- 172.21.15.92:0/2464402990 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff64015b2a0 con 0x7ff6400b4d30 2023-08-26T09:25:51.927 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.922+0000 7ff6457e8700 1 -- 172.21.15.92:0/2464402990 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff64004eeb0 con 0x7ff6400b4d30 2023-08-26T09:25:51.928 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.922+0000 7ff6277fe700 1 -- 172.21.15.92:0/2464402990 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff638054160 con 0x7ff6400b4d30 2023-08-26T09:25:51.928 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 32 2023-08-26T09:25:51.929 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.924+0000 7ff6457e8700 1 -- 172.21.15.92:0/2464402990 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7ff62c06a110 msgr2=0x7ff62c06c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:51.930 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.924+0000 7ff6457e8700 1 --2- 172.21.15.92:0/2464402990 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7ff62c06a110 0x7ff62c06c5d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff634008fd0 tx=0x7ff634007000 comp rx=0 tx=0).stop 2023-08-26T09:25:51.930 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.924+0000 7ff6457e8700 1 -- 172.21.15.92:0/2464402990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6400b4d30 msgr2=0x7ff640159770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:51.930 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.924+0000 7ff6457e8700 1 --2- 172.21.15.92:0/2464402990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6400b4d30 0x7ff640159770 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff6400d0b30 tx=0x7ff6380114b0 comp rx=0 tx=0).stop 2023-08-26T09:25:51.930 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.924+0000 7ff6457e8700 1 -- 172.21.15.92:0/2464402990 shutdown_connections 2023-08-26T09:25:51.930 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.924+0000 7ff6457e8700 1 --2- 172.21.15.92:0/2464402990 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7ff62c06a110 0x7ff62c06c5d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:51.931 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.924+0000 7ff6457e8700 1 --2- 172.21.15.92:0/2464402990 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff628003a00 0x7ff6401f4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:51.931 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.924+0000 7ff6457e8700 1 --2- 172.21.15.92:0/2464402990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6400b4d30 0x7ff640159770 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:51.931 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.924+0000 7ff6457e8700 1 --2- 172.21.15.92:0/2464402990 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff64015b580 0x7ff6400b47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:51.931 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.924+0000 7ff6457e8700 1 -- 172.21.15.92:0/2464402990 >> 172.21.15.92:0/2464402990 conn(0x7ff64006aac0 msgr2=0x7ff6400d1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:51.931 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.925+0000 7ff6457e8700 1 -- 172.21.15.92:0/2464402990 shutdown_connections 2023-08-26T09:25:51.932 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:51.925+0000 7ff6457e8700 1 -- 172.21.15.92:0/2464402990 wait complete. 2023-08-26T09:25:51.942 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-26T09:25:52.066 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.061+0000 7f14de7e9700 1 Processor -- start 2023-08-26T09:25:52.066 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.061+0000 7f14de7e9700 1 -- start start 2023-08-26T09:25:52.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.062+0000 7f14de7e9700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f14d815a190 0x7f14d8071710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:52.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.062+0000 7f14de7e9700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f14d80ae740 0x7f14d80ca900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:52.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.062+0000 7f14de7e9700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14d8071fb0 con 0x7f14d815a570 2023-08-26T09:25:52.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.062+0000 7f14de7e9700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14d80c9b40 con 0x7f14d815a190 2023-08-26T09:25:52.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.062+0000 7f14de7e9700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14d80c9e20 con 0x7f14d80ae740 2023-08-26T09:25:52.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.062+0000 7f14d7fff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f14d815a190 0x7f14d8071710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:52.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.062+0000 7f14d7fff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f14d815a190 0x7f14d8071710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45828/0 (socket says 172.21.15.92:45828) 2023-08-26T09:25:52.070 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.062+0000 7f14d7fff700 1 -- 172.21.15.92:0/1995839932 learned_addr learned my addr 172.21.15.92:0/1995839932 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:52.070 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.062+0000 7f14d77fe700 1 --2- 172.21.15.92:0/1995839932 >> v2:172.21.15.188:3300/0 conn(0x7f14d80ae740 0x7f14d80ca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:52.070 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.062+0000 7f14d7fff700 1 -- 172.21.15.92:0/1995839932 >> v2:172.21.15.188:3300/0 conn(0x7f14d80ae740 msgr2=0x7f14d80ca900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:52.070 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.062+0000 7f14d7fff700 1 --2- 172.21.15.92:0/1995839932 >> v2:172.21.15.188:3300/0 conn(0x7f14d80ae740 0x7f14d80ca900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:52.070 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.062+0000 7f14d7fff700 1 -- 172.21.15.92:0/1995839932 >> v1:172.21.15.188:6789/0 conn(0x7f14d815a570 legacy=0x7f14d815aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:52.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.062+0000 7f14d7fff700 1 -- 172.21.15.92:0/1995839932 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d80ca100 con 0x7f14d815a190 2023-08-26T09:25:52.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.062+0000 7f14d7fff700 1 --2- 172.21.15.92:0/1995839932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14d815a190 0x7f14d8071710 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f14d8070080 tx=0x7f14cc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4e7adbdb8e3ee36 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:52.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.063+0000 7f14d6ffd700 1 -- 172.21.15.92:0/1995839932 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14cc004230 con 0x7f14d815a190 2023-08-26T09:25:52.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.063+0000 7f14d6ffd700 1 -- 172.21.15.92:0/1995839932 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14cc004390 con 0x7f14d815a190 2023-08-26T09:25:52.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.063+0000 7f14d6ffd700 1 -- 172.21.15.92:0/1995839932 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14cc0036a0 con 0x7f14d815a190 2023-08-26T09:25:52.072 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.063+0000 7f14de7e9700 1 -- 172.21.15.92:0/1995839932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14d815a190 msgr2=0x7f14d8071710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:52.072 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.063+0000 7f14de7e9700 1 --2- 172.21.15.92:0/1995839932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14d815a190 0x7f14d8071710 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f14d8070080 tx=0x7f14cc009bd0 comp rx=0 tx=0).stop 2023-08-26T09:25:52.072 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.063+0000 7f14de7e9700 1 -- 172.21.15.92:0/1995839932 shutdown_connections 2023-08-26T09:25:52.072 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.063+0000 7f14de7e9700 1 --2- 172.21.15.92:0/1995839932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14d815a190 0x7f14d8071710 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:52.072 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.063+0000 7f14de7e9700 1 --2- 172.21.15.92:0/1995839932 >> v2:172.21.15.188:3300/0 conn(0x7f14d80ae740 0x7f14d80ca900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:52.073 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.063+0000 7f14de7e9700 1 -- 172.21.15.92:0/1995839932 >> 172.21.15.92:0/1995839932 conn(0x7f14d80cf450 msgr2=0x7f14d80cf860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:52.073 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.063+0000 7f14de7e9700 1 -- 172.21.15.92:0/1995839932 shutdown_connections 2023-08-26T09:25:52.073 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.063+0000 7f14de7e9700 1 -- 172.21.15.92:0/1995839932 wait complete. 2023-08-26T09:25:52.075 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.065+0000 7f14de7e9700 1 Processor -- start 2023-08-26T09:25:52.076 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.065+0000 7f14de7e9700 1 -- start start 2023-08-26T09:25:52.076 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.066+0000 7f14de7e9700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f14d80ae740 0x7f14d80c40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:52.076 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.066+0000 7f14de7e9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14d815a190 0x7f14d80b2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:52.076 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.066+0000 7f14de7e9700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f14d815a570 0x7f14d815c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:52.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.066+0000 7f14de7e9700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d80c53b0 con 0x7f14d815a190 2023-08-26T09:25:52.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.066+0000 7f14de7e9700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d80b32f0 con 0x7f14d815a570 2023-08-26T09:25:52.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.066+0000 7f14de7e9700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14d80b2960 con 0x7f14d80ae740 2023-08-26T09:25:52.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.066+0000 7f14d77fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14d815a190 0x7f14d80b2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:52.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.066+0000 7f14d77fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14d815a190 0x7f14d80b2110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45836/0 (socket says 172.21.15.92:45836) 2023-08-26T09:25:52.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.066+0000 7f14d77fe700 1 -- 172.21.15.92:0/2914913918 learned_addr learned my addr 172.21.15.92:0/2914913918 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:52.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.066+0000 7f14dcd86700 1 --2- 172.21.15.92:0/2914913918 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f14d815a570 0x7f14d815c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:52.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.066+0000 7f14d7fff700 1 --2- 172.21.15.92:0/2914913918 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f14d80ae740 0x7f14d80c40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:52.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.066+0000 7f14d77fe700 1 -- 172.21.15.92:0/2914913918 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f14d80ae740 msgr2=0x7f14d80c40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:52.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.066+0000 7f14d77fe700 1 --2- 172.21.15.92:0/2914913918 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f14d80ae740 0x7f14d80c40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:52.079 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.066+0000 7f14d77fe700 1 -- 172.21.15.92:0/2914913918 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f14d815a570 msgr2=0x7f14d815c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:52.079 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.066+0000 7f14d77fe700 1 --2- 172.21.15.92:0/2914913918 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f14d815a570 0x7f14d815c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:52.079 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.066+0000 7f14d77fe700 1 -- 172.21.15.92:0/2914913918 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14cc009550 con 0x7f14d815a190 2023-08-26T09:25:52.079 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.066+0000 7f14d77fe700 1 --2- 172.21.15.92:0/2914913918 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14d815a190 0x7f14d80b2110 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f14c800faa0 tx=0x7f14c800fe60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:52.079 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.066+0000 7f14d4ff9700 1 -- 172.21.15.92:0/2914913918 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c8007ac0 con 0x7f14d815a190 2023-08-26T09:25:52.080 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.066+0000 7f14d4ff9700 1 -- 172.21.15.92:0/2914913918 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c8007c20 con 0x7f14d815a190 2023-08-26T09:25:52.080 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.067+0000 7f14d4ff9700 1 -- 172.21.15.92:0/2914913918 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c801a460 con 0x7f14d815a190 2023-08-26T09:25:52.080 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.067+0000 7f14de7e9700 1 -- 172.21.15.92:0/2914913918 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14d80b2c40 con 0x7f14d815a190 2023-08-26T09:25:52.080 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.067+0000 7f14de7e9700 1 -- 172.21.15.92:0/2914913918 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14d80b3500 con 0x7f14d815a190 2023-08-26T09:25:52.080 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.067+0000 7f14de7e9700 1 -- 172.21.15.92:0/2914913918 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14d80b26b0 con 0x7f14d815a190 2023-08-26T09:25:52.081 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.068+0000 7f14d4ff9700 1 -- 172.21.15.92:0/2914913918 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f14c8011450 con 0x7f14d815a190 2023-08-26T09:25:52.081 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.068+0000 7f14d4ff9700 1 --2- 172.21.15.92:0/2914913918 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f14c406a0e0 0x7f14c406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:52.081 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.068+0000 7f14d4ff9700 1 -- 172.21.15.92:0/2914913918 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f14c808ac80 con 0x7f14d815a190 2023-08-26T09:25:52.081 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.068+0000 7f14d7fff700 1 --2- 172.21.15.92:0/2914913918 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f14c406a0e0 0x7f14c406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:52.081 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.069+0000 7f14d7fff700 1 --2- 172.21.15.92:0/2914913918 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f14c406a0e0 0x7f14c406c5a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f14cc009130 tx=0x7f14cc008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:52.082 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.073+0000 7f14d4ff9700 1 -- 172.21.15.92:0/2914913918 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f14c80562d0 con 0x7f14d815a190 2023-08-26T09:25:52.269 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.264+0000 7f14de7e9700 1 -- 172.21.15.92:0/2914913918 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f14d804eeb0 con 0x7f14d815a190 2023-08-26T09:25:52.270 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.265+0000 7f14d4ff9700 1 -- 172.21.15.92:0/2914913918 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f14c80150a0 con 0x7f14d815a190 2023-08-26T09:25:52.270 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 64 2023-08-26T09:25:52.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.266+0000 7f14de7e9700 1 -- 172.21.15.92:0/2914913918 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f14c406a0e0 msgr2=0x7f14c406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:52.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.266+0000 7f14de7e9700 1 --2- 172.21.15.92:0/2914913918 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f14c406a0e0 0x7f14c406c5a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f14cc009130 tx=0x7f14cc008030 comp rx=0 tx=0).stop 2023-08-26T09:25:52.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.266+0000 7f14de7e9700 1 -- 172.21.15.92:0/2914913918 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14d815a190 msgr2=0x7f14d80b2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:52.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.266+0000 7f14de7e9700 1 --2- 172.21.15.92:0/2914913918 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14d815a190 0x7f14d80b2110 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f14c800faa0 tx=0x7f14c800fe60 comp rx=0 tx=0).stop 2023-08-26T09:25:52.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.267+0000 7f14de7e9700 1 -- 172.21.15.92:0/2914913918 shutdown_connections 2023-08-26T09:25:52.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.267+0000 7f14de7e9700 1 --2- 172.21.15.92:0/2914913918 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f14c406a0e0 0x7f14c406c5a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:52.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.267+0000 7f14de7e9700 1 --2- 172.21.15.92:0/2914913918 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f14d815a570 0x7f14d815c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:52.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.267+0000 7f14de7e9700 1 --2- 172.21.15.92:0/2914913918 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f14d80ae740 0x7f14d80c40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:52.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.267+0000 7f14de7e9700 1 --2- 172.21.15.92:0/2914913918 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14d815a190 0x7f14d80b2110 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:52.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.267+0000 7f14de7e9700 1 -- 172.21.15.92:0/2914913918 >> 172.21.15.92:0/2914913918 conn(0x7f14d80cf450 msgr2=0x7f14d806b710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:52.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.267+0000 7f14de7e9700 1 -- 172.21.15.92:0/2914913918 shutdown_connections 2023-08-26T09:25:52.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.267+0000 7f14de7e9700 1 -- 172.21.15.92:0/2914913918 wait complete. 2023-08-26T09:25:52.284 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-26T09:25:52.404 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.400+0000 7f3395091700 1 Processor -- start 2023-08-26T09:25:52.405 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.400+0000 7f3395091700 1 -- start start 2023-08-26T09:25:52.407 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.400+0000 7f3395091700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f339015b0c0 0x7f33900cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:52.407 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.400+0000 7f3395091700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f33900cf910 0x7f33900cd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:52.407 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.400+0000 7f3395091700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33900ce1c0 con 0x7f33900cdd30 2023-08-26T09:25:52.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.400+0000 7f3395091700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33900cfea0 con 0x7f33900cf910 2023-08-26T09:25:52.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.400+0000 7f3395091700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33900b4760 con 0x7f339015b0c0 2023-08-26T09:25:52.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.401+0000 7f338ed9d700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f339015b0c0 0x7f33900cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:52.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.401+0000 7f338e59c700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f33900cf910 0x7f33900cd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:52.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.401+0000 7f338f59e700 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f33900cdd30 0x7f33900b1a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.92:52968/0 (socket says 172.21.15.92:52968) 2023-08-26T09:25:52.409 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.401+0000 7f338e59c700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f33900cf910 0x7f33900cd7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.92:34650/0 (socket says 172.21.15.92:34650) 2023-08-26T09:25:52.409 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.401+0000 7f338ed9d700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f339015b0c0 0x7f33900cf3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.92:44506/0 (socket says 172.21.15.92:44506) 2023-08-26T09:25:52.409 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.401+0000 7f338f59e700 1 -- 172.21.15.92:0/2371618393 learned_addr learned my addr 172.21.15.92:0/2371618393 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:52.409 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.401+0000 7f338dd9b700 1 -- 172.21.15.92:0/2371618393 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3488898086 0 0) 0x7f3388001490 con 0x7f33900cdd30 2023-08-26T09:25:52.409 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.401+0000 7f338dd9b700 1 -- 172.21.15.92:0/2371618393 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33780035b0 con 0x7f33900cdd30 2023-08-26T09:25:52.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.401+0000 7f338ed9d700 1 -- 172.21.15.92:0/2371618393 >> v2:172.21.15.188:3300/0 conn(0x7f33900cf910 msgr2=0x7f33900cd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:52.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.401+0000 7f338ed9d700 1 --2- 172.21.15.92:0/2371618393 >> v2:172.21.15.188:3300/0 conn(0x7f33900cf910 0x7f33900cd7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:52.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.401+0000 7f338ed9d700 1 -- 172.21.15.92:0/2371618393 >> v1:172.21.15.188:6789/0 conn(0x7f33900cdd30 legacy=0x7f33900b1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:52.411 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.401+0000 7f338ed9d700 1 -- 172.21.15.92:0/2371618393 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33900b3e30 con 0x7f339015b0c0 2023-08-26T09:25:52.412 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.401+0000 7f338e59c700 1 --2- 172.21.15.92:0/2371618393 >> v2:172.21.15.188:3300/0 conn(0x7f33900cf910 0x7f33900cd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-26T09:25:52.412 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.401+0000 7f338ed9d700 1 --2- 172.21.15.92:0/2371618393 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f339015b0c0 0x7f33900cf3d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3380009820 tx=0x7f3380009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efcd2eb350389f4 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:52.412 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.402+0000 7f338dd9b700 1 -- 172.21.15.92:0/2371618393 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3380005e30 con 0x7f339015b0c0 2023-08-26T09:25:52.412 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.402+0000 7f338dd9b700 1 -- 172.21.15.92:0/2371618393 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3380006030 con 0x7f339015b0c0 2023-08-26T09:25:52.412 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.402+0000 7f338dd9b700 1 -- 172.21.15.92:0/2371618393 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33800063c0 con 0x7f339015b0c0 2023-08-26T09:25:52.413 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.402+0000 7f3395091700 1 -- 172.21.15.92:0/2371618393 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f339015b0c0 msgr2=0x7f33900cf3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:52.413 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.402+0000 7f3395091700 1 --2- 172.21.15.92:0/2371618393 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f339015b0c0 0x7f33900cf3d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3380009820 tx=0x7f3380009b30 comp rx=0 tx=0).stop 2023-08-26T09:25:52.413 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.402+0000 7f3395091700 1 -- 172.21.15.92:0/2371618393 shutdown_connections 2023-08-26T09:25:52.413 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.402+0000 7f3395091700 1 --2- 172.21.15.92:0/2371618393 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f339015b0c0 0x7f33900cf3d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:52.413 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.402+0000 7f3395091700 1 --2- 172.21.15.92:0/2371618393 >> v2:172.21.15.188:3300/0 conn(0x7f33900cf910 0x7f33900cd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:52.414 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.402+0000 7f3395091700 1 -- 172.21.15.92:0/2371618393 >> 172.21.15.92:0/2371618393 conn(0x7f339009a1b0 msgr2=0x7f33900d0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:52.414 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.402+0000 7f3395091700 1 -- 172.21.15.92:0/2371618393 shutdown_connections 2023-08-26T09:25:52.414 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.402+0000 7f3395091700 1 -- 172.21.15.92:0/2371618393 wait complete. 2023-08-26T09:25:52.417 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.404+0000 7f3395091700 1 Processor -- start 2023-08-26T09:25:52.417 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.404+0000 7f3395091700 1 -- start start 2023-08-26T09:25:52.418 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.404+0000 7f3395091700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33900cdd30 0x7f33901f3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:52.418 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.404+0000 7f3395091700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f33900cf910 0x7f339015c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:52.418 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.404+0000 7f3395091700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f339015b0c0 0x7f33901ef950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:52.418 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.404+0000 7f3395091700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33901f3970 con 0x7f33900cdd30 2023-08-26T09:25:52.418 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.404+0000 7f3395091700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339006c0e0 con 0x7f339015b0c0 2023-08-26T09:25:52.419 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.404+0000 7f3395091700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f339006c3c0 con 0x7f33900cf910 2023-08-26T09:25:52.419 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.404+0000 7f338ed9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33900cdd30 0x7f33901f3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:52.419 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.404+0000 7f338ed9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33900cdd30 0x7f33901f3430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45846/0 (socket says 172.21.15.92:45846) 2023-08-26T09:25:52.419 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.404+0000 7f338ed9d700 1 -- 172.21.15.92:0/3125063935 learned_addr learned my addr 172.21.15.92:0/3125063935 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:52.419 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.405+0000 7f338e59c700 1 --2- 172.21.15.92:0/3125063935 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f33900cf910 0x7f339015c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:52.420 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.405+0000 7f338f59e700 1 --2- 172.21.15.92:0/3125063935 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f339015b0c0 0x7f33901ef950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:52.420 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.405+0000 7f338ed9d700 1 -- 172.21.15.92:0/3125063935 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f33900cf910 msgr2=0x7f339015c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:52.420 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.405+0000 7f338ed9d700 1 --2- 172.21.15.92:0/3125063935 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f33900cf910 0x7f339015c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:52.420 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.405+0000 7f338ed9d700 1 -- 172.21.15.92:0/3125063935 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f339015b0c0 msgr2=0x7f33901ef950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:52.420 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.405+0000 7f338ed9d700 1 --2- 172.21.15.92:0/3125063935 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f339015b0c0 0x7f33901ef950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:52.421 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.405+0000 7f338ed9d700 1 -- 172.21.15.92:0/3125063935 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33840094a0 con 0x7f33900cdd30 2023-08-26T09:25:52.421 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.405+0000 7f338f59e700 1 --2- 172.21.15.92:0/3125063935 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f339015b0c0 0x7f33901ef950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:52.421 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.405+0000 7f338ed9d700 1 --2- 172.21.15.92:0/3125063935 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33900cdd30 0x7f33901f3430 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3380000c00 tx=0x7f3380004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:52.421 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.405+0000 7f33777fe700 1 -- 172.21.15.92:0/3125063935 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33800063a0 con 0x7f33900cdd30 2023-08-26T09:25:52.421 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.405+0000 7f33777fe700 1 -- 172.21.15.92:0/3125063935 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3380020070 con 0x7f33900cdd30 2023-08-26T09:25:52.422 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.405+0000 7f3395091700 1 -- 172.21.15.92:0/3125063935 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3380009430 con 0x7f33900cdd30 2023-08-26T09:25:52.422 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.405+0000 7f33777fe700 1 -- 172.21.15.92:0/3125063935 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3380006760 con 0x7f33900cdd30 2023-08-26T09:25:52.422 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.405+0000 7f3395091700 1 -- 172.21.15.92:0/3125063935 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f339006c980 con 0x7f33900cdd30 2023-08-26T09:25:52.422 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.406+0000 7f3395091700 1 -- 172.21.15.92:0/3125063935 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f339004e660 con 0x7f33900cdd30 2023-08-26T09:25:52.422 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.406+0000 7f33777fe700 1 -- 172.21.15.92:0/3125063935 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3380022030 con 0x7f33900cdd30 2023-08-26T09:25:52.422 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.407+0000 7f33777fe700 1 --2- 172.21.15.92:0/3125063935 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f337c06a110 0x7f337c06c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:52.423 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.407+0000 7f338e59c700 1 --2- 172.21.15.92:0/3125063935 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f337c06a110 0x7f337c06c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:52.423 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.407+0000 7f33777fe700 1 -- 172.21.15.92:0/3125063935 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3380089a20 con 0x7f33900cdd30 2023-08-26T09:25:52.423 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.407+0000 7f338e59c700 1 --2- 172.21.15.92:0/3125063935 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f337c06a110 0x7f337c06c5d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f339006e020 tx=0x7f3384009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:52.423 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.411+0000 7f33777fe700 1 -- 172.21.15.92:0/3125063935 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3380055260 con 0x7f33900cdd30 2023-08-26T09:25:52.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.616+0000 7f3395091700 1 -- 172.21.15.92:0/3125063935 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f33900c77a0 con 0x7f33900cdd30 2023-08-26T09:25:52.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.616+0000 7f33777fe700 1 -- 172.21.15.92:0/3125063935 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3380058880 con 0x7f33900cdd30 2023-08-26T09:25:52.623 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.618+0000 7f3395091700 1 -- 172.21.15.92:0/3125063935 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f337c06a110 msgr2=0x7f337c06c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:52.624 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.618+0000 7f3395091700 1 --2- 172.21.15.92:0/3125063935 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f337c06a110 0x7f337c06c5d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f339006e020 tx=0x7f3384009210 comp rx=0 tx=0).stop 2023-08-26T09:25:52.624 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.618+0000 7f3395091700 1 -- 172.21.15.92:0/3125063935 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33900cdd30 msgr2=0x7f33901f3430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:52.624 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.618+0000 7f3395091700 1 --2- 172.21.15.92:0/3125063935 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33900cdd30 0x7f33901f3430 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3380000c00 tx=0x7f3380004750 comp rx=0 tx=0).stop 2023-08-26T09:25:52.624 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.618+0000 7f3395091700 1 -- 172.21.15.92:0/3125063935 shutdown_connections 2023-08-26T09:25:52.624 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.618+0000 7f3395091700 1 --2- 172.21.15.92:0/3125063935 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f337c06a110 0x7f337c06c5d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:52.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.618+0000 7f3395091700 1 --2- 172.21.15.92:0/3125063935 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f339015b0c0 0x7f33901ef950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:52.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.618+0000 7f3395091700 1 --2- 172.21.15.92:0/3125063935 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33900cdd30 0x7f33901f3430 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:52.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.618+0000 7f3395091700 1 --2- 172.21.15.92:0/3125063935 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f33900cf910 0x7f339015c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:52.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.618+0000 7f3395091700 1 -- 172.21.15.92:0/3125063935 >> 172.21.15.92:0/3125063935 conn(0x7f339009a1b0 msgr2=0x7f33900b4bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:52.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.618+0000 7f3395091700 1 -- 172.21.15.92:0/3125063935 shutdown_connections 2023-08-26T09:25:52.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.618+0000 7f3395091700 1 -- 172.21.15.92:0/3125063935 wait complete. 2023-08-26T09:25:52.626 INFO:teuthology.orchestra.run.smithi092.stderr:listed 0 entries 2023-08-26T09:25:52.635 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi092.front.sepia.ceph.com... 2023-08-26T09:25:52.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:52.635 DEBUG:teuthology.orchestra.run.smithi092:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-08-26T09:25:52.680 INFO:teuthology.orchestra.run:waiting for 300 2023-08-26T09:25:52.680 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi092.front.sepia.ceph.com 2023-08-26T09:25:52.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:52.681 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-26T09:25:52.760 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-08-26T09:25:52.760 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-26T09:25:52.781 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-08-26T09:25:52.782 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-26T09:25:52.841 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-26T09:25:52.961 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.956+0000 7f68b8350700 1 Processor -- start 2023-08-26T09:25:52.961 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.956+0000 7f68b8350700 1 -- start start 2023-08-26T09:25:52.963 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.957+0000 7f68b8350700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f68b015d550 0x7f68b00ce050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:52.964 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.957+0000 7f68b8350700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f68b00ce590 0x7f68b00d16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:52.964 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.957+0000 7f68b8350700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68b00b64b0 con 0x7f68b00d1c00 2023-08-26T09:25:52.964 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.957+0000 7f68b8350700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68b015d930 con 0x7f68b015d550 2023-08-26T09:25:52.964 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.957+0000 7f68b8350700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68b00cea10 con 0x7f68b00ce590 2023-08-26T09:25:52.964 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.957+0000 7f68b60ec700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f68b015d550 0x7f68b00ce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:52.965 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.958+0000 7f68b60ec700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f68b015d550 0x7f68b00ce050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45854/0 (socket says 172.21.15.92:45854) 2023-08-26T09:25:52.965 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.958+0000 7f68b60ec700 1 -- 172.21.15.92:0/4000531774 learned_addr learned my addr 172.21.15.92:0/4000531774 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:52.965 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.958+0000 7f68b60ec700 1 -- 172.21.15.92:0/4000531774 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f68b00ce590 msgr2=0x7f68b00d16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:52.965 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.958+0000 7f68b60ec700 1 --2- 172.21.15.92:0/4000531774 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f68b00ce590 0x7f68b00d16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:52.965 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.958+0000 7f68b60ec700 1 -- 172.21.15.92:0/4000531774 >> v1:172.21.15.188:6789/0 conn(0x7f68b00d1c00 legacy=0x7f68b006a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:52.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.958+0000 7f68b60ec700 1 -- 172.21.15.92:0/4000531774 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b00b6d30 con 0x7f68b015d550 2023-08-26T09:25:52.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.958+0000 7f68b60ec700 1 --2- 172.21.15.92:0/4000531774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68b015d550 0x7f68b00ce050 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f68a00098f0 tx=0x7f68a0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25492c22b8bd1304 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:52.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.958+0000 7f68b50ea700 1 -- 172.21.15.92:0/4000531774 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a0004230 con 0x7f68b015d550 2023-08-26T09:25:52.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.958+0000 7f68b50ea700 1 -- 172.21.15.92:0/4000531774 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68a0004390 con 0x7f68b015d550 2023-08-26T09:25:52.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.958+0000 7f68b50ea700 1 -- 172.21.15.92:0/4000531774 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a00036a0 con 0x7f68b015d550 2023-08-26T09:25:52.967 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.959+0000 7f68b8350700 1 -- 172.21.15.92:0/4000531774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68b015d550 msgr2=0x7f68b00ce050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:52.967 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.959+0000 7f68b8350700 1 --2- 172.21.15.92:0/4000531774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68b015d550 0x7f68b00ce050 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f68a00098f0 tx=0x7f68a0009c00 comp rx=0 tx=0).stop 2023-08-26T09:25:52.967 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.959+0000 7f68b8350700 1 -- 172.21.15.92:0/4000531774 shutdown_connections 2023-08-26T09:25:52.967 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.959+0000 7f68b8350700 1 --2- 172.21.15.92:0/4000531774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68b015d550 0x7f68b00ce050 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:52.967 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.959+0000 7f68b8350700 1 --2- 172.21.15.92:0/4000531774 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f68b00ce590 0x7f68b00d16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:52.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.959+0000 7f68b8350700 1 -- 172.21.15.92:0/4000531774 >> 172.21.15.92:0/4000531774 conn(0x7f68b00cfa90 msgr2=0x7f68b00cfea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:52.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.959+0000 7f68b8350700 1 -- 172.21.15.92:0/4000531774 shutdown_connections 2023-08-26T09:25:52.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.959+0000 7f68b8350700 1 -- 172.21.15.92:0/4000531774 wait complete. 2023-08-26T09:25:52.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.960+0000 7f68b8350700 1 Processor -- start 2023-08-26T09:25:52.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.960+0000 7f68b8350700 1 -- start start 2023-08-26T09:25:52.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.961+0000 7f68b8350700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68b00ce590 0x7f68b00ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:52.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.961+0000 7f68b8350700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f68b00d1c00 0x7f68b0156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:52.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.961+0000 7f68b8350700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68b015d550 0x7f68b0159d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:52.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.961+0000 7f68b8350700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b00caaf0 con 0x7f68b00ce590 2023-08-26T09:25:52.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.961+0000 7f68b8350700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b00cb390 con 0x7f68b015d550 2023-08-26T09:25:52.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.961+0000 7f68b8350700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68b0157b80 con 0x7f68b00d1c00 2023-08-26T09:25:52.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.961+0000 7f68b60ec700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68b00ce590 0x7f68b00ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:52.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.961+0000 7f68b60ec700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68b00ce590 0x7f68b00ccc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45860/0 (socket says 172.21.15.92:45860) 2023-08-26T09:25:52.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.961+0000 7f68b60ec700 1 -- 172.21.15.92:0/3335353263 learned_addr learned my addr 172.21.15.92:0/3335353263 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:52.973 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.961+0000 7f68b58eb700 1 --2- 172.21.15.92:0/3335353263 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f68b00d1c00 0x7f68b0156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:52.973 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.961+0000 7f68b68ed700 1 --2- 172.21.15.92:0/3335353263 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68b015d550 0x7f68b0159d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:52.973 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.961+0000 7f68b60ec700 1 -- 172.21.15.92:0/3335353263 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f68b00d1c00 msgr2=0x7f68b0156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:52.973 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.961+0000 7f68b60ec700 1 --2- 172.21.15.92:0/3335353263 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f68b00d1c00 0x7f68b0156bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:52.973 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.961+0000 7f68b60ec700 1 -- 172.21.15.92:0/3335353263 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68b015d550 msgr2=0x7f68b0159d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:52.974 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.961+0000 7f68b60ec700 1 --2- 172.21.15.92:0/3335353263 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68b015d550 0x7f68b0159d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:52.974 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.961+0000 7f68b60ec700 1 -- 172.21.15.92:0/3335353263 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a0009550 con 0x7f68b00ce590 2023-08-26T09:25:52.974 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.961+0000 7f68b58eb700 1 --2- 172.21.15.92:0/3335353263 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f68b00d1c00 0x7f68b0156bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:25:52.974 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.961+0000 7f68b68ed700 1 --2- 172.21.15.92:0/3335353263 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68b015d550 0x7f68b0159d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:25:52.974 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.961+0000 7f68b60ec700 1 --2- 172.21.15.92:0/3335353263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68b00ce590 0x7f68b00ccc20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f68a000b0e0 tx=0x7f68a0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:52.974 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.961+0000 7f68a6ffd700 1 -- 172.21.15.92:0/3335353263 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a000b860 con 0x7f68b00ce590 2023-08-26T09:25:52.975 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.961+0000 7f68a6ffd700 1 -- 172.21.15.92:0/3335353263 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68a000b9e0 con 0x7f68b00ce590 2023-08-26T09:25:52.975 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.961+0000 7f68a6ffd700 1 -- 172.21.15.92:0/3335353263 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a000bd90 con 0x7f68b00ce590 2023-08-26T09:25:52.975 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.961+0000 7f68b8350700 1 -- 172.21.15.92:0/3335353263 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68b0157100 con 0x7f68b00ce590 2023-08-26T09:25:52.975 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.961+0000 7f68b8350700 1 -- 172.21.15.92:0/3335353263 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68b00cad40 con 0x7f68b00ce590 2023-08-26T09:25:52.975 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.962+0000 7f68b8350700 1 -- 172.21.15.92:0/3335353263 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68b004e660 con 0x7f68b00ce590 2023-08-26T09:25:52.976 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.963+0000 7f68a6ffd700 1 -- 172.21.15.92:0/3335353263 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f68a001b440 con 0x7f68b00ce590 2023-08-26T09:25:52.976 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.963+0000 7f68a6ffd700 1 --2- 172.21.15.92:0/3335353263 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f689406a0e0 0x7f689406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:52.976 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.963+0000 7f68b58eb700 1 --2- 172.21.15.92:0/3335353263 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f689406a0e0 0x7f689406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:52.977 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.963+0000 7f68a6ffd700 1 -- 172.21.15.92:0/3335353263 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f68a0089f10 con 0x7f68b00ce590 2023-08-26T09:25:52.977 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.963+0000 7f68b58eb700 1 --2- 172.21.15.92:0/3335353263 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f689406a0e0 0x7f689406c5a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f68b015f4c0 tx=0x7f68ac008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:52.977 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:52.967+0000 7f68a6ffd700 1 -- 172.21.15.92:0/3335353263 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f68a0055690 con 0x7f68b00ce590 2023-08-26T09:25:53.164 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.159+0000 7f68b8350700 1 -- 172.21.15.92:0/3335353263 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f68b006baa0 con 0x7f68b00ce590 2023-08-26T09:25:53.165 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.160+0000 7f68a6ffd700 1 -- 172.21.15.92:0/3335353263 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+18209 (secure 0 0 0) 0x7f68a001f090 con 0x7f68b00ce590 2023-08-26T09:25:53.166 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:25:53.166 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":20,"fsid":"254a2d31-bd41-4507-8326-1b205ac24377","created":"2023-08-26T09:24:55.352131+0000","modified":"2023-08-26T09:25:15.447635+0000","last_up_change":"2023-08-26T09:25:06.124496+0000","last_in_change":"2023-08-26T09:24:57.840725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-26T09:25:06.650431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-26T09:25:06.973382+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-26T09:25:11.584141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-26T09:25:12.814990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e9e7638-4459-4d8d-8e40-130bcf48df66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6819","nonce":382827192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6824","nonce":382827192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6831","nonce":382827192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6827","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6829","nonce":382827192}]},"public_addr":"172.21.15.92:6819/382827192","cluster_addr":"172.21.15.92:6824/382827192","heartbeat_back_addr":"172.21.15.92:6831/382827192","heartbeat_front_addr":"172.21.15.92:6829/382827192","state":["exists","up"]},{"osd":1,"uuid":"164e68c9-aedd-4df5-9b70-f4b1ec3bda13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6809","nonce":618773438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6811","nonce":618773438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6815","nonce":618773438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6813","nonce":618773438}]},"public_addr":"172.21.15.92:6809/618773438","cluster_addr":"172.21.15.92:6811/618773438","heartbeat_back_addr":"172.21.15.92:6815/618773438","heartbeat_front_addr":"172.21.15.92:6813/618773438","state":["exists","up"]},{"osd":2,"uuid":"8701dfee-629a-4d30-82e4-b8fac340303f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6818","nonce":3697397687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6821","nonce":3697397687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6828","nonce":3697397687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6823","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6825","nonce":3697397687}]},"public_addr":"172.21.15.92:6818/3697397687","cluster_addr":"172.21.15.92:6821/3697397687","heartbeat_back_addr":"172.21.15.92:6828/3697397687","heartbeat_front_addr":"172.21.15.92:6825/3697397687","state":["exists","up"]},{"osd":3,"uuid":"93bdc94d-dc07-495f-995a-a6ad072f0247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6801","nonce":3579846453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6803","nonce":3579846453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6807","nonce":3579846453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6805","nonce":3579846453}]},"public_addr":"172.21.15.92:6801/3579846453","cluster_addr":"172.21.15.92:6803/3579846453","heartbeat_back_addr":"172.21.15.92:6807/3579846453","heartbeat_front_addr":"172.21.15.92:6805/3579846453","state":["exists","up"]},{"osd":4,"uuid":"d9d0ea80-8481-46a7-9677-c338d32cf1d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6809","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6811","nonce":3228383424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6813","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6815","nonce":3228383424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6821","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6823","nonce":3228383424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6817","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6819","nonce":3228383424}]},"public_addr":"172.21.15.188:6811/3228383424","cluster_addr":"172.21.15.188:6815/3228383424","heartbeat_back_addr":"172.21.15.188:6823/3228383424","heartbeat_front_addr":"172.21.15.188:6819/3228383424","state":["exists","up"]},{"osd":5,"uuid":"38d03253-467a-456f-bd5e-5a46532a0b18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6801","nonce":1655821054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6803","nonce":1655821054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6807","nonce":1655821054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6805","nonce":1655821054}]},"public_addr":"172.21.15.188:6801/1655821054","cluster_addr":"172.21.15.188:6803/1655821054","heartbeat_back_addr":"172.21.15.188:6807/1655821054","heartbeat_front_addr":"172.21.15.188:6805/1655821054","state":["exists","up"]},{"osd":6,"uuid":"d61564b5-136f-42e5-a843-626c2017cc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6810","nonce":2069976891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6814","nonce":2069976891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6822","nonce":2069976891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6818","nonce":2069976891}]},"public_addr":"172.21.15.188:6810/2069976891","cluster_addr":"172.21.15.188:6814/2069976891","heartbeat_back_addr":"172.21.15.188:6822/2069976891","heartbeat_front_addr":"172.21.15.188:6818/2069976891","state":["exists","up"]},{"osd":7,"uuid":"fae2949e-0d62-42cd-ba72-08f516084b20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6825","nonce":1882888860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6827","nonce":1882888860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6831","nonce":1882888860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6829","nonce":1882888860}]},"public_addr":"172.21.15.188:6825/1882888860","cluster_addr":"172.21.15.188:6827/1882888860","heartbeat_back_addr":"172.21.15.188:6831/1882888860","heartbeat_front_addr":"172.21.15.188:6829/1882888860","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.038523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.063160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.000857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.975572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.023848+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.765194+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.081365+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:05.110745+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-26T09:25:53.168 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.163+0000 7f68b8350700 1 -- 172.21.15.92:0/3335353263 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f689406a0e0 msgr2=0x7f689406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:53.168 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.163+0000 7f68b8350700 1 --2- 172.21.15.92:0/3335353263 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f689406a0e0 0x7f689406c5a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f68b015f4c0 tx=0x7f68ac008040 comp rx=0 tx=0).stop 2023-08-26T09:25:53.168 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.163+0000 7f68b8350700 1 -- 172.21.15.92:0/3335353263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68b00ce590 msgr2=0x7f68b00ccc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:53.168 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.163+0000 7f68b8350700 1 --2- 172.21.15.92:0/3335353263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68b00ce590 0x7f68b00ccc20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f68a000b0e0 tx=0x7f68a0004750 comp rx=0 tx=0).stop 2023-08-26T09:25:53.169 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.163+0000 7f68b8350700 1 -- 172.21.15.92:0/3335353263 shutdown_connections 2023-08-26T09:25:53.169 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.163+0000 7f68b8350700 1 --2- 172.21.15.92:0/3335353263 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f689406a0e0 0x7f689406c5a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:53.169 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.163+0000 7f68b8350700 1 --2- 172.21.15.92:0/3335353263 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68b015d550 0x7f68b0159d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:53.169 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.163+0000 7f68b8350700 1 --2- 172.21.15.92:0/3335353263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68b00ce590 0x7f68b00ccc20 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:53.169 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.163+0000 7f68b8350700 1 --2- 172.21.15.92:0/3335353263 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f68b00d1c00 0x7f68b0156bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:53.170 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.163+0000 7f68b8350700 1 -- 172.21.15.92:0/3335353263 >> 172.21.15.92:0/3335353263 conn(0x7f68b00cfa90 msgr2=0x7f68b015fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:53.170 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.163+0000 7f68b8350700 1 -- 172.21.15.92:0/3335353263 shutdown_connections 2023-08-26T09:25:53.170 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.163+0000 7f68b8350700 1 -- 172.21.15.92:0/3335353263 wait complete. 2023-08-26T09:25:53.180 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-26T09:25:06.650431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-26T09:25:06.973382+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-26T09:25:11.584141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-26T09:25:12.814990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-26T09:25:53.181 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-26T09:25:53.305 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.300+0000 7f8d154a4700 1 Processor -- start 2023-08-26T09:25:53.306 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.300+0000 7f8d154a4700 1 -- start start 2023-08-26T09:25:53.313 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.301+0000 7f8d154a4700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f8d100af390 0x7f8d10070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:53.313 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.301+0000 7f8d154a4700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f8d10071260 0x7f8d1006a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:53.313 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.301+0000 7f8d154a4700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d100aee50 con 0x7f8d1015d220 2023-08-26T09:25:53.313 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.301+0000 7f8d154a4700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d100af130 con 0x7f8d10071260 2023-08-26T09:25:53.314 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.301+0000 7f8d154a4700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d100c4cb0 con 0x7f8d100af390 2023-08-26T09:25:53.314 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.301+0000 7f8d0f7fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f8d10071260 0x7f8d1006a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:53.314 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.301+0000 7f8d0f7fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f8d10071260 0x7f8d1006a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45872/0 (socket says 172.21.15.92:45872) 2023-08-26T09:25:53.314 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.301+0000 7f8d0effd700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f8d1015d220 0x7f8d1006db70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:57882/0 (socket says 172.21.15.92:57882) 2023-08-26T09:25:53.314 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.301+0000 7f8d0f7fe700 1 -- 172.21.15.92:0/1705618506 learned_addr learned my addr 172.21.15.92:0/1705618506 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:53.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.302+0000 7f8d0e7fc700 1 --2- 172.21.15.92:0/1705618506 >> v2:172.21.15.188:3300/0 conn(0x7f8d100af390 0x7f8d10070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:53.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.302+0000 7f8d0f7fe700 1 -- 172.21.15.92:0/1705618506 >> v2:172.21.15.188:3300/0 conn(0x7f8d100af390 msgr2=0x7f8d10070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:53.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.302+0000 7f8d0f7fe700 1 --2- 172.21.15.92:0/1705618506 >> v2:172.21.15.188:3300/0 conn(0x7f8d100af390 0x7f8d10070d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:53.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.302+0000 7f8d0f7fe700 1 -- 172.21.15.92:0/1705618506 >> v1:172.21.15.92:6789/0 conn(0x7f8d1015d220 legacy=0x7f8d1006db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:53.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.302+0000 7f8d0f7fe700 1 -- 172.21.15.92:0/1705618506 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d100c4f90 con 0x7f8d10071260 2023-08-26T09:25:53.316 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.302+0000 7f8d0dffb700 1 -- 172.21.15.92:0/1705618506 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1330168308 0 0) 0x7f8d100aee50 con 0x7f8d1015d220 2023-08-26T09:25:53.316 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.302+0000 7f8d0f7fe700 1 --2- 172.21.15.92:0/1705618506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d10071260 0x7f8d1006a320 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8d10072240 tx=0x7f8d0800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dff0936156f8f4e1 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:53.316 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.302+0000 7f8d0dffb700 1 -- 172.21.15.92:0/1705618506 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0800e070 con 0x7f8d10071260 2023-08-26T09:25:53.316 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.302+0000 7f8d0dffb700 1 -- 172.21.15.92:0/1705618506 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d0800b910 con 0x7f8d10071260 2023-08-26T09:25:53.317 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.302+0000 7f8d0dffb700 1 -- 172.21.15.92:0/1705618506 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0800bcc0 con 0x7f8d10071260 2023-08-26T09:25:53.317 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.303+0000 7f8d154a4700 1 -- 172.21.15.92:0/1705618506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d10071260 msgr2=0x7f8d1006a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:53.317 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.303+0000 7f8d154a4700 1 --2- 172.21.15.92:0/1705618506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d10071260 0x7f8d1006a320 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8d10072240 tx=0x7f8d0800b330 comp rx=0 tx=0).stop 2023-08-26T09:25:53.317 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.303+0000 7f8d154a4700 1 -- 172.21.15.92:0/1705618506 shutdown_connections 2023-08-26T09:25:53.318 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.303+0000 7f8d154a4700 1 --2- 172.21.15.92:0/1705618506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d10071260 0x7f8d1006a320 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:53.318 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.303+0000 7f8d154a4700 1 --2- 172.21.15.92:0/1705618506 >> v2:172.21.15.188:3300/0 conn(0x7f8d100af390 0x7f8d10070d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:53.318 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.303+0000 7f8d154a4700 1 -- 172.21.15.92:0/1705618506 >> 172.21.15.92:0/1705618506 conn(0x7f8d1006b430 msgr2=0x7f8d1006b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:53.318 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.303+0000 7f8d154a4700 1 -- 172.21.15.92:0/1705618506 shutdown_connections 2023-08-26T09:25:53.318 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.303+0000 7f8d154a4700 1 -- 172.21.15.92:0/1705618506 wait complete. 2023-08-26T09:25:53.319 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.304+0000 7f8d154a4700 1 Processor -- start 2023-08-26T09:25:53.319 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.304+0000 7f8d154a4700 1 -- start start 2023-08-26T09:25:53.319 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.305+0000 7f8d154a4700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8d10071260 0x7f8d100b5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:53.319 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.305+0000 7f8d154a4700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8d100af390 0x7f8d101f2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:53.319 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.305+0000 7f8d154a4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d1015d220 0x7f8d1015a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:53.320 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.305+0000 7f8d154a4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d101595a0 con 0x7f8d1015d220 2023-08-26T09:25:53.320 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.305+0000 7f8d154a4700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d10156ef0 con 0x7f8d100af390 2023-08-26T09:25:53.320 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.305+0000 7f8d154a4700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d100b5770 con 0x7f8d10071260 2023-08-26T09:25:53.320 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.305+0000 7f8d0f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d1015d220 0x7f8d1015a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:53.320 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.305+0000 7f8d0f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d1015d220 0x7f8d1015a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45878/0 (socket says 172.21.15.92:45878) 2023-08-26T09:25:53.321 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.305+0000 7f8d0f7fe700 1 -- 172.21.15.92:0/503175353 learned_addr learned my addr 172.21.15.92:0/503175353 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:53.321 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.305+0000 7f8d0f7fe700 1 -- 172.21.15.92:0/503175353 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8d10071260 msgr2=0x7f8d100b5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:53.321 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.305+0000 7f8d0e7fc700 1 --2- 172.21.15.92:0/503175353 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8d100af390 0x7f8d101f2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:53.321 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.305+0000 7f8d0effd700 1 --2- 172.21.15.92:0/503175353 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8d10071260 0x7f8d100b5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:53.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.305+0000 7f8d0f7fe700 1 --2- 172.21.15.92:0/503175353 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8d10071260 0x7f8d100b5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:53.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.305+0000 7f8d0f7fe700 1 -- 172.21.15.92:0/503175353 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8d100af390 msgr2=0x7f8d101f2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:53.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.305+0000 7f8d0f7fe700 1 --2- 172.21.15.92:0/503175353 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8d100af390 0x7f8d101f2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:53.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.305+0000 7f8d0f7fe700 1 -- 172.21.15.92:0/503175353 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d08009b30 con 0x7f8d1015d220 2023-08-26T09:25:53.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.305+0000 7f8d0f7fe700 1 --2- 172.21.15.92:0/503175353 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d1015d220 0x7f8d1015a910 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8d1006f8d0 tx=0x7f8d08004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:53.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.305+0000 7f8cf77fe700 1 -- 172.21.15.92:0/503175353 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d080099b0 con 0x7f8d1015d220 2023-08-26T09:25:53.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.306+0000 7f8cf77fe700 1 -- 172.21.15.92:0/503175353 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d080092e0 con 0x7f8d1015d220 2023-08-26T09:25:53.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.306+0000 7f8d154a4700 1 -- 172.21.15.92:0/503175353 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d1015e920 con 0x7f8d1015d220 2023-08-26T09:25:53.324 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.306+0000 7f8cf77fe700 1 -- 172.21.15.92:0/503175353 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0801c660 con 0x7f8d1015d220 2023-08-26T09:25:53.324 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.306+0000 7f8d154a4700 1 -- 172.21.15.92:0/503175353 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d1015eee0 con 0x7f8d1015d220 2023-08-26T09:25:53.324 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.307+0000 7f8d154a4700 1 -- 172.21.15.92:0/503175353 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d10066b50 con 0x7f8d1015d220 2023-08-26T09:25:53.324 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.307+0000 7f8cf77fe700 1 -- 172.21.15.92:0/503175353 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8d0801c7c0 con 0x7f8d1015d220 2023-08-26T09:25:53.325 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.307+0000 7f8cf77fe700 1 --2- 172.21.15.92:0/503175353 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f8cfc06a0e0 0x7f8cfc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:53.325 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.308+0000 7f8d0effd700 1 --2- 172.21.15.92:0/503175353 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f8cfc06a0e0 0x7f8cfc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:53.325 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.308+0000 7f8cf77fe700 1 -- 172.21.15.92:0/503175353 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8d08089f80 con 0x7f8d1015d220 2023-08-26T09:25:53.325 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.308+0000 7f8d0effd700 1 --2- 172.21.15.92:0/503175353 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f8cfc06a0e0 0x7f8cfc06c5a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8d04000f60 tx=0x7f8d04009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:53.326 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.312+0000 7f8cf77fe700 1 -- 172.21.15.92:0/503175353 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8d080bc990 con 0x7f8d1015d220 2023-08-26T09:25:53.508 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.503+0000 7f8d154a4700 1 -- 172.21.15.92:0/503175353 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8d1004eeb0 con 0x7f8d1015d220 2023-08-26T09:25:53.509 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.504+0000 7f8cf77fe700 1 -- 172.21.15.92:0/503175353 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8d08055820 con 0x7f8d1015d220 2023-08-26T09:25:53.509 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 8 2023-08-26T09:25:53.511 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.506+0000 7f8d154a4700 1 -- 172.21.15.92:0/503175353 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f8cfc06a0e0 msgr2=0x7f8cfc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:53.512 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.506+0000 7f8d154a4700 1 --2- 172.21.15.92:0/503175353 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f8cfc06a0e0 0x7f8cfc06c5a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8d04000f60 tx=0x7f8d04009040 comp rx=0 tx=0).stop 2023-08-26T09:25:53.512 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.506+0000 7f8d154a4700 1 -- 172.21.15.92:0/503175353 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d1015d220 msgr2=0x7f8d1015a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:53.512 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.506+0000 7f8d154a4700 1 --2- 172.21.15.92:0/503175353 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d1015d220 0x7f8d1015a910 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8d1006f8d0 tx=0x7f8d08004ad0 comp rx=0 tx=0).stop 2023-08-26T09:25:53.512 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.506+0000 7f8d154a4700 1 -- 172.21.15.92:0/503175353 shutdown_connections 2023-08-26T09:25:53.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.506+0000 7f8d154a4700 1 --2- 172.21.15.92:0/503175353 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d1015d220 0x7f8d1015a910 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:53.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.506+0000 7f8d154a4700 1 --2- 172.21.15.92:0/503175353 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8d10071260 0x7f8d100b5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:53.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.506+0000 7f8d154a4700 1 --2- 172.21.15.92:0/503175353 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f8cfc06a0e0 0x7f8cfc06c5a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:53.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.506+0000 7f8d154a4700 1 --2- 172.21.15.92:0/503175353 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8d100af390 0x7f8d101f2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:53.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.506+0000 7f8d154a4700 1 -- 172.21.15.92:0/503175353 >> 172.21.15.92:0/503175353 conn(0x7f8d1006b430 msgr2=0x7f8d10071a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:53.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.506+0000 7f8d154a4700 1 -- 172.21.15.92:0/503175353 shutdown_connections 2023-08-26T09:25:53.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.506+0000 7f8d154a4700 1 -- 172.21.15.92:0/503175353 wait complete. 2023-08-26T09:25:53.523 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-26T09:25:53.645 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.640+0000 7fb1a8a4f700 1 Processor -- start 2023-08-26T09:25:53.646 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.641+0000 7fb1a8a4f700 1 -- start start 2023-08-26T09:25:53.654 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.641+0000 7fb1a8a4f700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb1a40b28d0 0x7fb1a40b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:53.654 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.642+0000 7fb1a8a4f700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1a415e9b0 con 0x7fb1a40ce450 2023-08-26T09:25:53.654 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.642+0000 7fb1a8a4f700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1a41614a0 con 0x7fb1a415da10 2023-08-26T09:25:53.654 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.642+0000 7fb1a8a4f700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a40b31f0 con 0x7fb1a40b28d0 2023-08-26T09:25:53.655 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.642+0000 7fb1a1d9b700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fb1a40ce450 0x7fb1a4161930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:57898/0 (socket says 172.21.15.92:57898) 2023-08-26T09:25:53.655 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.642+0000 7fb1a1d9b700 1 -- 172.21.15.92:0/179261711 learned_addr learned my addr 172.21.15.92:0/179261711 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:53.655 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.642+0000 7fb1a259c700 1 --2- 172.21.15.92:0/179261711 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb1a40b28d0 0x7fb1a40b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:53.655 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.642+0000 7fb1a159a700 1 -- 172.21.15.92:0/179261711 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2709813085 0 0) 0x7fb1a415e9b0 con 0x7fb1a40ce450 2023-08-26T09:25:53.655 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.642+0000 7fb1a159a700 1 -- 172.21.15.92:0/179261711 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb18c0035b0 con 0x7fb1a40ce450 2023-08-26T09:25:53.656 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.642+0000 7fb1a159a700 1 -- 172.21.15.92:0/179261711 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 981213596 0 0) 0x7fb18c0035b0 con 0x7fb1a40ce450 2023-08-26T09:25:53.656 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.642+0000 7fb1a159a700 1 -- 172.21.15.92:0/179261711 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb1a40b28d0 msgr2=0x7fb1a40b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:53.656 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.642+0000 7fb1a159a700 1 --2- 172.21.15.92:0/179261711 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb1a40b28d0 0x7fb1a40b2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:53.656 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.642+0000 7fb1a159a700 1 -- 172.21.15.92:0/179261711 >> v1:172.21.15.188:6789/0 conn(0x7fb1a415da10 legacy=0x7fb1a415ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:53.656 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.642+0000 7fb1a159a700 1 -- 172.21.15.92:0/179261711 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a415e3f0 con 0x7fb1a40ce450 2023-08-26T09:25:53.657 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.642+0000 7fb1a159a700 1 -- 172.21.15.92:0/179261711 <== mon.0 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1019361464 0 0) 0x7fb194001670 con 0x7fb1a40ce450 2023-08-26T09:25:53.657 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.642+0000 7fb1a159a700 1 -- 172.21.15.92:0/179261711 >> v1:172.21.15.92:6789/0 conn(0x7fb1a40ce450 legacy=0x7fb1a4161930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:53.657 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.642+0000 7fb1a159a700 1 --2- 172.21.15.92:0/179261711 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb18c003a30 0x7fb18c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:53.657 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.642+0000 7fb1a159a700 1 --2- 172.21.15.92:0/179261711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb18c004390 0x7fb18c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:53.657 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.642+0000 7fb1a159a700 1 --2- 172.21.15.92:0/179261711 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb1a40b28d0 0x7fb18c005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:53.657 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.642+0000 7fb1a159a700 1 -- 172.21.15.92:0/179261711 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a40b31f0 con 0x7fb18c004390 2023-08-26T09:25:53.658 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.642+0000 7fb1a159a700 1 -- 172.21.15.92:0/179261711 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18c00ba40 con 0x7fb18c003a30 2023-08-26T09:25:53.658 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.642+0000 7fb1a159a700 1 -- 172.21.15.92:0/179261711 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb18c00bc00 con 0x7fb1a40b28d0 2023-08-26T09:25:53.658 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.642+0000 7fb1a1d9b700 1 --2- 172.21.15.92:0/179261711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb18c004390 0x7fb18c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:53.658 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.642+0000 7fb1a259c700 1 --2- 172.21.15.92:0/179261711 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb18c003a30 0x7fb18c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:53.658 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.643+0000 7fb1a2d9d700 1 --2- 172.21.15.92:0/179261711 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb1a40b28d0 0x7fb18c005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:53.659 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.643+0000 7fb1a1d9b700 1 -- 172.21.15.92:0/179261711 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb1a40b28d0 msgr2=0x7fb18c005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:53.659 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.643+0000 7fb1a1d9b700 1 --2- 172.21.15.92:0/179261711 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb1a40b28d0 0x7fb18c005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:53.659 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.643+0000 7fb1a1d9b700 1 -- 172.21.15.92:0/179261711 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb18c003a30 msgr2=0x7fb18c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:53.659 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.643+0000 7fb1a1d9b700 1 --2- 172.21.15.92:0/179261711 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb18c003a30 0x7fb18c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:53.659 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.643+0000 7fb1a1d9b700 1 -- 172.21.15.92:0/179261711 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb18c0035b0 con 0x7fb18c004390 2023-08-26T09:25:53.660 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.643+0000 7fb1a1d9b700 1 --2- 172.21.15.92:0/179261711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb18c004390 0x7fb18c004850 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb1a40ce870 tx=0x7fb18c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1fbda345378b46f server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:53.660 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.643+0000 7fb1a159a700 1 -- 172.21.15.92:0/179261711 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb194005b60 con 0x7fb18c004390 2023-08-26T09:25:53.660 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.643+0000 7fb1a159a700 1 -- 172.21.15.92:0/179261711 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb194005cc0 con 0x7fb18c004390 2023-08-26T09:25:53.660 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.643+0000 7fb1a159a700 1 -- 172.21.15.92:0/179261711 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1940082e0 con 0x7fb18c004390 2023-08-26T09:25:53.660 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.643+0000 7fb1a8a4f700 1 -- 172.21.15.92:0/179261711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb18c004390 msgr2=0x7fb18c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:53.661 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.643+0000 7fb1a8a4f700 1 --2- 172.21.15.92:0/179261711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb18c004390 0x7fb18c004850 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb1a40ce870 tx=0x7fb18c005880 comp rx=0 tx=0).stop 2023-08-26T09:25:53.661 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.643+0000 7fb1a2d9d700 1 -- 172.21.15.92:0/179261711 reap_dead start 2023-08-26T09:25:53.661 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.644+0000 7fb1a8a4f700 1 -- 172.21.15.92:0/179261711 shutdown_connections 2023-08-26T09:25:53.661 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.644+0000 7fb1a8a4f700 1 -- 172.21.15.92:0/179261711 >> 172.21.15.92:0/179261711 conn(0x7fb1a40cd8d0 msgr2=0x7fb1a40cdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:53.661 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.644+0000 7fb1a8a4f700 1 -- 172.21.15.92:0/179261711 shutdown_connections 2023-08-26T09:25:53.661 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.644+0000 7fb1a8a4f700 1 -- 172.21.15.92:0/179261711 wait complete. 2023-08-26T09:25:53.662 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.645+0000 7fb1a8a4f700 1 Processor -- start 2023-08-26T09:25:53.662 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.645+0000 7fb1a8a4f700 1 -- start start 2023-08-26T09:25:53.662 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.646+0000 7fb1a8a4f700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb18c004390 0x7fb1a4157670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:53.662 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.646+0000 7fb1a8a4f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1a41f5fe0 0x7fb1a41f6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:53.662 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.646+0000 7fb1a8a4f700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb1a40c9810 0x7fb1a40c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:53.663 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.646+0000 7fb1a8a4f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a41f69a0 con 0x7fb1a41f5fe0 2023-08-26T09:25:53.663 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.646+0000 7fb1a8a4f700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a40ca1d0 con 0x7fb1a40c9810 2023-08-26T09:25:53.663 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.646+0000 7fb1a8a4f700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a40cafc0 con 0x7fb18c004390 2023-08-26T09:25:53.663 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.646+0000 7fb1a1d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1a41f5fe0 0x7fb1a41f6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:53.663 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.646+0000 7fb1a1d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1a41f5fe0 0x7fb1a41f6460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45896/0 (socket says 172.21.15.92:45896) 2023-08-26T09:25:53.664 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.646+0000 7fb1a1d9b700 1 -- 172.21.15.92:0/733010723 learned_addr learned my addr 172.21.15.92:0/733010723 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:53.664 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.646+0000 7fb1a259c700 1 --2- 172.21.15.92:0/733010723 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb18c004390 0x7fb1a4157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:53.664 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.646+0000 7fb1a2d9d700 1 --2- 172.21.15.92:0/733010723 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb1a40c9810 0x7fb1a40c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:53.664 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.646+0000 7fb1a1d9b700 1 -- 172.21.15.92:0/733010723 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb18c004390 msgr2=0x7fb1a4157670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:53.664 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.646+0000 7fb1a1d9b700 1 --2- 172.21.15.92:0/733010723 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb18c004390 0x7fb1a4157670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:53.664 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.646+0000 7fb1a1d9b700 1 -- 172.21.15.92:0/733010723 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb1a40c9810 msgr2=0x7fb1a40c9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:53.665 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.646+0000 7fb1a1d9b700 1 --2- 172.21.15.92:0/733010723 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb1a40c9810 0x7fb1a40c9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:53.665 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.646+0000 7fb1a1d9b700 1 -- 172.21.15.92:0/733010723 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a4157bb0 con 0x7fb1a41f5fe0 2023-08-26T09:25:53.665 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.646+0000 7fb1a259c700 1 --2- 172.21.15.92:0/733010723 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb18c004390 0x7fb1a4157670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:53.665 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.646+0000 7fb1a2d9d700 1 --2- 172.21.15.92:0/733010723 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb1a40c9810 0x7fb1a40c9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:53.665 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.646+0000 7fb1a1d9b700 1 --2- 172.21.15.92:0/733010723 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1a41f5fe0 0x7fb1a41f6460 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb194000c00 tx=0x7fb194004a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:53.666 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.646+0000 7fb192ffd700 1 -- 172.21.15.92:0/733010723 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb194001080 con 0x7fb1a41f5fe0 2023-08-26T09:25:53.666 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.646+0000 7fb192ffd700 1 -- 172.21.15.92:0/733010723 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb194005e30 con 0x7fb1a41f5fe0 2023-08-26T09:25:53.666 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.646+0000 7fb1a8a4f700 1 -- 172.21.15.92:0/733010723 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1a40ca440 con 0x7fb1a41f5fe0 2023-08-26T09:25:53.666 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.646+0000 7fb192ffd700 1 -- 172.21.15.92:0/733010723 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb194008320 con 0x7fb1a41f5fe0 2023-08-26T09:25:53.666 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.647+0000 7fb1a8a4f700 1 -- 172.21.15.92:0/733010723 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1a40caa00 con 0x7fb1a41f5fe0 2023-08-26T09:25:53.666 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.648+0000 7fb1a8a4f700 1 -- 172.21.15.92:0/733010723 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1a404eeb0 con 0x7fb1a41f5fe0 2023-08-26T09:25:53.667 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.648+0000 7fb192ffd700 1 -- 172.21.15.92:0/733010723 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb194008480 con 0x7fb1a41f5fe0 2023-08-26T09:25:53.667 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.648+0000 7fb192ffd700 1 --2- 172.21.15.92:0/733010723 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb18406a0e0 0x7fb18406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:53.667 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.648+0000 7fb192ffd700 1 -- 172.21.15.92:0/733010723 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb1940894a0 con 0x7fb1a41f5fe0 2023-08-26T09:25:53.667 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.648+0000 7fb1a259c700 1 --2- 172.21.15.92:0/733010723 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb18406a0e0 0x7fb18406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:53.667 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.649+0000 7fb1a259c700 1 --2- 172.21.15.92:0/733010723 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb18406a0e0 0x7fb18406c5a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb198009c60 tx=0x7fb198008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:53.668 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.653+0000 7fb192ffd700 1 -- 172.21.15.92:0/733010723 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb194054c20 con 0x7fb1a41f5fe0 2023-08-26T09:25:53.846 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.841+0000 7fb1a8a4f700 1 -- 172.21.15.92:0/733010723 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb1a40b37f0 con 0x7fb1a41f5fe0 2023-08-26T09:25:53.846 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.841+0000 7fb192ffd700 1 -- 172.21.15.92:0/733010723 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb194058240 con 0x7fb1a41f5fe0 2023-08-26T09:25:53.847 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 1 2023-08-26T09:25:53.848 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.843+0000 7fb1a8a4f700 1 -- 172.21.15.92:0/733010723 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb18406a0e0 msgr2=0x7fb18406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:53.848 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.843+0000 7fb1a8a4f700 1 --2- 172.21.15.92:0/733010723 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb18406a0e0 0x7fb18406c5a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb198009c60 tx=0x7fb198008040 comp rx=0 tx=0).stop 2023-08-26T09:25:53.849 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.843+0000 7fb1a8a4f700 1 -- 172.21.15.92:0/733010723 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1a41f5fe0 msgr2=0x7fb1a41f6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:53.849 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.843+0000 7fb1a8a4f700 1 --2- 172.21.15.92:0/733010723 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1a41f5fe0 0x7fb1a41f6460 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb194000c00 tx=0x7fb194004a90 comp rx=0 tx=0).stop 2023-08-26T09:25:53.849 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.843+0000 7fb1a8a4f700 1 -- 172.21.15.92:0/733010723 shutdown_connections 2023-08-26T09:25:53.849 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.843+0000 7fb1a8a4f700 1 --2- 172.21.15.92:0/733010723 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb18406a0e0 0x7fb18406c5a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:53.849 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.843+0000 7fb1a8a4f700 1 --2- 172.21.15.92:0/733010723 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb1a40c9810 0x7fb1a40c9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:53.850 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.843+0000 7fb1a8a4f700 1 --2- 172.21.15.92:0/733010723 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb18c004390 0x7fb1a4157670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:53.850 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.843+0000 7fb1a8a4f700 1 --2- 172.21.15.92:0/733010723 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1a41f5fe0 0x7fb1a41f6460 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:53.850 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.843+0000 7fb1a8a4f700 1 -- 172.21.15.92:0/733010723 >> 172.21.15.92:0/733010723 conn(0x7fb1a40cd8d0 msgr2=0x7fb1a40cf610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:53.850 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.843+0000 7fb1a8a4f700 1 -- 172.21.15.92:0/733010723 shutdown_connections 2023-08-26T09:25:53.850 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.843+0000 7fb1a8a4f700 1 -- 172.21.15.92:0/733010723 wait complete. 2023-08-26T09:25:53.860 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-26T09:25:53.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.979+0000 7faa5fd78700 1 Processor -- start 2023-08-26T09:25:53.985 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.980+0000 7faa5fd78700 1 -- start start 2023-08-26T09:25:53.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.980+0000 7faa5fd78700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7faa5815d220 0x7faa580af390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:53.989 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.980+0000 7faa5fd78700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa580aee50 con 0x7faa5806db70 2023-08-26T09:25:53.989 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.980+0000 7faa5fd78700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa580af130 con 0x7faa58071430 2023-08-26T09:25:53.989 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.980+0000 7faa5fd78700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa580c4cb0 con 0x7faa5815d220 2023-08-26T09:25:53.989 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.981+0000 7faa5d313700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7faa5806db70 0x7faa58070d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:57916/0 (socket says 172.21.15.92:57916) 2023-08-26T09:25:53.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.981+0000 7faa5d313700 1 -- 172.21.15.92:0/4236837627 learned_addr learned my addr 172.21.15.92:0/4236837627 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:53.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.981+0000 7faa5db14700 1 --2- 172.21.15.92:0/4236837627 >> v2:172.21.15.188:3300/0 conn(0x7faa5815d220 0x7faa580af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:53.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.981+0000 7faa5cb12700 1 -- 172.21.15.92:0/4236837627 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 900801371 0 0) 0x7faa580aee50 con 0x7faa5806db70 2023-08-26T09:25:53.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.981+0000 7faa5cb12700 1 -- 172.21.15.92:0/4236837627 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa440035b0 con 0x7faa5806db70 2023-08-26T09:25:53.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.981+0000 7faa5cb12700 1 -- 172.21.15.92:0/4236837627 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2600103350 0 0) 0x7faa440035b0 con 0x7faa5806db70 2023-08-26T09:25:53.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.981+0000 7faa5cb12700 1 -- 172.21.15.92:0/4236837627 >> v2:172.21.15.188:3300/0 conn(0x7faa5815d220 msgr2=0x7faa580af390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:53.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.981+0000 7faa5cb12700 1 --2- 172.21.15.92:0/4236837627 >> v2:172.21.15.188:3300/0 conn(0x7faa5815d220 0x7faa580af390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:53.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.981+0000 7faa5cb12700 1 -- 172.21.15.92:0/4236837627 >> v1:172.21.15.188:6789/0 conn(0x7faa58071430 legacy=0x7faa5806a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:53.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.981+0000 7faa5cb12700 1 -- 172.21.15.92:0/4236837627 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa580c4f90 con 0x7faa5806db70 2023-08-26T09:25:53.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.981+0000 7faa5cb12700 1 -- 172.21.15.92:0/4236837627 <== mon.0 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1019361464 0 0) 0x7faa54001670 con 0x7faa5806db70 2023-08-26T09:25:53.992 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.981+0000 7faa5cb12700 1 -- 172.21.15.92:0/4236837627 >> v1:172.21.15.92:6789/0 conn(0x7faa5806db70 legacy=0x7faa58070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:53.992 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.981+0000 7faa5cb12700 1 --2- 172.21.15.92:0/4236837627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa44003a00 0x7faa44003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:53.992 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.981+0000 7faa5cb12700 1 --2- 172.21.15.92:0/4236837627 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faa44004850 0x7faa44004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:53.992 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.981+0000 7faa5cb12700 1 --2- 172.21.15.92:0/4236837627 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faa44005210 0x7faa4400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:53.992 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.981+0000 7faa5cb12700 1 -- 172.21.15.92:0/4236837627 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa580c4cb0 con 0x7faa44003a00 2023-08-26T09:25:53.993 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.981+0000 7faa5cb12700 1 -- 172.21.15.92:0/4236837627 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4400c0b0 con 0x7faa44004850 2023-08-26T09:25:53.993 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.981+0000 7faa5cb12700 1 -- 172.21.15.92:0/4236837627 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa4400c270 con 0x7faa44005210 2023-08-26T09:25:53.993 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.981+0000 7faa5db14700 1 --2- 172.21.15.92:0/4236837627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa44003a00 0x7faa44003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:53.993 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.981+0000 7faa5d313700 1 --2- 172.21.15.92:0/4236837627 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faa44004850 0x7faa44004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:53.993 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.981+0000 7faa5e315700 1 --2- 172.21.15.92:0/4236837627 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faa44005210 0x7faa4400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:53.994 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.982+0000 7faa5db14700 1 -- 172.21.15.92:0/4236837627 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faa44005210 msgr2=0x7faa4400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:53.994 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.982+0000 7faa5db14700 1 --2- 172.21.15.92:0/4236837627 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faa44005210 0x7faa4400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:53.994 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.982+0000 7faa5db14700 1 -- 172.21.15.92:0/4236837627 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faa44004850 msgr2=0x7faa44004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:53.994 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.982+0000 7faa5db14700 1 --2- 172.21.15.92:0/4236837627 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faa44004850 0x7faa44004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:53.994 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.982+0000 7faa5db14700 1 -- 172.21.15.92:0/4236837627 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa440035b0 con 0x7faa44003a00 2023-08-26T09:25:53.995 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.982+0000 7faa5e315700 1 --2- 172.21.15.92:0/4236837627 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faa44005210 0x7faa4400ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:53.995 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.982+0000 7faa5e315700 1 -- 172.21.15.92:0/4236837627 reap_dead start 2023-08-26T09:25:53.995 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.982+0000 7faa5db14700 1 --2- 172.21.15.92:0/4236837627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa44003a00 0x7faa44003e20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7faa48009b60 tx=0x7faa44005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2feecd840e32a89f server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:53.995 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.982+0000 7faa5cb12700 1 -- 172.21.15.92:0/4236837627 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4800e6c0 con 0x7faa44003a00 2023-08-26T09:25:53.995 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.982+0000 7faa5cb12700 1 -- 172.21.15.92:0/4236837627 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa4800e820 con 0x7faa44003a00 2023-08-26T09:25:53.996 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.982+0000 7faa5cb12700 1 -- 172.21.15.92:0/4236837627 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4800eb90 con 0x7faa44003a00 2023-08-26T09:25:53.996 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.982+0000 7faa5fd78700 1 -- 172.21.15.92:0/4236837627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa44003a00 msgr2=0x7faa44003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:53.996 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.982+0000 7faa5fd78700 1 --2- 172.21.15.92:0/4236837627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa44003a00 0x7faa44003e20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7faa48009b60 tx=0x7faa44005880 comp rx=0 tx=0).stop 2023-08-26T09:25:53.996 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.982+0000 7faa5fd78700 1 -- 172.21.15.92:0/4236837627 shutdown_connections 2023-08-26T09:25:53.996 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.982+0000 7faa5fd78700 1 --2- 172.21.15.92:0/4236837627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa44003a00 0x7faa44003e20 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:53.997 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.982+0000 7faa5fd78700 1 -- 172.21.15.92:0/4236837627 >> 172.21.15.92:0/4236837627 conn(0x7faa5806b430 msgr2=0x7faa5806b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:53.997 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.983+0000 7faa5fd78700 1 -- 172.21.15.92:0/4236837627 shutdown_connections 2023-08-26T09:25:53.997 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.983+0000 7faa5fd78700 1 -- 172.21.15.92:0/4236837627 wait complete. 2023-08-26T09:25:53.997 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.984+0000 7faa5fd78700 1 Processor -- start 2023-08-26T09:25:53.997 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.984+0000 7faa5fd78700 1 -- start start 2023-08-26T09:25:54.000 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.984+0000 7faa5fd78700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa44003a00 0x7faa5815be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:54.000 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.984+0000 7faa5fd78700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faa580add60 0x7faa581f6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:54.000 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.984+0000 7faa5fd78700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faa581f6ec0 0x7faa58152e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:54.000 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.985+0000 7faa5fd78700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa581580c0 con 0x7faa44003a00 2023-08-26T09:25:54.001 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.985+0000 7faa5fd78700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa581f64f0 con 0x7faa580add60 2023-08-26T09:25:54.001 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.985+0000 7faa5fd78700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa5814f1d0 con 0x7faa581f6ec0 2023-08-26T09:25:54.001 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.985+0000 7faa5db14700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa44003a00 0x7faa5815be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:54.001 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.985+0000 7faa5db14700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa44003a00 0x7faa5815be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45914/0 (socket says 172.21.15.92:45914) 2023-08-26T09:25:54.001 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.985+0000 7faa5db14700 1 -- 172.21.15.92:0/2464645201 learned_addr learned my addr 172.21.15.92:0/2464645201 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:54.002 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.985+0000 7faa5d313700 1 --2- 172.21.15.92:0/2464645201 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faa580add60 0x7faa581f6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:54.002 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.985+0000 7faa5e315700 1 --2- 172.21.15.92:0/2464645201 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faa581f6ec0 0x7faa58152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:54.002 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.985+0000 7faa5db14700 1 -- 172.21.15.92:0/2464645201 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faa581f6ec0 msgr2=0x7faa58152e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:54.002 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.985+0000 7faa5db14700 1 --2- 172.21.15.92:0/2464645201 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faa581f6ec0 0x7faa58152e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:54.002 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.985+0000 7faa5db14700 1 -- 172.21.15.92:0/2464645201 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faa580add60 msgr2=0x7faa581f6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:54.003 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.985+0000 7faa5db14700 1 --2- 172.21.15.92:0/2464645201 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faa580add60 0x7faa581f6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:54.003 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.985+0000 7faa5db14700 1 -- 172.21.15.92:0/2464645201 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa5814f4b0 con 0x7faa44003a00 2023-08-26T09:25:54.003 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.985+0000 7faa5e315700 1 --2- 172.21.15.92:0/2464645201 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faa581f6ec0 0x7faa58152e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:54.003 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.985+0000 7faa5d313700 1 --2- 172.21.15.92:0/2464645201 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faa580add60 0x7faa581f6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:54.003 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.985+0000 7faa5db14700 1 --2- 172.21.15.92:0/2464645201 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa44003a00 0x7faa5815be80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7faa4400c080 tx=0x7faa480047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:54.003 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.985+0000 7faa4e7fc700 1 -- 172.21.15.92:0/2464645201 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4800e6c0 con 0x7faa44003a00 2023-08-26T09:25:54.004 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.985+0000 7faa4e7fc700 1 -- 172.21.15.92:0/2464645201 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa48003ad0 con 0x7faa44003a00 2023-08-26T09:25:54.004 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.985+0000 7faa5fd78700 1 -- 172.21.15.92:0/2464645201 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa5814f790 con 0x7faa44003a00 2023-08-26T09:25:54.004 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.985+0000 7faa4e7fc700 1 -- 172.21.15.92:0/2464645201 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa48003e80 con 0x7faa44003a00 2023-08-26T09:25:54.004 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.985+0000 7faa5fd78700 1 -- 172.21.15.92:0/2464645201 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa5814ee60 con 0x7faa44003a00 2023-08-26T09:25:54.004 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.986+0000 7faa5fd78700 1 -- 172.21.15.92:0/2464645201 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa5804eeb0 con 0x7faa44003a00 2023-08-26T09:25:54.005 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.987+0000 7faa4e7fc700 1 -- 172.21.15.92:0/2464645201 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7faa48013470 con 0x7faa44003a00 2023-08-26T09:25:54.005 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.987+0000 7faa4e7fc700 1 --2- 172.21.15.92:0/2464645201 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7faa3c06a0e0 0x7faa3c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:54.005 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.987+0000 7faa5d313700 1 --2- 172.21.15.92:0/2464645201 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7faa3c06a0e0 0x7faa3c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:54.005 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.987+0000 7faa4e7fc700 1 -- 172.21.15.92:0/2464645201 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faa48089e00 con 0x7faa44003a00 2023-08-26T09:25:54.005 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.987+0000 7faa5d313700 1 --2- 172.21.15.92:0/2464645201 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7faa3c06a0e0 0x7faa3c06c5a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7faa580b0ad0 tx=0x7faa54009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:54.006 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:53.992+0000 7faa4e7fc700 1 -- 172.21.15.92:0/2464645201 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7faa480556a0 con 0x7faa44003a00 2023-08-26T09:25:54.184 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.179+0000 7faa5fd78700 1 -- 172.21.15.92:0/2464645201 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faa581580c0 con 0x7faa44003a00 2023-08-26T09:25:54.185 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.180+0000 7faa4e7fc700 1 -- 172.21.15.92:0/2464645201 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7faa480170a0 con 0x7faa44003a00 2023-08-26T09:25:54.185 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 32 2023-08-26T09:25:54.188 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.182+0000 7faa5fd78700 1 -- 172.21.15.92:0/2464645201 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7faa3c06a0e0 msgr2=0x7faa3c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:54.189 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.182+0000 7faa5fd78700 1 --2- 172.21.15.92:0/2464645201 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7faa3c06a0e0 0x7faa3c06c5a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7faa580b0ad0 tx=0x7faa54009040 comp rx=0 tx=0).stop 2023-08-26T09:25:54.189 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.182+0000 7faa5fd78700 1 -- 172.21.15.92:0/2464645201 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa44003a00 msgr2=0x7faa5815be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:54.189 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.182+0000 7faa5fd78700 1 --2- 172.21.15.92:0/2464645201 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa44003a00 0x7faa5815be80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7faa4400c080 tx=0x7faa480047c0 comp rx=0 tx=0).stop 2023-08-26T09:25:54.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.182+0000 7faa5fd78700 1 -- 172.21.15.92:0/2464645201 shutdown_connections 2023-08-26T09:25:54.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.182+0000 7faa5fd78700 1 --2- 172.21.15.92:0/2464645201 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faa581f6ec0 0x7faa58152e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:54.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.182+0000 7faa5fd78700 1 --2- 172.21.15.92:0/2464645201 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa44003a00 0x7faa5815be80 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:54.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.182+0000 7faa5fd78700 1 --2- 172.21.15.92:0/2464645201 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7faa3c06a0e0 0x7faa3c06c5a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:54.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.182+0000 7faa5fd78700 1 --2- 172.21.15.92:0/2464645201 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faa580add60 0x7faa581f6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:54.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.182+0000 7faa5fd78700 1 -- 172.21.15.92:0/2464645201 >> 172.21.15.92:0/2464645201 conn(0x7faa5806b430 msgr2=0x7faa580b10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:54.192 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.182+0000 7faa5fd78700 1 -- 172.21.15.92:0/2464645201 shutdown_connections 2023-08-26T09:25:54.192 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.182+0000 7faa5fd78700 1 -- 172.21.15.92:0/2464645201 wait complete. 2023-08-26T09:25:54.199 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-26T09:25:54.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.318+0000 7f9bb9209700 1 Processor -- start 2023-08-26T09:25:54.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.318+0000 7f9bb9209700 1 -- start start 2023-08-26T09:25:54.325 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.319+0000 7f9bb9209700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f9bb40ce150 0x7f9bb40ceb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:54.326 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.319+0000 7f9bb9209700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f9bb40c9aa0 0x7f9bb40c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:54.326 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.319+0000 7f9bb9209700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bb40cd3b0 con 0x7f9bb415def0 2023-08-26T09:25:54.326 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.319+0000 7f9bb9209700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bb40ca470 con 0x7f9bb40ce150 2023-08-26T09:25:54.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.319+0000 7f9bb9209700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bb40cd690 con 0x7f9bb40c9aa0 2023-08-26T09:25:54.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.319+0000 7f9bb259c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f9bb40ce150 0x7f9bb40ceb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:54.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.319+0000 7f9bb2d9d700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f9bb415def0 0x7f9bb415e2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:57934/0 (socket says 172.21.15.92:57934) 2023-08-26T09:25:54.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.319+0000 7f9bb2d9d700 1 -- 172.21.15.92:0/2602251441 learned_addr learned my addr 172.21.15.92:0/2602251441 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:54.328 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.319+0000 7f9bb259c700 1 -- 172.21.15.92:0/2602251441 >> v2:172.21.15.188:3300/0 conn(0x7f9bb40c9aa0 msgr2=0x7f9bb40c9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:54.328 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.319+0000 7f9bb259c700 1 --2- 172.21.15.92:0/2602251441 >> v2:172.21.15.188:3300/0 conn(0x7f9bb40c9aa0 0x7f9bb40c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:54.328 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.319+0000 7f9bb259c700 1 -- 172.21.15.92:0/2602251441 >> v1:172.21.15.92:6789/0 conn(0x7f9bb415def0 legacy=0x7f9bb415e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:54.329 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.319+0000 7f9bb1d9b700 1 -- 172.21.15.92:0/2602251441 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4127067501 0 0) 0x7f9bb40cd3b0 con 0x7f9bb415def0 2023-08-26T09:25:54.329 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.319+0000 7f9bb259c700 1 -- 172.21.15.92:0/2602251441 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb40cd970 con 0x7f9bb40ce150 2023-08-26T09:25:54.329 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.319+0000 7f9bb259c700 1 --2- 172.21.15.92:0/2602251441 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9bb40ce150 0x7f9bb40ceb80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8009840 tx=0x7f9ba8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d51d40fb12b8a4a5 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:54.329 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.319+0000 7f9bb1d9b700 1 -- 172.21.15.92:0/2602251441 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba8011830 con 0x7f9bb40ce150 2023-08-26T09:25:54.330 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.319+0000 7f9bb1d9b700 1 -- 172.21.15.92:0/2602251441 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba8011990 con 0x7f9bb40ce150 2023-08-26T09:25:54.330 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.319+0000 7f9bb1d9b700 1 -- 172.21.15.92:0/2602251441 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba8011d20 con 0x7f9bb40ce150 2023-08-26T09:25:54.330 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.320+0000 7f9bb9209700 1 -- 172.21.15.92:0/2602251441 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9bb40ce150 msgr2=0x7f9bb40ceb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:54.330 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.320+0000 7f9bb9209700 1 --2- 172.21.15.92:0/2602251441 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9bb40ce150 0x7f9bb40ceb80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8009840 tx=0x7f9ba8009b50 comp rx=0 tx=0).stop 2023-08-26T09:25:54.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.320+0000 7f9bb9209700 1 -- 172.21.15.92:0/2602251441 shutdown_connections 2023-08-26T09:25:54.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.320+0000 7f9bb9209700 1 --2- 172.21.15.92:0/2602251441 >> v2:172.21.15.188:3300/0 conn(0x7f9bb40c9aa0 0x7f9bb40c9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:54.332 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.320+0000 7f9bb9209700 1 --2- 172.21.15.92:0/2602251441 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9bb40ce150 0x7f9bb40ceb80 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:54.332 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.320+0000 7f9bb9209700 1 -- 172.21.15.92:0/2602251441 >> 172.21.15.92:0/2602251441 conn(0x7f9bb40cf450 msgr2=0x7f9bb40cf860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:54.332 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.320+0000 7f9bb9209700 1 -- 172.21.15.92:0/2602251441 shutdown_connections 2023-08-26T09:25:54.333 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.320+0000 7f9bb9209700 1 -- 172.21.15.92:0/2602251441 wait complete. 2023-08-26T09:25:54.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.322+0000 7f9bb9209700 1 Processor -- start 2023-08-26T09:25:54.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.322+0000 7f9bb9209700 1 -- start start 2023-08-26T09:25:54.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.323+0000 7f9bb9209700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9bb40c9aa0 0x7f9bb415ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:54.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.323+0000 7f9bb9209700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9bb415def0 0x7f9bb4154340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:54.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.323+0000 7f9bb9209700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9bb415d110 0x7f9bb40c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:54.340 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.323+0000 7f9bb9209700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb415c070 con 0x7f9bb415d110 2023-08-26T09:25:54.340 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.323+0000 7f9bb9209700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb415c350 con 0x7f9bb415def0 2023-08-26T09:25:54.340 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.323+0000 7f9bb9209700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb415c630 con 0x7f9bb40c9aa0 2023-08-26T09:25:54.341 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.323+0000 7f9bb359e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9bb415d110 0x7f9bb40c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:54.341 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.323+0000 7f9bb359e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9bb415d110 0x7f9bb40c8d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45930/0 (socket says 172.21.15.92:45930) 2023-08-26T09:25:54.341 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.323+0000 7f9bb359e700 1 -- 172.21.15.92:0/2752854798 learned_addr learned my addr 172.21.15.92:0/2752854798 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:54.341 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.323+0000 7f9bb2d9d700 1 --2- 172.21.15.92:0/2752854798 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9bb40c9aa0 0x7f9bb415ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:54.342 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.323+0000 7f9bb259c700 1 --2- 172.21.15.92:0/2752854798 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9bb415def0 0x7f9bb4154340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:54.342 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.323+0000 7f9bb359e700 1 -- 172.21.15.92:0/2752854798 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9bb40c9aa0 msgr2=0x7f9bb415ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:54.342 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.323+0000 7f9bb359e700 1 --2- 172.21.15.92:0/2752854798 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9bb40c9aa0 0x7f9bb415ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:54.342 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.323+0000 7f9bb359e700 1 -- 172.21.15.92:0/2752854798 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9bb415def0 msgr2=0x7f9bb4154340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:54.343 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.323+0000 7f9bb359e700 1 --2- 172.21.15.92:0/2752854798 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9bb415def0 0x7f9bb4154340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:54.343 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.323+0000 7f9bb359e700 1 -- 172.21.15.92:0/2752854798 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba80094a0 con 0x7f9bb415d110 2023-08-26T09:25:54.343 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.323+0000 7f9bb2d9d700 1 --2- 172.21.15.92:0/2752854798 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9bb40c9aa0 0x7f9bb415ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:25:54.343 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.323+0000 7f9bb359e700 1 --2- 172.21.15.92:0/2752854798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9bb415d110 0x7f9bb40c8d30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9bac00b970 tx=0x7f9bac00bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:54.344 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.323+0000 7f9b9b7fe700 1 -- 172.21.15.92:0/2752854798 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac00c9b0 con 0x7f9bb415d110 2023-08-26T09:25:54.344 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.323+0000 7f9b9b7fe700 1 -- 172.21.15.92:0/2752854798 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bac00cb30 con 0x7f9bb415d110 2023-08-26T09:25:54.344 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.323+0000 7f9bb9209700 1 -- 172.21.15.92:0/2752854798 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bb415c910 con 0x7f9bb415d110 2023-08-26T09:25:54.344 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.323+0000 7f9b9b7fe700 1 -- 172.21.15.92:0/2752854798 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac014440 con 0x7f9bb415d110 2023-08-26T09:25:54.345 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.323+0000 7f9bb9209700 1 -- 172.21.15.92:0/2752854798 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bb40c9270 con 0x7f9bb415d110 2023-08-26T09:25:54.345 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.324+0000 7f9bb9209700 1 -- 172.21.15.92:0/2752854798 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bb415ce30 con 0x7f9bb415d110 2023-08-26T09:25:54.345 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.325+0000 7f9b9b7fe700 1 -- 172.21.15.92:0/2752854798 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9bac01d3b0 con 0x7f9bb415d110 2023-08-26T09:25:54.345 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.325+0000 7f9b9b7fe700 1 --2- 172.21.15.92:0/2752854798 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f9ba006a0e0 0x7f9ba006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:54.346 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.325+0000 7f9b9b7fe700 1 -- 172.21.15.92:0/2752854798 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9bac006e40 con 0x7f9bb415d110 2023-08-26T09:25:54.346 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.325+0000 7f9bb2d9d700 1 --2- 172.21.15.92:0/2752854798 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f9ba006a0e0 0x7f9ba006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:54.346 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.326+0000 7f9bb2d9d700 1 --2- 172.21.15.92:0/2752854798 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f9ba006a0e0 0x7f9ba006c5a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9ba4000f60 tx=0x7f9ba4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:54.346 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.330+0000 7f9b9b7fe700 1 -- 172.21.15.92:0/2752854798 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9bb415ce30 con 0x7f9bb415d110 2023-08-26T09:25:54.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.522+0000 7f9bb9209700 1 -- 172.21.15.92:0/2752854798 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9bb415ce30 con 0x7f9bb415d110 2023-08-26T09:25:54.528 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.522+0000 7f9b9b7fe700 1 -- 172.21.15.92:0/2752854798 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9bb415ce30 con 0x7f9bb415d110 2023-08-26T09:25:54.528 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 64 2023-08-26T09:25:54.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.524+0000 7f9bb9209700 1 -- 172.21.15.92:0/2752854798 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f9ba006a0e0 msgr2=0x7f9ba006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:54.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.524+0000 7f9bb9209700 1 --2- 172.21.15.92:0/2752854798 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f9ba006a0e0 0x7f9ba006c5a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9ba4000f60 tx=0x7f9ba4009040 comp rx=0 tx=0).stop 2023-08-26T09:25:54.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.524+0000 7f9bb9209700 1 -- 172.21.15.92:0/2752854798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9bb415d110 msgr2=0x7f9bb40c8d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:54.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.524+0000 7f9bb9209700 1 --2- 172.21.15.92:0/2752854798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9bb415d110 0x7f9bb40c8d30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9bac00b970 tx=0x7f9bac00bd30 comp rx=0 tx=0).stop 2023-08-26T09:25:54.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.524+0000 7f9bb9209700 1 -- 172.21.15.92:0/2752854798 shutdown_connections 2023-08-26T09:25:54.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.524+0000 7f9bb9209700 1 --2- 172.21.15.92:0/2752854798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9bb415d110 0x7f9bb40c8d30 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:54.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.524+0000 7f9bb9209700 1 --2- 172.21.15.92:0/2752854798 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9bb40c9aa0 0x7f9bb415ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:54.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.524+0000 7f9bb9209700 1 --2- 172.21.15.92:0/2752854798 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f9ba006a0e0 0x7f9ba006c5a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:54.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.524+0000 7f9bb9209700 1 --2- 172.21.15.92:0/2752854798 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9bb415def0 0x7f9bb4154340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:54.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.524+0000 7f9bb9209700 1 -- 172.21.15.92:0/2752854798 >> 172.21.15.92:0/2752854798 conn(0x7f9bb40cf450 msgr2=0x7f9bb40aee90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:54.534 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.524+0000 7f9bb9209700 1 -- 172.21.15.92:0/2752854798 shutdown_connections 2023-08-26T09:25:54.534 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.524+0000 7f9bb9209700 1 -- 172.21.15.92:0/2752854798 wait complete. 2023-08-26T09:25:54.542 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-26T09:25:54.664 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.658+0000 7f7b54314700 1 Processor -- start 2023-08-26T09:25:54.664 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.658+0000 7f7b54314700 1 -- start start 2023-08-26T09:25:54.675 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.659+0000 7f7b54314700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f7b4c0cc540 0x7f7b4c0724b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:54.676 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.659+0000 7f7b54314700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b4c0b1e30 con 0x7f7b4c15b120 2023-08-26T09:25:54.676 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.659+0000 7f7b54314700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b4c0b1070 con 0x7f7b4c066020 2023-08-26T09:25:54.676 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.659+0000 7f7b54314700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b4c0b1350 con 0x7f7b4c0cc540 2023-08-26T09:25:54.676 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.659+0000 7f7b520b0700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f7b4c15b120 0x7f7b4c0cbe30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:57948/0 (socket says 172.21.15.92:57948) 2023-08-26T09:25:54.677 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.659+0000 7f7b520b0700 1 -- 172.21.15.92:0/437200203 learned_addr learned my addr 172.21.15.92:0/437200203 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:54.677 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.659+0000 7f7b510ae700 1 -- 172.21.15.92:0/437200203 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 72718801 0 0) 0x7f7b4c0b1e30 con 0x7f7b4c15b120 2023-08-26T09:25:54.677 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.659+0000 7f7b510ae700 1 -- 172.21.15.92:0/437200203 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b380035b0 con 0x7f7b4c15b120 2023-08-26T09:25:54.677 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.659+0000 7f7b518af700 1 --2- 172.21.15.92:0/437200203 >> v2:172.21.15.188:3300/0 conn(0x7f7b4c0cc540 0x7f7b4c0724b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:54.677 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.660+0000 7f7b510ae700 1 -- 172.21.15.92:0/437200203 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1073945489 0 0) 0x7f7b380035b0 con 0x7f7b4c15b120 2023-08-26T09:25:54.678 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.660+0000 7f7b510ae700 1 -- 172.21.15.92:0/437200203 >> v2:172.21.15.188:3300/0 conn(0x7f7b4c0cc540 msgr2=0x7f7b4c0724b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:54.678 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.660+0000 7f7b510ae700 1 --2- 172.21.15.92:0/437200203 >> v2:172.21.15.188:3300/0 conn(0x7f7b4c0cc540 0x7f7b4c0724b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:54.678 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.660+0000 7f7b510ae700 1 -- 172.21.15.92:0/437200203 >> v1:172.21.15.188:6789/0 conn(0x7f7b4c066020 legacy=0x7f7b4c0cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:54.678 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.660+0000 7f7b510ae700 1 -- 172.21.15.92:0/437200203 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b4c0b1630 con 0x7f7b4c15b120 2023-08-26T09:25:54.678 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.660+0000 7f7b510ae700 1 -- 172.21.15.92:0/437200203 <== mon.0 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1019361464 0 0) 0x7f7b3c0017f0 con 0x7f7b4c15b120 2023-08-26T09:25:54.679 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.660+0000 7f7b510ae700 1 -- 172.21.15.92:0/437200203 >> v1:172.21.15.92:6789/0 conn(0x7f7b4c15b120 legacy=0x7f7b4c0cbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:54.679 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.660+0000 7f7b510ae700 1 --2- 172.21.15.92:0/437200203 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b38003a00 0x7f7b38003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:54.679 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.660+0000 7f7b510ae700 1 --2- 172.21.15.92:0/437200203 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7b38004850 0x7f7b38004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:54.679 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.660+0000 7f7b510ae700 1 --2- 172.21.15.92:0/437200203 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7b38005330 0x7f7b3800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:54.679 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.660+0000 7f7b510ae700 1 -- 172.21.15.92:0/437200203 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c0b1350 con 0x7f7b38003a00 2023-08-26T09:25:54.680 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.660+0000 7f7b510ae700 1 -- 172.21.15.92:0/437200203 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3800c200 con 0x7f7b38005330 2023-08-26T09:25:54.680 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.660+0000 7f7b510ae700 1 -- 172.21.15.92:0/437200203 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3800c3c0 con 0x7f7b38004850 2023-08-26T09:25:54.680 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.660+0000 7f7b520b0700 1 --2- 172.21.15.92:0/437200203 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b38003a00 0x7f7b38003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:54.681 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.660+0000 7f7b518af700 1 --2- 172.21.15.92:0/437200203 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7b38004850 0x7f7b38004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:54.681 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.660+0000 7f7b528b1700 1 --2- 172.21.15.92:0/437200203 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7b38005330 0x7f7b3800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:54.681 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.660+0000 7f7b520b0700 1 -- 172.21.15.92:0/437200203 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7b38004850 msgr2=0x7f7b38004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:54.681 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.660+0000 7f7b520b0700 1 --2- 172.21.15.92:0/437200203 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7b38004850 0x7f7b38004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:54.681 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.660+0000 7f7b520b0700 1 -- 172.21.15.92:0/437200203 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7b38005330 msgr2=0x7f7b3800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:54.682 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.660+0000 7f7b520b0700 1 --2- 172.21.15.92:0/437200203 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7b38005330 0x7f7b3800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:54.682 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.660+0000 7f7b528b1700 1 -- 172.21.15.92:0/437200203 reap_dead start 2023-08-26T09:25:54.682 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.660+0000 7f7b520b0700 1 -- 172.21.15.92:0/437200203 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b380035b0 con 0x7f7b38003a00 2023-08-26T09:25:54.682 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.660+0000 7f7b520b0700 1 --2- 172.21.15.92:0/437200203 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b38003a00 0x7f7b38003e20 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c00c210 tx=0x7f7b38005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=674c805201c8bfe8 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:54.682 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.660+0000 7f7b510ae700 1 -- 172.21.15.92:0/437200203 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c00cdb0 con 0x7f7b38003a00 2023-08-26T09:25:54.683 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.660+0000 7f7b510ae700 1 -- 172.21.15.92:0/437200203 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b3c007b80 con 0x7f7b38003a00 2023-08-26T09:25:54.683 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.660+0000 7f7b510ae700 1 -- 172.21.15.92:0/437200203 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c0072f0 con 0x7f7b38003a00 2023-08-26T09:25:54.683 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.661+0000 7f7b54314700 1 -- 172.21.15.92:0/437200203 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b38003a00 msgr2=0x7f7b38003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:54.683 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.661+0000 7f7b54314700 1 --2- 172.21.15.92:0/437200203 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b38003a00 0x7f7b38003e20 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c00c210 tx=0x7f7b38005880 comp rx=0 tx=0).stop 2023-08-26T09:25:54.683 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.661+0000 7f7b54314700 1 -- 172.21.15.92:0/437200203 shutdown_connections 2023-08-26T09:25:54.684 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.661+0000 7f7b54314700 1 --2- 172.21.15.92:0/437200203 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b38003a00 0x7f7b38003e20 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:54.684 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.661+0000 7f7b54314700 1 -- 172.21.15.92:0/437200203 >> 172.21.15.92:0/437200203 conn(0x7f7b4c0b23c0 msgr2=0x7f7b4c0b27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:54.684 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.661+0000 7f7b54314700 1 -- 172.21.15.92:0/437200203 shutdown_connections 2023-08-26T09:25:54.684 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.661+0000 7f7b54314700 1 -- 172.21.15.92:0/437200203 wait complete. 2023-08-26T09:25:54.685 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.662+0000 7f7b54314700 1 Processor -- start 2023-08-26T09:25:54.685 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.662+0000 7f7b54314700 1 -- start start 2023-08-26T09:25:54.685 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.663+0000 7f7b54314700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7b38003a00 0x7f7b4c0ae0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:54.685 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.663+0000 7f7b54314700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b4c15d1d0 0x7f7b4c1f0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:54.685 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.663+0000 7f7b54314700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7b4c0c2f70 0x7f7b4c0c33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:54.686 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.663+0000 7f7b54314700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c0c3930 con 0x7f7b4c15d1d0 2023-08-26T09:25:54.686 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.663+0000 7f7b54314700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c15d940 con 0x7f7b4c0c2f70 2023-08-26T09:25:54.686 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.663+0000 7f7b54314700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c15dc20 con 0x7f7b38003a00 2023-08-26T09:25:54.687 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.663+0000 7f7b518af700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b4c15d1d0 0x7f7b4c1f0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:54.687 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.663+0000 7f7b518af700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b4c15d1d0 0x7f7b4c1f0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45948/0 (socket says 172.21.15.92:45948) 2023-08-26T09:25:54.687 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.663+0000 7f7b518af700 1 -- 172.21.15.92:0/3164365099 learned_addr learned my addr 172.21.15.92:0/3164365099 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:54.688 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.663+0000 7f7b520b0700 1 --2- 172.21.15.92:0/3164365099 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7b38003a00 0x7f7b4c0ae0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:54.688 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.663+0000 7f7b528b1700 1 --2- 172.21.15.92:0/3164365099 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7b4c0c2f70 0x7f7b4c0c33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:54.688 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.663+0000 7f7b518af700 1 -- 172.21.15.92:0/3164365099 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7b38003a00 msgr2=0x7f7b4c0ae0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:54.689 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.663+0000 7f7b518af700 1 --2- 172.21.15.92:0/3164365099 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7b38003a00 0x7f7b4c0ae0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:54.689 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.663+0000 7f7b518af700 1 -- 172.21.15.92:0/3164365099 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7b4c0c2f70 msgr2=0x7f7b4c0c33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:54.689 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.663+0000 7f7b518af700 1 --2- 172.21.15.92:0/3164365099 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7b4c0c2f70 0x7f7b4c0c33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:54.689 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.663+0000 7f7b518af700 1 -- 172.21.15.92:0/3164365099 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b4c15df00 con 0x7f7b4c15d1d0 2023-08-26T09:25:54.690 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.663+0000 7f7b528b1700 1 --2- 172.21.15.92:0/3164365099 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7b4c0c2f70 0x7f7b4c0c33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:25:54.690 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.664+0000 7f7b518af700 1 --2- 172.21.15.92:0/3164365099 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b4c15d1d0 0x7f7b4c1f0060 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7b48010840 tx=0x7f7b48010c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:54.690 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.664+0000 7f7b42ffd700 1 -- 172.21.15.92:0/3164365099 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b48015880 con 0x7f7b4c15d1d0 2023-08-26T09:25:54.691 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.664+0000 7f7b42ffd700 1 -- 172.21.15.92:0/3164365099 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b4800c050 con 0x7f7b4c15d1d0 2023-08-26T09:25:54.691 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.664+0000 7f7b54314700 1 -- 172.21.15.92:0/3164365099 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b4c15e1e0 con 0x7f7b4c15d1d0 2023-08-26T09:25:54.692 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.664+0000 7f7b42ffd700 1 -- 172.21.15.92:0/3164365099 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b48015c20 con 0x7f7b4c15d1d0 2023-08-26T09:25:54.692 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.664+0000 7f7b54314700 1 -- 172.21.15.92:0/3164365099 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b4c15d650 con 0x7f7b4c15d1d0 2023-08-26T09:25:54.692 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.665+0000 7f7b54314700 1 -- 172.21.15.92:0/3164365099 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b4c155310 con 0x7f7b4c15d1d0 2023-08-26T09:25:54.693 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.665+0000 7f7b42ffd700 1 -- 172.21.15.92:0/3164365099 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7b48016420 con 0x7f7b4c15d1d0 2023-08-26T09:25:54.693 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.665+0000 7f7b42ffd700 1 --2- 172.21.15.92:0/3164365099 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f7b3006a0e0 0x7f7b3006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:54.693 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.665+0000 7f7b42ffd700 1 -- 172.21.15.92:0/3164365099 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7b48088970 con 0x7f7b4c15d1d0 2023-08-26T09:25:54.693 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.666+0000 7f7b520b0700 1 --2- 172.21.15.92:0/3164365099 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f7b3006a0e0 0x7f7b3006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:54.693 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.666+0000 7f7b520b0700 1 --2- 172.21.15.92:0/3164365099 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f7b3006a0e0 0x7f7b3006c5a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c015040 tx=0x7f7b3c007000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:54.694 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.670+0000 7f7b42ffd700 1 -- 172.21.15.92:0/3164365099 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7b48054110 con 0x7f7b4c15d1d0 2023-08-26T09:25:54.880 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.875+0000 7f7b54314700 1 -- 172.21.15.92:0/3164365099 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7b4c155100 con 0x7f7b4c15d1d0 2023-08-26T09:25:54.881 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.875+0000 7f7b42ffd700 1 -- 172.21.15.92:0/3164365099 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7b48057730 con 0x7f7b4c15d1d0 2023-08-26T09:25:54.884 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.877+0000 7f7b54314700 1 -- 172.21.15.92:0/3164365099 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f7b3006a0e0 msgr2=0x7f7b3006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:54.884 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.877+0000 7f7b54314700 1 --2- 172.21.15.92:0/3164365099 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f7b3006a0e0 0x7f7b3006c5a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c015040 tx=0x7f7b3c007000 comp rx=0 tx=0).stop 2023-08-26T09:25:54.884 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.877+0000 7f7b54314700 1 -- 172.21.15.92:0/3164365099 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b4c15d1d0 msgr2=0x7f7b4c1f0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:54.884 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.877+0000 7f7b54314700 1 --2- 172.21.15.92:0/3164365099 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b4c15d1d0 0x7f7b4c1f0060 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7b48010840 tx=0x7f7b48010c00 comp rx=0 tx=0).stop 2023-08-26T09:25:54.885 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.877+0000 7f7b54314700 1 -- 172.21.15.92:0/3164365099 shutdown_connections 2023-08-26T09:25:54.885 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.877+0000 7f7b54314700 1 --2- 172.21.15.92:0/3164365099 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f7b3006a0e0 0x7f7b3006c5a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:54.885 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.877+0000 7f7b54314700 1 --2- 172.21.15.92:0/3164365099 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7b4c0c2f70 0x7f7b4c0c33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:54.885 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.877+0000 7f7b54314700 1 --2- 172.21.15.92:0/3164365099 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7b38003a00 0x7f7b4c0ae0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:54.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.877+0000 7f7b54314700 1 --2- 172.21.15.92:0/3164365099 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b4c15d1d0 0x7f7b4c1f0060 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:54.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.877+0000 7f7b54314700 1 -- 172.21.15.92:0/3164365099 >> 172.21.15.92:0/3164365099 conn(0x7f7b4c0b23c0 msgr2=0x7f7b4c0af7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:54.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.877+0000 7f7b54314700 1 -- 172.21.15.92:0/3164365099 shutdown_connections 2023-08-26T09:25:54.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:54.877+0000 7f7b54314700 1 -- 172.21.15.92:0/3164365099 wait complete. 2023-08-26T09:25:54.886 INFO:teuthology.orchestra.run.smithi092.stderr:listed 0 entries 2023-08-26T09:25:54.894 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-08-26T09:25:54.895 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-26T09:25:54.917 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-26T09:25:55.038 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.033+0000 7f18a66c9700 1 Processor -- start 2023-08-26T09:25:55.038 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.033+0000 7f18a66c9700 1 -- start start 2023-08-26T09:25:55.040 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.034+0000 7f18a66c9700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f18a015d6c0 0x7f18a00cea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:55.040 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.034+0000 7f18a66c9700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f18a00cef70 0x7f18a006cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:55.040 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.034+0000 7f18a66c9700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18a00cf4d0 con 0x7f18a00ca620 2023-08-26T09:25:55.041 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.034+0000 7f18a66c9700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18a00cb4a0 con 0x7f18a00cef70 2023-08-26T09:25:55.041 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.034+0000 7f18a66c9700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a00ce3b0 con 0x7f18a015d6c0 2023-08-26T09:25:55.041 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.034+0000 7f18a4c66700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f18a00cef70 0x7f18a006cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:55.041 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.034+0000 7f18a4c66700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f18a00cef70 0x7f18a006cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45958/0 (socket says 172.21.15.92:45958) 2023-08-26T09:25:55.041 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.034+0000 7f18a4c66700 1 -- 172.21.15.92:0/2828725071 learned_addr learned my addr 172.21.15.92:0/2828725071 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:55.042 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.034+0000 7f18a4c66700 1 -- 172.21.15.92:0/2828725071 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f18a015d6c0 msgr2=0x7f18a00cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:55.042 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.034+0000 7f18a4c66700 1 --2- 172.21.15.92:0/2828725071 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f18a015d6c0 0x7f18a00cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:55.042 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.034+0000 7f18a4c66700 1 -- 172.21.15.92:0/2828725071 >> v1:172.21.15.188:6789/0 conn(0x7f18a00ca620 legacy=0x7f18a00caa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:55.042 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.034+0000 7f18a4c66700 1 -- 172.21.15.92:0/2828725071 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a00ce690 con 0x7f18a00cef70 2023-08-26T09:25:55.043 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.034+0000 7f18a4c66700 1 --2- 172.21.15.92:0/2828725071 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18a00cef70 0x7f18a006cd60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1898009e50 tx=0x7f189800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2ddc0298d717cbf server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:55.043 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.034+0000 7f189effd700 1 -- 172.21.15.92:0/2828725071 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189800e070 con 0x7f18a00cef70 2023-08-26T09:25:55.043 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.035+0000 7f189effd700 1 -- 172.21.15.92:0/2828725071 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1898003a20 con 0x7f18a00cef70 2023-08-26T09:25:55.044 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.035+0000 7f189effd700 1 -- 172.21.15.92:0/2828725071 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1898003dd0 con 0x7f18a00cef70 2023-08-26T09:25:55.044 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.035+0000 7f18a66c9700 1 -- 172.21.15.92:0/2828725071 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18a00cef70 msgr2=0x7f18a006cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:55.044 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.035+0000 7f18a66c9700 1 --2- 172.21.15.92:0/2828725071 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18a00cef70 0x7f18a006cd60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1898009e50 tx=0x7f189800b330 comp rx=0 tx=0).stop 2023-08-26T09:25:55.045 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.035+0000 7f18a66c9700 1 -- 172.21.15.92:0/2828725071 shutdown_connections 2023-08-26T09:25:55.045 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.035+0000 7f18a66c9700 1 --2- 172.21.15.92:0/2828725071 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18a00cef70 0x7f18a006cd60 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:55.045 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.035+0000 7f18a66c9700 1 --2- 172.21.15.92:0/2828725071 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f18a015d6c0 0x7f18a00cea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:55.046 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.035+0000 7f18a66c9700 1 -- 172.21.15.92:0/2828725071 >> 172.21.15.92:0/2828725071 conn(0x7f18a00cc7b0 msgr2=0x7f18a00ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:55.046 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.035+0000 7f18a66c9700 1 -- 172.21.15.92:0/2828725071 shutdown_connections 2023-08-26T09:25:55.046 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.035+0000 7f18a66c9700 1 -- 172.21.15.92:0/2828725071 wait complete. 2023-08-26T09:25:55.051 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.037+0000 7f18a66c9700 1 Processor -- start 2023-08-26T09:25:55.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.037+0000 7f18a66c9700 1 -- start start 2023-08-26T09:25:55.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.038+0000 7f18a66c9700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f18a00ca620 0x7f18a0150480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:55.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.038+0000 7f18a66c9700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f18a00cef70 0x7f18a00c6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:55.053 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.038+0000 7f18a66c9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18a015d6c0 0x7f18a00c7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:55.053 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.038+0000 7f18a66c9700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a01509c0 con 0x7f18a015d6c0 2023-08-26T09:25:55.053 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.038+0000 7f18a66c9700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a006e040 con 0x7f18a00cef70 2023-08-26T09:25:55.054 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.038+0000 7f18a66c9700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a006e320 con 0x7f18a00ca620 2023-08-26T09:25:55.054 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.038+0000 7f18a4c66700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18a015d6c0 0x7f18a00c7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:55.054 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.038+0000 7f18a4c66700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18a015d6c0 0x7f18a00c7340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45964/0 (socket says 172.21.15.92:45964) 2023-08-26T09:25:55.055 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.038+0000 7f18a4c66700 1 -- 172.21.15.92:0/430261604 learned_addr learned my addr 172.21.15.92:0/430261604 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:55.055 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.038+0000 7f189ffff700 1 --2- 172.21.15.92:0/430261604 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f18a00ca620 0x7f18a0150480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:55.055 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.038+0000 7f189f7fe700 1 --2- 172.21.15.92:0/430261604 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f18a00cef70 0x7f18a00c6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:55.056 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.038+0000 7f18a4c66700 1 -- 172.21.15.92:0/430261604 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f18a00ca620 msgr2=0x7f18a0150480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:55.056 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.038+0000 7f18a4c66700 1 --2- 172.21.15.92:0/430261604 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f18a00ca620 0x7f18a0150480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:55.056 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.038+0000 7f18a4c66700 1 -- 172.21.15.92:0/430261604 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f18a00cef70 msgr2=0x7f18a00c6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:55.056 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.038+0000 7f18a4c66700 1 --2- 172.21.15.92:0/430261604 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f18a00cef70 0x7f18a00c6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:55.056 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.038+0000 7f18a4c66700 1 -- 172.21.15.92:0/430261604 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1898009b30 con 0x7f18a015d6c0 2023-08-26T09:25:55.057 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.038+0000 7f189ffff700 1 --2- 172.21.15.92:0/430261604 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f18a00ca620 0x7f18a0150480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:25:55.057 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.038+0000 7f18a4c66700 1 --2- 172.21.15.92:0/430261604 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18a015d6c0 0x7f18a00c7340 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f18a0072af0 tx=0x7f1898004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:55.057 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.038+0000 7f189cff9700 1 -- 172.21.15.92:0/430261604 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1898004440 con 0x7f18a015d6c0 2023-08-26T09:25:55.057 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.038+0000 7f189cff9700 1 -- 172.21.15.92:0/430261604 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18980045a0 con 0x7f18a015d6c0 2023-08-26T09:25:55.057 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.038+0000 7f18a66c9700 1 -- 172.21.15.92:0/430261604 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18a006e600 con 0x7f18a015d6c0 2023-08-26T09:25:55.058 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.038+0000 7f189cff9700 1 -- 172.21.15.92:0/430261604 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1898004950 con 0x7f18a015d6c0 2023-08-26T09:25:55.058 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.038+0000 7f18a66c9700 1 -- 172.21.15.92:0/430261604 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18a006ebc0 con 0x7f18a015d6c0 2023-08-26T09:25:55.058 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.039+0000 7f18a66c9700 1 -- 172.21.15.92:0/430261604 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18a015e2d0 con 0x7f18a015d6c0 2023-08-26T09:25:55.058 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.040+0000 7f189cff9700 1 -- 172.21.15.92:0/430261604 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1898012430 con 0x7f18a015d6c0 2023-08-26T09:25:55.058 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.040+0000 7f189cff9700 1 --2- 172.21.15.92:0/430261604 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f188c06a0e0 0x7f188c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:55.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.040+0000 7f189cff9700 1 -- 172.21.15.92:0/430261604 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1898089b20 con 0x7f18a015d6c0 2023-08-26T09:25:55.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.040+0000 7f189ffff700 1 --2- 172.21.15.92:0/430261604 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f188c06a0e0 0x7f188c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:55.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.041+0000 7f189ffff700 1 --2- 172.21.15.92:0/430261604 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f188c06a0e0 0x7f188c06c5a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1894006fd0 tx=0x7f1894008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:55.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.045+0000 7f189cff9700 1 -- 172.21.15.92:0/430261604 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1898055220 con 0x7f18a015d6c0 2023-08-26T09:25:55.245 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.240+0000 7f18a66c9700 1 -- 172.21.15.92:0/430261604 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18a004e660 con 0x7f18a015d6c0 2023-08-26T09:25:55.246 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.241+0000 7f189cff9700 1 -- 172.21.15.92:0/430261604 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+18209 (secure 0 0 0) 0x7f1898058840 con 0x7f18a015d6c0 2023-08-26T09:25:55.247 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:25:55.247 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":20,"fsid":"254a2d31-bd41-4507-8326-1b205ac24377","created":"2023-08-26T09:24:55.352131+0000","modified":"2023-08-26T09:25:15.447635+0000","last_up_change":"2023-08-26T09:25:06.124496+0000","last_in_change":"2023-08-26T09:24:57.840725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-26T09:25:06.650431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-26T09:25:06.973382+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-26T09:25:11.584141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-26T09:25:12.814990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e9e7638-4459-4d8d-8e40-130bcf48df66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6819","nonce":382827192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6824","nonce":382827192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6831","nonce":382827192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6827","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6829","nonce":382827192}]},"public_addr":"172.21.15.92:6819/382827192","cluster_addr":"172.21.15.92:6824/382827192","heartbeat_back_addr":"172.21.15.92:6831/382827192","heartbeat_front_addr":"172.21.15.92:6829/382827192","state":["exists","up"]},{"osd":1,"uuid":"164e68c9-aedd-4df5-9b70-f4b1ec3bda13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6809","nonce":618773438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6811","nonce":618773438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6815","nonce":618773438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6813","nonce":618773438}]},"public_addr":"172.21.15.92:6809/618773438","cluster_addr":"172.21.15.92:6811/618773438","heartbeat_back_addr":"172.21.15.92:6815/618773438","heartbeat_front_addr":"172.21.15.92:6813/618773438","state":["exists","up"]},{"osd":2,"uuid":"8701dfee-629a-4d30-82e4-b8fac340303f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6818","nonce":3697397687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6821","nonce":3697397687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6828","nonce":3697397687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6823","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6825","nonce":3697397687}]},"public_addr":"172.21.15.92:6818/3697397687","cluster_addr":"172.21.15.92:6821/3697397687","heartbeat_back_addr":"172.21.15.92:6828/3697397687","heartbeat_front_addr":"172.21.15.92:6825/3697397687","state":["exists","up"]},{"osd":3,"uuid":"93bdc94d-dc07-495f-995a-a6ad072f0247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6801","nonce":3579846453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6803","nonce":3579846453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6807","nonce":3579846453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6805","nonce":3579846453}]},"public_addr":"172.21.15.92:6801/3579846453","cluster_addr":"172.21.15.92:6803/3579846453","heartbeat_back_addr":"172.21.15.92:6807/3579846453","heartbeat_front_addr":"172.21.15.92:6805/3579846453","state":["exists","up"]},{"osd":4,"uuid":"d9d0ea80-8481-46a7-9677-c338d32cf1d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6809","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6811","nonce":3228383424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6813","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6815","nonce":3228383424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6821","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6823","nonce":3228383424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6817","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6819","nonce":3228383424}]},"public_addr":"172.21.15.188:6811/3228383424","cluster_addr":"172.21.15.188:6815/3228383424","heartbeat_back_addr":"172.21.15.188:6823/3228383424","heartbeat_front_addr":"172.21.15.188:6819/3228383424","state":["exists","up"]},{"osd":5,"uuid":"38d03253-467a-456f-bd5e-5a46532a0b18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6801","nonce":1655821054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6803","nonce":1655821054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6807","nonce":1655821054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6805","nonce":1655821054}]},"public_addr":"172.21.15.188:6801/1655821054","cluster_addr":"172.21.15.188:6803/1655821054","heartbeat_back_addr":"172.21.15.188:6807/1655821054","heartbeat_front_addr":"172.21.15.188:6805/1655821054","state":["exists","up"]},{"osd":6,"uuid":"d61564b5-136f-42e5-a843-626c2017cc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6810","nonce":2069976891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6814","nonce":2069976891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6822","nonce":2069976891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6818","nonce":2069976891}]},"public_addr":"172.21.15.188:6810/2069976891","cluster_addr":"172.21.15.188:6814/2069976891","heartbeat_back_addr":"172.21.15.188:6822/2069976891","heartbeat_front_addr":"172.21.15.188:6818/2069976891","state":["exists","up"]},{"osd":7,"uuid":"fae2949e-0d62-42cd-ba72-08f516084b20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6825","nonce":1882888860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6827","nonce":1882888860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6831","nonce":1882888860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6829","nonce":1882888860}]},"public_addr":"172.21.15.188:6825/1882888860","cluster_addr":"172.21.15.188:6827/1882888860","heartbeat_back_addr":"172.21.15.188:6831/1882888860","heartbeat_front_addr":"172.21.15.188:6829/1882888860","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.038523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.063160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.000857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.975572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.023848+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.765194+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.081365+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:05.110745+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-26T09:25:55.249 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.244+0000 7f18a66c9700 1 -- 172.21.15.92:0/430261604 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f188c06a0e0 msgr2=0x7f188c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:55.249 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.244+0000 7f18a66c9700 1 --2- 172.21.15.92:0/430261604 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f188c06a0e0 0x7f188c06c5a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1894006fd0 tx=0x7f1894008040 comp rx=0 tx=0).stop 2023-08-26T09:25:55.249 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.244+0000 7f18a66c9700 1 -- 172.21.15.92:0/430261604 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18a015d6c0 msgr2=0x7f18a00c7340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:55.249 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.244+0000 7f18a66c9700 1 --2- 172.21.15.92:0/430261604 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18a015d6c0 0x7f18a00c7340 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f18a0072af0 tx=0x7f1898004ad0 comp rx=0 tx=0).stop 2023-08-26T09:25:55.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.244+0000 7f18a66c9700 1 -- 172.21.15.92:0/430261604 shutdown_connections 2023-08-26T09:25:55.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.244+0000 7f18a66c9700 1 --2- 172.21.15.92:0/430261604 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18a015d6c0 0x7f18a00c7340 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:55.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.244+0000 7f18a66c9700 1 --2- 172.21.15.92:0/430261604 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f18a00ca620 0x7f18a0150480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:55.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.244+0000 7f18a66c9700 1 --2- 172.21.15.92:0/430261604 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f188c06a0e0 0x7f188c06c5a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:55.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.244+0000 7f18a66c9700 1 --2- 172.21.15.92:0/430261604 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f18a00cef70 0x7f18a00c6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:55.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.244+0000 7f18a66c9700 1 -- 172.21.15.92:0/430261604 >> 172.21.15.92:0/430261604 conn(0x7f18a00cc7b0 msgr2=0x7f18a00ccb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:55.251 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.244+0000 7f18a66c9700 1 -- 172.21.15.92:0/430261604 shutdown_connections 2023-08-26T09:25:55.251 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.244+0000 7f18a66c9700 1 -- 172.21.15.92:0/430261604 wait complete. 2023-08-26T09:25:55.261 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-26T09:25:06.650431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-26T09:25:06.973382+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-26T09:25:11.584141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-26T09:25:12.814990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-26T09:25:55.262 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-26T09:25:55.387 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.382+0000 7f926162c700 1 Processor -- start 2023-08-26T09:25:55.388 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.382+0000 7f926162c700 1 -- start start 2023-08-26T09:25:55.395 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.383+0000 7f926162c700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f925c15d490 0x7f925c06b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:55.396 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.383+0000 7f926162c700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f925c0d25d0 con 0x7f925c0b6250 2023-08-26T09:25:55.396 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.383+0000 7f926162c700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f925c0b57e0 con 0x7f925c0b1eb0 2023-08-26T09:25:55.396 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.383+0000 7f926162c700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f925c0cdc70 con 0x7f925c15d490 2023-08-26T09:25:55.396 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.383+0000 7f925b7fe700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f925c0b6250 0x7f925c0b66e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:57986/0 (socket says 172.21.15.92:57986) 2023-08-26T09:25:55.397 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.383+0000 7f925b7fe700 1 -- 172.21.15.92:0/182011331 learned_addr learned my addr 172.21.15.92:0/182011331 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:55.397 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.383+0000 7f925affd700 1 --2- 172.21.15.92:0/182011331 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f925c15d490 0x7f925c06b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:55.397 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.383+0000 7f9259ffb700 1 -- 172.21.15.92:0/182011331 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 619105528 0 0) 0x7f925c0d25d0 con 0x7f925c0b6250 2023-08-26T09:25:55.397 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.383+0000 7f9259ffb700 1 -- 172.21.15.92:0/182011331 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92440035b0 con 0x7f925c0b6250 2023-08-26T09:25:55.397 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.384+0000 7f9259ffb700 1 -- 172.21.15.92:0/182011331 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3004515829 0 0) 0x7f92440035b0 con 0x7f925c0b6250 2023-08-26T09:25:55.398 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.384+0000 7f9259ffb700 1 -- 172.21.15.92:0/182011331 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f925c15d490 msgr2=0x7f925c06b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:55.398 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.384+0000 7f9259ffb700 1 --2- 172.21.15.92:0/182011331 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f925c15d490 0x7f925c06b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:55.398 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.384+0000 7f9259ffb700 1 -- 172.21.15.92:0/182011331 >> v1:172.21.15.188:6789/0 conn(0x7f925c0b1eb0 legacy=0x7f925c0ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:55.399 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.384+0000 7f9259ffb700 1 -- 172.21.15.92:0/182011331 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f925c0d2820 con 0x7f925c0b6250 2023-08-26T09:25:55.399 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.384+0000 7f9259ffb700 1 -- 172.21.15.92:0/182011331 <== mon.0 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1019361464 0 0) 0x7f92540019f0 con 0x7f925c0b6250 2023-08-26T09:25:55.399 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.384+0000 7f9259ffb700 1 -- 172.21.15.92:0/182011331 >> v1:172.21.15.92:6789/0 conn(0x7f925c0b6250 legacy=0x7f925c0b66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:55.400 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.384+0000 7f9259ffb700 1 --2- 172.21.15.92:0/182011331 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9244003a30 0x7f9244003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:55.400 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.384+0000 7f9259ffb700 1 --2- 172.21.15.92:0/182011331 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f925c15d490 0x7f9244004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:55.400 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.384+0000 7f9259ffb700 1 --2- 172.21.15.92:0/182011331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9244004d90 0x7f9244005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:55.401 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.384+0000 7f9259ffb700 1 -- 172.21.15.92:0/182011331 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925c0cdc70 con 0x7f9244004d90 2023-08-26T09:25:55.401 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.384+0000 7f9259ffb700 1 -- 172.21.15.92:0/182011331 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924400bb40 con 0x7f9244003a30 2023-08-26T09:25:55.401 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.384+0000 7f9259ffb700 1 -- 172.21.15.92:0/182011331 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f924400bd00 con 0x7f925c15d490 2023-08-26T09:25:55.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.384+0000 7f925b7fe700 1 --2- 172.21.15.92:0/182011331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9244004d90 0x7f9244005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:55.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.384+0000 7f925affd700 1 --2- 172.21.15.92:0/182011331 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9244003a30 0x7f9244003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:55.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.384+0000 7f925a7fc700 1 --2- 172.21.15.92:0/182011331 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f925c15d490 0x7f9244004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:55.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.384+0000 7f925b7fe700 1 -- 172.21.15.92:0/182011331 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f925c15d490 msgr2=0x7f9244004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:55.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.384+0000 7f925b7fe700 1 --2- 172.21.15.92:0/182011331 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f925c15d490 0x7f9244004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:55.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.384+0000 7f925b7fe700 1 -- 172.21.15.92:0/182011331 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9244003a30 msgr2=0x7f9244003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:55.404 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.384+0000 7f925b7fe700 1 --2- 172.21.15.92:0/182011331 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9244003a30 0x7f9244003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:55.404 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.384+0000 7f925b7fe700 1 -- 172.21.15.92:0/182011331 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92440035b0 con 0x7f9244004d90 2023-08-26T09:25:55.404 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.384+0000 7f925b7fe700 1 --2- 172.21.15.92:0/182011331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9244004d90 0x7f9244005210 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f925400a830 tx=0x7f9244005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96173e7347af8d63 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:55.404 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.384+0000 7f9259ffb700 1 -- 172.21.15.92:0/182011331 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925400a2f0 con 0x7f9244004d90 2023-08-26T09:25:55.405 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.384+0000 7f9259ffb700 1 -- 172.21.15.92:0/182011331 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9254012600 con 0x7f9244004d90 2023-08-26T09:25:55.405 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.384+0000 7f9259ffb700 1 -- 172.21.15.92:0/182011331 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92540129b0 con 0x7f9244004d90 2023-08-26T09:25:55.405 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.385+0000 7f926162c700 1 -- 172.21.15.92:0/182011331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9244004d90 msgr2=0x7f9244005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:55.405 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.385+0000 7f926162c700 1 --2- 172.21.15.92:0/182011331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9244004d90 0x7f9244005210 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f925400a830 tx=0x7f9244005880 comp rx=0 tx=0).stop 2023-08-26T09:25:55.405 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.385+0000 7f925b7fe700 1 -- 172.21.15.92:0/182011331 reap_dead start 2023-08-26T09:25:55.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.385+0000 7f926162c700 1 -- 172.21.15.92:0/182011331 shutdown_connections 2023-08-26T09:25:55.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.385+0000 7f926162c700 1 -- 172.21.15.92:0/182011331 >> 172.21.15.92:0/182011331 conn(0x7f925c06aac0 msgr2=0x7f925c06aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:55.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.385+0000 7f926162c700 1 -- 172.21.15.92:0/182011331 shutdown_connections 2023-08-26T09:25:55.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.385+0000 7f926162c700 1 -- 172.21.15.92:0/182011331 wait complete. 2023-08-26T09:25:55.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.386+0000 7f926162c700 1 Processor -- start 2023-08-26T09:25:55.407 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.386+0000 7f926162c700 1 -- start start 2023-08-26T09:25:55.407 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.387+0000 7f926162c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f925c0c9430 0x7f925c0cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:55.407 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.387+0000 7f926162c700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f925c0c9810 0x7f925c14cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:55.407 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.387+0000 7f926162c700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f925c0cb100 0x7f925c14d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:55.407 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.387+0000 7f926162c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925c0cc260 con 0x7f925c0c9430 2023-08-26T09:25:55.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.387+0000 7f926162c700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925c0cb650 con 0x7f925c0c9810 2023-08-26T09:25:55.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.387+0000 7f926162c700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f925c0cb930 con 0x7f925c0cb100 2023-08-26T09:25:55.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.387+0000 7f925affd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f925c0c9430 0x7f925c0cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:55.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.387+0000 7f925affd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f925c0c9430 0x7f925c0cc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45980/0 (socket says 172.21.15.92:45980) 2023-08-26T09:25:55.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.387+0000 7f925affd700 1 -- 172.21.15.92:0/1342983090 learned_addr learned my addr 172.21.15.92:0/1342983090 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:55.409 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.387+0000 7f925a7fc700 1 --2- 172.21.15.92:0/1342983090 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f925c0c9810 0x7f925c14cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:55.409 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.387+0000 7f925b7fe700 1 --2- 172.21.15.92:0/1342983090 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f925c0cb100 0x7f925c14d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:55.409 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.388+0000 7f925affd700 1 -- 172.21.15.92:0/1342983090 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f925c0cb100 msgr2=0x7f925c14d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:55.409 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.388+0000 7f925affd700 1 --2- 172.21.15.92:0/1342983090 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f925c0cb100 0x7f925c14d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:55.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.388+0000 7f925affd700 1 -- 172.21.15.92:0/1342983090 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f925c0c9810 msgr2=0x7f925c14cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:55.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.388+0000 7f925affd700 1 --2- 172.21.15.92:0/1342983090 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f925c0c9810 0x7f925c14cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:55.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.388+0000 7f925affd700 1 -- 172.21.15.92:0/1342983090 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f925c0cbc10 con 0x7f925c0c9430 2023-08-26T09:25:55.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.388+0000 7f925affd700 1 --2- 172.21.15.92:0/1342983090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f925c0c9430 0x7f925c0cc6f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9250011aa0 tx=0x7f9250011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:55.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.388+0000 7f92437fe700 1 -- 172.21.15.92:0/1342983090 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9250011ee0 con 0x7f925c0c9430 2023-08-26T09:25:55.411 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.388+0000 7f92437fe700 1 -- 172.21.15.92:0/1342983090 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f925000f940 con 0x7f925c0c9430 2023-08-26T09:25:55.411 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.388+0000 7f926162c700 1 -- 172.21.15.92:0/1342983090 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f925c0cbef0 con 0x7f925c0c9430 2023-08-26T09:25:55.411 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.388+0000 7f92437fe700 1 -- 172.21.15.92:0/1342983090 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925000fcf0 con 0x7f925c0c9430 2023-08-26T09:25:55.411 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.388+0000 7f926162c700 1 -- 172.21.15.92:0/1342983090 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f925c14d6b0 con 0x7f925c0c9430 2023-08-26T09:25:55.411 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.389+0000 7f926162c700 1 -- 172.21.15.92:0/1342983090 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f925c0cd3a0 con 0x7f925c0c9430 2023-08-26T09:25:55.412 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.389+0000 7f92437fe700 1 -- 172.21.15.92:0/1342983090 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9250014440 con 0x7f925c0c9430 2023-08-26T09:25:55.412 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.390+0000 7f92437fe700 1 --2- 172.21.15.92:0/1342983090 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f924806a0e0 0x7f924806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:55.412 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.390+0000 7f925a7fc700 1 --2- 172.21.15.92:0/1342983090 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f924806a0e0 0x7f924806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:55.412 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.390+0000 7f92437fe700 1 -- 172.21.15.92:0/1342983090 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9250088c40 con 0x7f925c0c9430 2023-08-26T09:25:55.412 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.390+0000 7f925a7fc700 1 --2- 172.21.15.92:0/1342983090 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f924806a0e0 0x7f924806c5a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f925c0cd140 tx=0x7f924c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:55.413 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.394+0000 7f92437fe700 1 -- 172.21.15.92:0/1342983090 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9250057e80 con 0x7f925c0c9430 2023-08-26T09:25:55.588 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.583+0000 7f926162c700 1 -- 172.21.15.92:0/1342983090 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f925c0cc080 con 0x7f925c0c9430 2023-08-26T09:25:55.588 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.583+0000 7f92437fe700 1 -- 172.21.15.92:0/1342983090 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9250057a10 con 0x7f925c0c9430 2023-08-26T09:25:55.589 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 8 2023-08-26T09:25:55.590 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.585+0000 7f926162c700 1 -- 172.21.15.92:0/1342983090 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f924806a0e0 msgr2=0x7f924806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:55.591 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.585+0000 7f926162c700 1 --2- 172.21.15.92:0/1342983090 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f924806a0e0 0x7f924806c5a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f925c0cd140 tx=0x7f924c009040 comp rx=0 tx=0).stop 2023-08-26T09:25:55.591 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.585+0000 7f926162c700 1 -- 172.21.15.92:0/1342983090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f925c0c9430 msgr2=0x7f925c0cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:55.591 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.585+0000 7f926162c700 1 --2- 172.21.15.92:0/1342983090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f925c0c9430 0x7f925c0cc6f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9250011aa0 tx=0x7f9250011db0 comp rx=0 tx=0).stop 2023-08-26T09:25:55.591 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.585+0000 7f926162c700 1 -- 172.21.15.92:0/1342983090 shutdown_connections 2023-08-26T09:25:55.591 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.585+0000 7f926162c700 1 --2- 172.21.15.92:0/1342983090 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f925c0cb100 0x7f925c14d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:55.592 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.585+0000 7f926162c700 1 --2- 172.21.15.92:0/1342983090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f925c0c9430 0x7f925c0cc6f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:55.592 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.585+0000 7f926162c700 1 --2- 172.21.15.92:0/1342983090 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f924806a0e0 0x7f924806c5a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:55.592 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.585+0000 7f926162c700 1 --2- 172.21.15.92:0/1342983090 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f925c0c9810 0x7f925c14cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:55.592 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.585+0000 7f926162c700 1 -- 172.21.15.92:0/1342983090 >> 172.21.15.92:0/1342983090 conn(0x7f925c06aac0 msgr2=0x7f925c0b3590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:55.592 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.585+0000 7f926162c700 1 -- 172.21.15.92:0/1342983090 shutdown_connections 2023-08-26T09:25:55.593 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.585+0000 7f926162c700 1 -- 172.21.15.92:0/1342983090 wait complete. 2023-08-26T09:25:55.602 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-26T09:25:55.726 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.721+0000 7f8ade43b700 1 Processor -- start 2023-08-26T09:25:55.726 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.721+0000 7f8ade43b700 1 -- start start 2023-08-26T09:25:55.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.722+0000 7f8ade43b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f8ad80af390 0x7f8ad8070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:55.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.722+0000 7f8ade43b700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8ad8071260 0x7f8ad806a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:55.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.722+0000 7f8ade43b700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ad80aee50 con 0x7f8ad815d220 2023-08-26T09:25:55.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.722+0000 7f8ade43b700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ad80af130 con 0x7f8ad80af390 2023-08-26T09:25:55.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.722+0000 7f8ade43b700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad80c4cb0 con 0x7f8ad8071260 2023-08-26T09:25:55.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.722+0000 7f8ad77fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f8ad80af390 0x7f8ad8070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:55.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.722+0000 7f8ad7fff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f8ad815d220 0x7f8ad806db70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:58002/0 (socket says 172.21.15.92:58002) 2023-08-26T09:25:55.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.722+0000 7f8ad7fff700 1 -- 172.21.15.92:0/65381498 learned_addr learned my addr 172.21.15.92:0/65381498 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:55.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.722+0000 7f8adc9d8700 1 --2- 172.21.15.92:0/65381498 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8ad8071260 0x7f8ad806a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:55.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.722+0000 7f8ad77fe700 1 -- 172.21.15.92:0/65381498 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8ad8071260 msgr2=0x7f8ad806a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:55.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.722+0000 7f8ad77fe700 1 --2- 172.21.15.92:0/65381498 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8ad8071260 0x7f8ad806a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:55.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.722+0000 7f8ad77fe700 1 -- 172.21.15.92:0/65381498 >> v1:172.21.15.92:6789/0 conn(0x7f8ad815d220 legacy=0x7f8ad806db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:55.731 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.722+0000 7f8ad77fe700 1 -- 172.21.15.92:0/65381498 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad80c4f90 con 0x7f8ad80af390 2023-08-26T09:25:55.731 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.722+0000 7f8ad6ffd700 1 -- 172.21.15.92:0/65381498 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3686898997 0 0) 0x7f8ad80aee50 con 0x7f8ad815d220 2023-08-26T09:25:55.731 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.722+0000 7f8ad77fe700 1 --2- 172.21.15.92:0/65381498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ad80af390 0x7f8ad8070d20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8009840 tx=0x7f8ac8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9978cdd12e401c07 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:55.731 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.723+0000 7f8ad6ffd700 1 -- 172.21.15.92:0/65381498 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac8011830 con 0x7f8ad80af390 2023-08-26T09:25:55.731 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.723+0000 7f8ad6ffd700 1 -- 172.21.15.92:0/65381498 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac8011990 con 0x7f8ad80af390 2023-08-26T09:25:55.732 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.723+0000 7f8ad6ffd700 1 -- 172.21.15.92:0/65381498 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac8011d20 con 0x7f8ad80af390 2023-08-26T09:25:55.732 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.723+0000 7f8ade43b700 1 -- 172.21.15.92:0/65381498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ad80af390 msgr2=0x7f8ad8070d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:55.732 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.723+0000 7f8ade43b700 1 --2- 172.21.15.92:0/65381498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ad80af390 0x7f8ad8070d20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8009840 tx=0x7f8ac8009b50 comp rx=0 tx=0).stop 2023-08-26T09:25:55.732 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.723+0000 7f8ade43b700 1 -- 172.21.15.92:0/65381498 shutdown_connections 2023-08-26T09:25:55.732 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.723+0000 7f8ade43b700 1 --2- 172.21.15.92:0/65381498 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8ad8071260 0x7f8ad806a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:55.732 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.723+0000 7f8ade43b700 1 --2- 172.21.15.92:0/65381498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ad80af390 0x7f8ad8070d20 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:55.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.723+0000 7f8ade43b700 1 -- 172.21.15.92:0/65381498 >> 172.21.15.92:0/65381498 conn(0x7f8ad806b430 msgr2=0x7f8ad806b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:55.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.723+0000 7f8ade43b700 1 -- 172.21.15.92:0/65381498 shutdown_connections 2023-08-26T09:25:55.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.723+0000 7f8ade43b700 1 -- 172.21.15.92:0/65381498 wait complete. 2023-08-26T09:25:55.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.724+0000 7f8ade43b700 1 Processor -- start 2023-08-26T09:25:55.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.725+0000 7f8ade43b700 1 -- start start 2023-08-26T09:25:55.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.725+0000 7f8ade43b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ad8071260 0x7f8ad8155af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:55.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.725+0000 7f8ade43b700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8ad80af390 0x7f8ad815a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:55.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.725+0000 7f8ade43b700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8ad815d220 0x7f8ad815ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:55.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.725+0000 7f8ade43b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad815d780 con 0x7f8ad8071260 2023-08-26T09:25:55.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.725+0000 7f8ade43b700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad815d9d0 con 0x7f8ad80af390 2023-08-26T09:25:55.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.725+0000 7f8ade43b700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad815dcb0 con 0x7f8ad815d220 2023-08-26T09:25:55.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.725+0000 7f8ad7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ad8071260 0x7f8ad8155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:55.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.725+0000 7f8ad7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ad8071260 0x7f8ad8155af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45994/0 (socket says 172.21.15.92:45994) 2023-08-26T09:25:55.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.725+0000 7f8ad7fff700 1 -- 172.21.15.92:0/608617086 learned_addr learned my addr 172.21.15.92:0/608617086 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:55.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.725+0000 7f8adc9d8700 1 --2- 172.21.15.92:0/608617086 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8ad815d220 0x7f8ad815ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:55.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.725+0000 7f8ad77fe700 1 --2- 172.21.15.92:0/608617086 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8ad80af390 0x7f8ad815a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:55.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.726+0000 7f8ad7fff700 1 -- 172.21.15.92:0/608617086 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8ad815d220 msgr2=0x7f8ad815ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:55.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.726+0000 7f8ad7fff700 1 --2- 172.21.15.92:0/608617086 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8ad815d220 0x7f8ad815ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:55.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.726+0000 7f8ad7fff700 1 -- 172.21.15.92:0/608617086 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8ad80af390 msgr2=0x7f8ad815a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:55.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.726+0000 7f8ad7fff700 1 --2- 172.21.15.92:0/608617086 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8ad80af390 0x7f8ad815a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:55.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.726+0000 7f8ad7fff700 1 -- 172.21.15.92:0/608617086 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac80094a0 con 0x7f8ad8071260 2023-08-26T09:25:55.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.726+0000 7f8ad7fff700 1 --2- 172.21.15.92:0/608617086 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ad8071260 0x7f8ad8155af0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8acc00c550 tx=0x7f8acc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:55.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.726+0000 7f8ad4ff9700 1 -- 172.21.15.92:0/608617086 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8acc004c80 con 0x7f8ad8071260 2023-08-26T09:25:55.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.726+0000 7f8ad4ff9700 1 -- 172.21.15.92:0/608617086 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8acc004e00 con 0x7f8ad8071260 2023-08-26T09:25:55.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.726+0000 7f8ad4ff9700 1 -- 172.21.15.92:0/608617086 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8acc007310 con 0x7f8ad8071260 2023-08-26T09:25:55.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.726+0000 7f8ade43b700 1 -- 172.21.15.92:0/608617086 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ad815df90 con 0x7f8ad8071260 2023-08-26T09:25:55.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.726+0000 7f8ade43b700 1 -- 172.21.15.92:0/608617086 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ad815e550 con 0x7f8ad8071260 2023-08-26T09:25:55.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.727+0000 7f8ade43b700 1 -- 172.21.15.92:0/608617086 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ad815e740 con 0x7f8ad8071260 2023-08-26T09:25:55.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.727+0000 7f8ad4ff9700 1 -- 172.21.15.92:0/608617086 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8acc007470 con 0x7f8ad8071260 2023-08-26T09:25:55.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.728+0000 7f8ad4ff9700 1 --2- 172.21.15.92:0/608617086 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f8ac406a0e0 0x7f8ac406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:55.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.728+0000 7f8ad4ff9700 1 -- 172.21.15.92:0/608617086 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8acc088110 con 0x7f8ad8071260 2023-08-26T09:25:55.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.728+0000 7f8ad77fe700 1 --2- 172.21.15.92:0/608617086 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f8ac406a0e0 0x7f8ac406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:55.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.728+0000 7f8ad77fe700 1 --2- 172.21.15.92:0/608617086 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f8ac406a0e0 0x7f8ac406c5a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8ac80090b0 tx=0x7f8ac8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:55.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.732+0000 7f8ad4ff9700 1 -- 172.21.15.92:0/608617086 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8acc053800 con 0x7f8ad8071260 2023-08-26T09:25:55.925 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.921+0000 7f8ade43b700 1 -- 172.21.15.92:0/608617086 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8ad804eeb0 con 0x7f8ad8071260 2023-08-26T09:25:55.926 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.921+0000 7f8ad4ff9700 1 -- 172.21.15.92:0/608617086 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8acc056e20 con 0x7f8ad8071260 2023-08-26T09:25:55.926 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 1 2023-08-26T09:25:55.928 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.923+0000 7f8ade43b700 1 -- 172.21.15.92:0/608617086 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f8ac406a0e0 msgr2=0x7f8ac406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:55.928 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.923+0000 7f8ade43b700 1 --2- 172.21.15.92:0/608617086 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f8ac406a0e0 0x7f8ac406c5a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8ac80090b0 tx=0x7f8ac8008030 comp rx=0 tx=0).stop 2023-08-26T09:25:55.928 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.923+0000 7f8ade43b700 1 -- 172.21.15.92:0/608617086 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ad8071260 msgr2=0x7f8ad8155af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:55.929 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.923+0000 7f8ade43b700 1 --2- 172.21.15.92:0/608617086 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ad8071260 0x7f8ad8155af0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8acc00c550 tx=0x7f8acc00c860 comp rx=0 tx=0).stop 2023-08-26T09:25:55.929 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.923+0000 7f8ade43b700 1 -- 172.21.15.92:0/608617086 shutdown_connections 2023-08-26T09:25:55.929 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.923+0000 7f8ade43b700 1 --2- 172.21.15.92:0/608617086 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8ad815d220 0x7f8ad815ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:55.929 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.923+0000 7f8ade43b700 1 --2- 172.21.15.92:0/608617086 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ad8071260 0x7f8ad8155af0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:55.929 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.923+0000 7f8ade43b700 1 --2- 172.21.15.92:0/608617086 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f8ac406a0e0 0x7f8ac406c5a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:55.930 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.923+0000 7f8ade43b700 1 --2- 172.21.15.92:0/608617086 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8ad80af390 0x7f8ad815a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:55.930 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.923+0000 7f8ade43b700 1 -- 172.21.15.92:0/608617086 >> 172.21.15.92:0/608617086 conn(0x7f8ad806b430 msgr2=0x7f8ad80732c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:55.930 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.923+0000 7f8ade43b700 1 -- 172.21.15.92:0/608617086 shutdown_connections 2023-08-26T09:25:55.930 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:55.923+0000 7f8ade43b700 1 -- 172.21.15.92:0/608617086 wait complete. 2023-08-26T09:25:55.940 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-26T09:25:56.064 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.059+0000 7fad6d1b6700 1 Processor -- start 2023-08-26T09:25:56.064 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.059+0000 7fad6d1b6700 1 -- start start 2023-08-26T09:25:56.066 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.060+0000 7fad6d1b6700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fad680b2d70 0x7fad6815edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:56.067 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.060+0000 7fad6d1b6700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fad680cb4a0 0x7fad680cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:56.067 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.060+0000 7fad6d1b6700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fad680d0320 0x7fad680d0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:56.067 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.060+0000 7fad6d1b6700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad6806eb10 con 0x7fad680cb4a0 2023-08-26T09:25:56.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.060+0000 7fad6d1b6700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad680d0ca0 con 0x7fad680d0320 2023-08-26T09:25:56.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.060+0000 7fad6d1b6700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad6806de90 con 0x7fad680b2d70 2023-08-26T09:25:56.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.060+0000 7fad6659c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fad680cb4a0 0x7fad680cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:56.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.060+0000 7fad6659c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fad680cb4a0 0x7fad680cb920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46004/0 (socket says 172.21.15.92:46004) 2023-08-26T09:25:56.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.060+0000 7fad6659c700 1 -- 172.21.15.92:0/3859935815 learned_addr learned my addr 172.21.15.92:0/3859935815 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:56.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.060+0000 7fad6659c700 1 -- 172.21.15.92:0/3859935815 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fad680b2d70 msgr2=0x7fad6815edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:56.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.060+0000 7fad66d9d700 1 --2- 172.21.15.92:0/3859935815 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fad680b2d70 0x7fad6815edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:56.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.060+0000 7fad6759e700 1 --2- 172.21.15.92:0/3859935815 >> v2:172.21.15.188:3300/0 conn(0x7fad680d0320 0x7fad680d0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:56.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.060+0000 7fad6659c700 1 --2- 172.21.15.92:0/3859935815 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fad680b2d70 0x7fad6815edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:56.070 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.060+0000 7fad6659c700 1 -- 172.21.15.92:0/3859935815 >> v2:172.21.15.188:3300/0 conn(0x7fad680d0320 msgr2=0x7fad680d0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:56.070 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.060+0000 7fad6659c700 1 --2- 172.21.15.92:0/3859935815 >> v2:172.21.15.188:3300/0 conn(0x7fad680d0320 0x7fad680d0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:56.070 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.060+0000 7fad6659c700 1 -- 172.21.15.92:0/3859935815 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad6806e170 con 0x7fad680cb4a0 2023-08-26T09:25:56.070 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.060+0000 7fad6659c700 1 --2- 172.21.15.92:0/3859935815 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad680cb4a0 0x7fad680cb920 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fad6806efc0 tx=0x7fad50009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e53454cc089848d server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:56.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.061+0000 7fad65d9b700 1 -- 172.21.15.92:0/3859935815 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5000b870 con 0x7fad680cb4a0 2023-08-26T09:25:56.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.061+0000 7fad65d9b700 1 -- 172.21.15.92:0/3859935815 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad5000b9d0 con 0x7fad680cb4a0 2023-08-26T09:25:56.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.061+0000 7fad65d9b700 1 -- 172.21.15.92:0/3859935815 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5000bd60 con 0x7fad680cb4a0 2023-08-26T09:25:56.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.061+0000 7fad6d1b6700 1 -- 172.21.15.92:0/3859935815 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad680cb4a0 msgr2=0x7fad680cb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:56.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.061+0000 7fad6d1b6700 1 --2- 172.21.15.92:0/3859935815 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad680cb4a0 0x7fad680cb920 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fad6806efc0 tx=0x7fad50009bd0 comp rx=0 tx=0).stop 2023-08-26T09:25:56.072 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.061+0000 7fad6d1b6700 1 -- 172.21.15.92:0/3859935815 shutdown_connections 2023-08-26T09:25:56.072 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.061+0000 7fad6d1b6700 1 --2- 172.21.15.92:0/3859935815 >> v2:172.21.15.188:3300/0 conn(0x7fad680d0320 0x7fad680d0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:56.072 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.061+0000 7fad6d1b6700 1 --2- 172.21.15.92:0/3859935815 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fad680b2d70 0x7fad6815edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:56.072 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.061+0000 7fad6d1b6700 1 --2- 172.21.15.92:0/3859935815 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad680cb4a0 0x7fad680cb920 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:56.073 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.061+0000 7fad6d1b6700 1 -- 172.21.15.92:0/3859935815 >> 172.21.15.92:0/3859935815 conn(0x7fad680cd8d0 msgr2=0x7fad680cdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:56.073 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.061+0000 7fad6d1b6700 1 -- 172.21.15.92:0/3859935815 shutdown_connections 2023-08-26T09:25:56.073 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.061+0000 7fad6d1b6700 1 -- 172.21.15.92:0/3859935815 wait complete. 2023-08-26T09:25:56.076 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.063+0000 7fad6d1b6700 1 Processor -- start 2023-08-26T09:25:56.076 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.063+0000 7fad6d1b6700 1 -- start start 2023-08-26T09:25:56.076 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.063+0000 7fad6d1b6700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fad680b2d70 0x7fad68152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:56.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.063+0000 7fad6d1b6700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fad680cb4a0 0x7fad680c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:56.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.063+0000 7fad6d1b6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad680d0320 0x7fad680b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:56.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.063+0000 7fad6d1b6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad680b3cc0 con 0x7fad680d0320 2023-08-26T09:25:56.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.063+0000 7fad6d1b6700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad680c5ba0 con 0x7fad680b2d70 2023-08-26T09:25:56.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.063+0000 7fad6d1b6700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad680c5e80 con 0x7fad680cb4a0 2023-08-26T09:25:56.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.064+0000 7fad6759e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad680d0320 0x7fad680b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:56.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.064+0000 7fad6759e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad680d0320 0x7fad680b43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46012/0 (socket says 172.21.15.92:46012) 2023-08-26T09:25:56.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.064+0000 7fad6759e700 1 -- 172.21.15.92:0/1619914209 learned_addr learned my addr 172.21.15.92:0/1619914209 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:56.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.064+0000 7fad66d9d700 1 --2- 172.21.15.92:0/1619914209 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fad680b2d70 0x7fad68152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:56.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.064+0000 7fad6659c700 1 --2- 172.21.15.92:0/1619914209 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fad680cb4a0 0x7fad680c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:56.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.064+0000 7fad6759e700 1 -- 172.21.15.92:0/1619914209 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fad680cb4a0 msgr2=0x7fad680c6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:56.079 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.064+0000 7fad6759e700 1 --2- 172.21.15.92:0/1619914209 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fad680cb4a0 0x7fad680c6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:56.079 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.064+0000 7fad6759e700 1 -- 172.21.15.92:0/1619914209 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fad680b2d70 msgr2=0x7fad68152210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:56.079 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.064+0000 7fad6759e700 1 --2- 172.21.15.92:0/1619914209 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fad680b2d70 0x7fad68152210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:56.079 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.064+0000 7fad6759e700 1 -- 172.21.15.92:0/1619914209 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad50009550 con 0x7fad680d0320 2023-08-26T09:25:56.079 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.064+0000 7fad66d9d700 1 --2- 172.21.15.92:0/1619914209 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fad680b2d70 0x7fad68152210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:56.080 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.064+0000 7fad6659c700 1 --2- 172.21.15.92:0/1619914209 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fad680cb4a0 0x7fad680c6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:56.080 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.064+0000 7fad6759e700 1 --2- 172.21.15.92:0/1619914209 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad680d0320 0x7fad680b43c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fad6000cc30 tx=0x7fad6000a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:56.080 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.064+0000 7fad5f7fe700 1 -- 172.21.15.92:0/1619914209 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6000ab70 con 0x7fad680d0320 2023-08-26T09:25:56.080 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.064+0000 7fad5f7fe700 1 -- 172.21.15.92:0/1619914209 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad6000acd0 con 0x7fad680d0320 2023-08-26T09:25:56.080 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.064+0000 7fad6d1b6700 1 -- 172.21.15.92:0/1619914209 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad680c6160 con 0x7fad680d0320 2023-08-26T09:25:56.081 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.064+0000 7fad5f7fe700 1 -- 172.21.15.92:0/1619914209 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad60003c40 con 0x7fad680d0320 2023-08-26T09:25:56.081 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.064+0000 7fad6d1b6700 1 -- 172.21.15.92:0/1619914209 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad680c6720 con 0x7fad680d0320 2023-08-26T09:25:56.081 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.065+0000 7fad6d1b6700 1 -- 172.21.15.92:0/1619914209 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad6804eeb0 con 0x7fad680d0320 2023-08-26T09:25:56.081 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.066+0000 7fad5f7fe700 1 -- 172.21.15.92:0/1619914209 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fad6000f3f0 con 0x7fad680d0320 2023-08-26T09:25:56.081 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.066+0000 7fad5f7fe700 1 --2- 172.21.15.92:0/1619914209 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fad4806a0e0 0x7fad4806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:56.082 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.066+0000 7fad5f7fe700 1 -- 172.21.15.92:0/1619914209 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fad60088730 con 0x7fad680d0320 2023-08-26T09:25:56.082 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.066+0000 7fad66d9d700 1 --2- 172.21.15.92:0/1619914209 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fad4806a0e0 0x7fad4806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:56.082 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.067+0000 7fad66d9d700 1 --2- 172.21.15.92:0/1619914209 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fad4806a0e0 0x7fad4806c5a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fad5800aa90 tx=0x7fad58008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:56.082 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.070+0000 7fad5f7fe700 1 -- 172.21.15.92:0/1619914209 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fad60053eb0 con 0x7fad680d0320 2023-08-26T09:25:56.264 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.259+0000 7fad6d1b6700 1 -- 172.21.15.92:0/1619914209 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fad6806e700 con 0x7fad680d0320 2023-08-26T09:25:56.264 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.259+0000 7fad5f7fe700 1 -- 172.21.15.92:0/1619914209 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fad600574d0 con 0x7fad680d0320 2023-08-26T09:25:56.264 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 32 2023-08-26T09:25:56.266 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.261+0000 7fad6d1b6700 1 -- 172.21.15.92:0/1619914209 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fad4806a0e0 msgr2=0x7fad4806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:56.267 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.261+0000 7fad6d1b6700 1 --2- 172.21.15.92:0/1619914209 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fad4806a0e0 0x7fad4806c5a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fad5800aa90 tx=0x7fad58008040 comp rx=0 tx=0).stop 2023-08-26T09:25:56.267 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.261+0000 7fad6d1b6700 1 -- 172.21.15.92:0/1619914209 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad680d0320 msgr2=0x7fad680b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:56.267 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.261+0000 7fad6d1b6700 1 --2- 172.21.15.92:0/1619914209 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad680d0320 0x7fad680b43c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fad6000cc30 tx=0x7fad6000a1f0 comp rx=0 tx=0).stop 2023-08-26T09:25:56.267 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.261+0000 7fad6d1b6700 1 -- 172.21.15.92:0/1619914209 shutdown_connections 2023-08-26T09:25:56.267 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.261+0000 7fad6d1b6700 1 --2- 172.21.15.92:0/1619914209 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fad4806a0e0 0x7fad4806c5a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:56.268 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.261+0000 7fad6d1b6700 1 --2- 172.21.15.92:0/1619914209 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fad680b2d70 0x7fad68152210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:56.268 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.261+0000 7fad6d1b6700 1 --2- 172.21.15.92:0/1619914209 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad680d0320 0x7fad680b43c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:56.268 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.261+0000 7fad6d1b6700 1 --2- 172.21.15.92:0/1619914209 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fad680cb4a0 0x7fad680c6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:56.268 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.261+0000 7fad6d1b6700 1 -- 172.21.15.92:0/1619914209 >> 172.21.15.92:0/1619914209 conn(0x7fad680cd8d0 msgr2=0x7fad680d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:56.269 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.261+0000 7fad6d1b6700 1 -- 172.21.15.92:0/1619914209 shutdown_connections 2023-08-26T09:25:56.269 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.261+0000 7fad6d1b6700 1 -- 172.21.15.92:0/1619914209 wait complete. 2023-08-26T09:25:56.279 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-26T09:25:56.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.398+0000 7f4ca363e700 1 Processor -- start 2023-08-26T09:25:56.404 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.398+0000 7f4ca363e700 1 -- start start 2023-08-26T09:25:56.407 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.399+0000 7f4ca363e700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4c9c0b28d0 0x7f4c9c0b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:56.407 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.399+0000 7f4ca363e700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f4c9c15da10 0x7f4c9c15ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:56.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.399+0000 7f4ca363e700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c9c15e9b0 con 0x7f4c9c0ce450 2023-08-26T09:25:56.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.399+0000 7f4ca363e700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c9c1614a0 con 0x7f4c9c15da10 2023-08-26T09:25:56.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.399+0000 7f4ca363e700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9c0b31f0 con 0x7f4c9c0b28d0 2023-08-26T09:25:56.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.399+0000 7f4ca0bd9700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f4c9c0ce450 0x7f4c9c161930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:58032/0 (socket says 172.21.15.92:58032) 2023-08-26T09:25:56.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.399+0000 7f4ca0bd9700 1 -- 172.21.15.92:0/851569161 learned_addr learned my addr 172.21.15.92:0/851569161 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:56.409 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.399+0000 7f4ca13da700 1 --2- 172.21.15.92:0/851569161 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4c9c0b28d0 0x7f4c9c0b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:56.409 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.399+0000 7f4ca1bdb700 1 --2- 172.21.15.92:0/851569161 >> v2:172.21.15.188:3300/0 conn(0x7f4c9c15da10 0x7f4c9c15ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:56.409 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.399+0000 7f4c93fff700 1 -- 172.21.15.92:0/851569161 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1637867844 0 0) 0x7f4c9c15e9b0 con 0x7f4c9c0ce450 2023-08-26T09:25:56.409 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.399+0000 7f4c93fff700 1 -- 172.21.15.92:0/851569161 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c880035b0 con 0x7f4c9c0ce450 2023-08-26T09:25:56.409 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.400+0000 7f4c93fff700 1 -- 172.21.15.92:0/851569161 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1638271444 0 0) 0x7f4c880035b0 con 0x7f4c9c0ce450 2023-08-26T09:25:56.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.400+0000 7f4c93fff700 1 -- 172.21.15.92:0/851569161 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4c9c0b28d0 msgr2=0x7f4c9c0b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:56.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.400+0000 7f4c93fff700 1 --2- 172.21.15.92:0/851569161 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4c9c0b28d0 0x7f4c9c0b2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:56.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.400+0000 7f4c93fff700 1 -- 172.21.15.92:0/851569161 >> v2:172.21.15.188:3300/0 conn(0x7f4c9c15da10 msgr2=0x7f4c9c15ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:56.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.400+0000 7f4c93fff700 1 --2- 172.21.15.92:0/851569161 >> v2:172.21.15.188:3300/0 conn(0x7f4c9c15da10 0x7f4c9c15ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:56.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.400+0000 7f4c93fff700 1 -- 172.21.15.92:0/851569161 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c9c15e3f0 con 0x7f4c9c0ce450 2023-08-26T09:25:56.411 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.400+0000 7f4c93fff700 1 -- 172.21.15.92:0/851569161 <== mon.0 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1019361464 0 0) 0x7f4c98001670 con 0x7f4c9c0ce450 2023-08-26T09:25:56.411 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.400+0000 7f4c93fff700 1 -- 172.21.15.92:0/851569161 >> v1:172.21.15.92:6789/0 conn(0x7f4c9c0ce450 legacy=0x7f4c9c161930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:56.411 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.400+0000 7f4c93fff700 1 --2- 172.21.15.92:0/851569161 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4c88003a00 0x7f4c88003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:56.411 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.400+0000 7f4c93fff700 1 --2- 172.21.15.92:0/851569161 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4c9c0b28d0 0x7f4c88004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:56.411 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.400+0000 7f4c93fff700 1 --2- 172.21.15.92:0/851569161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c88004d90 0x7f4c88005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:56.412 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.400+0000 7f4c93fff700 1 -- 172.21.15.92:0/851569161 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9c1614a0 con 0x7f4c88004d90 2023-08-26T09:25:56.412 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.400+0000 7f4c93fff700 1 -- 172.21.15.92:0/851569161 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9c0b31f0 con 0x7f4c88003a00 2023-08-26T09:25:56.412 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.400+0000 7f4c93fff700 1 -- 172.21.15.92:0/851569161 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8800ba10 con 0x7f4c9c0b28d0 2023-08-26T09:25:56.412 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.400+0000 7f4ca1bdb700 1 --2- 172.21.15.92:0/851569161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c88004d90 0x7f4c88005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:56.412 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.400+0000 7f4ca13da700 1 --2- 172.21.15.92:0/851569161 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4c88003a00 0x7f4c88003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:56.413 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.400+0000 7f4ca0bd9700 1 --2- 172.21.15.92:0/851569161 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4c9c0b28d0 0x7f4c88004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:56.413 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.400+0000 7f4ca1bdb700 1 -- 172.21.15.92:0/851569161 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4c9c0b28d0 msgr2=0x7f4c88004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:56.413 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.400+0000 7f4ca1bdb700 1 --2- 172.21.15.92:0/851569161 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4c9c0b28d0 0x7f4c88004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:56.413 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.400+0000 7f4ca1bdb700 1 -- 172.21.15.92:0/851569161 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4c88003a00 msgr2=0x7f4c88003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:56.414 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.400+0000 7f4ca1bdb700 1 --2- 172.21.15.92:0/851569161 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4c88003a00 0x7f4c88003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:56.414 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.400+0000 7f4ca1bdb700 1 -- 172.21.15.92:0/851569161 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c880035b0 con 0x7f4c88004d90 2023-08-26T09:25:56.414 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.400+0000 7f4ca1bdb700 1 --2- 172.21.15.92:0/851569161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c88004d90 0x7f4c88005210 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4c94009fc0 tx=0x7f4c88005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44c4390149e54a6c server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:56.414 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.400+0000 7f4c93fff700 1 -- 172.21.15.92:0/851569161 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9400ec30 con 0x7f4c88004d90 2023-08-26T09:25:56.414 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.400+0000 7f4c93fff700 1 -- 172.21.15.92:0/851569161 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c9400f040 con 0x7f4c88004d90 2023-08-26T09:25:56.415 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.400+0000 7f4c93fff700 1 -- 172.21.15.92:0/851569161 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c94014480 con 0x7f4c88004d90 2023-08-26T09:25:56.415 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.401+0000 7f4ca363e700 1 -- 172.21.15.92:0/851569161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c88004d90 msgr2=0x7f4c88005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:56.415 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.401+0000 7f4ca363e700 1 --2- 172.21.15.92:0/851569161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c88004d90 0x7f4c88005210 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4c94009fc0 tx=0x7f4c88005880 comp rx=0 tx=0).stop 2023-08-26T09:25:56.415 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.401+0000 7f4ca1bdb700 1 -- 172.21.15.92:0/851569161 reap_dead start 2023-08-26T09:25:56.415 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.401+0000 7f4ca363e700 1 -- 172.21.15.92:0/851569161 shutdown_connections 2023-08-26T09:25:56.415 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.401+0000 7f4ca363e700 1 -- 172.21.15.92:0/851569161 >> 172.21.15.92:0/851569161 conn(0x7f4c9c0cd8d0 msgr2=0x7f4c9c0cdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:56.416 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.401+0000 7f4ca363e700 1 -- 172.21.15.92:0/851569161 shutdown_connections 2023-08-26T09:25:56.416 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.401+0000 7f4ca363e700 1 -- 172.21.15.92:0/851569161 wait complete. 2023-08-26T09:25:56.416 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.402+0000 7f4ca363e700 1 Processor -- start 2023-08-26T09:25:56.416 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.402+0000 7f4ca363e700 1 -- start start 2023-08-26T09:25:56.419 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.403+0000 7f4ca363e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c9c156cd0 0x7f4c9c1e6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:56.419 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.403+0000 7f4ca363e700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4c9c0c5820 0x7f4c9c0b5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:56.419 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.403+0000 7f4ca363e700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4c9c0ca530 0x7f4c9c0ca9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:56.419 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.403+0000 7f4ca363e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9c1e9890 con 0x7f4c9c156cd0 2023-08-26T09:25:56.420 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.403+0000 7f4ca363e700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9c1e6b60 con 0x7f4c9c0ca530 2023-08-26T09:25:56.420 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.403+0000 7f4ca363e700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9c0c5d20 con 0x7f4c9c0c5820 2023-08-26T09:25:56.420 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.403+0000 7f4ca13da700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c9c156cd0 0x7f4c9c1e6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:56.420 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.403+0000 7f4ca13da700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c9c156cd0 0x7f4c9c1e6620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46028/0 (socket says 172.21.15.92:46028) 2023-08-26T09:25:56.420 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.403+0000 7f4ca13da700 1 -- 172.21.15.92:0/3249473056 learned_addr learned my addr 172.21.15.92:0/3249473056 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:56.421 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.403+0000 7f4ca1bdb700 1 --2- 172.21.15.92:0/3249473056 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4c9c0ca530 0x7f4c9c0ca9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:56.421 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.403+0000 7f4ca0bd9700 1 --2- 172.21.15.92:0/3249473056 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4c9c0c5820 0x7f4c9c0b5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:56.421 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.404+0000 7f4ca13da700 1 -- 172.21.15.92:0/3249473056 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4c9c0c5820 msgr2=0x7f4c9c0b5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:56.421 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.404+0000 7f4ca13da700 1 --2- 172.21.15.92:0/3249473056 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4c9c0c5820 0x7f4c9c0b5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:56.422 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.404+0000 7f4ca13da700 1 -- 172.21.15.92:0/3249473056 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4c9c0ca530 msgr2=0x7f4c9c0ca9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:56.422 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.404+0000 7f4ca13da700 1 --2- 172.21.15.92:0/3249473056 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4c9c0ca530 0x7f4c9c0ca9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:56.422 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.404+0000 7f4ca13da700 1 -- 172.21.15.92:0/3249473056 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c9c0c6000 con 0x7f4c9c156cd0 2023-08-26T09:25:56.422 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.404+0000 7f4ca13da700 1 --2- 172.21.15.92:0/3249473056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c9c156cd0 0x7f4c9c1e6620 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c011ad0 tx=0x7f4c8c011de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:56.423 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.404+0000 7f4c91ffb700 1 -- 172.21.15.92:0/3249473056 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c00f940 con 0x7f4c9c156cd0 2023-08-26T09:25:56.423 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.404+0000 7f4c91ffb700 1 -- 172.21.15.92:0/3249473056 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c8c00faa0 con 0x7f4c9c156cd0 2023-08-26T09:25:56.423 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.404+0000 7f4ca363e700 1 -- 172.21.15.92:0/3249473056 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c9c0c62e0 con 0x7f4c9c156cd0 2023-08-26T09:25:56.423 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.404+0000 7f4c91ffb700 1 -- 172.21.15.92:0/3249473056 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c00fe50 con 0x7f4c9c156cd0 2023-08-26T09:25:56.423 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.404+0000 7f4ca363e700 1 -- 172.21.15.92:0/3249473056 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c9c0c68a0 con 0x7f4c9c156cd0 2023-08-26T09:25:56.423 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.405+0000 7f4ca363e700 1 -- 172.21.15.92:0/3249473056 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c9c04eeb0 con 0x7f4c9c156cd0 2023-08-26T09:25:56.424 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.406+0000 7f4c91ffb700 1 -- 172.21.15.92:0/3249473056 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4c8c014440 con 0x7f4c9c156cd0 2023-08-26T09:25:56.424 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.406+0000 7f4c91ffb700 1 --2- 172.21.15.92:0/3249473056 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f4c8006a0e0 0x7f4c8006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:56.424 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.406+0000 7f4c91ffb700 1 -- 172.21.15.92:0/3249473056 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4c8c088c00 con 0x7f4c9c156cd0 2023-08-26T09:25:56.424 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.406+0000 7f4ca0bd9700 1 --2- 172.21.15.92:0/3249473056 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f4c8006a0e0 0x7f4c8006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:56.424 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.406+0000 7f4ca0bd9700 1 --2- 172.21.15.92:0/3249473056 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f4c8006a0e0 0x7f4c8006c5a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c0c5330 tx=0x7f4c98007980 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:56.425 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.411+0000 7f4c91ffb700 1 -- 172.21.15.92:0/3249473056 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4c8c08f080 con 0x7f4c9c156cd0 2023-08-26T09:25:56.605 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.600+0000 7f4ca363e700 1 -- 172.21.15.92:0/3249473056 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4c9c0cb180 con 0x7f4c9c156cd0 2023-08-26T09:25:56.605 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.600+0000 7f4c91ffb700 1 -- 172.21.15.92:0/3249473056 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4c8c022020 con 0x7f4c9c156cd0 2023-08-26T09:25:56.605 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 64 2023-08-26T09:25:56.607 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.602+0000 7f4ca363e700 1 -- 172.21.15.92:0/3249473056 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f4c8006a0e0 msgr2=0x7f4c8006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:56.608 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.602+0000 7f4ca363e700 1 --2- 172.21.15.92:0/3249473056 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f4c8006a0e0 0x7f4c8006c5a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c0c5330 tx=0x7f4c98007980 comp rx=0 tx=0).stop 2023-08-26T09:25:56.608 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.602+0000 7f4ca363e700 1 -- 172.21.15.92:0/3249473056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c9c156cd0 msgr2=0x7f4c9c1e6620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:56.608 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.602+0000 7f4ca363e700 1 --2- 172.21.15.92:0/3249473056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c9c156cd0 0x7f4c9c1e6620 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c011ad0 tx=0x7f4c8c011de0 comp rx=0 tx=0).stop 2023-08-26T09:25:56.608 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.602+0000 7f4ca363e700 1 -- 172.21.15.92:0/3249473056 shutdown_connections 2023-08-26T09:25:56.608 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.602+0000 7f4ca363e700 1 --2- 172.21.15.92:0/3249473056 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f4c8006a0e0 0x7f4c8006c5a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:56.609 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.602+0000 7f4ca363e700 1 --2- 172.21.15.92:0/3249473056 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4c9c0ca530 0x7f4c9c0ca9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:56.609 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.602+0000 7f4ca363e700 1 --2- 172.21.15.92:0/3249473056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c9c156cd0 0x7f4c9c1e6620 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:56.609 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.602+0000 7f4ca363e700 1 --2- 172.21.15.92:0/3249473056 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4c9c0c5820 0x7f4c9c0b5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:56.609 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.602+0000 7f4ca363e700 1 -- 172.21.15.92:0/3249473056 >> 172.21.15.92:0/3249473056 conn(0x7f4c9c0cd8d0 msgr2=0x7f4c9c0b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:56.609 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.602+0000 7f4ca363e700 1 -- 172.21.15.92:0/3249473056 shutdown_connections 2023-08-26T09:25:56.610 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.602+0000 7f4ca363e700 1 -- 172.21.15.92:0/3249473056 wait complete. 2023-08-26T09:25:56.619 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-26T09:25:56.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.736+0000 7fbbf47c1700 1 Processor -- start 2023-08-26T09:25:56.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.736+0000 7fbbf47c1700 1 -- start start 2023-08-26T09:25:56.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.737+0000 7fbbf47c1700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fbbec0b3480 0x7fbbec0d0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:56.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.737+0000 7fbbf47c1700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbec15f9b0 con 0x7fbbec0d05c0 2023-08-26T09:25:56.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.737+0000 7fbbf47c1700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbec15edc0 con 0x7fbbec152100 2023-08-26T09:25:56.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.737+0000 7fbbf47c1700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbec0d0a30 con 0x7fbbec0b3480 2023-08-26T09:25:56.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.737+0000 7fbbf2d5e700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fbbec0d05c0 0x7fbbec0b5cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:58054/0 (socket says 172.21.15.92:58054) 2023-08-26T09:25:56.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.737+0000 7fbbf2d5e700 1 -- 172.21.15.92:0/69333932 learned_addr learned my addr 172.21.15.92:0/69333932 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:56.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.737+0000 7fbbf1d5c700 1 --2- 172.21.15.92:0/69333932 >> v2:172.21.15.188:3300/0 conn(0x7fbbec0b3480 0x7fbbec0d0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:56.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.737+0000 7fbbf155b700 1 -- 172.21.15.92:0/69333932 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 929259589 0 0) 0x7fbbec15f9b0 con 0x7fbbec0d05c0 2023-08-26T09:25:56.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.737+0000 7fbbf155b700 1 -- 172.21.15.92:0/69333932 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbd80035b0 con 0x7fbbec0d05c0 2023-08-26T09:25:56.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.737+0000 7fbbf155b700 1 -- 172.21.15.92:0/69333932 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3036064163 0 0) 0x7fbbd80035b0 con 0x7fbbec0d05c0 2023-08-26T09:25:56.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.737+0000 7fbbf1d5c700 1 -- 172.21.15.92:0/69333932 >> v1:172.21.15.188:6789/0 conn(0x7fbbec152100 legacy=0x7fbbec0cb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:56.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.737+0000 7fbbf1d5c700 1 -- 172.21.15.92:0/69333932 >> v1:172.21.15.92:6789/0 conn(0x7fbbec0d05c0 legacy=0x7fbbec0b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:56.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.737+0000 7fbbf1d5c700 1 -- 172.21.15.92:0/69333932 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbec15f080 con 0x7fbbec0b3480 2023-08-26T09:25:56.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.738+0000 7fbbf1d5c700 1 --2- 172.21.15.92:0/69333932 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbec0b3480 0x7fbbec0d0080 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc009840 tx=0x7fbbdc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce5752f054b26f2a server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:56.746 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.738+0000 7fbbf155b700 1 -- 172.21.15.92:0/69333932 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe40019f0 con 0x7fbbec0b3480 2023-08-26T09:25:56.746 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.738+0000 7fbbf155b700 1 -- 172.21.15.92:0/69333932 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbdc004030 con 0x7fbbec0b3480 2023-08-26T09:25:56.746 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.738+0000 7fbbf155b700 1 -- 172.21.15.92:0/69333932 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc0043c0 con 0x7fbbec0b3480 2023-08-26T09:25:56.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.738+0000 7fbbf47c1700 1 -- 172.21.15.92:0/69333932 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbec0b3480 msgr2=0x7fbbec0d0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:56.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.738+0000 7fbbf47c1700 1 --2- 172.21.15.92:0/69333932 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbec0b3480 0x7fbbec0d0080 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc009840 tx=0x7fbbdc009b50 comp rx=0 tx=0).stop 2023-08-26T09:25:56.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.738+0000 7fbbf47c1700 1 -- 172.21.15.92:0/69333932 shutdown_connections 2023-08-26T09:25:56.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.738+0000 7fbbf47c1700 1 --2- 172.21.15.92:0/69333932 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbec0b3480 0x7fbbec0d0080 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:56.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.738+0000 7fbbf47c1700 1 -- 172.21.15.92:0/69333932 >> 172.21.15.92:0/69333932 conn(0x7fbbec06faa0 msgr2=0x7fbbec06fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:56.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.738+0000 7fbbf47c1700 1 -- 172.21.15.92:0/69333932 shutdown_connections 2023-08-26T09:25:56.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.738+0000 7fbbf47c1700 1 -- 172.21.15.92:0/69333932 wait complete. 2023-08-26T09:25:56.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.740+0000 7fbbf47c1700 1 Processor -- start 2023-08-26T09:25:56.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.740+0000 7fbbf47c1700 1 -- start start 2023-08-26T09:25:56.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.740+0000 7fbbf47c1700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbbec0b3480 0x7fbbec0c6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:56.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.740+0000 7fbbf47c1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbec0d05c0 0x7fbbec14ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:56.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.740+0000 7fbbf47c1700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbec152100 0x7fbbec0cd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:56.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.740+0000 7fbbf47c1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbec14f1c0 con 0x7fbbec0d05c0 2023-08-26T09:25:56.753 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.740+0000 7fbbf47c1700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbec0c5fb0 con 0x7fbbec152100 2023-08-26T09:25:56.753 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.740+0000 7fbbf47c1700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbec06c2f0 con 0x7fbbec0b3480 2023-08-26T09:25:56.753 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.740+0000 7fbbf1d5c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbec0d05c0 0x7fbbec14ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:56.753 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.740+0000 7fbbf1d5c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbec0d05c0 0x7fbbec14ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46044/0 (socket says 172.21.15.92:46044) 2023-08-26T09:25:56.753 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.740+0000 7fbbf1d5c700 1 -- 172.21.15.92:0/3257083901 learned_addr learned my addr 172.21.15.92:0/3257083901 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:56.753 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.741+0000 7fbbf255d700 1 --2- 172.21.15.92:0/3257083901 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbbec0b3480 0x7fbbec0c6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:56.754 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.741+0000 7fbbf2d5e700 1 --2- 172.21.15.92:0/3257083901 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbec152100 0x7fbbec0cd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:56.754 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.741+0000 7fbbf1d5c700 1 -- 172.21.15.92:0/3257083901 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbbec0b3480 msgr2=0x7fbbec0c6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:56.754 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.741+0000 7fbbf1d5c700 1 --2- 172.21.15.92:0/3257083901 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbbec0b3480 0x7fbbec0c6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:56.754 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.741+0000 7fbbf1d5c700 1 -- 172.21.15.92:0/3257083901 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbec152100 msgr2=0x7fbbec0cd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:56.754 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.741+0000 7fbbf1d5c700 1 --2- 172.21.15.92:0/3257083901 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbec152100 0x7fbbec0cd0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:56.755 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.741+0000 7fbbf1d5c700 1 -- 172.21.15.92:0/3257083901 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbdc0094a0 con 0x7fbbec0d05c0 2023-08-26T09:25:56.755 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.741+0000 7fbbf1d5c700 1 --2- 172.21.15.92:0/3257083901 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbec0d05c0 0x7fbbec14ec80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc0090b0 tx=0x7fbbdc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:56.755 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.741+0000 7fbbe2ffd700 1 -- 172.21.15.92:0/3257083901 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc003c90 con 0x7fbbec0d05c0 2023-08-26T09:25:56.755 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.741+0000 7fbbe2ffd700 1 -- 172.21.15.92:0/3257083901 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbdc01f070 con 0x7fbbec0d05c0 2023-08-26T09:25:56.756 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.741+0000 7fbbf47c1700 1 -- 172.21.15.92:0/3257083901 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbec0c6200 con 0x7fbbec0d05c0 2023-08-26T09:25:56.756 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.741+0000 7fbbe2ffd700 1 -- 172.21.15.92:0/3257083901 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc011870 con 0x7fbbec0d05c0 2023-08-26T09:25:56.756 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.741+0000 7fbbf47c1700 1 -- 172.21.15.92:0/3257083901 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbec0c67c0 con 0x7fbbec0d05c0 2023-08-26T09:25:56.756 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.742+0000 7fbbf47c1700 1 -- 172.21.15.92:0/3257083901 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbec04e660 con 0x7fbbec0d05c0 2023-08-26T09:25:56.756 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.743+0000 7fbbe2ffd700 1 -- 172.21.15.92:0/3257083901 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbbdc021030 con 0x7fbbec0d05c0 2023-08-26T09:25:56.757 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.743+0000 7fbbe2ffd700 1 --2- 172.21.15.92:0/3257083901 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fbbd006a0e0 0x7fbbd006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:56.757 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.743+0000 7fbbe2ffd700 1 -- 172.21.15.92:0/3257083901 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbbdc089c20 con 0x7fbbec0d05c0 2023-08-26T09:25:56.757 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.743+0000 7fbbf255d700 1 --2- 172.21.15.92:0/3257083901 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fbbd006a0e0 0x7fbbd006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:56.757 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.744+0000 7fbbf255d700 1 --2- 172.21.15.92:0/3257083901 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fbbd006a0e0 0x7fbbd006c5a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbbec0b0620 tx=0x7fbbe8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:56.758 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.747+0000 7fbbe2ffd700 1 -- 172.21.15.92:0/3257083901 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fbbdc0553a0 con 0x7fbbec0d05c0 2023-08-26T09:25:56.956 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.951+0000 7fbbf47c1700 1 -- 172.21.15.92:0/3257083901 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbbec155990 con 0x7fbbec0d05c0 2023-08-26T09:25:56.956 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.952+0000 7fbbe2ffd700 1 -- 172.21.15.92:0/3257083901 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbbdc0589c0 con 0x7fbbec0d05c0 2023-08-26T09:25:56.959 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.954+0000 7fbbf47c1700 1 -- 172.21.15.92:0/3257083901 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fbbd006a0e0 msgr2=0x7fbbd006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:56.959 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.954+0000 7fbbf47c1700 1 --2- 172.21.15.92:0/3257083901 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fbbd006a0e0 0x7fbbd006c5a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbbec0b0620 tx=0x7fbbe8009040 comp rx=0 tx=0).stop 2023-08-26T09:25:56.959 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.954+0000 7fbbf47c1700 1 -- 172.21.15.92:0/3257083901 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbec0d05c0 msgr2=0x7fbbec14ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:56.959 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.954+0000 7fbbf47c1700 1 --2- 172.21.15.92:0/3257083901 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbec0d05c0 0x7fbbec14ec80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc0090b0 tx=0x7fbbdc004750 comp rx=0 tx=0).stop 2023-08-26T09:25:56.960 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.954+0000 7fbbf47c1700 1 -- 172.21.15.92:0/3257083901 shutdown_connections 2023-08-26T09:25:56.960 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.954+0000 7fbbf47c1700 1 --2- 172.21.15.92:0/3257083901 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fbbd006a0e0 0x7fbbd006c5a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:56.960 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.954+0000 7fbbf47c1700 1 --2- 172.21.15.92:0/3257083901 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbec152100 0x7fbbec0cd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:56.960 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.954+0000 7fbbf47c1700 1 --2- 172.21.15.92:0/3257083901 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbbec0b3480 0x7fbbec0c6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:56.960 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.954+0000 7fbbf47c1700 1 --2- 172.21.15.92:0/3257083901 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbec0d05c0 0x7fbbec14ec80 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:56.960 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.954+0000 7fbbf47c1700 1 -- 172.21.15.92:0/3257083901 >> 172.21.15.92:0/3257083901 conn(0x7fbbec06faa0 msgr2=0x7fbbec0cf240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:56.961 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.954+0000 7fbbf47c1700 1 -- 172.21.15.92:0/3257083901 shutdown_connections 2023-08-26T09:25:56.961 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:56.954+0000 7fbbf47c1700 1 -- 172.21.15.92:0/3257083901 wait complete. 2023-08-26T09:25:56.961 INFO:teuthology.orchestra.run.smithi092.stderr:listed 0 entries 2023-08-26T09:25:56.970 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi188.front.sepia.ceph.com... 2023-08-26T09:25:56.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:56.971 DEBUG:teuthology.orchestra.run.smithi188:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-08-26T09:25:57.017 INFO:teuthology.orchestra.run:waiting for 300 2023-08-26T09:25:57.018 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi188.front.sepia.ceph.com 2023-08-26T09:25:57.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:25:57.018 DEBUG:teuthology.orchestra.run.smithi188:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-26T09:25:57.047 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-08-26T09:25:57.047 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-26T09:25:57.066 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-08-26T09:25:57.066 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-26T09:25:57.126 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-26T09:25:57.289 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.284+0000 7f208b9d2700 1 Processor -- start 2023-08-26T09:25:57.289 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.284+0000 7f208b9d2700 1 -- start start 2023-08-26T09:25:57.292 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.285+0000 7f208b9d2700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f208415d6c0 0x7f20840cea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:57.292 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.285+0000 7f208b9d2700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20840cf4d0 con 0x7f20840ca620 2023-08-26T09:25:57.292 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.285+0000 7f208b9d2700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20840ce3b0 con 0x7f20840cef70 2023-08-26T09:25:57.292 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.285+0000 7f208b9d2700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20840cb4a0 con 0x7f208415d6c0 2023-08-26T09:25:57.293 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.285+0000 7f208976e700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f20840ca620 0x7f20840caa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:58064/0 (socket says 172.21.15.92:58064) 2023-08-26T09:25:57.293 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.285+0000 7f208976e700 1 -- 172.21.15.92:0/1298971034 learned_addr learned my addr 172.21.15.92:0/1298971034 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:57.293 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.286+0000 7f2088f6d700 1 --2- 172.21.15.92:0/1298971034 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f208415d6c0 0x7f20840cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:57.293 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.286+0000 7f207bfff700 1 -- 172.21.15.92:0/1298971034 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1794751860 0 0) 0x7f20840cf4d0 con 0x7f20840ca620 2023-08-26T09:25:57.293 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.286+0000 7f207bfff700 1 -- 172.21.15.92:0/1298971034 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20700035b0 con 0x7f20840ca620 2023-08-26T09:25:57.294 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.286+0000 7f207bfff700 1 -- 172.21.15.92:0/1298971034 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 977602097 0 0) 0x7f20840ce3b0 con 0x7f20840cef70 2023-08-26T09:25:57.294 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.286+0000 7f207bfff700 1 -- 172.21.15.92:0/1298971034 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20840cf4d0 con 0x7f20840cef70 2023-08-26T09:25:57.294 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.286+0000 7f207bfff700 1 -- 172.21.15.92:0/1298971034 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2833657536 0 0) 0x7f20700035b0 con 0x7f20840ca620 2023-08-26T09:25:57.294 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.286+0000 7f2088f6d700 1 -- 172.21.15.92:0/1298971034 >> v1:172.21.15.188:6789/0 conn(0x7f20840cef70 legacy=0x7f208406cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:57.294 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.286+0000 7f2088f6d700 1 -- 172.21.15.92:0/1298971034 >> v1:172.21.15.92:6789/0 conn(0x7f20840ca620 legacy=0x7f20840caa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:57.295 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.286+0000 7f2088f6d700 1 -- 172.21.15.92:0/1298971034 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20840ce690 con 0x7f208415d6c0 2023-08-26T09:25:57.295 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.286+0000 7f2088f6d700 1 --2- 172.21.15.92:0/1298971034 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f208415d6c0 0x7f20840cea30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2080009870 tx=0x7f2080009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d09d20b7352c805f server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:57.295 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.286+0000 7f207bfff700 1 -- 172.21.15.92:0/1298971034 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2074001670 con 0x7f208415d6c0 2023-08-26T09:25:57.295 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.286+0000 7f207bfff700 1 -- 172.21.15.92:0/1298971034 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2080004030 con 0x7f208415d6c0 2023-08-26T09:25:57.295 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.286+0000 7f207bfff700 1 -- 172.21.15.92:0/1298971034 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20800043c0 con 0x7f208415d6c0 2023-08-26T09:25:57.295 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.287+0000 7f208b9d2700 1 -- 172.21.15.92:0/1298971034 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f208415d6c0 msgr2=0x7f20840cea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:57.296 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.287+0000 7f208b9d2700 1 --2- 172.21.15.92:0/1298971034 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f208415d6c0 0x7f20840cea30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2080009870 tx=0x7f2080009b80 comp rx=0 tx=0).stop 2023-08-26T09:25:57.296 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.287+0000 7f208b9d2700 1 -- 172.21.15.92:0/1298971034 shutdown_connections 2023-08-26T09:25:57.296 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.287+0000 7f208b9d2700 1 --2- 172.21.15.92:0/1298971034 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f208415d6c0 0x7f20840cea30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:57.296 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.287+0000 7f208b9d2700 1 -- 172.21.15.92:0/1298971034 >> 172.21.15.92:0/1298971034 conn(0x7f20840cc7b0 msgr2=0x7f20840ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:57.296 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.287+0000 7f208b9d2700 1 -- 172.21.15.92:0/1298971034 shutdown_connections 2023-08-26T09:25:57.297 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.287+0000 7f208b9d2700 1 -- 172.21.15.92:0/1298971034 wait complete. 2023-08-26T09:25:57.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.288+0000 7f208b9d2700 1 Processor -- start 2023-08-26T09:25:57.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.288+0000 7f208b9d2700 1 -- start start 2023-08-26T09:25:57.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.289+0000 7f208b9d2700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f20840ca620 0x7f20840c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:57.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.289+0000 7f208b9d2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20840cef70 0x7f2084151570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:57.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.289+0000 7f208b9d2700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f208415d6c0 0x7f20840c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:57.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.289+0000 7f208b9d2700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20840c9c90 con 0x7f20840cef70 2023-08-26T09:25:57.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.289+0000 7f208b9d2700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20840c79f0 con 0x7f20840ca620 2023-08-26T09:25:57.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.289+0000 7f208b9d2700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20840c7c90 con 0x7f208415d6c0 2023-08-26T09:25:57.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.289+0000 7f2088f6d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20840cef70 0x7f2084151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:57.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.289+0000 7f2088f6d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20840cef70 0x7f2084151570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46058/0 (socket says 172.21.15.92:46058) 2023-08-26T09:25:57.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.289+0000 7f2088f6d700 1 -- 172.21.15.92:0/335812367 learned_addr learned my addr 172.21.15.92:0/335812367 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:57.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.289+0000 7f208976e700 1 --2- 172.21.15.92:0/335812367 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f20840ca620 0x7f20840c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:57.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.289+0000 7f2089f6f700 1 --2- 172.21.15.92:0/335812367 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f208415d6c0 0x7f20840c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:57.304 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.289+0000 7f2088f6d700 1 -- 172.21.15.92:0/335812367 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f208415d6c0 msgr2=0x7f20840c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:57.304 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.289+0000 7f2088f6d700 1 --2- 172.21.15.92:0/335812367 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f208415d6c0 0x7f20840c91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:57.304 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.289+0000 7f2088f6d700 1 -- 172.21.15.92:0/335812367 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f20840ca620 msgr2=0x7f20840c8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:57.304 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.289+0000 7f2088f6d700 1 --2- 172.21.15.92:0/335812367 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f20840ca620 0x7f20840c8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:57.304 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.289+0000 7f2088f6d700 1 -- 172.21.15.92:0/335812367 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20800094a0 con 0x7f20840cef70 2023-08-26T09:25:57.305 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.289+0000 7f208976e700 1 --2- 172.21.15.92:0/335812367 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f20840ca620 0x7f20840c8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:57.305 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.289+0000 7f2088f6d700 1 --2- 172.21.15.92:0/335812367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20840cef70 0x7f2084151570 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2080000c00 tx=0x7f2080004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:57.305 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.290+0000 7f2079ffb700 1 -- 172.21.15.92:0/335812367 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2080003e30 con 0x7f20840cef70 2023-08-26T09:25:57.305 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.290+0000 7f2079ffb700 1 -- 172.21.15.92:0/335812367 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f208001f070 con 0x7f20840cef70 2023-08-26T09:25:57.305 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.290+0000 7f208b9d2700 1 -- 172.21.15.92:0/335812367 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20840c7f70 con 0x7f20840cef70 2023-08-26T09:25:57.306 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.290+0000 7f2079ffb700 1 -- 172.21.15.92:0/335812367 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2080011850 con 0x7f20840cef70 2023-08-26T09:25:57.306 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.290+0000 7f208b9d2700 1 -- 172.21.15.92:0/335812367 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20840c8530 con 0x7f20840cef70 2023-08-26T09:25:57.306 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.291+0000 7f208b9d2700 1 -- 172.21.15.92:0/335812367 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f208404e660 con 0x7f20840cef70 2023-08-26T09:25:57.306 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.291+0000 7f2079ffb700 1 -- 172.21.15.92:0/335812367 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2080021030 con 0x7f20840cef70 2023-08-26T09:25:57.306 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.292+0000 7f2079ffb700 1 --2- 172.21.15.92:0/335812367 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f206806a0e0 0x7f206806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:57.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.292+0000 7f2079ffb700 1 -- 172.21.15.92:0/335812367 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f20800898a0 con 0x7f20840cef70 2023-08-26T09:25:57.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.292+0000 7f208976e700 1 --2- 172.21.15.92:0/335812367 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f206806a0e0 0x7f206806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:57.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.292+0000 7f208976e700 1 --2- 172.21.15.92:0/335812367 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f206806a0e0 0x7f206806c5a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2074001380 tx=0x7f2074001630 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:57.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.296+0000 7f2079ffb700 1 -- 172.21.15.92:0/335812367 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2080054f90 con 0x7f20840cef70 2023-08-26T09:25:57.494 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.489+0000 7f208b9d2700 1 -- 172.21.15.92:0/335812367 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20840cbba0 con 0x7f20840cef70 2023-08-26T09:25:57.495 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.490+0000 7f2079ffb700 1 -- 172.21.15.92:0/335812367 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+18209 (secure 0 0 0) 0x7f20800119b0 con 0x7f20840cef70 2023-08-26T09:25:57.495 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:25:57.496 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":20,"fsid":"254a2d31-bd41-4507-8326-1b205ac24377","created":"2023-08-26T09:24:55.352131+0000","modified":"2023-08-26T09:25:15.447635+0000","last_up_change":"2023-08-26T09:25:06.124496+0000","last_in_change":"2023-08-26T09:24:57.840725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-26T09:25:06.650431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-26T09:25:06.973382+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-26T09:25:11.584141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-26T09:25:12.814990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e9e7638-4459-4d8d-8e40-130bcf48df66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6819","nonce":382827192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6824","nonce":382827192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6831","nonce":382827192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6827","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6829","nonce":382827192}]},"public_addr":"172.21.15.92:6819/382827192","cluster_addr":"172.21.15.92:6824/382827192","heartbeat_back_addr":"172.21.15.92:6831/382827192","heartbeat_front_addr":"172.21.15.92:6829/382827192","state":["exists","up"]},{"osd":1,"uuid":"164e68c9-aedd-4df5-9b70-f4b1ec3bda13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6809","nonce":618773438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6811","nonce":618773438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6815","nonce":618773438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6813","nonce":618773438}]},"public_addr":"172.21.15.92:6809/618773438","cluster_addr":"172.21.15.92:6811/618773438","heartbeat_back_addr":"172.21.15.92:6815/618773438","heartbeat_front_addr":"172.21.15.92:6813/618773438","state":["exists","up"]},{"osd":2,"uuid":"8701dfee-629a-4d30-82e4-b8fac340303f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6818","nonce":3697397687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6821","nonce":3697397687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6828","nonce":3697397687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6823","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6825","nonce":3697397687}]},"public_addr":"172.21.15.92:6818/3697397687","cluster_addr":"172.21.15.92:6821/3697397687","heartbeat_back_addr":"172.21.15.92:6828/3697397687","heartbeat_front_addr":"172.21.15.92:6825/3697397687","state":["exists","up"]},{"osd":3,"uuid":"93bdc94d-dc07-495f-995a-a6ad072f0247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6801","nonce":3579846453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6803","nonce":3579846453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6807","nonce":3579846453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6805","nonce":3579846453}]},"public_addr":"172.21.15.92:6801/3579846453","cluster_addr":"172.21.15.92:6803/3579846453","heartbeat_back_addr":"172.21.15.92:6807/3579846453","heartbeat_front_addr":"172.21.15.92:6805/3579846453","state":["exists","up"]},{"osd":4,"uuid":"d9d0ea80-8481-46a7-9677-c338d32cf1d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6809","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6811","nonce":3228383424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6813","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6815","nonce":3228383424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6821","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6823","nonce":3228383424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6817","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6819","nonce":3228383424}]},"public_addr":"172.21.15.188:6811/3228383424","cluster_addr":"172.21.15.188:6815/3228383424","heartbeat_back_addr":"172.21.15.188:6823/3228383424","heartbeat_front_addr":"172.21.15.188:6819/3228383424","state":["exists","up"]},{"osd":5,"uuid":"38d03253-467a-456f-bd5e-5a46532a0b18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6801","nonce":1655821054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6803","nonce":1655821054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6807","nonce":1655821054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6805","nonce":1655821054}]},"public_addr":"172.21.15.188:6801/1655821054","cluster_addr":"172.21.15.188:6803/1655821054","heartbeat_back_addr":"172.21.15.188:6807/1655821054","heartbeat_front_addr":"172.21.15.188:6805/1655821054","state":["exists","up"]},{"osd":6,"uuid":"d61564b5-136f-42e5-a843-626c2017cc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6810","nonce":2069976891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6814","nonce":2069976891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6822","nonce":2069976891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6818","nonce":2069976891}]},"public_addr":"172.21.15.188:6810/2069976891","cluster_addr":"172.21.15.188:6814/2069976891","heartbeat_back_addr":"172.21.15.188:6822/2069976891","heartbeat_front_addr":"172.21.15.188:6818/2069976891","state":["exists","up"]},{"osd":7,"uuid":"fae2949e-0d62-42cd-ba72-08f516084b20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6825","nonce":1882888860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6827","nonce":1882888860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6831","nonce":1882888860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6829","nonce":1882888860}]},"public_addr":"172.21.15.188:6825/1882888860","cluster_addr":"172.21.15.188:6827/1882888860","heartbeat_back_addr":"172.21.15.188:6831/1882888860","heartbeat_front_addr":"172.21.15.188:6829/1882888860","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.038523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.063160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.000857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.975572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.023848+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.765194+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.081365+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:05.110745+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-26T09:25:57.497 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.492+0000 7f208b9d2700 1 -- 172.21.15.92:0/335812367 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f206806a0e0 msgr2=0x7f206806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:57.497 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.492+0000 7f208b9d2700 1 --2- 172.21.15.92:0/335812367 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f206806a0e0 0x7f206806c5a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2074001380 tx=0x7f2074001630 comp rx=0 tx=0).stop 2023-08-26T09:25:57.498 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.492+0000 7f208b9d2700 1 -- 172.21.15.92:0/335812367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20840cef70 msgr2=0x7f2084151570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:57.498 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.492+0000 7f208b9d2700 1 --2- 172.21.15.92:0/335812367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20840cef70 0x7f2084151570 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2080000c00 tx=0x7f2080004750 comp rx=0 tx=0).stop 2023-08-26T09:25:57.498 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.492+0000 7f208b9d2700 1 -- 172.21.15.92:0/335812367 shutdown_connections 2023-08-26T09:25:57.498 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.492+0000 7f208b9d2700 1 --2- 172.21.15.92:0/335812367 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f206806a0e0 0x7f206806c5a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:57.499 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.492+0000 7f208b9d2700 1 --2- 172.21.15.92:0/335812367 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f20840ca620 0x7f20840c8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:57.499 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.492+0000 7f208b9d2700 1 --2- 172.21.15.92:0/335812367 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f208415d6c0 0x7f20840c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:57.499 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.492+0000 7f208b9d2700 1 --2- 172.21.15.92:0/335812367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20840cef70 0x7f2084151570 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:57.499 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.492+0000 7f208b9d2700 1 -- 172.21.15.92:0/335812367 >> 172.21.15.92:0/335812367 conn(0x7f20840cc7b0 msgr2=0x7f20840ccb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:57.499 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.492+0000 7f208b9d2700 1 -- 172.21.15.92:0/335812367 shutdown_connections 2023-08-26T09:25:57.499 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.492+0000 7f208b9d2700 1 -- 172.21.15.92:0/335812367 wait complete. 2023-08-26T09:25:57.509 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-26T09:25:06.650431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-26T09:25:06.973382+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-26T09:25:11.584141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-26T09:25:12.814990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-26T09:25:57.510 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-26T09:25:57.633 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.628+0000 7ff981179700 1 Processor -- start 2023-08-26T09:25:57.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.628+0000 7ff981179700 1 -- start start 2023-08-26T09:25:57.640 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.629+0000 7ff981179700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff97c15d220 0x7ff97c0af390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:57.640 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.629+0000 7ff981179700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7ff97c06db70 0x7ff97c070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:57.640 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.629+0000 7ff981179700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff97c071260 0x7ff97c160d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:57.640 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.629+0000 7ff981179700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff97c0aee50 con 0x7ff97c15d220 2023-08-26T09:25:57.640 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.629+0000 7ff981179700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff97c0af130 con 0x7ff97c06db70 2023-08-26T09:25:57.641 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.629+0000 7ff981179700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c0c4cb0 con 0x7ff97c071260 2023-08-26T09:25:57.641 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.629+0000 7ff97ad9d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff97c15d220 0x7ff97c0af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:57.641 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.629+0000 7ff97ad9d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff97c15d220 0x7ff97c0af390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46064/0 (socket says 172.21.15.92:46064) 2023-08-26T09:25:57.641 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.629+0000 7ff97ad9d700 1 -- 172.21.15.92:0/853035427 learned_addr learned my addr 172.21.15.92:0/853035427 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:57.641 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.629+0000 7ff97b59e700 1 --2- 172.21.15.92:0/853035427 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff97c071260 0x7ff97c160d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:57.642 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.629+0000 7ff97a59c700 1 --2- 172.21.15.92:0/853035427 >> v2:172.21.15.188:3300/0 conn(0x7ff97c06db70 0x7ff97c070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:57.642 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.630+0000 7ff97ad9d700 1 -- 172.21.15.92:0/853035427 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff97c071260 msgr2=0x7ff97c160d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:57.642 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.630+0000 7ff97ad9d700 1 --2- 172.21.15.92:0/853035427 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff97c071260 0x7ff97c160d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:57.642 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.630+0000 7ff97ad9d700 1 -- 172.21.15.92:0/853035427 >> v2:172.21.15.188:3300/0 conn(0x7ff97c06db70 msgr2=0x7ff97c070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:57.642 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.630+0000 7ff97ad9d700 1 --2- 172.21.15.92:0/853035427 >> v2:172.21.15.188:3300/0 conn(0x7ff97c06db70 0x7ff97c070d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:57.643 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.630+0000 7ff97ad9d700 1 -- 172.21.15.92:0/853035427 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff97c0c4f90 con 0x7ff97c15d220 2023-08-26T09:25:57.643 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.630+0000 7ff97ad9d700 1 --2- 172.21.15.92:0/853035427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff97c15d220 0x7ff97c0af390 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ff97c072240 tx=0x7ff96c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdf6977618cc3bcd server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:57.643 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.630+0000 7ff979d9b700 1 -- 172.21.15.92:0/853035427 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96c011830 con 0x7ff97c15d220 2023-08-26T09:25:57.643 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.630+0000 7ff979d9b700 1 -- 172.21.15.92:0/853035427 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff96c011990 con 0x7ff97c15d220 2023-08-26T09:25:57.643 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.630+0000 7ff979d9b700 1 -- 172.21.15.92:0/853035427 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96c011d20 con 0x7ff97c15d220 2023-08-26T09:25:57.644 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.630+0000 7ff981179700 1 -- 172.21.15.92:0/853035427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff97c15d220 msgr2=0x7ff97c0af390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:57.644 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.630+0000 7ff981179700 1 --2- 172.21.15.92:0/853035427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff97c15d220 0x7ff97c0af390 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ff97c072240 tx=0x7ff96c009bd0 comp rx=0 tx=0).stop 2023-08-26T09:25:57.644 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.630+0000 7ff981179700 1 -- 172.21.15.92:0/853035427 shutdown_connections 2023-08-26T09:25:57.644 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.630+0000 7ff981179700 1 --2- 172.21.15.92:0/853035427 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff97c071260 0x7ff97c160d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:57.644 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.631+0000 7ff981179700 1 --2- 172.21.15.92:0/853035427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff97c15d220 0x7ff97c0af390 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:57.645 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.631+0000 7ff981179700 1 --2- 172.21.15.92:0/853035427 >> v2:172.21.15.188:3300/0 conn(0x7ff97c06db70 0x7ff97c070d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:57.645 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.631+0000 7ff981179700 1 -- 172.21.15.92:0/853035427 >> 172.21.15.92:0/853035427 conn(0x7ff97c06b430 msgr2=0x7ff97c06b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:57.645 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.631+0000 7ff981179700 1 -- 172.21.15.92:0/853035427 shutdown_connections 2023-08-26T09:25:57.645 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.631+0000 7ff981179700 1 -- 172.21.15.92:0/853035427 wait complete. 2023-08-26T09:25:57.645 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.632+0000 7ff981179700 1 Processor -- start 2023-08-26T09:25:57.646 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.632+0000 7ff981179700 1 -- start start 2023-08-26T09:25:57.646 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.633+0000 7ff981179700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff97c06db70 0x7ff97c1f21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:57.646 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.633+0000 7ff981179700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff97c071260 0x7ff97c1f67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:57.646 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.633+0000 7ff981179700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff97c15d220 0x7ff97c15bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:57.646 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.633+0000 7ff981179700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c1f26e0 con 0x7ff97c06db70 2023-08-26T09:25:57.647 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.633+0000 7ff981179700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c0c70b0 con 0x7ff97c071260 2023-08-26T09:25:57.647 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.633+0000 7ff981179700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c1f6ce0 con 0x7ff97c15d220 2023-08-26T09:25:57.647 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.633+0000 7ff97ad9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff97c06db70 0x7ff97c1f21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:57.647 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.634+0000 7ff97ad9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff97c06db70 0x7ff97c1f21a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46072/0 (socket says 172.21.15.92:46072) 2023-08-26T09:25:57.648 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.634+0000 7ff97ad9d700 1 -- 172.21.15.92:0/1850411182 learned_addr learned my addr 172.21.15.92:0/1850411182 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:57.648 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.634+0000 7ff97b59e700 1 --2- 172.21.15.92:0/1850411182 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff97c15d220 0x7ff97c15bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:57.648 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.634+0000 7ff97a59c700 1 --2- 172.21.15.92:0/1850411182 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff97c071260 0x7ff97c1f67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:57.648 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.634+0000 7ff97ad9d700 1 -- 172.21.15.92:0/1850411182 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff97c15d220 msgr2=0x7ff97c15bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:57.648 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.634+0000 7ff97ad9d700 1 --2- 172.21.15.92:0/1850411182 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff97c15d220 0x7ff97c15bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:57.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.634+0000 7ff97ad9d700 1 -- 172.21.15.92:0/1850411182 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff97c071260 msgr2=0x7ff97c1f67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:57.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.634+0000 7ff97ad9d700 1 --2- 172.21.15.92:0/1850411182 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff97c071260 0x7ff97c1f67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:57.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.634+0000 7ff97ad9d700 1 -- 172.21.15.92:0/1850411182 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff96c009550 con 0x7ff97c06db70 2023-08-26T09:25:57.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.634+0000 7ff97ad9d700 1 --2- 172.21.15.92:0/1850411182 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff97c06db70 0x7ff97c1f21a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff96c009c10 tx=0x7ff96c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:57.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.634+0000 7ff9637fe700 1 -- 172.21.15.92:0/1850411182 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96c004510 con 0x7ff97c06db70 2023-08-26T09:25:57.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.634+0000 7ff9637fe700 1 -- 172.21.15.92:0/1850411182 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff96c01e070 con 0x7ff97c06db70 2023-08-26T09:25:57.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.634+0000 7ff9637fe700 1 -- 172.21.15.92:0/1850411182 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96c0038e0 con 0x7ff97c06db70 2023-08-26T09:25:57.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.634+0000 7ff981179700 1 -- 172.21.15.92:0/1850411182 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff97c15dc40 con 0x7ff97c06db70 2023-08-26T09:25:57.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.634+0000 7ff981179700 1 -- 172.21.15.92:0/1850411182 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff97c15e200 con 0x7ff97c06db70 2023-08-26T09:25:57.651 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.635+0000 7ff981179700 1 -- 172.21.15.92:0/1850411182 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff97c04eeb0 con 0x7ff97c06db70 2023-08-26T09:25:57.652 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.635+0000 7ff9637fe700 1 -- 172.21.15.92:0/1850411182 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff96c003a40 con 0x7ff97c06db70 2023-08-26T09:25:57.652 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.636+0000 7ff9637fe700 1 --2- 172.21.15.92:0/1850411182 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7ff96806a0e0 0x7ff96806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:57.652 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.636+0000 7ff9637fe700 1 -- 172.21.15.92:0/1850411182 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff96c089330 con 0x7ff97c06db70 2023-08-26T09:25:57.652 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.636+0000 7ff97a59c700 1 --2- 172.21.15.92:0/1850411182 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7ff96806a0e0 0x7ff96806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:57.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.636+0000 7ff97a59c700 1 --2- 172.21.15.92:0/1850411182 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7ff96806a0e0 0x7ff96806c5a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff97c1565a0 tx=0x7ff970008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:57.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.640+0000 7ff9637fe700 1 -- 172.21.15.92:0/1850411182 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff96c054ab0 con 0x7ff97c06db70 2023-08-26T09:25:57.834 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.829+0000 7ff981179700 1 -- 172.21.15.92:0/1850411182 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff97c0ad6d0 con 0x7ff97c06db70 2023-08-26T09:25:57.834 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.829+0000 7ff9637fe700 1 -- 172.21.15.92:0/1850411182 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff96c0580d0 con 0x7ff97c06db70 2023-08-26T09:25:57.835 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 8 2023-08-26T09:25:57.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.831+0000 7ff981179700 1 -- 172.21.15.92:0/1850411182 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7ff96806a0e0 msgr2=0x7ff96806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:57.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.831+0000 7ff981179700 1 --2- 172.21.15.92:0/1850411182 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7ff96806a0e0 0x7ff96806c5a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff97c1565a0 tx=0x7ff970008040 comp rx=0 tx=0).stop 2023-08-26T09:25:57.838 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.831+0000 7ff981179700 1 -- 172.21.15.92:0/1850411182 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff97c06db70 msgr2=0x7ff97c1f21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:57.838 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.831+0000 7ff981179700 1 --2- 172.21.15.92:0/1850411182 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff97c06db70 0x7ff97c1f21a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff96c009c10 tx=0x7ff96c004750 comp rx=0 tx=0).stop 2023-08-26T09:25:57.838 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.831+0000 7ff981179700 1 -- 172.21.15.92:0/1850411182 shutdown_connections 2023-08-26T09:25:57.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.831+0000 7ff981179700 1 --2- 172.21.15.92:0/1850411182 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff97c15d220 0x7ff97c15bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:57.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.831+0000 7ff981179700 1 --2- 172.21.15.92:0/1850411182 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff97c06db70 0x7ff97c1f21a0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:57.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.831+0000 7ff981179700 1 --2- 172.21.15.92:0/1850411182 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7ff96806a0e0 0x7ff96806c5a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:57.840 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.831+0000 7ff981179700 1 --2- 172.21.15.92:0/1850411182 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff97c071260 0x7ff97c1f67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:57.840 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.831+0000 7ff981179700 1 -- 172.21.15.92:0/1850411182 >> 172.21.15.92:0/1850411182 conn(0x7ff97c06b430 msgr2=0x7ff97c156c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:57.840 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.832+0000 7ff981179700 1 -- 172.21.15.92:0/1850411182 shutdown_connections 2023-08-26T09:25:57.840 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.832+0000 7ff981179700 1 -- 172.21.15.92:0/1850411182 wait complete. 2023-08-26T09:25:57.849 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-26T09:25:57.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.968+0000 7f9fa295d700 1 Processor -- start 2023-08-26T09:25:57.973 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.968+0000 7f9fa295d700 1 -- start start 2023-08-26T09:25:57.978 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.968+0000 7f9fa295d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f9f9c15d220 0x7f9f9c0af390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:57.979 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.968+0000 7f9fa295d700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9f9c071430 0x7f9f9c06a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:57.979 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.968+0000 7f9fa295d700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f9c0718c0 con 0x7f9f9c06db70 2023-08-26T09:25:57.979 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.968+0000 7f9fa295d700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f9c0aee50 con 0x7f9f9c15d220 2023-08-26T09:25:57.979 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.968+0000 7f9fa295d700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c0af130 con 0x7f9f9c071430 2023-08-26T09:25:57.979 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.969+0000 7f9f9bfff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f9f9c15d220 0x7f9f9c0af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:57.980 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.969+0000 7f9f9b7fe700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f9f9c06db70 0x7f9f9c070d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:58094/0 (socket says 172.21.15.92:58094) 2023-08-26T09:25:57.980 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.969+0000 7f9f9b7fe700 1 -- 172.21.15.92:0/3849491911 learned_addr learned my addr 172.21.15.92:0/3849491911 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:57.980 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.969+0000 7f9f9bfff700 1 -- 172.21.15.92:0/3849491911 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9f9c071430 msgr2=0x7f9f9c06a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:57.980 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.969+0000 7f9fa0efa700 1 --2- 172.21.15.92:0/3849491911 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9f9c071430 0x7f9f9c06a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:57.980 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.969+0000 7f9f9affd700 1 -- 172.21.15.92:0/3849491911 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 318891358 0 0) 0x7f9f9c0718c0 con 0x7f9f9c06db70 2023-08-26T09:25:57.981 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.969+0000 7f9f9bfff700 1 --2- 172.21.15.92:0/3849491911 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9f9c071430 0x7f9f9c06a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:57.981 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.969+0000 7f9f9bfff700 1 -- 172.21.15.92:0/3849491911 >> v1:172.21.15.92:6789/0 conn(0x7f9f9c06db70 legacy=0x7f9f9c070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:57.981 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.969+0000 7f9f9bfff700 1 -- 172.21.15.92:0/3849491911 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f9c0c4cb0 con 0x7f9f9c15d220 2023-08-26T09:25:57.981 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.969+0000 7f9f9bfff700 1 --2- 172.21.15.92:0/3849491911 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f9c15d220 0x7f9f9c0af390 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c009840 tx=0x7f9f8c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db4c28e65cf53790 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:57.981 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.969+0000 7f9f9affd700 1 -- 172.21.15.92:0/3849491911 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c011830 con 0x7f9f9c15d220 2023-08-26T09:25:57.982 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.969+0000 7f9f9affd700 1 -- 172.21.15.92:0/3849491911 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f8c011990 con 0x7f9f9c15d220 2023-08-26T09:25:57.982 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.969+0000 7f9f9affd700 1 -- 172.21.15.92:0/3849491911 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c011d20 con 0x7f9f9c15d220 2023-08-26T09:25:57.982 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.970+0000 7f9fa295d700 1 -- 172.21.15.92:0/3849491911 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f9c15d220 msgr2=0x7f9f9c0af390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:57.982 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.970+0000 7f9fa295d700 1 --2- 172.21.15.92:0/3849491911 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f9c15d220 0x7f9f9c0af390 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c009840 tx=0x7f9f8c009b50 comp rx=0 tx=0).stop 2023-08-26T09:25:57.982 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.970+0000 7f9fa295d700 1 -- 172.21.15.92:0/3849491911 shutdown_connections 2023-08-26T09:25:57.983 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.970+0000 7f9fa295d700 1 --2- 172.21.15.92:0/3849491911 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9f9c071430 0x7f9f9c06a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:57.983 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.970+0000 7f9fa295d700 1 --2- 172.21.15.92:0/3849491911 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f9c15d220 0x7f9f9c0af390 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:57.983 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.970+0000 7f9fa295d700 1 -- 172.21.15.92:0/3849491911 >> 172.21.15.92:0/3849491911 conn(0x7f9f9c06b430 msgr2=0x7f9f9c06b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:57.983 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.970+0000 7f9fa295d700 1 -- 172.21.15.92:0/3849491911 shutdown_connections 2023-08-26T09:25:57.983 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.970+0000 7f9fa295d700 1 -- 172.21.15.92:0/3849491911 wait complete. 2023-08-26T09:25:57.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.971+0000 7f9fa295d700 1 Processor -- start 2023-08-26T09:25:57.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.971+0000 7f9fa295d700 1 -- start start 2023-08-26T09:25:57.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.972+0000 7f9fa295d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f9c06db70 0x7f9f9c14c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:57.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.972+0000 7f9fa295d700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9f9c071430 0x7f9f9c0ce8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:57.985 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.972+0000 7f9fa295d700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9f9c15d220 0x7f9f9c0cee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:57.985 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.972+0000 7f9fa295d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c14cad0 con 0x7f9f9c06db70 2023-08-26T09:25:57.985 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.972+0000 7f9fa295d700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c0b03b0 con 0x7f9f9c15d220 2023-08-26T09:25:57.985 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.972+0000 7f9fa295d700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c14c570 con 0x7f9f9c071430 2023-08-26T09:25:57.985 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.972+0000 7f9f9bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f9c06db70 0x7f9f9c14c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:57.986 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.972+0000 7f9f9bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f9c06db70 0x7f9f9c14c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46084/0 (socket says 172.21.15.92:46084) 2023-08-26T09:25:57.986 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.972+0000 7f9f9bfff700 1 -- 172.21.15.92:0/782219510 learned_addr learned my addr 172.21.15.92:0/782219510 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:57.986 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.972+0000 7f9fa0efa700 1 --2- 172.21.15.92:0/782219510 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9f9c15d220 0x7f9f9c0cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:57.986 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.972+0000 7f9f9b7fe700 1 --2- 172.21.15.92:0/782219510 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9f9c071430 0x7f9f9c0ce8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:57.986 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.972+0000 7f9f9bfff700 1 -- 172.21.15.92:0/782219510 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9f9c071430 msgr2=0x7f9f9c0ce8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:57.987 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.972+0000 7f9f9bfff700 1 --2- 172.21.15.92:0/782219510 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9f9c071430 0x7f9f9c0ce8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:57.987 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.972+0000 7f9f9bfff700 1 -- 172.21.15.92:0/782219510 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9f9c15d220 msgr2=0x7f9f9c0cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:57.987 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.972+0000 7f9f9bfff700 1 --2- 172.21.15.92:0/782219510 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9f9c15d220 0x7f9f9c0cee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:57.987 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.972+0000 7f9f9bfff700 1 -- 172.21.15.92:0/782219510 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f8c0094a0 con 0x7f9f9c06db70 2023-08-26T09:25:57.987 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.972+0000 7f9fa0efa700 1 --2- 172.21.15.92:0/782219510 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9f9c15d220 0x7f9f9c0cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:57.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.972+0000 7f9f9b7fe700 1 --2- 172.21.15.92:0/782219510 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9f9c071430 0x7f9f9c0ce8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:57.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.972+0000 7f9f9bfff700 1 --2- 172.21.15.92:0/782219510 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f9c06db70 0x7f9f9c14c030 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c014040 tx=0x7f9f8c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:57.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.973+0000 7f9f98ff9700 1 -- 172.21.15.92:0/782219510 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c0045f0 con 0x7f9f9c06db70 2023-08-26T09:25:57.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.973+0000 7f9f98ff9700 1 -- 172.21.15.92:0/782219510 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f8c01e070 con 0x7f9f9c06db70 2023-08-26T09:25:57.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.973+0000 7f9fa295d700 1 -- 172.21.15.92:0/782219510 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f9c0af310 con 0x7f9f9c06db70 2023-08-26T09:25:57.989 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.973+0000 7f9f98ff9700 1 -- 172.21.15.92:0/782219510 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c003ae0 con 0x7f9f9c06db70 2023-08-26T09:25:57.989 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.973+0000 7f9fa295d700 1 -- 172.21.15.92:0/782219510 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f9c0af8d0 con 0x7f9f9c06db70 2023-08-26T09:25:57.989 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.974+0000 7f9fa295d700 1 -- 172.21.15.92:0/782219510 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f9c04eeb0 con 0x7f9f9c06db70 2023-08-26T09:25:57.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.974+0000 7f9f98ff9700 1 -- 172.21.15.92:0/782219510 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9f8c003c40 con 0x7f9f9c06db70 2023-08-26T09:25:57.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.974+0000 7f9f98ff9700 1 --2- 172.21.15.92:0/782219510 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f9f8806a0e0 0x7f9f8806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:57.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.975+0000 7f9f9b7fe700 1 --2- 172.21.15.92:0/782219510 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f9f8806a0e0 0x7f9f8806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:57.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.975+0000 7f9f98ff9700 1 -- 172.21.15.92:0/782219510 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9f8c089690 con 0x7f9f9c06db70 2023-08-26T09:25:57.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.975+0000 7f9f9b7fe700 1 --2- 172.21.15.92:0/782219510 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f9f8806a0e0 0x7f9f8806c5a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c1619e0 tx=0x7f9f90007cc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:57.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:57.979+0000 7f9f98ff9700 1 -- 172.21.15.92:0/782219510 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9f8c054e10 con 0x7f9f9c06db70 2023-08-26T09:25:58.172 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.167+0000 7f9fa295d700 1 -- 172.21.15.92:0/782219510 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9f9c073d50 con 0x7f9f9c06db70 2023-08-26T09:25:58.173 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.168+0000 7f9f98ff9700 1 -- 172.21.15.92:0/782219510 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9f8c020020 con 0x7f9f9c06db70 2023-08-26T09:25:58.173 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 1 2023-08-26T09:25:58.175 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.170+0000 7f9fa295d700 1 -- 172.21.15.92:0/782219510 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f9f8806a0e0 msgr2=0x7f9f8806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:58.175 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.170+0000 7f9fa295d700 1 --2- 172.21.15.92:0/782219510 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f9f8806a0e0 0x7f9f8806c5a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c1619e0 tx=0x7f9f90007cc0 comp rx=0 tx=0).stop 2023-08-26T09:25:58.176 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.170+0000 7f9fa295d700 1 -- 172.21.15.92:0/782219510 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f9c06db70 msgr2=0x7f9f9c14c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:58.176 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.170+0000 7f9fa295d700 1 --2- 172.21.15.92:0/782219510 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f9c06db70 0x7f9f9c14c030 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c014040 tx=0x7f9f8c004750 comp rx=0 tx=0).stop 2023-08-26T09:25:58.176 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.170+0000 7f9fa295d700 1 -- 172.21.15.92:0/782219510 shutdown_connections 2023-08-26T09:25:58.176 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.170+0000 7f9fa295d700 1 --2- 172.21.15.92:0/782219510 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f9f8806a0e0 0x7f9f8806c5a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:58.176 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.170+0000 7f9fa295d700 1 --2- 172.21.15.92:0/782219510 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9f9c15d220 0x7f9f9c0cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:58.177 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.170+0000 7f9fa295d700 1 --2- 172.21.15.92:0/782219510 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f9c06db70 0x7f9f9c14c030 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:58.177 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.170+0000 7f9fa295d700 1 --2- 172.21.15.92:0/782219510 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9f9c071430 0x7f9f9c0ce8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:58.177 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.170+0000 7f9fa295d700 1 -- 172.21.15.92:0/782219510 >> 172.21.15.92:0/782219510 conn(0x7f9f9c06b430 msgr2=0x7f9f9c0718c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:58.177 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.170+0000 7f9fa295d700 1 -- 172.21.15.92:0/782219510 shutdown_connections 2023-08-26T09:25:58.177 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.170+0000 7f9fa295d700 1 -- 172.21.15.92:0/782219510 wait complete. 2023-08-26T09:25:58.187 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-26T09:25:58.311 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.306+0000 7fbf42265700 1 Processor -- start 2023-08-26T09:25:58.311 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.306+0000 7fbf42265700 1 -- start start 2023-08-26T09:25:58.313 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.307+0000 7fbf42265700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fbf3c071430 0x7fbf3c167ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:58.314 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.307+0000 7fbf42265700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf3c0aee50 con 0x7fbf3c0af390 2023-08-26T09:25:58.314 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.307+0000 7fbf42265700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf3c0af130 con 0x7fbf3c15d220 2023-08-26T09:25:58.314 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.307+0000 7fbf42265700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf3c0c4cb0 con 0x7fbf3c071430 2023-08-26T09:25:58.314 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.307+0000 7fbf3b7fe700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fbf3c0af390 0x7fbf3c070d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:58108/0 (socket says 172.21.15.92:58108) 2023-08-26T09:25:58.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.307+0000 7fbf3b7fe700 1 -- 172.21.15.92:0/117874089 learned_addr learned my addr 172.21.15.92:0/117874089 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:58.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.307+0000 7fbf40802700 1 --2- 172.21.15.92:0/117874089 >> v2:172.21.15.92:3300/0 conn(0x7fbf3c071430 0x7fbf3c167ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:58.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.307+0000 7fbf3affd700 1 -- 172.21.15.92:0/117874089 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 850910181 0 0) 0x7fbf3c0aee50 con 0x7fbf3c0af390 2023-08-26T09:25:58.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.307+0000 7fbf3affd700 1 -- 172.21.15.92:0/117874089 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf240035b0 con 0x7fbf3c0af390 2023-08-26T09:25:58.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.307+0000 7fbf40802700 1 -- 172.21.15.92:0/117874089 >> v1:172.21.15.188:6789/0 conn(0x7fbf3c15d220 legacy=0x7fbf3c06db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:58.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.307+0000 7fbf40802700 1 -- 172.21.15.92:0/117874089 >> v1:172.21.15.92:6789/0 conn(0x7fbf3c0af390 legacy=0x7fbf3c070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:58.316 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.307+0000 7fbf40802700 1 -- 172.21.15.92:0/117874089 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf3c0c4f90 con 0x7fbf3c071430 2023-08-26T09:25:58.316 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.307+0000 7fbf40802700 1 --2- 172.21.15.92:0/117874089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf3c071430 0x7fbf3c167ee0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fbf34009d90 tx=0x7fbf3400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd2f40a9ddc384fb server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:58.316 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.308+0000 7fbf3affd700 1 -- 172.21.15.92:0/117874089 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3400e070 con 0x7fbf3c071430 2023-08-26T09:25:58.316 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.308+0000 7fbf3affd700 1 -- 172.21.15.92:0/117874089 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf3400bb20 con 0x7fbf3c071430 2023-08-26T09:25:58.316 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.308+0000 7fbf3affd700 1 -- 172.21.15.92:0/117874089 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf34012430 con 0x7fbf3c071430 2023-08-26T09:25:58.317 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.308+0000 7fbf42265700 1 -- 172.21.15.92:0/117874089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf3c071430 msgr2=0x7fbf3c167ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:58.317 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.308+0000 7fbf42265700 1 --2- 172.21.15.92:0/117874089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf3c071430 0x7fbf3c167ee0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fbf34009d90 tx=0x7fbf3400b330 comp rx=0 tx=0).stop 2023-08-26T09:25:58.317 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.308+0000 7fbf42265700 1 -- 172.21.15.92:0/117874089 shutdown_connections 2023-08-26T09:25:58.317 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.308+0000 7fbf42265700 1 --2- 172.21.15.92:0/117874089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf3c071430 0x7fbf3c167ee0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:58.317 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.308+0000 7fbf42265700 1 -- 172.21.15.92:0/117874089 >> 172.21.15.92:0/117874089 conn(0x7fbf3c06b430 msgr2=0x7fbf3c06b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:58.318 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.308+0000 7fbf42265700 1 -- 172.21.15.92:0/117874089 shutdown_connections 2023-08-26T09:25:58.318 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.308+0000 7fbf42265700 1 -- 172.21.15.92:0/117874089 wait complete. 2023-08-26T09:25:58.320 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.309+0000 7fbf42265700 1 Processor -- start 2023-08-26T09:25:58.321 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.310+0000 7fbf42265700 1 -- start start 2023-08-26T09:25:58.321 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.310+0000 7fbf42265700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf3c071430 0x7fbf3c1f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:58.321 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.310+0000 7fbf42265700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf3c0af390 0x7fbf3c152600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:58.321 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.310+0000 7fbf42265700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbf3c15d220 0x7fbf3c1532e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:58.321 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.310+0000 7fbf42265700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf3c1f69e0 con 0x7fbf3c0af390 2023-08-26T09:25:58.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.310+0000 7fbf42265700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf3c159b80 con 0x7fbf3c071430 2023-08-26T09:25:58.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.310+0000 7fbf42265700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf3c1530c0 con 0x7fbf3c15d220 2023-08-26T09:25:58.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.310+0000 7fbf3b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf3c0af390 0x7fbf3c152600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:58.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.310+0000 7fbf3b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf3c0af390 0x7fbf3c152600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46100/0 (socket says 172.21.15.92:46100) 2023-08-26T09:25:58.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.310+0000 7fbf3b7fe700 1 -- 172.21.15.92:0/374568049 learned_addr learned my addr 172.21.15.92:0/374568049 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:58.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.311+0000 7fbf3bfff700 1 --2- 172.21.15.92:0/374568049 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf3c071430 0x7fbf3c1f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:58.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.311+0000 7fbf40802700 1 --2- 172.21.15.92:0/374568049 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbf3c15d220 0x7fbf3c1532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:58.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.311+0000 7fbf3b7fe700 1 -- 172.21.15.92:0/374568049 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbf3c15d220 msgr2=0x7fbf3c1532e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:58.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.311+0000 7fbf3b7fe700 1 --2- 172.21.15.92:0/374568049 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbf3c15d220 0x7fbf3c1532e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:58.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.311+0000 7fbf3b7fe700 1 -- 172.21.15.92:0/374568049 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf3c071430 msgr2=0x7fbf3c1f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:58.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.311+0000 7fbf3b7fe700 1 --2- 172.21.15.92:0/374568049 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf3c071430 0x7fbf3c1f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:58.324 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.311+0000 7fbf3b7fe700 1 -- 172.21.15.92:0/374568049 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf34009a70 con 0x7fbf3c0af390 2023-08-26T09:25:58.324 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.311+0000 7fbf3bfff700 1 --2- 172.21.15.92:0/374568049 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf3c071430 0x7fbf3c1f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:58.324 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.311+0000 7fbf3b7fe700 1 --2- 172.21.15.92:0/374568049 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf3c0af390 0x7fbf3c152600 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c00c700 tx=0x7fbf2c00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:58.324 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.311+0000 7fbf38ff9700 1 -- 172.21.15.92:0/374568049 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c005d70 con 0x7fbf3c0af390 2023-08-26T09:25:58.324 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.311+0000 7fbf38ff9700 1 -- 172.21.15.92:0/374568049 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf2c0070d0 con 0x7fbf3c0af390 2023-08-26T09:25:58.325 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.311+0000 7fbf38ff9700 1 -- 172.21.15.92:0/374568049 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c007460 con 0x7fbf3c0af390 2023-08-26T09:25:58.325 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.311+0000 7fbf42265700 1 -- 172.21.15.92:0/374568049 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf3c152b40 con 0x7fbf3c0af390 2023-08-26T09:25:58.325 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.311+0000 7fbf42265700 1 -- 172.21.15.92:0/374568049 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf3c159530 con 0x7fbf3c0af390 2023-08-26T09:25:58.325 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.312+0000 7fbf42265700 1 -- 172.21.15.92:0/374568049 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf3c04eeb0 con 0x7fbf3c0af390 2023-08-26T09:25:58.325 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.312+0000 7fbf38ff9700 1 -- 172.21.15.92:0/374568049 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbf2c0075c0 con 0x7fbf3c0af390 2023-08-26T09:25:58.326 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.313+0000 7fbf38ff9700 1 --2- 172.21.15.92:0/374568049 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fbf2806a0e0 0x7fbf2806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:58.326 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.313+0000 7fbf3bfff700 1 --2- 172.21.15.92:0/374568049 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fbf2806a0e0 0x7fbf2806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:58.326 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.313+0000 7fbf38ff9700 1 -- 172.21.15.92:0/374568049 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbf2c087b30 con 0x7fbf3c0af390 2023-08-26T09:25:58.326 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.313+0000 7fbf3bfff700 1 --2- 172.21.15.92:0/374568049 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fbf2806a0e0 0x7fbf2806c5a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbf30000f60 tx=0x7fbf30009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:58.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.317+0000 7fbf38ff9700 1 -- 172.21.15.92:0/374568049 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fbf2c053230 con 0x7fbf3c0af390 2023-08-26T09:25:58.512 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.507+0000 7fbf42265700 1 -- 172.21.15.92:0/374568049 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbf3c159cc0 con 0x7fbf3c0af390 2023-08-26T09:25:58.512 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.507+0000 7fbf38ff9700 1 -- 172.21.15.92:0/374568049 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbf2c056850 con 0x7fbf3c0af390 2023-08-26T09:25:58.513 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 32 2023-08-26T09:25:58.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.509+0000 7fbf42265700 1 -- 172.21.15.92:0/374568049 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fbf2806a0e0 msgr2=0x7fbf2806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:58.515 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.509+0000 7fbf42265700 1 --2- 172.21.15.92:0/374568049 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fbf2806a0e0 0x7fbf2806c5a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbf30000f60 tx=0x7fbf30009040 comp rx=0 tx=0).stop 2023-08-26T09:25:58.515 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.509+0000 7fbf42265700 1 -- 172.21.15.92:0/374568049 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf3c0af390 msgr2=0x7fbf3c152600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:58.515 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.509+0000 7fbf42265700 1 --2- 172.21.15.92:0/374568049 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf3c0af390 0x7fbf3c152600 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c00c700 tx=0x7fbf2c00cac0 comp rx=0 tx=0).stop 2023-08-26T09:25:58.515 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.509+0000 7fbf42265700 1 -- 172.21.15.92:0/374568049 shutdown_connections 2023-08-26T09:25:58.516 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.509+0000 7fbf42265700 1 --2- 172.21.15.92:0/374568049 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fbf2806a0e0 0x7fbf2806c5a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:58.516 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.509+0000 7fbf42265700 1 --2- 172.21.15.92:0/374568049 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf3c071430 0x7fbf3c1f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:58.516 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.509+0000 7fbf42265700 1 --2- 172.21.15.92:0/374568049 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbf3c15d220 0x7fbf3c1532e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:58.516 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.509+0000 7fbf42265700 1 --2- 172.21.15.92:0/374568049 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf3c0af390 0x7fbf3c152600 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:58.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.509+0000 7fbf42265700 1 -- 172.21.15.92:0/374568049 >> 172.21.15.92:0/374568049 conn(0x7fbf3c06b430 msgr2=0x7fbf3c06da70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:58.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.509+0000 7fbf42265700 1 -- 172.21.15.92:0/374568049 shutdown_connections 2023-08-26T09:25:58.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.509+0000 7fbf42265700 1 -- 172.21.15.92:0/374568049 wait complete. 2023-08-26T09:25:58.526 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-26T09:25:58.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.645+0000 7f68a611e700 1 Processor -- start 2023-08-26T09:25:58.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.645+0000 7f68a611e700 1 -- start start 2023-08-26T09:25:58.652 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.645+0000 7f68a611e700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f68a015d220 0x7f68a00af390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:58.652 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.645+0000 7f68a611e700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f68a006db70 0x7f68a0070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:58.652 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.645+0000 7f68a611e700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68a00aee50 con 0x7f68a0071260 2023-08-26T09:25:58.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.645+0000 7f68a611e700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68a00af130 con 0x7f68a015d220 2023-08-26T09:25:58.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.645+0000 7f68a611e700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a00c4cb0 con 0x7f68a006db70 2023-08-26T09:25:58.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.646+0000 7f689f7fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f68a015d220 0x7f68a00af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:58.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.646+0000 7f689f7fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f68a015d220 0x7f68a00af390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46106/0 (socket says 172.21.15.92:46106) 2023-08-26T09:25:58.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.646+0000 7f689f7fe700 1 -- 172.21.15.92:0/1774965656 learned_addr learned my addr 172.21.15.92:0/1774965656 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:58.654 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.646+0000 7f689effd700 1 --2- 172.21.15.92:0/1774965656 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f68a006db70 0x7f68a0070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:58.654 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.646+0000 7f689f7fe700 1 -- 172.21.15.92:0/1774965656 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f68a006db70 msgr2=0x7f68a0070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:58.654 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.646+0000 7f689f7fe700 1 --2- 172.21.15.92:0/1774965656 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f68a006db70 0x7f68a0070d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:58.654 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.646+0000 7f689f7fe700 1 -- 172.21.15.92:0/1774965656 >> v1:172.21.15.188:6789/0 conn(0x7f68a0071260 legacy=0x7f68a0160d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:58.655 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.646+0000 7f689f7fe700 1 -- 172.21.15.92:0/1774965656 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a00c4f90 con 0x7f68a015d220 2023-08-26T09:25:58.655 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.646+0000 7f689f7fe700 1 --2- 172.21.15.92:0/1774965656 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68a015d220 0x7f68a00af390 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f68900098f0 tx=0x7f6890009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51572bf71eb70b9 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:58.655 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.646+0000 7f689e7fc700 1 -- 172.21.15.92:0/1774965656 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6890011830 con 0x7f68a015d220 2023-08-26T09:25:58.655 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.646+0000 7f689e7fc700 1 -- 172.21.15.92:0/1774965656 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6890011990 con 0x7f68a015d220 2023-08-26T09:25:58.655 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.646+0000 7f689e7fc700 1 -- 172.21.15.92:0/1774965656 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6890011d20 con 0x7f68a015d220 2023-08-26T09:25:58.656 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.647+0000 7f68a611e700 1 -- 172.21.15.92:0/1774965656 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68a015d220 msgr2=0x7f68a00af390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:58.656 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.647+0000 7f68a611e700 1 --2- 172.21.15.92:0/1774965656 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68a015d220 0x7f68a00af390 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f68900098f0 tx=0x7f6890009c00 comp rx=0 tx=0).stop 2023-08-26T09:25:58.656 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.647+0000 7f68a611e700 1 -- 172.21.15.92:0/1774965656 shutdown_connections 2023-08-26T09:25:58.656 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.647+0000 7f68a611e700 1 --2- 172.21.15.92:0/1774965656 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68a015d220 0x7f68a00af390 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:58.656 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.647+0000 7f68a611e700 1 --2- 172.21.15.92:0/1774965656 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f68a006db70 0x7f68a0070d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:58.657 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.647+0000 7f68a611e700 1 -- 172.21.15.92:0/1774965656 >> 172.21.15.92:0/1774965656 conn(0x7f68a006b430 msgr2=0x7f68a006b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:58.657 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.647+0000 7f68a611e700 1 -- 172.21.15.92:0/1774965656 shutdown_connections 2023-08-26T09:25:58.657 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.647+0000 7f68a611e700 1 -- 172.21.15.92:0/1774965656 wait complete. 2023-08-26T09:25:58.660 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.648+0000 7f68a611e700 1 Processor -- start 2023-08-26T09:25:58.660 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.648+0000 7f68a611e700 1 -- start start 2023-08-26T09:25:58.661 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.649+0000 7f68a611e700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68a006db70 0x7f68a015d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:58.661 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.649+0000 7f68a611e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68a0071260 0x7f68a0160130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:58.661 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.649+0000 7f68a611e700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f68a015d220 0x7f68a0155bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:58.661 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.649+0000 7f68a611e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a015ee20 con 0x7f68a0071260 2023-08-26T09:25:58.661 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.649+0000 7f68a611e700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a015dd80 con 0x7f68a006db70 2023-08-26T09:25:58.662 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.649+0000 7f68a611e700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a015e060 con 0x7f68a015d220 2023-08-26T09:25:58.662 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.649+0000 7f689effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68a0071260 0x7f68a0160130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:58.662 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.649+0000 7f689effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68a0071260 0x7f68a0160130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46114/0 (socket says 172.21.15.92:46114) 2023-08-26T09:25:58.662 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.649+0000 7f689effd700 1 -- 172.21.15.92:0/2309274998 learned_addr learned my addr 172.21.15.92:0/2309274998 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:58.662 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.649+0000 7f689f7fe700 1 --2- 172.21.15.92:0/2309274998 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68a006db70 0x7f68a015d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:58.663 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.649+0000 7f689ffff700 1 --2- 172.21.15.92:0/2309274998 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f68a015d220 0x7f68a0155bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:58.663 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.649+0000 7f689effd700 1 -- 172.21.15.92:0/2309274998 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f68a015d220 msgr2=0x7f68a0155bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:58.663 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.649+0000 7f689effd700 1 --2- 172.21.15.92:0/2309274998 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f68a015d220 0x7f68a0155bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:58.663 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.649+0000 7f689effd700 1 -- 172.21.15.92:0/2309274998 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68a006db70 msgr2=0x7f68a015d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:58.663 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.649+0000 7f689effd700 1 --2- 172.21.15.92:0/2309274998 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68a006db70 0x7f68a015d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:58.664 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.649+0000 7f689effd700 1 -- 172.21.15.92:0/2309274998 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6890009550 con 0x7f68a0071260 2023-08-26T09:25:58.664 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.649+0000 7f689effd700 1 --2- 172.21.15.92:0/2309274998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68a0071260 0x7f68a0160130 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f688800e9b0 tx=0x7f688800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:58.664 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.650+0000 7f6897fff700 1 -- 172.21.15.92:0/2309274998 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6888009710 con 0x7f68a0071260 2023-08-26T09:25:58.664 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.650+0000 7f6897fff700 1 -- 172.21.15.92:0/2309274998 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f688800c850 con 0x7f68a0071260 2023-08-26T09:25:58.664 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.650+0000 7f68a611e700 1 -- 172.21.15.92:0/2309274998 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68a015e340 con 0x7f68a0071260 2023-08-26T09:25:58.665 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.650+0000 7f6897fff700 1 -- 172.21.15.92:0/2309274998 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688800cbc0 con 0x7f68a0071260 2023-08-26T09:25:58.665 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.650+0000 7f68a611e700 1 -- 172.21.15.92:0/2309274998 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68a015e900 con 0x7f68a0071260 2023-08-26T09:25:58.665 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.651+0000 7f68a611e700 1 -- 172.21.15.92:0/2309274998 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68a015eb20 con 0x7f68a0071260 2023-08-26T09:25:58.665 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.651+0000 7f6897fff700 1 -- 172.21.15.92:0/2309274998 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f688800cd20 con 0x7f68a0071260 2023-08-26T09:25:58.665 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.651+0000 7f6897fff700 1 --2- 172.21.15.92:0/2309274998 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f688006a0b0 0x7f688006c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:58.666 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.651+0000 7f6897fff700 1 -- 172.21.15.92:0/2309274998 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f68880885f0 con 0x7f68a0071260 2023-08-26T09:25:58.666 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.651+0000 7f689f7fe700 1 --2- 172.21.15.92:0/2309274998 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f688006a0b0 0x7f688006c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:58.666 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.652+0000 7f689f7fe700 1 --2- 172.21.15.92:0/2309274998 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f688006a0b0 0x7f688006c570 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6890014040 tx=0x7f6890008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:58.666 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.656+0000 7f6897fff700 1 -- 172.21.15.92:0/2309274998 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f6888057800 con 0x7f68a0071260 2023-08-26T09:25:58.851 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.846+0000 7f68a611e700 1 -- 172.21.15.92:0/2309274998 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f68a004eeb0 con 0x7f68a0071260 2023-08-26T09:25:58.851 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.846+0000 7f6897fff700 1 -- 172.21.15.92:0/2309274998 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6888057390 con 0x7f68a0071260 2023-08-26T09:25:58.851 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 64 2023-08-26T09:25:58.853 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.848+0000 7f68a611e700 1 -- 172.21.15.92:0/2309274998 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f688006a0b0 msgr2=0x7f688006c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:58.853 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.848+0000 7f68a611e700 1 --2- 172.21.15.92:0/2309274998 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f688006a0b0 0x7f688006c570 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6890014040 tx=0x7f6890008030 comp rx=0 tx=0).stop 2023-08-26T09:25:58.854 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.848+0000 7f68a611e700 1 -- 172.21.15.92:0/2309274998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68a0071260 msgr2=0x7f68a0160130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:58.854 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.848+0000 7f68a611e700 1 --2- 172.21.15.92:0/2309274998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68a0071260 0x7f68a0160130 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f688800e9b0 tx=0x7f688800ed70 comp rx=0 tx=0).stop 2023-08-26T09:25:58.854 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.848+0000 7f68a611e700 1 -- 172.21.15.92:0/2309274998 shutdown_connections 2023-08-26T09:25:58.854 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.848+0000 7f68a611e700 1 --2- 172.21.15.92:0/2309274998 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f688006a0b0 0x7f688006c570 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:58.854 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.848+0000 7f68a611e700 1 --2- 172.21.15.92:0/2309274998 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68a006db70 0x7f68a015d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:58.855 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.848+0000 7f68a611e700 1 --2- 172.21.15.92:0/2309274998 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f68a015d220 0x7f68a0155bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:58.855 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.848+0000 7f68a611e700 1 --2- 172.21.15.92:0/2309274998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68a0071260 0x7f68a0160130 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:58.855 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.848+0000 7f68a611e700 1 -- 172.21.15.92:0/2309274998 >> 172.21.15.92:0/2309274998 conn(0x7f68a006b430 msgr2=0x7f68a00ad810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:58.855 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.848+0000 7f68a611e700 1 -- 172.21.15.92:0/2309274998 shutdown_connections 2023-08-26T09:25:58.856 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.848+0000 7f68a611e700 1 -- 172.21.15.92:0/2309274998 wait complete. 2023-08-26T09:25:58.866 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-26T09:25:58.987 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.982+0000 7efcb9a7b700 1 Processor -- start 2023-08-26T09:25:58.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.982+0000 7efcb9a7b700 1 -- start start 2023-08-26T09:25:58.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.983+0000 7efcb9a7b700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efcb4152100 0x7efcb40cb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:58.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.983+0000 7efcb9a7b700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcb415f9b0 con 0x7efcb40d0790 2023-08-26T09:25:58.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.983+0000 7efcb9a7b700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcb415edc0 con 0x7efcb40b3480 2023-08-26T09:25:58.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.983+0000 7efcb9a7b700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcb415f080 con 0x7efcb4152100 2023-08-26T09:25:58.992 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.983+0000 7efcb3fff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7efcb40d0790 0x7efcb40b5cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:58138/0 (socket says 172.21.15.92:58138) 2023-08-26T09:25:58.992 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.983+0000 7efcb3fff700 1 -- 172.21.15.92:0/1758067012 learned_addr learned my addr 172.21.15.92:0/1758067012 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:25:58.992 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.984+0000 7efcb37fe700 1 --2- 172.21.15.92:0/1758067012 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efcb4152100 0x7efcb40cb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:58.992 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.984+0000 7efcb27fc700 1 -- 172.21.15.92:0/1758067012 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3736572331 0 0) 0x7efcb415f9b0 con 0x7efcb40d0790 2023-08-26T09:25:58.992 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.984+0000 7efcb27fc700 1 -- 172.21.15.92:0/1758067012 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc9c0035b0 con 0x7efcb40d0790 2023-08-26T09:25:58.993 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.984+0000 7efcb27fc700 1 -- 172.21.15.92:0/1758067012 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 411627680 0 0) 0x7efc9c0035b0 con 0x7efcb40d0790 2023-08-26T09:25:58.993 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.984+0000 7efcb27fc700 1 -- 172.21.15.92:0/1758067012 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efcb4152100 msgr2=0x7efcb40cb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:58.993 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.984+0000 7efcb27fc700 1 --2- 172.21.15.92:0/1758067012 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efcb4152100 0x7efcb40cb4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:58.993 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.984+0000 7efcb27fc700 1 -- 172.21.15.92:0/1758067012 >> v1:172.21.15.188:6789/0 conn(0x7efcb40b3480 legacy=0x7efcb40d0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:58.993 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.984+0000 7efcb27fc700 1 -- 172.21.15.92:0/1758067012 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb415f360 con 0x7efcb40d0790 2023-08-26T09:25:58.994 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.984+0000 7efcb27fc700 1 -- 172.21.15.92:0/1758067012 <== mon.0 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1019361464 0 0) 0x7efcac0019f0 con 0x7efcb40d0790 2023-08-26T09:25:58.994 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.984+0000 7efcb27fc700 1 -- 172.21.15.92:0/1758067012 >> v1:172.21.15.92:6789/0 conn(0x7efcb40d0790 legacy=0x7efcb40b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:58.994 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.984+0000 7efcb27fc700 1 --2- 172.21.15.92:0/1758067012 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc9c003a30 0x7efc9c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:58.994 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.984+0000 7efcb27fc700 1 --2- 172.21.15.92:0/1758067012 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc9c004850 0x7efc9c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:58.994 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.984+0000 7efcb27fc700 1 --2- 172.21.15.92:0/1758067012 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efcb4152100 0x7efc9c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:58.995 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.984+0000 7efcb27fc700 1 -- 172.21.15.92:0/1758067012 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb415f080 con 0x7efc9c003a30 2023-08-26T09:25:58.995 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.984+0000 7efcb27fc700 1 -- 172.21.15.92:0/1758067012 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c00bac0 con 0x7efc9c004850 2023-08-26T09:25:58.995 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.984+0000 7efcb27fc700 1 -- 172.21.15.92:0/1758067012 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c00bc80 con 0x7efcb4152100 2023-08-26T09:25:58.995 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.984+0000 7efcb37fe700 1 --2- 172.21.15.92:0/1758067012 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc9c003a30 0x7efc9c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:58.995 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.984+0000 7efcb2ffd700 1 --2- 172.21.15.92:0/1758067012 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc9c004850 0x7efc9c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:58.997 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.984+0000 7efcb3fff700 1 --2- 172.21.15.92:0/1758067012 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efcb4152100 0x7efc9c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:58.997 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.984+0000 7efcb37fe700 1 -- 172.21.15.92:0/1758067012 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efcb4152100 msgr2=0x7efc9c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:58.997 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.984+0000 7efcb37fe700 1 --2- 172.21.15.92:0/1758067012 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efcb4152100 0x7efc9c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:58.997 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.984+0000 7efcb37fe700 1 -- 172.21.15.92:0/1758067012 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc9c004850 msgr2=0x7efc9c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:58.997 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.984+0000 7efcb37fe700 1 --2- 172.21.15.92:0/1758067012 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc9c004850 0x7efc9c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:58.998 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.984+0000 7efcb37fe700 1 -- 172.21.15.92:0/1758067012 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc9c0035b0 con 0x7efc9c003a30 2023-08-26T09:25:58.998 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.984+0000 7efcb2ffd700 1 --2- 172.21.15.92:0/1758067012 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc9c004850 0x7efc9c004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:58.998 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.984+0000 7efcb37fe700 1 --2- 172.21.15.92:0/1758067012 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc9c003a30 0x7efc9c003e50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7efca8009b30 tx=0x7efc9c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ee950fc93e4aa8f server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:58.998 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.985+0000 7efcb27fc700 1 -- 172.21.15.92:0/1758067012 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca800e6c0 con 0x7efc9c003a30 2023-08-26T09:25:58.998 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.985+0000 7efcb27fc700 1 -- 172.21.15.92:0/1758067012 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efca800e820 con 0x7efc9c003a30 2023-08-26T09:25:58.999 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.985+0000 7efcb27fc700 1 -- 172.21.15.92:0/1758067012 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca800eb90 con 0x7efc9c003a30 2023-08-26T09:25:58.999 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.985+0000 7efcb9a7b700 1 -- 172.21.15.92:0/1758067012 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc9c003a30 msgr2=0x7efc9c003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:58.999 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.985+0000 7efcb9a7b700 1 --2- 172.21.15.92:0/1758067012 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc9c003a30 0x7efc9c003e50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7efca8009b30 tx=0x7efc9c005880 comp rx=0 tx=0).stop 2023-08-26T09:25:58.999 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.985+0000 7efcb3fff700 1 -- 172.21.15.92:0/1758067012 reap_dead start 2023-08-26T09:25:58.999 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.985+0000 7efcb9a7b700 1 -- 172.21.15.92:0/1758067012 shutdown_connections 2023-08-26T09:25:59.000 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.985+0000 7efcb9a7b700 1 -- 172.21.15.92:0/1758067012 >> 172.21.15.92:0/1758067012 conn(0x7efcb406faa0 msgr2=0x7efcb406fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:59.000 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.985+0000 7efcb9a7b700 1 -- 172.21.15.92:0/1758067012 shutdown_connections 2023-08-26T09:25:59.000 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.985+0000 7efcb9a7b700 1 -- 172.21.15.92:0/1758067012 wait complete. 2023-08-26T09:25:59.000 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.986+0000 7efcb9a7b700 1 Processor -- start 2023-08-26T09:25:59.003 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.986+0000 7efcb9a7b700 1 -- start start 2023-08-26T09:25:59.003 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.987+0000 7efcb9a7b700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc9c003a30 0x7efcb40c72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:59.003 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.987+0000 7efcb9a7b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efcb40ca060 0x7efcb4146fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:59.004 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.987+0000 7efcb9a7b700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efcb406b430 0x7efcb40cea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:59.004 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.987+0000 7efcb9a7b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb40c7830 con 0x7efcb40ca060 2023-08-26T09:25:59.004 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.987+0000 7efcb9a7b700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb40c5960 con 0x7efc9c003a30 2023-08-26T09:25:59.004 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.987+0000 7efcb9a7b700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcb40ca7d0 con 0x7efcb406b430 2023-08-26T09:25:59.004 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.987+0000 7efcb2ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efcb40ca060 0x7efcb4146fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:59.005 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.987+0000 7efcb2ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efcb40ca060 0x7efcb4146fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46134/0 (socket says 172.21.15.92:46134) 2023-08-26T09:25:59.005 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.987+0000 7efcb2ffd700 1 -- 172.21.15.92:0/1141406253 learned_addr learned my addr 172.21.15.92:0/1141406253 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:59.005 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.987+0000 7efcb3fff700 1 --2- 172.21.15.92:0/1141406253 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efcb406b430 0x7efcb40cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:59.005 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.987+0000 7efcb37fe700 1 --2- 172.21.15.92:0/1141406253 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc9c003a30 0x7efcb40c72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:59.006 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.988+0000 7efcb2ffd700 1 -- 172.21.15.92:0/1141406253 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efcb406b430 msgr2=0x7efcb40cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:59.006 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.988+0000 7efcb2ffd700 1 --2- 172.21.15.92:0/1141406253 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efcb406b430 0x7efcb40cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:59.006 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.988+0000 7efcb2ffd700 1 -- 172.21.15.92:0/1141406253 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc9c003a30 msgr2=0x7efcb40c72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:59.006 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.988+0000 7efcb2ffd700 1 --2- 172.21.15.92:0/1141406253 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc9c003a30 0x7efcb40c72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:59.006 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.988+0000 7efcb2ffd700 1 -- 172.21.15.92:0/1141406253 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb40caab0 con 0x7efcb40ca060 2023-08-26T09:25:59.007 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.988+0000 7efcb37fe700 1 --2- 172.21.15.92:0/1141406253 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc9c003a30 0x7efcb40c72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:59.007 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.988+0000 7efcb3fff700 1 --2- 172.21.15.92:0/1141406253 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efcb406b430 0x7efcb40cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:25:59.007 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.988+0000 7efcb2ffd700 1 --2- 172.21.15.92:0/1141406253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efcb40ca060 0x7efcb4146fc0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7efca400e780 tx=0x7efca400eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:59.007 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.988+0000 7efc9bfff700 1 -- 172.21.15.92:0/1141406253 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca40052e0 con 0x7efcb40ca060 2023-08-26T09:25:59.007 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.988+0000 7efc9bfff700 1 -- 172.21.15.92:0/1141406253 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efca4005440 con 0x7efcb40ca060 2023-08-26T09:25:59.008 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.988+0000 7efcb9a7b700 1 -- 172.21.15.92:0/1141406253 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcb40c5c00 con 0x7efcb40ca060 2023-08-26T09:25:59.008 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.988+0000 7efc9bfff700 1 -- 172.21.15.92:0/1141406253 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca40038c0 con 0x7efcb40ca060 2023-08-26T09:25:59.008 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.988+0000 7efcb9a7b700 1 -- 172.21.15.92:0/1141406253 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcb40cad90 con 0x7efcb40ca060 2023-08-26T09:25:59.008 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.989+0000 7efcb9a7b700 1 -- 172.21.15.92:0/1141406253 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcb40c5f70 con 0x7efcb40ca060 2023-08-26T09:25:59.008 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.989+0000 7efc9bfff700 1 -- 172.21.15.92:0/1141406253 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7efca4003a20 con 0x7efcb40ca060 2023-08-26T09:25:59.009 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.990+0000 7efc9bfff700 1 --2- 172.21.15.92:0/1141406253 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7efca006a0e0 0x7efca006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:59.009 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.990+0000 7efc9bfff700 1 -- 172.21.15.92:0/1141406253 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efca4087cb0 con 0x7efcb40ca060 2023-08-26T09:25:59.009 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.990+0000 7efcb37fe700 1 --2- 172.21.15.92:0/1141406253 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7efca006a0e0 0x7efca006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:59.009 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.990+0000 7efcb37fe700 1 --2- 172.21.15.92:0/1141406253 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7efca006a0e0 0x7efca006c5a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7efca80090b0 tx=0x7efca8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:59.009 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:58.994+0000 7efc9bfff700 1 -- 172.21.15.92:0/1141406253 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7efca4053460 con 0x7efcb40ca060 2023-08-26T09:25:59.205 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.201+0000 7efcb9a7b700 1 -- 172.21.15.92:0/1141406253 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7efcb404e660 con 0x7efcb40ca060 2023-08-26T09:25:59.206 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.201+0000 7efc9bfff700 1 -- 172.21.15.92:0/1141406253 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7efca4019080 con 0x7efcb40ca060 2023-08-26T09:25:59.208 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.203+0000 7efcb9a7b700 1 -- 172.21.15.92:0/1141406253 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7efca006a0e0 msgr2=0x7efca006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:59.208 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.203+0000 7efcb9a7b700 1 --2- 172.21.15.92:0/1141406253 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7efca006a0e0 0x7efca006c5a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7efca80090b0 tx=0x7efca8008030 comp rx=0 tx=0).stop 2023-08-26T09:25:59.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.203+0000 7efcb9a7b700 1 -- 172.21.15.92:0/1141406253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efcb40ca060 msgr2=0x7efcb4146fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:59.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.203+0000 7efcb9a7b700 1 --2- 172.21.15.92:0/1141406253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efcb40ca060 0x7efcb4146fc0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7efca400e780 tx=0x7efca400eb40 comp rx=0 tx=0).stop 2023-08-26T09:25:59.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.203+0000 7efcb9a7b700 1 -- 172.21.15.92:0/1141406253 shutdown_connections 2023-08-26T09:25:59.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.203+0000 7efcb9a7b700 1 --2- 172.21.15.92:0/1141406253 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7efca006a0e0 0x7efca006c5a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:59.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.203+0000 7efcb9a7b700 1 --2- 172.21.15.92:0/1141406253 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc9c003a30 0x7efcb40c72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:59.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.203+0000 7efcb9a7b700 1 --2- 172.21.15.92:0/1141406253 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efcb406b430 0x7efcb40cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:59.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.203+0000 7efcb9a7b700 1 --2- 172.21.15.92:0/1141406253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efcb40ca060 0x7efcb4146fc0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:59.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.203+0000 7efcb9a7b700 1 -- 172.21.15.92:0/1141406253 >> 172.21.15.92:0/1141406253 conn(0x7efcb406faa0 msgr2=0x7efcb40d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:59.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.203+0000 7efcb9a7b700 1 -- 172.21.15.92:0/1141406253 shutdown_connections 2023-08-26T09:25:59.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.203+0000 7efcb9a7b700 1 -- 172.21.15.92:0/1141406253 wait complete. 2023-08-26T09:25:59.211 INFO:teuthology.orchestra.run.smithi092.stderr:listed 0 entries 2023-08-26T09:25:59.220 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-08-26T09:25:59.221 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-26T09:25:59.238 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-26T09:25:59.398 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.394+0000 7fa2c45b4700 1 Processor -- start 2023-08-26T09:25:59.399 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.394+0000 7fa2c45b4700 1 -- start start 2023-08-26T09:25:59.401 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.395+0000 7fa2c45b4700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa2bc15a010 0x7fa2bc06c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:59.401 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.395+0000 7fa2c45b4700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa2bc0b2f90 0x7fa2bc066020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:59.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.395+0000 7fa2c45b4700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2bc06b540 0x7fa2bc06a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:59.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.395+0000 7fa2c45b4700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2bc0cfc80 con 0x7fa2bc0b2f90 2023-08-26T09:25:59.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.395+0000 7fa2c45b4700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2bc0aeaf0 con 0x7fa2bc15a010 2023-08-26T09:25:59.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.395+0000 7fa2c45b4700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2bc06db00 con 0x7fa2bc06b540 2023-08-26T09:25:59.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.395+0000 7fa2c1b4f700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa2bc0b2f90 0x7fa2bc066020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:59.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.395+0000 7fa2c1b4f700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa2bc0b2f90 0x7fa2bc066020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46142/0 (socket says 172.21.15.92:46142) 2023-08-26T09:25:59.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.395+0000 7fa2c1b4f700 1 -- 172.21.15.92:0/1113418090 learned_addr learned my addr 172.21.15.92:0/1113418090 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:59.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.395+0000 7fa2c2b51700 1 --2- 172.21.15.92:0/1113418090 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2bc06b540 0x7fa2bc06a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:59.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.395+0000 7fa2c2350700 1 --2- 172.21.15.92:0/1113418090 >> v2:172.21.15.188:3300/0 conn(0x7fa2bc15a010 0x7fa2bc06c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:59.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.395+0000 7fa2c1b4f700 1 -- 172.21.15.92:0/1113418090 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2bc06b540 msgr2=0x7fa2bc06a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:59.404 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.395+0000 7fa2c1b4f700 1 --2- 172.21.15.92:0/1113418090 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2bc06b540 0x7fa2bc06a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:59.404 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.395+0000 7fa2c1b4f700 1 -- 172.21.15.92:0/1113418090 >> v2:172.21.15.188:3300/0 conn(0x7fa2bc15a010 msgr2=0x7fa2bc06c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:59.404 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.395+0000 7fa2c1b4f700 1 --2- 172.21.15.92:0/1113418090 >> v2:172.21.15.188:3300/0 conn(0x7fa2bc15a010 0x7fa2bc06c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:59.404 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.395+0000 7fa2c1b4f700 1 -- 172.21.15.92:0/1113418090 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2bc06dde0 con 0x7fa2bc0b2f90 2023-08-26T09:25:59.404 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.395+0000 7fa2c1b4f700 1 --2- 172.21.15.92:0/1113418090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2bc0b2f90 0x7fa2bc066020 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc071110 tx=0x7fa2ac009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb3207add667a337 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:59.405 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.395+0000 7fa2c134e700 1 -- 172.21.15.92:0/1113418090 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac011830 con 0x7fa2bc0b2f90 2023-08-26T09:25:59.405 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.395+0000 7fa2c134e700 1 -- 172.21.15.92:0/1113418090 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2ac011990 con 0x7fa2bc0b2f90 2023-08-26T09:25:59.405 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.395+0000 7fa2c134e700 1 -- 172.21.15.92:0/1113418090 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac011d20 con 0x7fa2bc0b2f90 2023-08-26T09:25:59.405 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.396+0000 7fa2c45b4700 1 -- 172.21.15.92:0/1113418090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2bc0b2f90 msgr2=0x7fa2bc066020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:59.405 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.396+0000 7fa2c45b4700 1 --2- 172.21.15.92:0/1113418090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2bc0b2f90 0x7fa2bc066020 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc071110 tx=0x7fa2ac009bd0 comp rx=0 tx=0).stop 2023-08-26T09:25:59.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.396+0000 7fa2c45b4700 1 -- 172.21.15.92:0/1113418090 shutdown_connections 2023-08-26T09:25:59.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.396+0000 7fa2c45b4700 1 --2- 172.21.15.92:0/1113418090 >> v2:172.21.15.188:3300/0 conn(0x7fa2bc15a010 0x7fa2bc06c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:59.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.396+0000 7fa2c45b4700 1 --2- 172.21.15.92:0/1113418090 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2bc06b540 0x7fa2bc06a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:59.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.396+0000 7fa2c45b4700 1 --2- 172.21.15.92:0/1113418090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2bc0b2f90 0x7fa2bc066020 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:59.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.396+0000 7fa2c45b4700 1 -- 172.21.15.92:0/1113418090 >> 172.21.15.92:0/1113418090 conn(0x7fa2bc0b23c0 msgr2=0x7fa2bc0b27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:59.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.396+0000 7fa2c45b4700 1 -- 172.21.15.92:0/1113418090 shutdown_connections 2023-08-26T09:25:59.407 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.396+0000 7fa2c45b4700 1 -- 172.21.15.92:0/1113418090 wait complete. 2023-08-26T09:25:59.409 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.398+0000 7fa2c45b4700 1 Processor -- start 2023-08-26T09:25:59.409 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.398+0000 7fa2c45b4700 1 -- start start 2023-08-26T09:25:59.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.399+0000 7fa2c45b4700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa2bc06b540 0x7fa2bc0c7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:59.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.399+0000 7fa2c45b4700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2bc0b2f90 0x7fa2bc0c73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:59.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.399+0000 7fa2c45b4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2bc15a010 0x7fa2bc156f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:59.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.399+0000 7fa2c45b4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2bc15b790 con 0x7fa2bc15a010 2023-08-26T09:25:59.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.399+0000 7fa2c45b4700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2bc0c7a20 con 0x7fa2bc06b540 2023-08-26T09:25:59.411 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.399+0000 7fa2c45b4700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2bc157490 con 0x7fa2bc0b2f90 2023-08-26T09:25:59.411 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.399+0000 7fa2c2b51700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2bc15a010 0x7fa2bc156f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:59.411 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.399+0000 7fa2c2b51700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2bc15a010 0x7fa2bc156f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46150/0 (socket says 172.21.15.92:46150) 2023-08-26T09:25:59.411 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.399+0000 7fa2c2b51700 1 -- 172.21.15.92:0/115435821 learned_addr learned my addr 172.21.15.92:0/115435821 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:59.411 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.399+0000 7fa2c2350700 1 --2- 172.21.15.92:0/115435821 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa2bc06b540 0x7fa2bc0c7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:59.412 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.399+0000 7fa2c1b4f700 1 --2- 172.21.15.92:0/115435821 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2bc0b2f90 0x7fa2bc0c73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:59.412 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.399+0000 7fa2c2b51700 1 -- 172.21.15.92:0/115435821 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2bc0b2f90 msgr2=0x7fa2bc0c73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:59.412 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.399+0000 7fa2c2b51700 1 --2- 172.21.15.92:0/115435821 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2bc0b2f90 0x7fa2bc0c73b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:59.412 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.399+0000 7fa2c2b51700 1 -- 172.21.15.92:0/115435821 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa2bc06b540 msgr2=0x7fa2bc0c7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:59.412 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.399+0000 7fa2c2b51700 1 --2- 172.21.15.92:0/115435821 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa2bc06b540 0x7fa2bc0c7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:59.413 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.399+0000 7fa2c2b51700 1 -- 172.21.15.92:0/115435821 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ac009550 con 0x7fa2bc15a010 2023-08-26T09:25:59.413 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.399+0000 7fa2c2b51700 1 --2- 172.21.15.92:0/115435821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2bc15a010 0x7fa2bc156f50 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa2b400eed0 tx=0x7fa2b400b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:59.413 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.399+0000 7fa2b2ffd700 1 -- 172.21.15.92:0/115435821 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b4010040 con 0x7fa2bc15a010 2023-08-26T09:25:59.413 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.399+0000 7fa2b2ffd700 1 -- 172.21.15.92:0/115435821 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2b400bcd0 con 0x7fa2bc15a010 2023-08-26T09:25:59.413 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.399+0000 7fa2c45b4700 1 -- 172.21.15.92:0/115435821 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2bc15adf0 con 0x7fa2bc15a010 2023-08-26T09:25:59.414 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.399+0000 7fa2b2ffd700 1 -- 172.21.15.92:0/115435821 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b4014640 con 0x7fa2bc15a010 2023-08-26T09:25:59.414 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.399+0000 7fa2c45b4700 1 -- 172.21.15.92:0/115435821 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2bc15b3b0 con 0x7fa2bc15a010 2023-08-26T09:25:59.414 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.400+0000 7fa2c45b4700 1 -- 172.21.15.92:0/115435821 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2bc15b8d0 con 0x7fa2bc15a010 2023-08-26T09:25:59.414 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.401+0000 7fa2b2ffd700 1 -- 172.21.15.92:0/115435821 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa2b40147a0 con 0x7fa2bc15a010 2023-08-26T09:25:59.414 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.401+0000 7fa2b2ffd700 1 --2- 172.21.15.92:0/115435821 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa2a006a0e0 0x7fa2a006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:59.415 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.401+0000 7fa2c2350700 1 --2- 172.21.15.92:0/115435821 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa2a006a0e0 0x7fa2a006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:59.415 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.401+0000 7fa2b2ffd700 1 -- 172.21.15.92:0/115435821 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa2b4088c20 con 0x7fa2bc15a010 2023-08-26T09:25:59.415 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.402+0000 7fa2c2350700 1 --2- 172.21.15.92:0/115435821 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa2a006a0e0 0x7fa2a006c5a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa2b80099f0 tx=0x7fa2b8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:59.415 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.406+0000 7fa2b2ffd700 1 -- 172.21.15.92:0/115435821 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa2b4057e30 con 0x7fa2bc15a010 2023-08-26T09:25:59.605 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.600+0000 7fa2c45b4700 1 -- 172.21.15.92:0/115435821 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2bc04e660 con 0x7fa2bc15a010 2023-08-26T09:25:59.606 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.601+0000 7fa2b2ffd700 1 -- 172.21.15.92:0/115435821 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+18209 (secure 0 0 0) 0x7fa2b40579c0 con 0x7fa2bc15a010 2023-08-26T09:25:59.606 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:25:59.607 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":20,"fsid":"254a2d31-bd41-4507-8326-1b205ac24377","created":"2023-08-26T09:24:55.352131+0000","modified":"2023-08-26T09:25:15.447635+0000","last_up_change":"2023-08-26T09:25:06.124496+0000","last_in_change":"2023-08-26T09:24:57.840725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-26T09:25:06.650431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-26T09:25:06.973382+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-26T09:25:11.584141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-26T09:25:12.814990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e9e7638-4459-4d8d-8e40-130bcf48df66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6819","nonce":382827192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6824","nonce":382827192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6831","nonce":382827192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6827","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6829","nonce":382827192}]},"public_addr":"172.21.15.92:6819/382827192","cluster_addr":"172.21.15.92:6824/382827192","heartbeat_back_addr":"172.21.15.92:6831/382827192","heartbeat_front_addr":"172.21.15.92:6829/382827192","state":["exists","up"]},{"osd":1,"uuid":"164e68c9-aedd-4df5-9b70-f4b1ec3bda13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6809","nonce":618773438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6811","nonce":618773438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6815","nonce":618773438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6813","nonce":618773438}]},"public_addr":"172.21.15.92:6809/618773438","cluster_addr":"172.21.15.92:6811/618773438","heartbeat_back_addr":"172.21.15.92:6815/618773438","heartbeat_front_addr":"172.21.15.92:6813/618773438","state":["exists","up"]},{"osd":2,"uuid":"8701dfee-629a-4d30-82e4-b8fac340303f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6818","nonce":3697397687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6821","nonce":3697397687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6828","nonce":3697397687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6823","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6825","nonce":3697397687}]},"public_addr":"172.21.15.92:6818/3697397687","cluster_addr":"172.21.15.92:6821/3697397687","heartbeat_back_addr":"172.21.15.92:6828/3697397687","heartbeat_front_addr":"172.21.15.92:6825/3697397687","state":["exists","up"]},{"osd":3,"uuid":"93bdc94d-dc07-495f-995a-a6ad072f0247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6801","nonce":3579846453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6803","nonce":3579846453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6807","nonce":3579846453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6805","nonce":3579846453}]},"public_addr":"172.21.15.92:6801/3579846453","cluster_addr":"172.21.15.92:6803/3579846453","heartbeat_back_addr":"172.21.15.92:6807/3579846453","heartbeat_front_addr":"172.21.15.92:6805/3579846453","state":["exists","up"]},{"osd":4,"uuid":"d9d0ea80-8481-46a7-9677-c338d32cf1d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6809","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6811","nonce":3228383424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6813","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6815","nonce":3228383424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6821","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6823","nonce":3228383424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6817","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6819","nonce":3228383424}]},"public_addr":"172.21.15.188:6811/3228383424","cluster_addr":"172.21.15.188:6815/3228383424","heartbeat_back_addr":"172.21.15.188:6823/3228383424","heartbeat_front_addr":"172.21.15.188:6819/3228383424","state":["exists","up"]},{"osd":5,"uuid":"38d03253-467a-456f-bd5e-5a46532a0b18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6801","nonce":1655821054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6803","nonce":1655821054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6807","nonce":1655821054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6805","nonce":1655821054}]},"public_addr":"172.21.15.188:6801/1655821054","cluster_addr":"172.21.15.188:6803/1655821054","heartbeat_back_addr":"172.21.15.188:6807/1655821054","heartbeat_front_addr":"172.21.15.188:6805/1655821054","state":["exists","up"]},{"osd":6,"uuid":"d61564b5-136f-42e5-a843-626c2017cc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6810","nonce":2069976891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6814","nonce":2069976891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6822","nonce":2069976891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6818","nonce":2069976891}]},"public_addr":"172.21.15.188:6810/2069976891","cluster_addr":"172.21.15.188:6814/2069976891","heartbeat_back_addr":"172.21.15.188:6822/2069976891","heartbeat_front_addr":"172.21.15.188:6818/2069976891","state":["exists","up"]},{"osd":7,"uuid":"fae2949e-0d62-42cd-ba72-08f516084b20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6825","nonce":1882888860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6827","nonce":1882888860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6831","nonce":1882888860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6829","nonce":1882888860}]},"public_addr":"172.21.15.188:6825/1882888860","cluster_addr":"172.21.15.188:6827/1882888860","heartbeat_back_addr":"172.21.15.188:6831/1882888860","heartbeat_front_addr":"172.21.15.188:6829/1882888860","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.038523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.063160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.000857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.975572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.023848+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.765194+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.081365+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:05.110745+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-26T09:25:59.609 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.604+0000 7fa2c45b4700 1 -- 172.21.15.92:0/115435821 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa2a006a0e0 msgr2=0x7fa2a006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:59.609 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.604+0000 7fa2c45b4700 1 --2- 172.21.15.92:0/115435821 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa2a006a0e0 0x7fa2a006c5a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa2b80099f0 tx=0x7fa2b8008040 comp rx=0 tx=0).stop 2023-08-26T09:25:59.609 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.604+0000 7fa2c45b4700 1 -- 172.21.15.92:0/115435821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2bc15a010 msgr2=0x7fa2bc156f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:59.610 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.604+0000 7fa2c45b4700 1 --2- 172.21.15.92:0/115435821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2bc15a010 0x7fa2bc156f50 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa2b400eed0 tx=0x7fa2b400b390 comp rx=0 tx=0).stop 2023-08-26T09:25:59.610 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.604+0000 7fa2c45b4700 1 -- 172.21.15.92:0/115435821 shutdown_connections 2023-08-26T09:25:59.610 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.604+0000 7fa2c45b4700 1 --2- 172.21.15.92:0/115435821 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa2a006a0e0 0x7fa2a006c5a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:59.610 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.604+0000 7fa2c45b4700 1 --2- 172.21.15.92:0/115435821 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa2bc06b540 0x7fa2bc0c7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:59.610 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.604+0000 7fa2c45b4700 1 --2- 172.21.15.92:0/115435821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2bc15a010 0x7fa2bc156f50 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:59.611 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.604+0000 7fa2c45b4700 1 --2- 172.21.15.92:0/115435821 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2bc0b2f90 0x7fa2bc0c73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:59.611 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.604+0000 7fa2c45b4700 1 -- 172.21.15.92:0/115435821 >> 172.21.15.92:0/115435821 conn(0x7fa2bc0b23c0 msgr2=0x7fa2bc1592b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:59.611 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.604+0000 7fa2c45b4700 1 -- 172.21.15.92:0/115435821 shutdown_connections 2023-08-26T09:25:59.611 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.604+0000 7fa2c45b4700 1 -- 172.21.15.92:0/115435821 wait complete. 2023-08-26T09:25:59.621 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-26T09:25:06.650431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-26T09:25:06.973382+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-26T09:25:11.584141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-26T09:25:12.814990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-26T09:25:59.622 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-26T09:25:59.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.740+0000 7f7a521f2700 1 Processor -- start 2023-08-26T09:25:59.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.740+0000 7f7a521f2700 1 -- start start 2023-08-26T09:25:59.747 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.741+0000 7f7a521f2700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f7a4c0af390 0x7f7a4c070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:59.748 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.741+0000 7f7a521f2700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f7a4c071260 0x7f7a4c06a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:59.748 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.741+0000 7f7a521f2700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a4c0aee50 con 0x7f7a4c15d220 2023-08-26T09:25:59.748 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.741+0000 7f7a521f2700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a4c0af130 con 0x7f7a4c071260 2023-08-26T09:25:59.748 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.741+0000 7f7a521f2700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a4c0c4cb0 con 0x7f7a4c0af390 2023-08-26T09:25:59.749 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.741+0000 7f7a4bfff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f7a4c071260 0x7f7a4c06a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:59.749 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.741+0000 7f7a4bfff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f7a4c071260 0x7f7a4c06a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46158/0 (socket says 172.21.15.92:46158) 2023-08-26T09:25:59.749 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.741+0000 7f7a4bfff700 1 -- 172.21.15.92:0/814707299 learned_addr learned my addr 172.21.15.92:0/814707299 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:59.749 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.741+0000 7f7a4affd700 1 --2- 172.21.15.92:0/814707299 >> v2:172.21.15.188:3300/0 conn(0x7f7a4c0af390 0x7f7a4c070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:59.749 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.741+0000 7f7a4bfff700 1 -- 172.21.15.92:0/814707299 >> v2:172.21.15.188:3300/0 conn(0x7f7a4c0af390 msgr2=0x7f7a4c070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:25:59.749 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.741+0000 7f7a4bfff700 1 --2- 172.21.15.92:0/814707299 >> v2:172.21.15.188:3300/0 conn(0x7f7a4c0af390 0x7f7a4c070d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:59.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.741+0000 7f7a4bfff700 1 -- 172.21.15.92:0/814707299 >> v1:172.21.15.188:6789/0 conn(0x7f7a4c15d220 legacy=0x7f7a4c06db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:59.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.741+0000 7f7a4bfff700 1 -- 172.21.15.92:0/814707299 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a4c0c4f90 con 0x7f7a4c071260 2023-08-26T09:25:59.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.741+0000 7f7a4bfff700 1 --2- 172.21.15.92:0/814707299 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a4c071260 0x7f7a4c06a320 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c072240 tx=0x7f7a3c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3762cdf291f35bb5 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:59.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.742+0000 7f7a4a7fc700 1 -- 172.21.15.92:0/814707299 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c00e070 con 0x7f7a4c071260 2023-08-26T09:25:59.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.742+0000 7f7a4a7fc700 1 -- 172.21.15.92:0/814707299 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a3c00b910 con 0x7f7a4c071260 2023-08-26T09:25:59.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.742+0000 7f7a4a7fc700 1 -- 172.21.15.92:0/814707299 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c00bcc0 con 0x7f7a4c071260 2023-08-26T09:25:59.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.742+0000 7f7a521f2700 1 -- 172.21.15.92:0/814707299 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a4c071260 msgr2=0x7f7a4c06a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:59.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.742+0000 7f7a521f2700 1 --2- 172.21.15.92:0/814707299 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a4c071260 0x7f7a4c06a320 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c072240 tx=0x7f7a3c00b330 comp rx=0 tx=0).stop 2023-08-26T09:25:59.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.742+0000 7f7a521f2700 1 -- 172.21.15.92:0/814707299 shutdown_connections 2023-08-26T09:25:59.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.742+0000 7f7a521f2700 1 --2- 172.21.15.92:0/814707299 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a4c071260 0x7f7a4c06a320 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:59.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.742+0000 7f7a521f2700 1 --2- 172.21.15.92:0/814707299 >> v2:172.21.15.188:3300/0 conn(0x7f7a4c0af390 0x7f7a4c070d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:59.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.742+0000 7f7a521f2700 1 -- 172.21.15.92:0/814707299 >> 172.21.15.92:0/814707299 conn(0x7f7a4c06b430 msgr2=0x7f7a4c06b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:59.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.742+0000 7f7a521f2700 1 -- 172.21.15.92:0/814707299 shutdown_connections 2023-08-26T09:25:59.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.742+0000 7f7a521f2700 1 -- 172.21.15.92:0/814707299 wait complete. 2023-08-26T09:25:59.754 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.743+0000 7f7a521f2700 1 Processor -- start 2023-08-26T09:25:59.755 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.744+0000 7f7a521f2700 1 -- start start 2023-08-26T09:25:59.755 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.744+0000 7f7a521f2700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a4c071260 0x7f7a4c152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:59.755 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.744+0000 7f7a521f2700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a4c0af390 0x7f7a4c0ad920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:59.755 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.744+0000 7f7a521f2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a4c15d220 0x7f7a4c0ade60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:59.756 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.744+0000 7f7a521f2700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4c0ae840 con 0x7f7a4c15d220 2023-08-26T09:25:59.756 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.744+0000 7f7a521f2700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4c158d80 con 0x7f7a4c0af390 2023-08-26T09:25:59.756 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.744+0000 7f7a521f2700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4c153100 con 0x7f7a4c071260 2023-08-26T09:25:59.756 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.744+0000 7f7a4bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a4c15d220 0x7f7a4c0ade60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:59.756 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.744+0000 7f7a4bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a4c15d220 0x7f7a4c0ade60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46164/0 (socket says 172.21.15.92:46164) 2023-08-26T09:25:59.756 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.744+0000 7f7a4bfff700 1 -- 172.21.15.92:0/714405713 learned_addr learned my addr 172.21.15.92:0/714405713 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:25:59.757 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.744+0000 7f7a4affd700 1 --2- 172.21.15.92:0/714405713 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a4c0af390 0x7f7a4c0ad920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:59.757 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.744+0000 7f7a4b7fe700 1 --2- 172.21.15.92:0/714405713 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a4c071260 0x7f7a4c152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:59.757 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.745+0000 7f7a4bfff700 1 -- 172.21.15.92:0/714405713 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a4c071260 msgr2=0x7f7a4c152bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:59.757 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.745+0000 7f7a4bfff700 1 --2- 172.21.15.92:0/714405713 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a4c071260 0x7f7a4c152bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:59.757 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.745+0000 7f7a4bfff700 1 -- 172.21.15.92:0/714405713 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a4c0af390 msgr2=0x7f7a4c0ad920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:59.758 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.745+0000 7f7a4bfff700 1 --2- 172.21.15.92:0/714405713 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a4c0af390 0x7f7a4c0ad920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:59.758 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.745+0000 7f7a4bfff700 1 -- 172.21.15.92:0/714405713 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a3c009b30 con 0x7f7a4c15d220 2023-08-26T09:25:59.758 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.745+0000 7f7a4bfff700 1 --2- 172.21.15.92:0/714405713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a4c15d220 0x7f7a4c0ade60 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c06f8d0 tx=0x7f7a3c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:59.758 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.745+0000 7f7a33fff700 1 -- 172.21.15.92:0/714405713 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c004880 con 0x7f7a4c15d220 2023-08-26T09:25:59.758 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.745+0000 7f7a33fff700 1 -- 172.21.15.92:0/714405713 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a3c0099b0 con 0x7f7a4c15d220 2023-08-26T09:25:59.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.745+0000 7f7a33fff700 1 -- 172.21.15.92:0/714405713 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c01c680 con 0x7f7a4c15d220 2023-08-26T09:25:59.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.745+0000 7f7a521f2700 1 -- 172.21.15.92:0/714405713 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a4c1573c0 con 0x7f7a4c15d220 2023-08-26T09:25:59.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.745+0000 7f7a521f2700 1 -- 172.21.15.92:0/714405713 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a4c157980 con 0x7f7a4c15d220 2023-08-26T09:25:59.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.746+0000 7f7a521f2700 1 -- 172.21.15.92:0/714405713 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a4c04eeb0 con 0x7f7a4c15d220 2023-08-26T09:25:59.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.746+0000 7f7a33fff700 1 -- 172.21.15.92:0/714405713 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7a3c01c7e0 con 0x7f7a4c15d220 2023-08-26T09:25:59.760 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.747+0000 7f7a33fff700 1 --2- 172.21.15.92:0/714405713 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f7a3806a0e0 0x7f7a3806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:25:59.760 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.747+0000 7f7a33fff700 1 -- 172.21.15.92:0/714405713 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7a3c08a0f0 con 0x7f7a4c15d220 2023-08-26T09:25:59.760 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.747+0000 7f7a4b7fe700 1 --2- 172.21.15.92:0/714405713 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f7a3806a0e0 0x7f7a3806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:25:59.760 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.747+0000 7f7a4b7fe700 1 --2- 172.21.15.92:0/714405713 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f7a3806a0e0 0x7f7a3806c5a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7a44007fd0 tx=0x7f7a44009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:25:59.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.751+0000 7f7a33fff700 1 -- 172.21.15.92:0/714405713 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7a3c055870 con 0x7f7a4c15d220 2023-08-26T09:25:59.945 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.940+0000 7f7a521f2700 1 -- 172.21.15.92:0/714405713 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7a4c073710 con 0x7f7a4c15d220 2023-08-26T09:25:59.945 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.940+0000 7f7a33fff700 1 -- 172.21.15.92:0/714405713 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7a3c058e90 con 0x7f7a4c15d220 2023-08-26T09:25:59.945 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 8 2023-08-26T09:25:59.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.942+0000 7f7a521f2700 1 -- 172.21.15.92:0/714405713 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f7a3806a0e0 msgr2=0x7f7a3806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:59.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.942+0000 7f7a521f2700 1 --2- 172.21.15.92:0/714405713 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f7a3806a0e0 0x7f7a3806c5a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7a44007fd0 tx=0x7f7a44009040 comp rx=0 tx=0).stop 2023-08-26T09:25:59.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.942+0000 7f7a521f2700 1 -- 172.21.15.92:0/714405713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a4c15d220 msgr2=0x7f7a4c0ade60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:25:59.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.942+0000 7f7a521f2700 1 --2- 172.21.15.92:0/714405713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a4c15d220 0x7f7a4c0ade60 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c06f8d0 tx=0x7f7a3c004ad0 comp rx=0 tx=0).stop 2023-08-26T09:25:59.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.942+0000 7f7a521f2700 1 -- 172.21.15.92:0/714405713 shutdown_connections 2023-08-26T09:25:59.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.942+0000 7f7a521f2700 1 --2- 172.21.15.92:0/714405713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a4c15d220 0x7f7a4c0ade60 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:59.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.942+0000 7f7a521f2700 1 --2- 172.21.15.92:0/714405713 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a4c071260 0x7f7a4c152bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:59.949 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.942+0000 7f7a521f2700 1 --2- 172.21.15.92:0/714405713 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f7a3806a0e0 0x7f7a3806c5a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:59.949 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.942+0000 7f7a521f2700 1 --2- 172.21.15.92:0/714405713 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a4c0af390 0x7f7a4c0ad920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:25:59.949 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.942+0000 7f7a521f2700 1 -- 172.21.15.92:0/714405713 >> 172.21.15.92:0/714405713 conn(0x7f7a4c06b430 msgr2=0x7f7a4c06a320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:25:59.949 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.942+0000 7f7a521f2700 1 -- 172.21.15.92:0/714405713 shutdown_connections 2023-08-26T09:25:59.949 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:25:59.942+0000 7f7a521f2700 1 -- 172.21.15.92:0/714405713 wait complete. 2023-08-26T09:25:59.959 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-26T09:26:00.082 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.078+0000 7ff5afc6d700 1 Processor -- start 2023-08-26T09:26:00.083 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.078+0000 7ff5afc6d700 1 -- start start 2023-08-26T09:26:00.092 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.079+0000 7ff5afc6d700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff5a8159dd0 0x7ff5a80cf220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:00.092 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.079+0000 7ff5afc6d700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5a80c6200 con 0x7ff5a8071430 2023-08-26T09:26:00.092 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.079+0000 7ff5afc6d700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5a80ce740 con 0x7ff5a806e110 2023-08-26T09:26:00.093 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.079+0000 7ff5afc6d700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a80cea20 con 0x7ff5a8159dd0 2023-08-26T09:26:00.093 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.079+0000 7ff5ae20a700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7ff5a8071430 0x7ff5a80c5490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:58186/0 (socket says 172.21.15.92:58186) 2023-08-26T09:26:00.093 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.079+0000 7ff5ae20a700 1 -- 172.21.15.92:0/1305503864 learned_addr learned my addr 172.21.15.92:0/1305503864 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:26:00.094 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.079+0000 7ff5ada09700 1 --2- 172.21.15.92:0/1305503864 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff5a8159dd0 0x7ff5a80cf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:00.094 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.079+0000 7ff5aca07700 1 -- 172.21.15.92:0/1305503864 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 904927838 0 0) 0x7ff5a80c6200 con 0x7ff5a8071430 2023-08-26T09:26:00.095 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.079+0000 7ff5aca07700 1 -- 172.21.15.92:0/1305503864 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5940035b0 con 0x7ff5a8071430 2023-08-26T09:26:00.095 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.079+0000 7ff5aca07700 1 -- 172.21.15.92:0/1305503864 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2476433559 0 0) 0x7ff5940035b0 con 0x7ff5a8071430 2023-08-26T09:26:00.095 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.079+0000 7ff5aca07700 1 -- 172.21.15.92:0/1305503864 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff5a8159dd0 msgr2=0x7ff5a80cf220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:00.096 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.079+0000 7ff5aca07700 1 --2- 172.21.15.92:0/1305503864 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff5a8159dd0 0x7ff5a80cf220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:00.096 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.079+0000 7ff5aca07700 1 -- 172.21.15.92:0/1305503864 >> v1:172.21.15.188:6789/0 conn(0x7ff5a806e110 legacy=0x7ff5a8070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:00.096 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.079+0000 7ff5aca07700 1 -- 172.21.15.92:0/1305503864 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a80ced00 con 0x7ff5a8071430 2023-08-26T09:26:00.097 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.079+0000 7ff5aca07700 1 -- 172.21.15.92:0/1305503864 <== mon.0 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1019361464 0 0) 0x7ff5a00019f0 con 0x7ff5a8071430 2023-08-26T09:26:00.097 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.079+0000 7ff5ada09700 1 --2- 172.21.15.92:0/1305503864 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff5a8159dd0 0x7ff5a80cf220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-26T09:26:00.097 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.079+0000 7ff5aca07700 1 -- 172.21.15.92:0/1305503864 >> v1:172.21.15.92:6789/0 conn(0x7ff5a8071430 legacy=0x7ff5a80c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:00.097 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.079+0000 7ff5aca07700 1 --2- 172.21.15.92:0/1305503864 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff5a8159dd0 0x7ff594003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:00.098 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.079+0000 7ff5aca07700 1 --2- 172.21.15.92:0/1305503864 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff594003f70 0x7ff594004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:00.098 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.080+0000 7ff5aca07700 1 --2- 172.21.15.92:0/1305503864 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff594004d90 0x7ff594005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:00.098 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.080+0000 7ff5aca07700 1 -- 172.21.15.92:0/1305503864 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a80cea20 con 0x7ff594003f70 2023-08-26T09:26:00.098 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.080+0000 7ff5aca07700 1 -- 172.21.15.92:0/1305503864 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59400bb20 con 0x7ff594004d90 2023-08-26T09:26:00.098 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.080+0000 7ff5aca07700 1 -- 172.21.15.92:0/1305503864 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff59400bce0 con 0x7ff5a8159dd0 2023-08-26T09:26:00.099 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.080+0000 7ff5ad208700 1 --2- 172.21.15.92:0/1305503864 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff594003f70 0x7ff594004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:00.099 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.080+0000 7ff5ada09700 1 --2- 172.21.15.92:0/1305503864 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff5a8159dd0 0x7ff594003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:00.099 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.080+0000 7ff5ae20a700 1 --2- 172.21.15.92:0/1305503864 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff594004d90 0x7ff594005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:00.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.080+0000 7ff5ad208700 1 -- 172.21.15.92:0/1305503864 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff5a8159dd0 msgr2=0x7ff594003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:00.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.080+0000 7ff5ad208700 1 --2- 172.21.15.92:0/1305503864 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff5a8159dd0 0x7ff594003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:00.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.080+0000 7ff5ad208700 1 -- 172.21.15.92:0/1305503864 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff594004d90 msgr2=0x7ff594005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:00.101 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.080+0000 7ff5ad208700 1 --2- 172.21.15.92:0/1305503864 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff594004d90 0x7ff594005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:00.101 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.080+0000 7ff5ad208700 1 -- 172.21.15.92:0/1305503864 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5980094a0 con 0x7ff594003f70 2023-08-26T09:26:00.101 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.080+0000 7ff5ae20a700 1 --2- 172.21.15.92:0/1305503864 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff594004d90 0x7ff594005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:26:00.102 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.080+0000 7ff5ad208700 1 --2- 172.21.15.92:0/1305503864 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff594003f70 0x7ff594004850 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff5a40018d0 tx=0x7ff594005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1023d522006c5409 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:00.102 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.080+0000 7ff5aca07700 1 -- 172.21.15.92:0/1305503864 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a400c690 con 0x7ff594003f70 2023-08-26T09:26:00.102 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.080+0000 7ff5aca07700 1 -- 172.21.15.92:0/1305503864 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a400c7f0 con 0x7ff594003f70 2023-08-26T09:26:00.102 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.080+0000 7ff5aca07700 1 -- 172.21.15.92:0/1305503864 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a400cba0 con 0x7ff594003f70 2023-08-26T09:26:00.102 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.081+0000 7ff5afc6d700 1 -- 172.21.15.92:0/1305503864 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff594003f70 msgr2=0x7ff594004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:00.103 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.081+0000 7ff5afc6d700 1 --2- 172.21.15.92:0/1305503864 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff594003f70 0x7ff594004850 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff5a40018d0 tx=0x7ff594005880 comp rx=0 tx=0).stop 2023-08-26T09:26:00.103 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.081+0000 7ff5ae20a700 1 -- 172.21.15.92:0/1305503864 reap_dead start 2023-08-26T09:26:00.103 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.081+0000 7ff5afc6d700 1 -- 172.21.15.92:0/1305503864 shutdown_connections 2023-08-26T09:26:00.103 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.081+0000 7ff5afc6d700 1 -- 172.21.15.92:0/1305503864 >> 172.21.15.92:0/1305503864 conn(0x7ff5a806b430 msgr2=0x7ff5a806b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:00.104 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.081+0000 7ff5afc6d700 1 -- 172.21.15.92:0/1305503864 shutdown_connections 2023-08-26T09:26:00.104 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.081+0000 7ff5afc6d700 1 -- 172.21.15.92:0/1305503864 wait complete. 2023-08-26T09:26:00.104 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.082+0000 7ff5afc6d700 1 Processor -- start 2023-08-26T09:26:00.104 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.082+0000 7ff5afc6d700 1 -- start start 2023-08-26T09:26:00.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.083+0000 7ff5afc6d700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff594003f70 0x7ff5a81420e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:00.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.083+0000 7ff5afc6d700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff5a8157e50 0x7ff5a8144b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:00.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.083+0000 7ff5afc6d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff5a8143880 0x7ff5a815d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:00.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.083+0000 7ff5afc6d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a81433f0 con 0x7ff5a8143880 2023-08-26T09:26:00.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.083+0000 7ff5afc6d700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a81427e0 con 0x7ff5a8157e50 2023-08-26T09:26:00.106 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.083+0000 7ff5afc6d700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a8142ac0 con 0x7ff594003f70 2023-08-26T09:26:00.106 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.083+0000 7ff5ae20a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff5a8143880 0x7ff5a815d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:00.106 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.084+0000 7ff5ae20a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff5a8143880 0x7ff5a815d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46184/0 (socket says 172.21.15.92:46184) 2023-08-26T09:26:00.106 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.084+0000 7ff5ae20a700 1 -- 172.21.15.92:0/2563564345 learned_addr learned my addr 172.21.15.92:0/2563564345 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:00.106 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.084+0000 7ff5ada09700 1 --2- 172.21.15.92:0/2563564345 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff594003f70 0x7ff5a81420e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:00.107 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.084+0000 7ff5ad208700 1 --2- 172.21.15.92:0/2563564345 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff5a8157e50 0x7ff5a8144b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:00.107 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.084+0000 7ff5ae20a700 1 -- 172.21.15.92:0/2563564345 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff594003f70 msgr2=0x7ff5a81420e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:00.107 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.084+0000 7ff5ae20a700 1 --2- 172.21.15.92:0/2563564345 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff594003f70 0x7ff5a81420e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:00.107 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.084+0000 7ff5ae20a700 1 -- 172.21.15.92:0/2563564345 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff5a8157e50 msgr2=0x7ff5a8144b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:00.107 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.084+0000 7ff5ae20a700 1 --2- 172.21.15.92:0/2563564345 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff5a8157e50 0x7ff5a8144b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:00.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.084+0000 7ff5ae20a700 1 -- 172.21.15.92:0/2563564345 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a8142da0 con 0x7ff5a8143880 2023-08-26T09:26:00.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.084+0000 7ff5ae20a700 1 --2- 172.21.15.92:0/2563564345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff5a8143880 0x7ff5a815d980 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff5a806f8d0 tx=0x7ff5a0007c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:00.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.084+0000 7ff59e7fc700 1 -- 172.21.15.92:0/2563564345 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a000ec00 con 0x7ff5a8143880 2023-08-26T09:26:00.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.084+0000 7ff59e7fc700 1 -- 172.21.15.92:0/2563564345 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a000ed60 con 0x7ff5a8143880 2023-08-26T09:26:00.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.084+0000 7ff59e7fc700 1 -- 172.21.15.92:0/2563564345 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a0013660 con 0x7ff5a8143880 2023-08-26T09:26:00.110 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.084+0000 7ff5afc6d700 1 -- 172.21.15.92:0/2563564345 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a8143080 con 0x7ff5a8143880 2023-08-26T09:26:00.110 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.084+0000 7ff5afc6d700 1 -- 172.21.15.92:0/2563564345 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a81582d0 con 0x7ff5a8143880 2023-08-26T09:26:00.110 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.085+0000 7ff5afc6d700 1 -- 172.21.15.92:0/2563564345 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5a80b5ee0 con 0x7ff5a8143880 2023-08-26T09:26:00.110 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.085+0000 7ff59e7fc700 1 -- 172.21.15.92:0/2563564345 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff5a00137c0 con 0x7ff5a8143880 2023-08-26T09:26:00.111 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.086+0000 7ff59e7fc700 1 --2- 172.21.15.92:0/2563564345 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7ff58c06a0e0 0x7ff58c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:00.111 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.086+0000 7ff59e7fc700 1 -- 172.21.15.92:0/2563564345 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff5a0088a20 con 0x7ff5a8143880 2023-08-26T09:26:00.111 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.086+0000 7ff5ada09700 1 --2- 172.21.15.92:0/2563564345 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7ff58c06a0e0 0x7ff58c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:00.111 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.086+0000 7ff5ada09700 1 --2- 172.21.15.92:0/2563564345 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7ff58c06a0e0 0x7ff58c06c5a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff598009df0 tx=0x7ff598009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:00.112 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.090+0000 7ff59e7fc700 1 -- 172.21.15.92:0/2563564345 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff5a0054110 con 0x7ff5a8143880 2023-08-26T09:26:00.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.280+0000 7ff5afc6d700 1 -- 172.21.15.92:0/2563564345 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff5a804eeb0 con 0x7ff5a8143880 2023-08-26T09:26:00.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.280+0000 7ff59e7fc700 1 -- 172.21.15.92:0/2563564345 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff5a0001200 con 0x7ff5a8143880 2023-08-26T09:26:00.285 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 1 2023-08-26T09:26:00.287 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.282+0000 7ff5afc6d700 1 -- 172.21.15.92:0/2563564345 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7ff58c06a0e0 msgr2=0x7ff58c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:00.287 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.282+0000 7ff5afc6d700 1 --2- 172.21.15.92:0/2563564345 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7ff58c06a0e0 0x7ff58c06c5a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff598009df0 tx=0x7ff598009210 comp rx=0 tx=0).stop 2023-08-26T09:26:00.288 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.282+0000 7ff5afc6d700 1 -- 172.21.15.92:0/2563564345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff5a8143880 msgr2=0x7ff5a815d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:00.288 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.282+0000 7ff5afc6d700 1 --2- 172.21.15.92:0/2563564345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff5a8143880 0x7ff5a815d980 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff5a806f8d0 tx=0x7ff5a0007c90 comp rx=0 tx=0).stop 2023-08-26T09:26:00.288 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.282+0000 7ff5afc6d700 1 -- 172.21.15.92:0/2563564345 shutdown_connections 2023-08-26T09:26:00.288 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.282+0000 7ff5afc6d700 1 --2- 172.21.15.92:0/2563564345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff5a8143880 0x7ff5a815d980 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:00.288 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.282+0000 7ff5afc6d700 1 --2- 172.21.15.92:0/2563564345 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff594003f70 0x7ff5a81420e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:00.289 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.282+0000 7ff5afc6d700 1 --2- 172.21.15.92:0/2563564345 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7ff58c06a0e0 0x7ff58c06c5a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:00.289 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.282+0000 7ff5afc6d700 1 --2- 172.21.15.92:0/2563564345 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff5a8157e50 0x7ff5a8144b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:00.289 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.282+0000 7ff5afc6d700 1 -- 172.21.15.92:0/2563564345 >> 172.21.15.92:0/2563564345 conn(0x7ff5a806b430 msgr2=0x7ff5a815c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:00.289 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.282+0000 7ff5afc6d700 1 -- 172.21.15.92:0/2563564345 shutdown_connections 2023-08-26T09:26:00.289 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.282+0000 7ff5afc6d700 1 -- 172.21.15.92:0/2563564345 wait complete. 2023-08-26T09:26:00.299 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-26T09:26:00.423 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.418+0000 7f22c45ae700 1 Processor -- start 2023-08-26T09:26:00.423 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.418+0000 7f22c45ae700 1 -- start start 2023-08-26T09:26:00.425 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.419+0000 7f22c45ae700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f22bc071430 0x7f22bc167ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:00.425 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.419+0000 7f22c45ae700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22bc0aee50 con 0x7f22bc0af390 2023-08-26T09:26:00.426 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.419+0000 7f22c45ae700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22bc0af130 con 0x7f22bc15d220 2023-08-26T09:26:00.426 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.419+0000 7f22c45ae700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22bc0c4cb0 con 0x7f22bc071430 2023-08-26T09:26:00.426 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.419+0000 7f22c2b4b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f22bc071430 0x7f22bc167ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:00.426 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.419+0000 7f22c1b49700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f22bc0af390 0x7f22bc070d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:58202/0 (socket says 172.21.15.92:58202) 2023-08-26T09:26:00.426 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.419+0000 7f22c1b49700 1 -- 172.21.15.92:0/1126901853 learned_addr learned my addr 172.21.15.92:0/1126901853 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:26:00.427 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.420+0000 7f22c2b4b700 1 -- 172.21.15.92:0/1126901853 >> v1:172.21.15.188:6789/0 conn(0x7f22bc15d220 legacy=0x7f22bc06db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:00.427 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.420+0000 7f22c2b4b700 1 -- 172.21.15.92:0/1126901853 >> v1:172.21.15.92:6789/0 conn(0x7f22bc0af390 legacy=0x7f22bc070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:00.427 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.420+0000 7f22c2b4b700 1 -- 172.21.15.92:0/1126901853 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22bc0c4f90 con 0x7f22bc071430 2023-08-26T09:26:00.427 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.420+0000 7f22c2b4b700 1 --2- 172.21.15.92:0/1126901853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22bc071430 0x7f22bc167ee0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f22b4009d90 tx=0x7f22b400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd4467a756d40ff6 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:00.427 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.420+0000 7f22c1348700 1 -- 172.21.15.92:0/1126901853 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b400e070 con 0x7f22bc071430 2023-08-26T09:26:00.428 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.420+0000 7f22c1348700 1 -- 172.21.15.92:0/1126901853 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b400bbd0 con 0x7f22bc071430 2023-08-26T09:26:00.428 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.420+0000 7f22c1348700 1 -- 172.21.15.92:0/1126901853 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b4012430 con 0x7f22bc071430 2023-08-26T09:26:00.428 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.420+0000 7f22c45ae700 1 -- 172.21.15.92:0/1126901853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22bc071430 msgr2=0x7f22bc167ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:00.428 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.420+0000 7f22c45ae700 1 --2- 172.21.15.92:0/1126901853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22bc071430 0x7f22bc167ee0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f22b4009d90 tx=0x7f22b400b330 comp rx=0 tx=0).stop 2023-08-26T09:26:00.428 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.421+0000 7f22c45ae700 1 -- 172.21.15.92:0/1126901853 shutdown_connections 2023-08-26T09:26:00.429 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.421+0000 7f22c45ae700 1 --2- 172.21.15.92:0/1126901853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22bc071430 0x7f22bc167ee0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:00.429 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.421+0000 7f22c45ae700 1 -- 172.21.15.92:0/1126901853 >> 172.21.15.92:0/1126901853 conn(0x7f22bc06b430 msgr2=0x7f22bc06b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:00.429 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.421+0000 7f22c45ae700 1 -- 172.21.15.92:0/1126901853 shutdown_connections 2023-08-26T09:26:00.429 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.421+0000 7f22c45ae700 1 -- 172.21.15.92:0/1126901853 wait complete. 2023-08-26T09:26:00.432 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.422+0000 7f22c45ae700 1 Processor -- start 2023-08-26T09:26:00.432 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.422+0000 7f22c45ae700 1 -- start start 2023-08-26T09:26:00.432 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.422+0000 7f22c45ae700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f22bc071430 0x7f22bc153b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:00.432 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.422+0000 7f22c45ae700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f22bc0af390 0x7f22bc0b2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:00.433 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.422+0000 7f22c45ae700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22bc15d220 0x7f22bc157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:00.433 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.422+0000 7f22c45ae700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc159670 con 0x7f22bc15d220 2023-08-26T09:26:00.433 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.422+0000 7f22c45ae700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc1540a0 con 0x7f22bc071430 2023-08-26T09:26:00.433 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.422+0000 7f22c45ae700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc0b51a0 con 0x7f22bc0af390 2023-08-26T09:26:00.433 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.423+0000 7f22c2b4b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22bc15d220 0x7f22bc157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:00.434 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.423+0000 7f22c2b4b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22bc15d220 0x7f22bc157cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46196/0 (socket says 172.21.15.92:46196) 2023-08-26T09:26:00.434 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.423+0000 7f22c2b4b700 1 -- 172.21.15.92:0/921287069 learned_addr learned my addr 172.21.15.92:0/921287069 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:00.434 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.423+0000 7f22c234a700 1 --2- 172.21.15.92:0/921287069 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f22bc071430 0x7f22bc153b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:00.434 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.423+0000 7f22c1b49700 1 --2- 172.21.15.92:0/921287069 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f22bc0af390 0x7f22bc0b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:00.434 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.423+0000 7f22c2b4b700 1 -- 172.21.15.92:0/921287069 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f22bc0af390 msgr2=0x7f22bc0b2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:00.435 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.423+0000 7f22c2b4b700 1 --2- 172.21.15.92:0/921287069 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f22bc0af390 0x7f22bc0b2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:00.435 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.423+0000 7f22c2b4b700 1 -- 172.21.15.92:0/921287069 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f22bc071430 msgr2=0x7f22bc153b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:00.435 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.423+0000 7f22c2b4b700 1 --2- 172.21.15.92:0/921287069 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f22bc071430 0x7f22bc153b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:00.435 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.423+0000 7f22c2b4b700 1 -- 172.21.15.92:0/921287069 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b4009a70 con 0x7f22bc15d220 2023-08-26T09:26:00.435 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.423+0000 7f22c1b49700 1 --2- 172.21.15.92:0/921287069 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f22bc0af390 0x7f22bc0b2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:26:00.436 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.423+0000 7f22c234a700 1 --2- 172.21.15.92:0/921287069 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f22bc071430 0x7f22bc153b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:26:00.436 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.423+0000 7f22c2b4b700 1 --2- 172.21.15.92:0/921287069 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22bc15d220 0x7f22bc157cb0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f22b4014040 tx=0x7f22b4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:00.436 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.423+0000 7f22b2ffd700 1 -- 172.21.15.92:0/921287069 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b40098f0 con 0x7f22bc15d220 2023-08-26T09:26:00.436 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.423+0000 7f22b2ffd700 1 -- 172.21.15.92:0/921287069 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b4020070 con 0x7f22bc15d220 2023-08-26T09:26:00.436 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.423+0000 7f22c45ae700 1 -- 172.21.15.92:0/921287069 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22bc0b5480 con 0x7f22bc15d220 2023-08-26T09:26:00.437 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.423+0000 7f22b2ffd700 1 -- 172.21.15.92:0/921287069 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b4004280 con 0x7f22bc15d220 2023-08-26T09:26:00.437 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.423+0000 7f22c45ae700 1 -- 172.21.15.92:0/921287069 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22bc1598c0 con 0x7f22bc15d220 2023-08-26T09:26:00.437 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.424+0000 7f22c45ae700 1 -- 172.21.15.92:0/921287069 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22bc04eeb0 con 0x7f22bc15d220 2023-08-26T09:26:00.437 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.425+0000 7f22b2ffd700 1 -- 172.21.15.92:0/921287069 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f22b40043e0 con 0x7f22bc15d220 2023-08-26T09:26:00.437 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.425+0000 7f22b2ffd700 1 --2- 172.21.15.92:0/921287069 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f22a006a0e0 0x7f22a006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:00.437 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.425+0000 7f22b2ffd700 1 -- 172.21.15.92:0/921287069 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f22b4022070 con 0x7f22bc15d220 2023-08-26T09:26:00.438 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.425+0000 7f22c234a700 1 --2- 172.21.15.92:0/921287069 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f22a006a0e0 0x7f22a006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:00.438 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.425+0000 7f22c234a700 1 --2- 172.21.15.92:0/921287069 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f22a006a0e0 0x7f22a006c5a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f22bc1589e0 tx=0x7f22ac009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:00.438 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.429+0000 7f22b2ffd700 1 -- 172.21.15.92:0/921287069 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f22b4055fb0 con 0x7f22bc15d220 2023-08-26T09:26:00.624 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.619+0000 7f22c45ae700 1 -- 172.21.15.92:0/921287069 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f22bc159a80 con 0x7f22bc15d220 2023-08-26T09:26:00.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.620+0000 7f22b2ffd700 1 -- 172.21.15.92:0/921287069 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f22b401ae60 con 0x7f22bc15d220 2023-08-26T09:26:00.625 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 32 2023-08-26T09:26:00.627 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.622+0000 7f22c45ae700 1 -- 172.21.15.92:0/921287069 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f22a006a0e0 msgr2=0x7f22a006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:00.627 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.622+0000 7f22c45ae700 1 --2- 172.21.15.92:0/921287069 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f22a006a0e0 0x7f22a006c5a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f22bc1589e0 tx=0x7f22ac009040 comp rx=0 tx=0).stop 2023-08-26T09:26:00.627 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.622+0000 7f22c45ae700 1 -- 172.21.15.92:0/921287069 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22bc15d220 msgr2=0x7f22bc157cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:00.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.622+0000 7f22c45ae700 1 --2- 172.21.15.92:0/921287069 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22bc15d220 0x7f22bc157cb0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f22b4014040 tx=0x7f22b4004ad0 comp rx=0 tx=0).stop 2023-08-26T09:26:00.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.622+0000 7f22c45ae700 1 -- 172.21.15.92:0/921287069 shutdown_connections 2023-08-26T09:26:00.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.622+0000 7f22c45ae700 1 --2- 172.21.15.92:0/921287069 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f22a006a0e0 0x7f22a006c5a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:00.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.622+0000 7f22c45ae700 1 --2- 172.21.15.92:0/921287069 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f22bc071430 0x7f22bc153b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:00.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.622+0000 7f22c45ae700 1 --2- 172.21.15.92:0/921287069 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22bc15d220 0x7f22bc157cb0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:00.629 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.622+0000 7f22c45ae700 1 --2- 172.21.15.92:0/921287069 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f22bc0af390 0x7f22bc0b2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:00.629 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.622+0000 7f22c45ae700 1 -- 172.21.15.92:0/921287069 >> 172.21.15.92:0/921287069 conn(0x7f22bc06b430 msgr2=0x7f22bc06e750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:00.629 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.622+0000 7f22c45ae700 1 -- 172.21.15.92:0/921287069 shutdown_connections 2023-08-26T09:26:00.629 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.622+0000 7f22c45ae700 1 -- 172.21.15.92:0/921287069 wait complete. 2023-08-26T09:26:00.639 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-26T09:26:00.763 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.758+0000 7feb6f22f700 1 Processor -- start 2023-08-26T09:26:00.763 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.758+0000 7feb6f22f700 1 -- start start 2023-08-26T09:26:00.765 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.759+0000 7feb6f22f700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7feb6815def0 0x7feb680ceb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:00.766 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.759+0000 7feb6f22f700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb680cd3b0 con 0x7feb680ce150 2023-08-26T09:26:00.766 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.759+0000 7feb6f22f700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb680cd690 con 0x7feb680c9aa0 2023-08-26T09:26:00.766 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.759+0000 7feb6f22f700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb680cd970 con 0x7feb6815def0 2023-08-26T09:26:00.766 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.759+0000 7feb6cfcb700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7feb6815def0 0x7feb680ceb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:00.766 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.759+0000 7feb67fff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7feb680ce150 0x7feb6815e2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:58218/0 (socket says 172.21.15.92:58218) 2023-08-26T09:26:00.767 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.759+0000 7feb67fff700 1 -- 172.21.15.92:0/3972544121 learned_addr learned my addr 172.21.15.92:0/3972544121 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:26:00.767 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.759+0000 7feb6cfcb700 1 -- 172.21.15.92:0/3972544121 >> v1:172.21.15.188:6789/0 conn(0x7feb680c9aa0 legacy=0x7feb6806a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:00.767 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.759+0000 7feb6cfcb700 1 -- 172.21.15.92:0/3972544121 >> v1:172.21.15.92:6789/0 conn(0x7feb680ce150 legacy=0x7feb6815e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:00.767 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.759+0000 7feb6cfcb700 1 -- 172.21.15.92:0/3972544121 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb680cdc50 con 0x7feb6815def0 2023-08-26T09:26:00.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.759+0000 7feb677fe700 1 -- 172.21.15.92:0/3972544121 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2439590291 0 0) 0x7feb680cd3b0 con 0x7feb680ce150 2023-08-26T09:26:00.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.760+0000 7feb6cfcb700 1 --2- 172.21.15.92:0/3972544121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb6815def0 0x7feb680ceb80 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7feb5c009870 tx=0x7feb5c009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd806328f9de7b04 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:00.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.760+0000 7feb677fe700 1 -- 172.21.15.92:0/3972544121 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5c004230 con 0x7feb6815def0 2023-08-26T09:26:00.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.760+0000 7feb677fe700 1 -- 172.21.15.92:0/3972544121 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb5c004390 con 0x7feb6815def0 2023-08-26T09:26:00.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.760+0000 7feb677fe700 1 -- 172.21.15.92:0/3972544121 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5c0036a0 con 0x7feb6815def0 2023-08-26T09:26:00.769 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.760+0000 7feb6f22f700 1 -- 172.21.15.92:0/3972544121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb6815def0 msgr2=0x7feb680ceb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:00.769 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.760+0000 7feb6f22f700 1 --2- 172.21.15.92:0/3972544121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb6815def0 0x7feb680ceb80 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7feb5c009870 tx=0x7feb5c009b80 comp rx=0 tx=0).stop 2023-08-26T09:26:00.769 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.760+0000 7feb6f22f700 1 -- 172.21.15.92:0/3972544121 shutdown_connections 2023-08-26T09:26:00.769 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.760+0000 7feb6f22f700 1 --2- 172.21.15.92:0/3972544121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb6815def0 0x7feb680ceb80 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:00.769 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.760+0000 7feb6f22f700 1 -- 172.21.15.92:0/3972544121 >> 172.21.15.92:0/3972544121 conn(0x7feb680cf450 msgr2=0x7feb680cf860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:00.770 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.760+0000 7feb6f22f700 1 -- 172.21.15.92:0/3972544121 shutdown_connections 2023-08-26T09:26:00.770 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.760+0000 7feb6f22f700 1 -- 172.21.15.92:0/3972544121 wait complete. 2023-08-26T09:26:00.772 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.762+0000 7feb6f22f700 1 Processor -- start 2023-08-26T09:26:00.772 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.762+0000 7feb6f22f700 1 -- start start 2023-08-26T09:26:00.773 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.763+0000 7feb6f22f700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feb680c9aa0 0x7feb6815a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:00.773 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.763+0000 7feb6f22f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb6815def0 0x7feb68160200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:00.773 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.763+0000 7feb6f22f700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feb68156fe0 0x7feb68155ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:00.773 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.763+0000 7feb6f22f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb680c6990 con 0x7feb6815def0 2023-08-26T09:26:00.773 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.763+0000 7feb6f22f700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb680c8860 con 0x7feb68156fe0 2023-08-26T09:26:00.774 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.763+0000 7feb6f22f700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb680c9350 con 0x7feb680c9aa0 2023-08-26T09:26:00.774 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.763+0000 7feb67fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb6815def0 0x7feb68160200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:00.774 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.763+0000 7feb67fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb6815def0 0x7feb68160200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46208/0 (socket says 172.21.15.92:46208) 2023-08-26T09:26:00.774 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.763+0000 7feb67fff700 1 -- 172.21.15.92:0/2110298865 learned_addr learned my addr 172.21.15.92:0/2110298865 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:00.775 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.763+0000 7feb67fff700 1 -- 172.21.15.92:0/2110298865 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feb680c9aa0 msgr2=0x7feb6815a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:00.775 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.763+0000 7feb67fff700 1 --2- 172.21.15.92:0/2110298865 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feb680c9aa0 0x7feb6815a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:00.775 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.763+0000 7feb67fff700 1 -- 172.21.15.92:0/2110298865 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feb68156fe0 msgr2=0x7feb68155ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:00.775 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.763+0000 7feb6d7cc700 1 --2- 172.21.15.92:0/2110298865 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feb68156fe0 0x7feb68155ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:00.775 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.763+0000 7feb67fff700 1 --2- 172.21.15.92:0/2110298865 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feb68156fe0 0x7feb68155ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:00.775 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.763+0000 7feb67fff700 1 -- 172.21.15.92:0/2110298865 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb5c0094a0 con 0x7feb6815def0 2023-08-26T09:26:00.776 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.763+0000 7feb67fff700 1 --2- 172.21.15.92:0/2110298865 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb6815def0 0x7feb68160200 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7feb5400c570 tx=0x7feb5400c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:00.776 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.764+0000 7feb657fa700 1 -- 172.21.15.92:0/2110298865 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb54004c80 con 0x7feb6815def0 2023-08-26T09:26:00.776 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.764+0000 7feb657fa700 1 -- 172.21.15.92:0/2110298865 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb54004e00 con 0x7feb6815def0 2023-08-26T09:26:00.776 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.764+0000 7feb6f22f700 1 -- 172.21.15.92:0/2110298865 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb680c8ab0 con 0x7feb6815def0 2023-08-26T09:26:00.776 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.764+0000 7feb657fa700 1 -- 172.21.15.92:0/2110298865 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb54007310 con 0x7feb6815def0 2023-08-26T09:26:00.777 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.764+0000 7feb6f22f700 1 -- 172.21.15.92:0/2110298865 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb680c9070 con 0x7feb6815def0 2023-08-26T09:26:00.777 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.765+0000 7feb6f22f700 1 -- 172.21.15.92:0/2110298865 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb68158360 con 0x7feb6815def0 2023-08-26T09:26:00.777 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.765+0000 7feb657fa700 1 -- 172.21.15.92:0/2110298865 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7feb54007470 con 0x7feb6815def0 2023-08-26T09:26:00.777 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.765+0000 7feb657fa700 1 --2- 172.21.15.92:0/2110298865 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7feb4c06a0e0 0x7feb4c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:00.777 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.766+0000 7feb6cfcb700 1 --2- 172.21.15.92:0/2110298865 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7feb4c06a0e0 0x7feb4c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:00.777 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.766+0000 7feb657fa700 1 -- 172.21.15.92:0/2110298865 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7feb54088270 con 0x7feb6815def0 2023-08-26T09:26:00.778 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.766+0000 7feb6cfcb700 1 --2- 172.21.15.92:0/2110298865 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7feb4c06a0e0 0x7feb4c06c5a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7feb5c000c00 tx=0x7feb5c013040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:00.778 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.770+0000 7feb657fa700 1 -- 172.21.15.92:0/2110298865 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7feb68158360 con 0x7feb6815def0 2023-08-26T09:26:00.964 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.960+0000 7feb6f22f700 1 -- 172.21.15.92:0/2110298865 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7feb68158360 con 0x7feb6815def0 2023-08-26T09:26:00.965 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.960+0000 7feb657fa700 1 -- 172.21.15.92:0/2110298865 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7feb68158360 con 0x7feb6815def0 2023-08-26T09:26:00.965 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 64 2023-08-26T09:26:00.967 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.962+0000 7feb6f22f700 1 -- 172.21.15.92:0/2110298865 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7feb4c06a0e0 msgr2=0x7feb4c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:00.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.962+0000 7feb6f22f700 1 --2- 172.21.15.92:0/2110298865 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7feb4c06a0e0 0x7feb4c06c5a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7feb5c000c00 tx=0x7feb5c013040 comp rx=0 tx=0).stop 2023-08-26T09:26:00.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.962+0000 7feb6f22f700 1 -- 172.21.15.92:0/2110298865 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb6815def0 msgr2=0x7feb68160200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:00.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.962+0000 7feb6f22f700 1 --2- 172.21.15.92:0/2110298865 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb6815def0 0x7feb68160200 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7feb5400c570 tx=0x7feb5400c930 comp rx=0 tx=0).stop 2023-08-26T09:26:00.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.962+0000 7feb6f22f700 1 -- 172.21.15.92:0/2110298865 shutdown_connections 2023-08-26T09:26:00.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.962+0000 7feb6f22f700 1 --2- 172.21.15.92:0/2110298865 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7feb4c06a0e0 0x7feb4c06c5a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:00.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.962+0000 7feb6f22f700 1 --2- 172.21.15.92:0/2110298865 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feb68156fe0 0x7feb68155ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:00.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.962+0000 7feb6f22f700 1 --2- 172.21.15.92:0/2110298865 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feb680c9aa0 0x7feb6815a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:00.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.962+0000 7feb6f22f700 1 --2- 172.21.15.92:0/2110298865 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb6815def0 0x7feb68160200 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:00.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.962+0000 7feb6f22f700 1 -- 172.21.15.92:0/2110298865 >> 172.21.15.92:0/2110298865 conn(0x7feb680cf450 msgr2=0x7feb680ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:00.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.962+0000 7feb6f22f700 1 -- 172.21.15.92:0/2110298865 shutdown_connections 2023-08-26T09:26:00.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:00.962+0000 7feb6f22f700 1 -- 172.21.15.92:0/2110298865 wait complete. 2023-08-26T09:26:00.980 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-26T09:26:01.101 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.096+0000 7f8d5661e700 1 Processor -- start 2023-08-26T09:26:01.101 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.096+0000 7f8d5661e700 1 -- start start 2023-08-26T09:26:01.103 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.097+0000 7f8d5661e700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f8d50160b90 0x7f8d500cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:01.104 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.097+0000 7f8d5661e700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f8d5006d8a0 0x7f8d50161b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:01.104 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.097+0000 7f8d5661e700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d5006cf70 con 0x7f8d5006a320 2023-08-26T09:26:01.104 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.097+0000 7f8d5661e700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d50160f70 con 0x7f8d5006d8a0 2023-08-26T09:26:01.104 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.097+0000 7f8d5661e700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d50161670 con 0x7f8d50160b90 2023-08-26T09:26:01.104 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.097+0000 7f8d4f7fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f8d5006d8a0 0x7f8d50161b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:01.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.097+0000 7f8d4f7fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f8d5006d8a0 0x7f8d50161b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46218/0 (socket says 172.21.15.92:46218) 2023-08-26T09:26:01.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.097+0000 7f8d4f7fe700 1 -- 172.21.15.92:0/340943791 learned_addr learned my addr 172.21.15.92:0/340943791 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:01.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.097+0000 7f8d4ffff700 1 --2- 172.21.15.92:0/340943791 >> v2:172.21.15.188:3300/0 conn(0x7f8d50160b90 0x7f8d500cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:01.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.097+0000 7f8d4f7fe700 1 -- 172.21.15.92:0/340943791 >> v2:172.21.15.188:3300/0 conn(0x7f8d50160b90 msgr2=0x7f8d500cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:01.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.097+0000 7f8d4f7fe700 1 --2- 172.21.15.92:0/340943791 >> v2:172.21.15.188:3300/0 conn(0x7f8d50160b90 0x7f8d500cf780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:01.106 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.097+0000 7f8d4f7fe700 1 -- 172.21.15.92:0/340943791 >> v1:172.21.15.188:6789/0 conn(0x7f8d5006a320 legacy=0x7f8d50070ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:01.106 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.097+0000 7f8d4f7fe700 1 -- 172.21.15.92:0/340943791 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d50162040 con 0x7f8d5006d8a0 2023-08-26T09:26:01.106 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.097+0000 7f8d4f7fe700 1 --2- 172.21.15.92:0/340943791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d5006d8a0 0x7f8d50161b00 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8d5006fa80 tx=0x7f8d40009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=144b137dc8ad72e4 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:01.106 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.098+0000 7f8d4effd700 1 -- 172.21.15.92:0/340943791 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d40004230 con 0x7f8d5006d8a0 2023-08-26T09:26:01.106 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.098+0000 7f8d4effd700 1 -- 172.21.15.92:0/340943791 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d40004390 con 0x7f8d5006d8a0 2023-08-26T09:26:01.107 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.098+0000 7f8d4effd700 1 -- 172.21.15.92:0/340943791 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d400036a0 con 0x7f8d5006d8a0 2023-08-26T09:26:01.107 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.098+0000 7f8d5661e700 1 -- 172.21.15.92:0/340943791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d5006d8a0 msgr2=0x7f8d50161b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:01.107 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.098+0000 7f8d5661e700 1 --2- 172.21.15.92:0/340943791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d5006d8a0 0x7f8d50161b00 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8d5006fa80 tx=0x7f8d40009bd0 comp rx=0 tx=0).stop 2023-08-26T09:26:01.107 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.098+0000 7f8d5661e700 1 -- 172.21.15.92:0/340943791 shutdown_connections 2023-08-26T09:26:01.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.098+0000 7f8d5661e700 1 --2- 172.21.15.92:0/340943791 >> v2:172.21.15.188:3300/0 conn(0x7f8d50160b90 0x7f8d500cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:01.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.098+0000 7f8d5661e700 1 --2- 172.21.15.92:0/340943791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d5006d8a0 0x7f8d50161b00 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:01.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.098+0000 7f8d5661e700 1 -- 172.21.15.92:0/340943791 >> 172.21.15.92:0/340943791 conn(0x7f8d500cc790 msgr2=0x7f8d500ccb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:01.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.098+0000 7f8d5661e700 1 -- 172.21.15.92:0/340943791 shutdown_connections 2023-08-26T09:26:01.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.098+0000 7f8d5661e700 1 -- 172.21.15.92:0/340943791 wait complete. 2023-08-26T09:26:01.111 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.099+0000 7f8d5661e700 1 Processor -- start 2023-08-26T09:26:01.111 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.099+0000 7f8d5661e700 1 -- start start 2023-08-26T09:26:01.111 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.100+0000 7f8d5661e700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8d5006a320 0x7f8d50157d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:01.111 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.100+0000 7f8d5661e700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8d5006d8a0 0x7f8d500c8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:01.112 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.100+0000 7f8d5661e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d50160b90 0x7f8d500cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:01.112 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.100+0000 7f8d5661e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d50158270 con 0x7f8d50160b90 2023-08-26T09:26:01.112 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.100+0000 7f8d5661e700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d500b1d00 con 0x7f8d5006a320 2023-08-26T09:26:01.112 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.100+0000 7f8d5661e700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d500b10f0 con 0x7f8d5006d8a0 2023-08-26T09:26:01.112 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.100+0000 7f8d54bbb700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d50160b90 0x7f8d500cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:01.113 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.100+0000 7f8d54bbb700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d50160b90 0x7f8d500cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46228/0 (socket says 172.21.15.92:46228) 2023-08-26T09:26:01.113 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.100+0000 7f8d54bbb700 1 -- 172.21.15.92:0/3157824380 learned_addr learned my addr 172.21.15.92:0/3157824380 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:01.113 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.100+0000 7f8d4ffff700 1 --2- 172.21.15.92:0/3157824380 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8d5006a320 0x7f8d50157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:01.113 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.100+0000 7f8d4f7fe700 1 --2- 172.21.15.92:0/3157824380 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8d5006d8a0 0x7f8d500c8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:01.114 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.101+0000 7f8d54bbb700 1 -- 172.21.15.92:0/3157824380 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8d5006d8a0 msgr2=0x7f8d500c8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:01.114 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.101+0000 7f8d54bbb700 1 --2- 172.21.15.92:0/3157824380 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8d5006d8a0 0x7f8d500c8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:01.114 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.101+0000 7f8d54bbb700 1 -- 172.21.15.92:0/3157824380 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8d5006a320 msgr2=0x7f8d50157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:01.114 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.101+0000 7f8d54bbb700 1 --2- 172.21.15.92:0/3157824380 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8d5006a320 0x7f8d50157d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:01.115 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.101+0000 7f8d54bbb700 1 -- 172.21.15.92:0/3157824380 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d40009550 con 0x7f8d50160b90 2023-08-26T09:26:01.115 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.101+0000 7f8d54bbb700 1 --2- 172.21.15.92:0/3157824380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d50160b90 0x7f8d500cfd70 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8d4800b9c0 tx=0x7f8d4800bcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:01.115 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.101+0000 7f8d4cff9700 1 -- 172.21.15.92:0/3157824380 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4800d8e0 con 0x7f8d50160b90 2023-08-26T09:26:01.115 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.101+0000 7f8d4cff9700 1 -- 172.21.15.92:0/3157824380 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d4800da40 con 0x7f8d50160b90 2023-08-26T09:26:01.115 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.101+0000 7f8d5661e700 1 -- 172.21.15.92:0/3157824380 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d500b13d0 con 0x7f8d50160b90 2023-08-26T09:26:01.116 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.101+0000 7f8d4cff9700 1 -- 172.21.15.92:0/3157824380 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4800ddf0 con 0x7f8d50160b90 2023-08-26T09:26:01.116 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.101+0000 7f8d5661e700 1 -- 172.21.15.92:0/3157824380 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d500b1990 con 0x7f8d50160b90 2023-08-26T09:26:01.116 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.102+0000 7f8d5661e700 1 -- 172.21.15.92:0/3157824380 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d5004e660 con 0x7f8d50160b90 2023-08-26T09:26:01.116 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.102+0000 7f8d4cff9700 1 -- 172.21.15.92:0/3157824380 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8d48006d50 con 0x7f8d50160b90 2023-08-26T09:26:01.116 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.103+0000 7f8d4cff9700 1 --2- 172.21.15.92:0/3157824380 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f8d3c06a0e0 0x7f8d3c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:01.117 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.103+0000 7f8d4ffff700 1 --2- 172.21.15.92:0/3157824380 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f8d3c06a0e0 0x7f8d3c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:01.117 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.103+0000 7f8d4cff9700 1 -- 172.21.15.92:0/3157824380 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8d48011070 con 0x7f8d50160b90 2023-08-26T09:26:01.117 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.103+0000 7f8d4ffff700 1 --2- 172.21.15.92:0/3157824380 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f8d3c06a0e0 0x7f8d3c06c5a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8d44006fd0 tx=0x7f8d44008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:01.117 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.107+0000 7f8d4cff9700 1 -- 172.21.15.92:0/3157824380 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8d4804e990 con 0x7f8d50160b90 2023-08-26T09:26:01.320 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.315+0000 7f8d5661e700 1 -- 172.21.15.92:0/3157824380 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8d500b5c90 con 0x7f8d50160b90 2023-08-26T09:26:01.320 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.315+0000 7f8d4cff9700 1 -- 172.21.15.92:0/3157824380 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8d48053850 con 0x7f8d50160b90 2023-08-26T09:26:01.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.317+0000 7f8d5661e700 1 -- 172.21.15.92:0/3157824380 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f8d3c06a0e0 msgr2=0x7f8d3c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:01.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.317+0000 7f8d5661e700 1 --2- 172.21.15.92:0/3157824380 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f8d3c06a0e0 0x7f8d3c06c5a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8d44006fd0 tx=0x7f8d44008040 comp rx=0 tx=0).stop 2023-08-26T09:26:01.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.317+0000 7f8d5661e700 1 -- 172.21.15.92:0/3157824380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d50160b90 msgr2=0x7f8d500cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:01.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.317+0000 7f8d5661e700 1 --2- 172.21.15.92:0/3157824380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d50160b90 0x7f8d500cfd70 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8d4800b9c0 tx=0x7f8d4800bcd0 comp rx=0 tx=0).stop 2023-08-26T09:26:01.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.318+0000 7f8d5661e700 1 -- 172.21.15.92:0/3157824380 shutdown_connections 2023-08-26T09:26:01.324 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.318+0000 7f8d5661e700 1 --2- 172.21.15.92:0/3157824380 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f8d3c06a0e0 0x7f8d3c06c5a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:01.324 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.318+0000 7f8d5661e700 1 --2- 172.21.15.92:0/3157824380 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8d5006a320 0x7f8d50157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:01.324 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.318+0000 7f8d5661e700 1 --2- 172.21.15.92:0/3157824380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d50160b90 0x7f8d500cfd70 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:01.324 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.318+0000 7f8d5661e700 1 --2- 172.21.15.92:0/3157824380 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8d5006d8a0 0x7f8d500c8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:01.324 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.318+0000 7f8d5661e700 1 -- 172.21.15.92:0/3157824380 >> 172.21.15.92:0/3157824380 conn(0x7f8d500cc790 msgr2=0x7f8d50073350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:01.324 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.318+0000 7f8d5661e700 1 -- 172.21.15.92:0/3157824380 shutdown_connections 2023-08-26T09:26:01.325 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.318+0000 7f8d5661e700 1 -- 172.21.15.92:0/3157824380 wait complete. 2023-08-26T09:26:01.325 INFO:teuthology.orchestra.run.smithi092.stderr:listed 0 entries 2023-08-26T09:26:01.334 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi092.front.sepia.ceph.com... 2023-08-26T09:26:01.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:26:01.335 DEBUG:teuthology.orchestra.run.smithi092:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-08-26T09:26:01.382 INFO:teuthology.orchestra.run:waiting for 300 2023-08-26T09:26:01.382 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi092.front.sepia.ceph.com 2023-08-26T09:26:01.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:26:01.383 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-08-26T09:26:01.400 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-08-26T09:26:01.401 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-26T09:26:01.422 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-08-26T09:26:01.422 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-26T09:26:01.483 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-26T09:26:01.604 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.599+0000 7efd7f58e700 1 Processor -- start 2023-08-26T09:26:01.605 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.600+0000 7efd7f58e700 1 -- start start 2023-08-26T09:26:01.612 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.600+0000 7efd7f58e700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7efd78159d90 0x7efd780ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:01.612 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.600+0000 7efd7f58e700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efd780718e0 0x7efd780ce930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:01.612 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.600+0000 7efd7f58e700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7efd780cdd10 0x7efd7806c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:01.613 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.600+0000 7efd7f58e700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd780cbc30 con 0x7efd78159d90 2023-08-26T09:26:01.613 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.600+0000 7efd7f58e700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd780cb020 con 0x7efd780cdd10 2023-08-26T09:26:01.613 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.600+0000 7efd7f58e700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd780cb300 con 0x7efd780718e0 2023-08-26T09:26:01.613 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.601+0000 7efd7d32a700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7efd78159d90 0x7efd780ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:01.613 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.601+0000 7efd7d32a700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7efd78159d90 0x7efd780ce3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46232/0 (socket says 172.21.15.92:46232) 2023-08-26T09:26:01.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.601+0000 7efd7d32a700 1 -- 172.21.15.92:0/681830760 learned_addr learned my addr 172.21.15.92:0/681830760 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:01.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.601+0000 7efd7db2b700 1 --2- 172.21.15.92:0/681830760 >> v2:172.21.15.188:3300/0 conn(0x7efd780cdd10 0x7efd7806c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:01.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.601+0000 7efd7cb29700 1 --2- 172.21.15.92:0/681830760 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efd780718e0 0x7efd780ce930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:01.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.601+0000 7efd7d32a700 1 -- 172.21.15.92:0/681830760 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efd780718e0 msgr2=0x7efd780ce930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:01.615 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.601+0000 7efd7d32a700 1 --2- 172.21.15.92:0/681830760 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efd780718e0 0x7efd780ce930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:01.615 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.601+0000 7efd7d32a700 1 -- 172.21.15.92:0/681830760 >> v2:172.21.15.188:3300/0 conn(0x7efd780cdd10 msgr2=0x7efd7806c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:01.615 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.601+0000 7efd7d32a700 1 --2- 172.21.15.92:0/681830760 >> v2:172.21.15.188:3300/0 conn(0x7efd780cdd10 0x7efd7806c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:01.615 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.601+0000 7efd7d32a700 1 -- 172.21.15.92:0/681830760 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd780cb5e0 con 0x7efd78159d90 2023-08-26T09:26:01.616 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.601+0000 7efd7d32a700 1 --2- 172.21.15.92:0/681830760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd78159d90 0x7efd780ce3f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7efd78079ea0 tx=0x7efd68009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52d7937842c8a5e8 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:01.616 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.601+0000 7efd6ffff700 1 -- 172.21.15.92:0/681830760 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6800b870 con 0x7efd78159d90 2023-08-26T09:26:01.616 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.601+0000 7efd6ffff700 1 -- 172.21.15.92:0/681830760 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd6800b9d0 con 0x7efd78159d90 2023-08-26T09:26:01.616 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.601+0000 7efd6ffff700 1 -- 172.21.15.92:0/681830760 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6800bd60 con 0x7efd78159d90 2023-08-26T09:26:01.616 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.602+0000 7efd7f58e700 1 -- 172.21.15.92:0/681830760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd78159d90 msgr2=0x7efd780ce3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:01.616 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.602+0000 7efd7f58e700 1 --2- 172.21.15.92:0/681830760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd78159d90 0x7efd780ce3f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7efd78079ea0 tx=0x7efd68009bd0 comp rx=0 tx=0).stop 2023-08-26T09:26:01.617 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.602+0000 7efd7f58e700 1 -- 172.21.15.92:0/681830760 shutdown_connections 2023-08-26T09:26:01.617 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.602+0000 7efd7f58e700 1 --2- 172.21.15.92:0/681830760 >> v2:172.21.15.188:3300/0 conn(0x7efd780cdd10 0x7efd7806c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:01.617 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.602+0000 7efd7f58e700 1 --2- 172.21.15.92:0/681830760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd78159d90 0x7efd780ce3f0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:01.617 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.602+0000 7efd7f58e700 1 --2- 172.21.15.92:0/681830760 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efd780718e0 0x7efd780ce930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:01.617 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.602+0000 7efd7f58e700 1 -- 172.21.15.92:0/681830760 >> 172.21.15.92:0/681830760 conn(0x7efd780cfca0 msgr2=0x7efd780d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:01.618 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.602+0000 7efd7f58e700 1 -- 172.21.15.92:0/681830760 shutdown_connections 2023-08-26T09:26:01.618 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.602+0000 7efd7f58e700 1 -- 172.21.15.92:0/681830760 wait complete. 2023-08-26T09:26:01.618 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.603+0000 7efd7f58e700 1 Processor -- start 2023-08-26T09:26:01.618 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.603+0000 7efd7f58e700 1 -- start start 2023-08-26T09:26:01.619 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.604+0000 7efd7f58e700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efd780718e0 0x7efd78148300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:01.619 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.604+0000 7efd7f58e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd780cdd10 0x7efd780c5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:01.620 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.604+0000 7efd7f58e700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efd78159d90 0x7efd78150680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:01.620 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.604+0000 7efd7f58e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd780b3430 con 0x7efd780cdd10 2023-08-26T09:26:01.620 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.604+0000 7efd7f58e700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd780c6e10 con 0x7efd78159d90 2023-08-26T09:26:01.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.604+0000 7efd7f58e700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd780c7080 con 0x7efd780718e0 2023-08-26T09:26:01.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.604+0000 7efd7cb29700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd780cdd10 0x7efd780c5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:01.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.604+0000 7efd7cb29700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd780cdd10 0x7efd780c5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46240/0 (socket says 172.21.15.92:46240) 2023-08-26T09:26:01.622 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.604+0000 7efd7cb29700 1 -- 172.21.15.92:0/692145358 learned_addr learned my addr 172.21.15.92:0/692145358 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:01.622 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.604+0000 7efd7db2b700 1 --2- 172.21.15.92:0/692145358 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efd78159d90 0x7efd78150680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:01.622 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.604+0000 7efd7d32a700 1 --2- 172.21.15.92:0/692145358 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efd780718e0 0x7efd78148300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:01.622 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.604+0000 7efd7cb29700 1 -- 172.21.15.92:0/692145358 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efd780718e0 msgr2=0x7efd78148300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:01.623 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.604+0000 7efd7cb29700 1 --2- 172.21.15.92:0/692145358 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efd780718e0 0x7efd78148300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:01.623 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.604+0000 7efd7cb29700 1 -- 172.21.15.92:0/692145358 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efd78159d90 msgr2=0x7efd78150680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:01.623 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.604+0000 7efd7cb29700 1 --2- 172.21.15.92:0/692145358 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efd78159d90 0x7efd78150680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:01.624 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.604+0000 7efd7cb29700 1 -- 172.21.15.92:0/692145358 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd68009550 con 0x7efd780cdd10 2023-08-26T09:26:01.624 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.604+0000 7efd7db2b700 1 --2- 172.21.15.92:0/692145358 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efd78159d90 0x7efd78150680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:26:01.624 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.604+0000 7efd7cb29700 1 --2- 172.21.15.92:0/692145358 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd780cdd10 0x7efd780c5e80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7efd7400e7e0 tx=0x7efd7400eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:01.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.605+0000 7efd6dffb700 1 -- 172.21.15.92:0/692145358 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd74013610 con 0x7efd780cdd10 2023-08-26T09:26:01.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.605+0000 7efd6dffb700 1 -- 172.21.15.92:0/692145358 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd74013770 con 0x7efd780cdd10 2023-08-26T09:26:01.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.605+0000 7efd7f58e700 1 -- 172.21.15.92:0/692145358 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd780c7360 con 0x7efd780cdd10 2023-08-26T09:26:01.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.605+0000 7efd6dffb700 1 -- 172.21.15.92:0/692145358 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd74013b00 con 0x7efd780cdd10 2023-08-26T09:26:01.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.605+0000 7efd7f58e700 1 -- 172.21.15.92:0/692145358 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd780c63c0 con 0x7efd780cdd10 2023-08-26T09:26:01.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.606+0000 7efd7f58e700 1 -- 172.21.15.92:0/692145358 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd780c6640 con 0x7efd780cdd10 2023-08-26T09:26:01.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.606+0000 7efd6dffb700 1 -- 172.21.15.92:0/692145358 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7efd74013c60 con 0x7efd780cdd10 2023-08-26T09:26:01.627 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.606+0000 7efd6dffb700 1 --2- 172.21.15.92:0/692145358 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7efd5c06a0e0 0x7efd5c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:01.627 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.607+0000 7efd6dffb700 1 -- 172.21.15.92:0/692145358 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6120+0+0 (secure 0 0 0) 0x7efd74088100 con 0x7efd780cdd10 2023-08-26T09:26:01.627 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.607+0000 7efd7d32a700 1 --2- 172.21.15.92:0/692145358 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7efd5c06a0e0 0x7efd5c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:01.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.607+0000 7efd7d32a700 1 --2- 172.21.15.92:0/692145358 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7efd5c06a0e0 0x7efd5c06c5a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7efd68009c10 tx=0x7efd68008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:01.629 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.611+0000 7efd6dffb700 1 -- 172.21.15.92:0/692145358 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7efd740572d0 con 0x7efd780cdd10 2023-08-26T09:26:01.806 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.801+0000 7efd7f58e700 1 -- 172.21.15.92:0/692145358 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd7804e660 con 0x7efd780cdd10 2023-08-26T09:26:01.807 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.802+0000 7efd6dffb700 1 -- 172.21.15.92:0/692145358 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18304 (secure 0 0 0) 0x7efd74056e60 con 0x7efd780cdd10 2023-08-26T09:26:01.807 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:26:01.808 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":21,"fsid":"254a2d31-bd41-4507-8326-1b205ac24377","created":"2023-08-26T09:24:55.352131+0000","modified":"2023-08-26T09:26:01.240471+0000","last_up_change":"2023-08-26T09:25:06.124496+0000","last_in_change":"2023-08-26T09:24:57.840725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-26T09:25:06.650431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-26T09:25:06.973382+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-26T09:25:11.584141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-26T09:25:12.814990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e9e7638-4459-4d8d-8e40-130bcf48df66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6819","nonce":382827192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6824","nonce":382827192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6831","nonce":382827192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6827","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6829","nonce":382827192}]},"public_addr":"172.21.15.92:6819/382827192","cluster_addr":"172.21.15.92:6824/382827192","heartbeat_back_addr":"172.21.15.92:6831/382827192","heartbeat_front_addr":"172.21.15.92:6829/382827192","state":["exists","up"]},{"osd":1,"uuid":"164e68c9-aedd-4df5-9b70-f4b1ec3bda13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6809","nonce":618773438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6811","nonce":618773438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6815","nonce":618773438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6813","nonce":618773438}]},"public_addr":"172.21.15.92:6809/618773438","cluster_addr":"172.21.15.92:6811/618773438","heartbeat_back_addr":"172.21.15.92:6815/618773438","heartbeat_front_addr":"172.21.15.92:6813/618773438","state":["exists","up"]},{"osd":2,"uuid":"8701dfee-629a-4d30-82e4-b8fac340303f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6818","nonce":3697397687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6821","nonce":3697397687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6828","nonce":3697397687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6823","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6825","nonce":3697397687}]},"public_addr":"172.21.15.92:6818/3697397687","cluster_addr":"172.21.15.92:6821/3697397687","heartbeat_back_addr":"172.21.15.92:6828/3697397687","heartbeat_front_addr":"172.21.15.92:6825/3697397687","state":["exists","up"]},{"osd":3,"uuid":"93bdc94d-dc07-495f-995a-a6ad072f0247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6801","nonce":3579846453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6803","nonce":3579846453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6807","nonce":3579846453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6805","nonce":3579846453}]},"public_addr":"172.21.15.92:6801/3579846453","cluster_addr":"172.21.15.92:6803/3579846453","heartbeat_back_addr":"172.21.15.92:6807/3579846453","heartbeat_front_addr":"172.21.15.92:6805/3579846453","state":["exists","up"]},{"osd":4,"uuid":"d9d0ea80-8481-46a7-9677-c338d32cf1d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6809","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6811","nonce":3228383424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6813","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6815","nonce":3228383424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6821","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6823","nonce":3228383424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6817","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6819","nonce":3228383424}]},"public_addr":"172.21.15.188:6811/3228383424","cluster_addr":"172.21.15.188:6815/3228383424","heartbeat_back_addr":"172.21.15.188:6823/3228383424","heartbeat_front_addr":"172.21.15.188:6819/3228383424","state":["exists","up"]},{"osd":5,"uuid":"38d03253-467a-456f-bd5e-5a46532a0b18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6801","nonce":1655821054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6803","nonce":1655821054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6807","nonce":1655821054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6805","nonce":1655821054}]},"public_addr":"172.21.15.188:6801/1655821054","cluster_addr":"172.21.15.188:6803/1655821054","heartbeat_back_addr":"172.21.15.188:6807/1655821054","heartbeat_front_addr":"172.21.15.188:6805/1655821054","state":["exists","up"]},{"osd":6,"uuid":"d61564b5-136f-42e5-a843-626c2017cc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6810","nonce":2069976891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6814","nonce":2069976891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6822","nonce":2069976891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6818","nonce":2069976891}]},"public_addr":"172.21.15.188:6810/2069976891","cluster_addr":"172.21.15.188:6814/2069976891","heartbeat_back_addr":"172.21.15.188:6822/2069976891","heartbeat_front_addr":"172.21.15.188:6818/2069976891","state":["exists","up"]},{"osd":7,"uuid":"fae2949e-0d62-42cd-ba72-08f516084b20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6825","nonce":1882888860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6827","nonce":1882888860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6831","nonce":1882888860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6829","nonce":1882888860}]},"public_addr":"172.21.15.188:6825/1882888860","cluster_addr":"172.21.15.188:6827/1882888860","heartbeat_back_addr":"172.21.15.188:6831/1882888860","heartbeat_front_addr":"172.21.15.188:6829/1882888860","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.038523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.063160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.000857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.975572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.023848+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.765194+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.081365+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:05.110745+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.10","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-26T09:26:01.809 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.804+0000 7efd7f58e700 1 -- 172.21.15.92:0/692145358 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7efd5c06a0e0 msgr2=0x7efd5c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:01.809 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.804+0000 7efd7f58e700 1 --2- 172.21.15.92:0/692145358 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7efd5c06a0e0 0x7efd5c06c5a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7efd68009c10 tx=0x7efd68008030 comp rx=0 tx=0).stop 2023-08-26T09:26:01.810 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.804+0000 7efd7f58e700 1 -- 172.21.15.92:0/692145358 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd780cdd10 msgr2=0x7efd780c5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:01.810 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.804+0000 7efd7f58e700 1 --2- 172.21.15.92:0/692145358 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd780cdd10 0x7efd780c5e80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7efd7400e7e0 tx=0x7efd7400eba0 comp rx=0 tx=0).stop 2023-08-26T09:26:01.810 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.804+0000 7efd7f58e700 1 -- 172.21.15.92:0/692145358 shutdown_connections 2023-08-26T09:26:01.810 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.804+0000 7efd7f58e700 1 --2- 172.21.15.92:0/692145358 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7efd5c06a0e0 0x7efd5c06c5a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:01.810 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.804+0000 7efd7f58e700 1 --2- 172.21.15.92:0/692145358 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efd78159d90 0x7efd78150680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:01.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.804+0000 7efd7f58e700 1 --2- 172.21.15.92:0/692145358 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efd780718e0 0x7efd78148300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:01.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.804+0000 7efd7f58e700 1 --2- 172.21.15.92:0/692145358 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd780cdd10 0x7efd780c5e80 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:01.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.804+0000 7efd7f58e700 1 -- 172.21.15.92:0/692145358 >> 172.21.15.92:0/692145358 conn(0x7efd780cfca0 msgr2=0x7efd780af720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:01.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.804+0000 7efd7f58e700 1 -- 172.21.15.92:0/692145358 shutdown_connections 2023-08-26T09:26:01.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.804+0000 7efd7f58e700 1 -- 172.21.15.92:0/692145358 wait complete. 2023-08-26T09:26:01.822 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-26T09:25:06.650431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-26T09:25:06.973382+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-26T09:25:11.584141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-26T09:25:12.814990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-26T09:26:01.823 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-26T09:26:01.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.943+0000 7fb1a464b700 1 Processor -- start 2023-08-26T09:26:01.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.943+0000 7fb1a464b700 1 -- start start 2023-08-26T09:26:01.949 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.944+0000 7fb1a464b700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fb19c15d220 0x7fb19c0af390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:01.950 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.944+0000 7fb1a464b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fb19c06db70 0x7fb19c070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:01.950 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.944+0000 7fb1a464b700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb19c0aee50 con 0x7fb19c071260 2023-08-26T09:26:01.950 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.944+0000 7fb1a464b700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb19c0af130 con 0x7fb19c06db70 2023-08-26T09:26:01.950 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.944+0000 7fb1a464b700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb19c0c4cb0 con 0x7fb19c15d220 2023-08-26T09:26:01.951 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.944+0000 7fb1a1be6700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fb19c06db70 0x7fb19c070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:01.951 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.944+0000 7fb1a1be6700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fb19c06db70 0x7fb19c070d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46248/0 (socket says 172.21.15.92:46248) 2023-08-26T09:26:01.951 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.944+0000 7fb1a2be8700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fb19c071260 0x7fb19c160d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:58264/0 (socket says 172.21.15.92:58264) 2023-08-26T09:26:01.951 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.944+0000 7fb1a1be6700 1 -- 172.21.15.92:0/4104973982 learned_addr learned my addr 172.21.15.92:0/4104973982 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:01.951 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.944+0000 7fb1a23e7700 1 --2- 172.21.15.92:0/4104973982 >> v2:172.21.15.188:3300/0 conn(0x7fb19c15d220 0x7fb19c0af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:01.952 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.945+0000 7fb1a1be6700 1 -- 172.21.15.92:0/4104973982 >> v2:172.21.15.188:3300/0 conn(0x7fb19c15d220 msgr2=0x7fb19c0af390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:01.952 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.945+0000 7fb1a1be6700 1 --2- 172.21.15.92:0/4104973982 >> v2:172.21.15.188:3300/0 conn(0x7fb19c15d220 0x7fb19c0af390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:01.952 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.945+0000 7fb1a1be6700 1 -- 172.21.15.92:0/4104973982 >> v1:172.21.15.92:6789/0 conn(0x7fb19c071260 legacy=0x7fb19c160d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:01.952 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.945+0000 7fb1a1be6700 1 -- 172.21.15.92:0/4104973982 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb19c0c4f90 con 0x7fb19c06db70 2023-08-26T09:26:01.952 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.945+0000 7fb1a13e5700 1 -- 172.21.15.92:0/4104973982 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1524782495 0 0) 0x7fb19c0aee50 con 0x7fb19c071260 2023-08-26T09:26:01.953 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.945+0000 7fb1a1be6700 1 --2- 172.21.15.92:0/4104973982 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb19c06db70 0x7fb19c070d20 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb19c072c00 tx=0x7fb198009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e464c255149567fb server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:01.953 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.945+0000 7fb1a13e5700 1 -- 172.21.15.92:0/4104973982 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19800b870 con 0x7fb19c06db70 2023-08-26T09:26:01.953 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.945+0000 7fb1a13e5700 1 -- 172.21.15.92:0/4104973982 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb19800b9d0 con 0x7fb19c06db70 2023-08-26T09:26:01.953 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.945+0000 7fb1a13e5700 1 -- 172.21.15.92:0/4104973982 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19800bd60 con 0x7fb19c06db70 2023-08-26T09:26:01.956 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.945+0000 7fb1a464b700 1 -- 172.21.15.92:0/4104973982 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb19c06db70 msgr2=0x7fb19c070d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:01.956 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.945+0000 7fb1a464b700 1 --2- 172.21.15.92:0/4104973982 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb19c06db70 0x7fb19c070d20 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb19c072c00 tx=0x7fb198009bd0 comp rx=0 tx=0).stop 2023-08-26T09:26:01.957 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.945+0000 7fb1a464b700 1 -- 172.21.15.92:0/4104973982 shutdown_connections 2023-08-26T09:26:01.957 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.945+0000 7fb1a464b700 1 --2- 172.21.15.92:0/4104973982 >> v2:172.21.15.188:3300/0 conn(0x7fb19c15d220 0x7fb19c0af390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:01.957 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.945+0000 7fb1a464b700 1 --2- 172.21.15.92:0/4104973982 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb19c06db70 0x7fb19c070d20 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:01.957 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.945+0000 7fb1a464b700 1 -- 172.21.15.92:0/4104973982 >> 172.21.15.92:0/4104973982 conn(0x7fb19c06b430 msgr2=0x7fb19c06b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:01.957 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.945+0000 7fb1a464b700 1 -- 172.21.15.92:0/4104973982 shutdown_connections 2023-08-26T09:26:01.957 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.946+0000 7fb1a464b700 1 -- 172.21.15.92:0/4104973982 wait complete. 2023-08-26T09:26:01.958 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.947+0000 7fb1a464b700 1 Processor -- start 2023-08-26T09:26:01.958 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.947+0000 7fb1a464b700 1 -- start start 2023-08-26T09:26:01.958 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.947+0000 7fb1a464b700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb19c06db70 0x7fb19c0ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:01.958 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.947+0000 7fb1a464b700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb19c071260 0x7fb19c1f23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:01.958 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.947+0000 7fb1a464b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb19c15d220 0x7fb19c0ae280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:01.959 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.947+0000 7fb1a464b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19c0ade60 con 0x7fb19c15d220 2023-08-26T09:26:01.959 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.947+0000 7fb1a464b700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19c0ad1e0 con 0x7fb19c06db70 2023-08-26T09:26:01.959 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.947+0000 7fb1a464b700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb19c0ad4c0 con 0x7fb19c071260 2023-08-26T09:26:01.959 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.948+0000 7fb1a2be8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb19c15d220 0x7fb19c0ae280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:01.959 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.948+0000 7fb1a2be8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb19c15d220 0x7fb19c0ae280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46256/0 (socket says 172.21.15.92:46256) 2023-08-26T09:26:01.960 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.948+0000 7fb1a2be8700 1 -- 172.21.15.92:0/2537581308 learned_addr learned my addr 172.21.15.92:0/2537581308 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:01.960 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.948+0000 7fb1a23e7700 1 --2- 172.21.15.92:0/2537581308 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb19c06db70 0x7fb19c0ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:01.960 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.948+0000 7fb1a1be6700 1 --2- 172.21.15.92:0/2537581308 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb19c071260 0x7fb19c1f23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:01.960 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.948+0000 7fb1a2be8700 1 -- 172.21.15.92:0/2537581308 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb19c071260 msgr2=0x7fb19c1f23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:01.960 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.948+0000 7fb1a2be8700 1 --2- 172.21.15.92:0/2537581308 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb19c071260 0x7fb19c1f23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:01.961 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.948+0000 7fb1a2be8700 1 -- 172.21.15.92:0/2537581308 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb19c06db70 msgr2=0x7fb19c0ac8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:01.961 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.948+0000 7fb1a2be8700 1 --2- 172.21.15.92:0/2537581308 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb19c06db70 0x7fb19c0ac8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:01.961 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.948+0000 7fb1a2be8700 1 -- 172.21.15.92:0/2537581308 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb198009550 con 0x7fb19c15d220 2023-08-26T09:26:01.961 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.948+0000 7fb1a2be8700 1 --2- 172.21.15.92:0/2537581308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb19c15d220 0x7fb19c0ae280 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb194002230 tx=0x7fb19400cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:01.961 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.948+0000 7fb192ffd700 1 -- 172.21.15.92:0/2537581308 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19400aac0 con 0x7fb19c15d220 2023-08-26T09:26:01.961 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.948+0000 7fb192ffd700 1 -- 172.21.15.92:0/2537581308 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb19400ac40 con 0x7fb19c15d220 2023-08-26T09:26:01.962 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.948+0000 7fb1a464b700 1 -- 172.21.15.92:0/2537581308 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb19c0ad7a0 con 0x7fb19c15d220 2023-08-26T09:26:01.962 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.948+0000 7fb192ffd700 1 -- 172.21.15.92:0/2537581308 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1940070d0 con 0x7fb19c15d220 2023-08-26T09:26:01.962 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.948+0000 7fb1a464b700 1 -- 172.21.15.92:0/2537581308 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb19c0ace10 con 0x7fb19c15d220 2023-08-26T09:26:01.962 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.949+0000 7fb1a464b700 1 -- 172.21.15.92:0/2537581308 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb19c0acfa0 con 0x7fb19c15d220 2023-08-26T09:26:01.962 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.949+0000 7fb192ffd700 1 -- 172.21.15.92:0/2537581308 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb194007250 con 0x7fb19c15d220 2023-08-26T09:26:01.963 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.950+0000 7fb192ffd700 1 --2- 172.21.15.92:0/2537581308 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb18006a0e0 0x7fb18006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:01.963 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.950+0000 7fb192ffd700 1 -- 172.21.15.92:0/2537581308 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fb1940882c0 con 0x7fb19c15d220 2023-08-26T09:26:01.963 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.950+0000 7fb1a23e7700 1 --2- 172.21.15.92:0/2537581308 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb18006a0e0 0x7fb18006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:01.963 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.950+0000 7fb1a23e7700 1 --2- 172.21.15.92:0/2537581308 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb18006a0e0 0x7fb18006c5a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb18c006b20 tx=0x7fb18c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:01.964 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:01.954+0000 7fb192ffd700 1 -- 172.21.15.92:0/2537581308 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb19c0acfa0 con 0x7fb19c15d220 2023-08-26T09:26:02.148 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.143+0000 7fb1a464b700 1 -- 172.21.15.92:0/2537581308 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb19c0adfa0 con 0x7fb19c15d220 2023-08-26T09:26:02.148 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.143+0000 7fb192ffd700 1 -- 172.21.15.92:0/2537581308 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb19c0adfa0 con 0x7fb19c15d220 2023-08-26T09:26:02.149 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 8 2023-08-26T09:26:02.151 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.146+0000 7fb1a464b700 1 -- 172.21.15.92:0/2537581308 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb18006a0e0 msgr2=0x7fb18006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:02.151 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.146+0000 7fb1a464b700 1 --2- 172.21.15.92:0/2537581308 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb18006a0e0 0x7fb18006c5a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb18c006b20 tx=0x7fb18c008040 comp rx=0 tx=0).stop 2023-08-26T09:26:02.151 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.146+0000 7fb1a464b700 1 -- 172.21.15.92:0/2537581308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb19c15d220 msgr2=0x7fb19c0ae280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:02.152 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.146+0000 7fb1a464b700 1 --2- 172.21.15.92:0/2537581308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb19c15d220 0x7fb19c0ae280 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb194002230 tx=0x7fb19400cf50 comp rx=0 tx=0).stop 2023-08-26T09:26:02.152 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.146+0000 7fb1a464b700 1 -- 172.21.15.92:0/2537581308 shutdown_connections 2023-08-26T09:26:02.152 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.146+0000 7fb1a464b700 1 --2- 172.21.15.92:0/2537581308 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb18006a0e0 0x7fb18006c5a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:02.152 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.146+0000 7fb1a464b700 1 --2- 172.21.15.92:0/2537581308 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb19c06db70 0x7fb19c0ac8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:02.152 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.146+0000 7fb1a464b700 1 --2- 172.21.15.92:0/2537581308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb19c15d220 0x7fb19c0ae280 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:02.153 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.146+0000 7fb1a464b700 1 --2- 172.21.15.92:0/2537581308 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb19c071260 0x7fb19c1f23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:02.153 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.146+0000 7fb1a464b700 1 -- 172.21.15.92:0/2537581308 >> 172.21.15.92:0/2537581308 conn(0x7fb19c06b430 msgr2=0x7fb19c15c130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:02.153 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.146+0000 7fb1a464b700 1 -- 172.21.15.92:0/2537581308 shutdown_connections 2023-08-26T09:26:02.153 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.146+0000 7fb1a464b700 1 -- 172.21.15.92:0/2537581308 wait complete. 2023-08-26T09:26:02.163 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-26T09:26:02.289 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.284+0000 7f4ae560a700 1 Processor -- start 2023-08-26T09:26:02.289 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.284+0000 7f4ae560a700 1 -- start start 2023-08-26T09:26:02.297 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.285+0000 7f4ae560a700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f4ae00b28d0 0x7f4ae00b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:02.297 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.285+0000 7f4ae560a700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4ae00ce450 0x7f4ae0161930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:02.298 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.285+0000 7f4ae560a700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4ae015da10 0x7f4ae015ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:02.298 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.285+0000 7f4ae560a700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ae015e9b0 con 0x7f4ae00ce450 2023-08-26T09:26:02.298 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.285+0000 7f4ae560a700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ae01614a0 con 0x7f4ae00b28d0 2023-08-26T09:26:02.298 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.285+0000 7f4ae560a700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae00b31f0 con 0x7f4ae015da10 2023-08-26T09:26:02.298 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.285+0000 7f4ade7fc700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4ae00ce450 0x7f4ae0161930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:02.299 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.285+0000 7f4ade7fc700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4ae00ce450 0x7f4ae0161930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46262/0 (socket says 172.21.15.92:46262) 2023-08-26T09:26:02.299 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.285+0000 7f4ade7fc700 1 -- 172.21.15.92:0/2019473931 learned_addr learned my addr 172.21.15.92:0/2019473931 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:02.299 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.285+0000 7f4adeffd700 1 --2- 172.21.15.92:0/2019473931 >> v2:172.21.15.188:3300/0 conn(0x7f4ae00b28d0 0x7f4ae00b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:02.299 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.285+0000 7f4adf7fe700 1 --2- 172.21.15.92:0/2019473931 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4ae015da10 0x7f4ae015ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:02.299 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.285+0000 7f4ade7fc700 1 -- 172.21.15.92:0/2019473931 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4ae015da10 msgr2=0x7f4ae015ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:02.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.285+0000 7f4ade7fc700 1 --2- 172.21.15.92:0/2019473931 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4ae015da10 0x7f4ae015ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:02.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.285+0000 7f4ade7fc700 1 -- 172.21.15.92:0/2019473931 >> v2:172.21.15.188:3300/0 conn(0x7f4ae00b28d0 msgr2=0x7f4ae00b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:02.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.285+0000 7f4ade7fc700 1 --2- 172.21.15.92:0/2019473931 >> v2:172.21.15.188:3300/0 conn(0x7f4ae00b28d0 0x7f4ae00b2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:02.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.285+0000 7f4ade7fc700 1 -- 172.21.15.92:0/2019473931 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae015e3f0 con 0x7f4ae00ce450 2023-08-26T09:26:02.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.285+0000 7f4adeffd700 1 --2- 172.21.15.92:0/2019473931 >> v2:172.21.15.188:3300/0 conn(0x7f4ae00b28d0 0x7f4ae00b2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:26:02.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.285+0000 7f4ade7fc700 1 --2- 172.21.15.92:0/2019473931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ae00ce450 0x7f4ae0161930 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4ae00d0db0 tx=0x7f4ad0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe3e6dac702ed04a server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:02.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.285+0000 7f4addffb700 1 -- 172.21.15.92:0/2019473931 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad000b870 con 0x7f4ae00ce450 2023-08-26T09:26:02.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.286+0000 7f4addffb700 1 -- 172.21.15.92:0/2019473931 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ad000b9d0 con 0x7f4ae00ce450 2023-08-26T09:26:02.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.286+0000 7f4addffb700 1 -- 172.21.15.92:0/2019473931 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad000bd60 con 0x7f4ae00ce450 2023-08-26T09:26:02.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.286+0000 7f4ae560a700 1 -- 172.21.15.92:0/2019473931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ae00ce450 msgr2=0x7f4ae0161930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:02.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.286+0000 7f4ae560a700 1 --2- 172.21.15.92:0/2019473931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ae00ce450 0x7f4ae0161930 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4ae00d0db0 tx=0x7f4ad0009bd0 comp rx=0 tx=0).stop 2023-08-26T09:26:02.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.286+0000 7f4ae560a700 1 -- 172.21.15.92:0/2019473931 shutdown_connections 2023-08-26T09:26:02.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.286+0000 7f4ae560a700 1 --2- 172.21.15.92:0/2019473931 >> v2:172.21.15.188:3300/0 conn(0x7f4ae00b28d0 0x7f4ae00b2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:02.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.286+0000 7f4ae560a700 1 --2- 172.21.15.92:0/2019473931 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4ae015da10 0x7f4ae015ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:02.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.286+0000 7f4ae560a700 1 --2- 172.21.15.92:0/2019473931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ae00ce450 0x7f4ae0161930 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:02.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.286+0000 7f4ae560a700 1 -- 172.21.15.92:0/2019473931 >> 172.21.15.92:0/2019473931 conn(0x7f4ae00cd8d0 msgr2=0x7f4ae00cdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:02.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.286+0000 7f4ae560a700 1 -- 172.21.15.92:0/2019473931 shutdown_connections 2023-08-26T09:26:02.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.286+0000 7f4ae560a700 1 -- 172.21.15.92:0/2019473931 wait complete. 2023-08-26T09:26:02.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.287+0000 7f4ae560a700 1 Processor -- start 2023-08-26T09:26:02.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.287+0000 7f4ae560a700 1 -- start start 2023-08-26T09:26:02.304 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.288+0000 7f4ae560a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ae00b28d0 0x7f4ae01f6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:02.304 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.288+0000 7f4ae560a700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4ae00ce450 0x7f4ae01f2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:02.304 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.288+0000 7f4ae560a700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4ae015da10 0x7f4ae00b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:02.304 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.288+0000 7f4ae560a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae01f71e0 con 0x7f4ae00b28d0 2023-08-26T09:26:02.304 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.288+0000 7f4ae560a700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae01578c0 con 0x7f4ae00ce450 2023-08-26T09:26:02.305 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.288+0000 7f4ae560a700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae0153df0 con 0x7f4ae015da10 2023-08-26T09:26:02.305 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.288+0000 7f4adeffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ae00b28d0 0x7f4ae01f6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:02.305 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.288+0000 7f4adeffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ae00b28d0 0x7f4ae01f6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46266/0 (socket says 172.21.15.92:46266) 2023-08-26T09:26:02.305 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.288+0000 7f4adeffd700 1 -- 172.21.15.92:0/1221077401 learned_addr learned my addr 172.21.15.92:0/1221077401 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:02.305 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.288+0000 7f4adf7fe700 1 --2- 172.21.15.92:0/1221077401 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4ae015da10 0x7f4ae00b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:02.306 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.288+0000 7f4ade7fc700 1 --2- 172.21.15.92:0/1221077401 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4ae00ce450 0x7f4ae01f2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:02.306 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.289+0000 7f4adeffd700 1 -- 172.21.15.92:0/1221077401 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4ae015da10 msgr2=0x7f4ae00b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:02.306 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.289+0000 7f4adeffd700 1 --2- 172.21.15.92:0/1221077401 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4ae015da10 0x7f4ae00b5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:02.306 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.289+0000 7f4adeffd700 1 -- 172.21.15.92:0/1221077401 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4ae00ce450 msgr2=0x7f4ae01f2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:02.306 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.289+0000 7f4adeffd700 1 --2- 172.21.15.92:0/1221077401 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4ae00ce450 0x7f4ae01f2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:02.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.289+0000 7f4adeffd700 1 -- 172.21.15.92:0/1221077401 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad0009550 con 0x7f4ae00b28d0 2023-08-26T09:26:02.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.289+0000 7f4adeffd700 1 --2- 172.21.15.92:0/1221077401 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ae00b28d0 0x7f4ae01f6c00 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4ad400c7f0 tx=0x7f4ad400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:02.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.289+0000 7f4ac77fe700 1 -- 172.21.15.92:0/1221077401 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad4011800 con 0x7f4ae00b28d0 2023-08-26T09:26:02.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.289+0000 7f4ac77fe700 1 -- 172.21.15.92:0/1221077401 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ad4011960 con 0x7f4ae00b28d0 2023-08-26T09:26:02.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.289+0000 7f4ae560a700 1 -- 172.21.15.92:0/1221077401 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ae00b3a10 con 0x7f4ae00b28d0 2023-08-26T09:26:02.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.289+0000 7f4ac77fe700 1 -- 172.21.15.92:0/1221077401 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad4011d10 con 0x7f4ae00b28d0 2023-08-26T09:26:02.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.289+0000 7f4ae560a700 1 -- 172.21.15.92:0/1221077401 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ae00b66e0 con 0x7f4ae00b28d0 2023-08-26T09:26:02.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.290+0000 7f4ae560a700 1 -- 172.21.15.92:0/1221077401 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ae00b68d0 con 0x7f4ae00b28d0 2023-08-26T09:26:02.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.290+0000 7f4ac77fe700 1 -- 172.21.15.92:0/1221077401 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4ad4018360 con 0x7f4ae00b28d0 2023-08-26T09:26:02.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.291+0000 7f4ac77fe700 1 --2- 172.21.15.92:0/1221077401 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f4acc06a0e0 0x7f4acc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:02.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.291+0000 7f4ac77fe700 1 -- 172.21.15.92:0/1221077401 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f4ad4088560 con 0x7f4ae00b28d0 2023-08-26T09:26:02.309 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.291+0000 7f4ade7fc700 1 --2- 172.21.15.92:0/1221077401 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f4acc06a0e0 0x7f4acc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:02.309 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.291+0000 7f4ade7fc700 1 --2- 172.21.15.92:0/1221077401 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f4acc06a0e0 0x7f4acc06c5a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4ad0014040 tx=0x7f4ad0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:02.309 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.295+0000 7f4ac77fe700 1 -- 172.21.15.92:0/1221077401 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4ad4053b80 con 0x7f4ae00b28d0 2023-08-26T09:26:02.495 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.490+0000 7f4ae560a700 1 -- 172.21.15.92:0/1221077401 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4ae004eeb0 con 0x7f4ae00b28d0 2023-08-26T09:26:02.496 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.491+0000 7f4ac77fe700 1 -- 172.21.15.92:0/1221077401 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4ad40571a0 con 0x7f4ae00b28d0 2023-08-26T09:26:02.496 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 1 2023-08-26T09:26:02.498 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.493+0000 7f4ae560a700 1 -- 172.21.15.92:0/1221077401 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f4acc06a0e0 msgr2=0x7f4acc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:02.498 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.493+0000 7f4ae560a700 1 --2- 172.21.15.92:0/1221077401 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f4acc06a0e0 0x7f4acc06c5a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4ad0014040 tx=0x7f4ad0008030 comp rx=0 tx=0).stop 2023-08-26T09:26:02.498 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.493+0000 7f4ae560a700 1 -- 172.21.15.92:0/1221077401 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ae00b28d0 msgr2=0x7f4ae01f6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:02.499 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.493+0000 7f4ae560a700 1 --2- 172.21.15.92:0/1221077401 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ae00b28d0 0x7f4ae01f6c00 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4ad400c7f0 tx=0x7f4ad400cbb0 comp rx=0 tx=0).stop 2023-08-26T09:26:02.499 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.493+0000 7f4ae560a700 1 -- 172.21.15.92:0/1221077401 shutdown_connections 2023-08-26T09:26:02.499 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.493+0000 7f4ae560a700 1 --2- 172.21.15.92:0/1221077401 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4ae015da10 0x7f4ae00b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:02.499 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.493+0000 7f4ae560a700 1 --2- 172.21.15.92:0/1221077401 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ae00b28d0 0x7f4ae01f6c00 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:02.499 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.493+0000 7f4ae560a700 1 --2- 172.21.15.92:0/1221077401 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f4acc06a0e0 0x7f4acc06c5a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:02.500 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.493+0000 7f4ae560a700 1 --2- 172.21.15.92:0/1221077401 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4ae00ce450 0x7f4ae01f2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:02.500 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.493+0000 7f4ae560a700 1 -- 172.21.15.92:0/1221077401 >> 172.21.15.92:0/1221077401 conn(0x7f4ae00cd8d0 msgr2=0x7f4ae00d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:02.500 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.493+0000 7f4ae560a700 1 -- 172.21.15.92:0/1221077401 shutdown_connections 2023-08-26T09:26:02.500 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.493+0000 7f4ae560a700 1 -- 172.21.15.92:0/1221077401 wait complete. 2023-08-26T09:26:02.510 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-26T09:26:02.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.629+0000 7f79bbf0a700 1 Processor -- start 2023-08-26T09:26:02.637 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.629+0000 7f79bbf0a700 1 -- start start 2023-08-26T09:26:02.642 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.630+0000 7f79bbf0a700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f79b415d220 0x7f79b40af390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:02.642 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.630+0000 7f79bbf0a700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f79b406db70 0x7f79b4070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:02.642 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.630+0000 7f79bbf0a700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b40aee50 con 0x7f79b4071260 2023-08-26T09:26:02.642 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.630+0000 7f79bbf0a700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b40af130 con 0x7f79b406db70 2023-08-26T09:26:02.643 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.630+0000 7f79bbf0a700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b40c4cb0 con 0x7f79b415d220 2023-08-26T09:26:02.643 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.630+0000 7f79b94a5700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f79b406db70 0x7f79b4070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:02.643 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.630+0000 7f79b94a5700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f79b406db70 0x7f79b4070d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46274/0 (socket says 172.21.15.92:46274) 2023-08-26T09:26:02.643 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.630+0000 7f79b94a5700 1 -- 172.21.15.92:0/3816582236 learned_addr learned my addr 172.21.15.92:0/3816582236 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:02.644 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.630+0000 7f79b94a5700 1 -- 172.21.15.92:0/3816582236 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f79b415d220 msgr2=0x7f79b40af390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:02.644 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.630+0000 7f79b94a5700 1 --2- 172.21.15.92:0/3816582236 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f79b415d220 0x7f79b40af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:02.644 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.630+0000 7f79b94a5700 1 -- 172.21.15.92:0/3816582236 >> v1:172.21.15.188:6789/0 conn(0x7f79b4071260 legacy=0x7f79b4160d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:02.644 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.630+0000 7f79b94a5700 1 -- 172.21.15.92:0/3816582236 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b40c4f90 con 0x7f79b406db70 2023-08-26T09:26:02.644 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.630+0000 7f79b94a5700 1 --2- 172.21.15.92:0/3816582236 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79b406db70 0x7f79b4070d20 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f79b00098f0 tx=0x7f79b0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=797dfa069560f56 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:02.645 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.630+0000 7f79b8ca4700 1 -- 172.21.15.92:0/3816582236 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b0004230 con 0x7f79b406db70 2023-08-26T09:26:02.645 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.631+0000 7f79b8ca4700 1 -- 172.21.15.92:0/3816582236 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b0004390 con 0x7f79b406db70 2023-08-26T09:26:02.645 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.631+0000 7f79b8ca4700 1 -- 172.21.15.92:0/3816582236 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b00036a0 con 0x7f79b406db70 2023-08-26T09:26:02.645 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.631+0000 7f79bbf0a700 1 -- 172.21.15.92:0/3816582236 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79b406db70 msgr2=0x7f79b4070d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:02.645 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.631+0000 7f79bbf0a700 1 --2- 172.21.15.92:0/3816582236 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79b406db70 0x7f79b4070d20 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f79b00098f0 tx=0x7f79b0009c00 comp rx=0 tx=0).stop 2023-08-26T09:26:02.646 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.631+0000 7f79bbf0a700 1 -- 172.21.15.92:0/3816582236 shutdown_connections 2023-08-26T09:26:02.646 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.631+0000 7f79bbf0a700 1 --2- 172.21.15.92:0/3816582236 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f79b415d220 0x7f79b40af390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:02.646 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.631+0000 7f79bbf0a700 1 --2- 172.21.15.92:0/3816582236 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79b406db70 0x7f79b4070d20 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:02.647 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.631+0000 7f79bbf0a700 1 -- 172.21.15.92:0/3816582236 >> 172.21.15.92:0/3816582236 conn(0x7f79b406b430 msgr2=0x7f79b406b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:02.647 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.631+0000 7f79bbf0a700 1 -- 172.21.15.92:0/3816582236 shutdown_connections 2023-08-26T09:26:02.647 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.631+0000 7f79bbf0a700 1 -- 172.21.15.92:0/3816582236 wait complete. 2023-08-26T09:26:02.647 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.633+0000 7f79bbf0a700 1 Processor -- start 2023-08-26T09:26:02.647 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.633+0000 7f79bbf0a700 1 -- start start 2023-08-26T09:26:02.648 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.634+0000 7f79bbf0a700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f79b406db70 0x7f79b41f3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:02.648 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.634+0000 7f79bbf0a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79b4071260 0x7f79b40b4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:02.648 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.634+0000 7f79bbf0a700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f79b415d220 0x7f79b40b4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:02.648 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.634+0000 7f79bbf0a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b40b0160 con 0x7f79b4071260 2023-08-26T09:26:02.648 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.634+0000 7f79bbf0a700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b40b0440 con 0x7f79b415d220 2023-08-26T09:26:02.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.634+0000 7f79bbf0a700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b40b0720 con 0x7f79b406db70 2023-08-26T09:26:02.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.634+0000 7f79b94a5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79b4071260 0x7f79b40b4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:02.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.634+0000 7f79b94a5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79b4071260 0x7f79b40b4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46282/0 (socket says 172.21.15.92:46282) 2023-08-26T09:26:02.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.634+0000 7f79b94a5700 1 -- 172.21.15.92:0/3972424655 learned_addr learned my addr 172.21.15.92:0/3972424655 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:02.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.634+0000 7f79b9ca6700 1 --2- 172.21.15.92:0/3972424655 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f79b406db70 0x7f79b41f3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:02.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.634+0000 7f79ba4a7700 1 --2- 172.21.15.92:0/3972424655 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f79b415d220 0x7f79b40b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:02.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.634+0000 7f79b94a5700 1 -- 172.21.15.92:0/3972424655 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f79b406db70 msgr2=0x7f79b41f3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:02.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.634+0000 7f79b94a5700 1 --2- 172.21.15.92:0/3972424655 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f79b406db70 0x7f79b41f3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:02.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.634+0000 7f79b94a5700 1 -- 172.21.15.92:0/3972424655 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f79b415d220 msgr2=0x7f79b40b4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:02.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.634+0000 7f79b94a5700 1 --2- 172.21.15.92:0/3972424655 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f79b415d220 0x7f79b40b4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:02.651 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.634+0000 7f79b94a5700 1 -- 172.21.15.92:0/3972424655 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b0009550 con 0x7f79b4071260 2023-08-26T09:26:02.651 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.634+0000 7f79b9ca6700 1 --2- 172.21.15.92:0/3972424655 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f79b406db70 0x7f79b41f3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:26:02.651 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.634+0000 7f79b94a5700 1 --2- 172.21.15.92:0/3972424655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79b4071260 0x7f79b40b4230 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f79b0009130 tx=0x7f79b0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:02.651 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.634+0000 7f79aa7fc700 1 -- 172.21.15.92:0/3972424655 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b0003e70 con 0x7f79b4071260 2023-08-26T09:26:02.651 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.634+0000 7f79aa7fc700 1 -- 172.21.15.92:0/3972424655 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b001f070 con 0x7f79b4071260 2023-08-26T09:26:02.652 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.634+0000 7f79bbf0a700 1 -- 172.21.15.92:0/3972424655 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79b40b0a00 con 0x7f79b4071260 2023-08-26T09:26:02.652 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.634+0000 7f79aa7fc700 1 -- 172.21.15.92:0/3972424655 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b000b8a0 con 0x7f79b4071260 2023-08-26T09:26:02.652 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.634+0000 7f79bbf0a700 1 -- 172.21.15.92:0/3972424655 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79b40af430 con 0x7f79b4071260 2023-08-26T09:26:02.652 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.635+0000 7f79bbf0a700 1 -- 172.21.15.92:0/3972424655 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79b404eeb0 con 0x7f79b4071260 2023-08-26T09:26:02.652 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.636+0000 7f79aa7fc700 1 -- 172.21.15.92:0/3972424655 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f79b0021030 con 0x7f79b4071260 2023-08-26T09:26:02.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.636+0000 7f79aa7fc700 1 --2- 172.21.15.92:0/3972424655 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f799806a0e0 0x7f799806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:02.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.636+0000 7f79aa7fc700 1 -- 172.21.15.92:0/3972424655 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f79b0089d50 con 0x7f79b4071260 2023-08-26T09:26:02.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.636+0000 7f79b9ca6700 1 --2- 172.21.15.92:0/3972424655 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f799806a0e0 0x7f799806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:02.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.637+0000 7f79b9ca6700 1 --2- 172.21.15.92:0/3972424655 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f799806a0e0 0x7f799806c5a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f79a4006fd0 tx=0x7f79a4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:02.654 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.641+0000 7f79aa7fc700 1 -- 172.21.15.92:0/3972424655 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f79b00553f0 con 0x7f79b4071260 2023-08-26T09:26:02.834 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.829+0000 7f79bbf0a700 1 -- 172.21.15.92:0/3972424655 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f79b404eeb0 con 0x7f79b4071260 2023-08-26T09:26:02.834 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.829+0000 7f79aa7fc700 1 -- 172.21.15.92:0/3972424655 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f79b0058a10 con 0x7f79b4071260 2023-08-26T09:26:02.835 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 32 2023-08-26T09:26:02.836 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.831+0000 7f79bbf0a700 1 -- 172.21.15.92:0/3972424655 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f799806a0e0 msgr2=0x7f799806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:02.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.831+0000 7f79bbf0a700 1 --2- 172.21.15.92:0/3972424655 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f799806a0e0 0x7f799806c5a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f79a4006fd0 tx=0x7f79a4008040 comp rx=0 tx=0).stop 2023-08-26T09:26:02.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.831+0000 7f79bbf0a700 1 -- 172.21.15.92:0/3972424655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79b4071260 msgr2=0x7f79b40b4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:02.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.831+0000 7f79bbf0a700 1 --2- 172.21.15.92:0/3972424655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79b4071260 0x7f79b40b4230 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f79b0009130 tx=0x7f79b0004750 comp rx=0 tx=0).stop 2023-08-26T09:26:02.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.831+0000 7f79bbf0a700 1 -- 172.21.15.92:0/3972424655 shutdown_connections 2023-08-26T09:26:02.838 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.831+0000 7f79bbf0a700 1 --2- 172.21.15.92:0/3972424655 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f799806a0e0 0x7f799806c5a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:02.838 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.831+0000 7f79bbf0a700 1 --2- 172.21.15.92:0/3972424655 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f79b415d220 0x7f79b40b4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:02.838 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.831+0000 7f79bbf0a700 1 --2- 172.21.15.92:0/3972424655 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f79b406db70 0x7f79b41f3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:02.838 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.831+0000 7f79bbf0a700 1 --2- 172.21.15.92:0/3972424655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79b4071260 0x7f79b40b4230 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:02.838 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.831+0000 7f79bbf0a700 1 -- 172.21.15.92:0/3972424655 >> 172.21.15.92:0/3972424655 conn(0x7f79b406b430 msgr2=0x7f79b415c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:02.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.832+0000 7f79bbf0a700 1 -- 172.21.15.92:0/3972424655 shutdown_connections 2023-08-26T09:26:02.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.832+0000 7f79bbf0a700 1 -- 172.21.15.92:0/3972424655 wait complete. 2023-08-26T09:26:02.848 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-26T09:26:02.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.967+0000 7f8c880e7700 1 Processor -- start 2023-08-26T09:26:02.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.967+0000 7f8c880e7700 1 -- start start 2023-08-26T09:26:02.974 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.968+0000 7f8c880e7700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f8c80159dd0 0x7f8c800cf220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:02.975 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.968+0000 7f8c880e7700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8c8006e110 0x7f8c8006e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:02.975 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.968+0000 7f8c880e7700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c8006eab0 con 0x7f8c80070d20 2023-08-26T09:26:02.975 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.968+0000 7f8c880e7700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c800c6200 con 0x7f8c80159dd0 2023-08-26T09:26:02.975 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.968+0000 7f8c880e7700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c800ce740 con 0x7f8c8006e110 2023-08-26T09:26:02.975 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.968+0000 7f8c85e83700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f8c80159dd0 0x7f8c800cf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:02.976 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.968+0000 7f8c86684700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f8c80070d20 0x7f8c800711b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:58306/0 (socket says 172.21.15.92:58306) 2023-08-26T09:26:02.976 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.968+0000 7f8c86684700 1 -- 172.21.15.92:0/3367359843 learned_addr learned my addr 172.21.15.92:0/3367359843 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:26:02.976 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.968+0000 7f8c85682700 1 --2- 172.21.15.92:0/3367359843 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8c8006e110 0x7f8c8006e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:02.976 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.968+0000 7f8c85e83700 1 -- 172.21.15.92:0/3367359843 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8c8006e110 msgr2=0x7f8c8006e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:02.976 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.968+0000 7f8c85e83700 1 --2- 172.21.15.92:0/3367359843 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8c8006e110 0x7f8c8006e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:02.977 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.968+0000 7f8c85e83700 1 -- 172.21.15.92:0/3367359843 >> v1:172.21.15.92:6789/0 conn(0x7f8c80070d20 legacy=0x7f8c800711b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:02.977 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.968+0000 7f8c85e83700 1 -- 172.21.15.92:0/3367359843 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c800cea20 con 0x7f8c80159dd0 2023-08-26T09:26:02.977 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.968+0000 7f8c84e81700 1 -- 172.21.15.92:0/3367359843 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3012083019 0 0) 0x7f8c8006eab0 con 0x7f8c80070d20 2023-08-26T09:26:02.977 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.968+0000 7f8c85e83700 1 --2- 172.21.15.92:0/3367359843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c80159dd0 0x7f8c800cf220 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c00bae0 tx=0x7f8c7c00bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=302e13f9018ae5b2 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:02.977 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.968+0000 7f8c84e81700 1 -- 172.21.15.92:0/3367359843 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c00dd30 con 0x7f8c80159dd0 2023-08-26T09:26:02.978 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.968+0000 7f8c84e81700 1 -- 172.21.15.92:0/3367359843 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c7c00de90 con 0x7f8c80159dd0 2023-08-26T09:26:02.978 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.968+0000 7f8c84e81700 1 -- 172.21.15.92:0/3367359843 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c010690 con 0x7f8c80159dd0 2023-08-26T09:26:02.978 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.969+0000 7f8c880e7700 1 -- 172.21.15.92:0/3367359843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c80159dd0 msgr2=0x7f8c800cf220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:02.978 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.969+0000 7f8c880e7700 1 --2- 172.21.15.92:0/3367359843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c80159dd0 0x7f8c800cf220 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c00bae0 tx=0x7f8c7c00bdf0 comp rx=0 tx=0).stop 2023-08-26T09:26:02.978 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.969+0000 7f8c880e7700 1 -- 172.21.15.92:0/3367359843 shutdown_connections 2023-08-26T09:26:02.979 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.969+0000 7f8c880e7700 1 --2- 172.21.15.92:0/3367359843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c80159dd0 0x7f8c800cf220 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:02.979 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.969+0000 7f8c880e7700 1 --2- 172.21.15.92:0/3367359843 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8c8006e110 0x7f8c8006e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:02.979 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.969+0000 7f8c880e7700 1 -- 172.21.15.92:0/3367359843 >> 172.21.15.92:0/3367359843 conn(0x7f8c8006b430 msgr2=0x7f8c8006b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:02.979 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.969+0000 7f8c880e7700 1 -- 172.21.15.92:0/3367359843 shutdown_connections 2023-08-26T09:26:02.979 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.969+0000 7f8c880e7700 1 -- 172.21.15.92:0/3367359843 wait complete. 2023-08-26T09:26:02.982 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.970+0000 7f8c880e7700 1 Processor -- start 2023-08-26T09:26:02.982 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.970+0000 7f8c880e7700 1 -- start start 2023-08-26T09:26:02.983 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.971+0000 7f8c880e7700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8c8006e110 0x7f8c80158370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:02.983 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.971+0000 7f8c880e7700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8c80070d20 0x7f8c801516f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:02.983 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.971+0000 7f8c880e7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c80159dd0 0x7f8c8014f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:02.983 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.971+0000 7f8c880e7700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c80158c50 con 0x7f8c80159dd0 2023-08-26T09:26:02.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.971+0000 7f8c880e7700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c80158f30 con 0x7f8c80070d20 2023-08-26T09:26:02.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.971+0000 7f8c880e7700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c80159210 con 0x7f8c8006e110 2023-08-26T09:26:02.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.971+0000 7f8c86684700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c80159dd0 0x7f8c8014f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:02.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.971+0000 7f8c86684700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c80159dd0 0x7f8c8014f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46298/0 (socket says 172.21.15.92:46298) 2023-08-26T09:26:02.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.971+0000 7f8c86684700 1 -- 172.21.15.92:0/1824964978 learned_addr learned my addr 172.21.15.92:0/1824964978 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:02.985 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.971+0000 7f8c85e83700 1 --2- 172.21.15.92:0/1824964978 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8c8006e110 0x7f8c80158370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:02.985 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.971+0000 7f8c85682700 1 --2- 172.21.15.92:0/1824964978 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8c80070d20 0x7f8c801516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:02.985 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.971+0000 7f8c86684700 1 -- 172.21.15.92:0/1824964978 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8c8006e110 msgr2=0x7f8c80158370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:02.985 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.971+0000 7f8c86684700 1 --2- 172.21.15.92:0/1824964978 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8c8006e110 0x7f8c80158370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:02.985 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.971+0000 7f8c86684700 1 -- 172.21.15.92:0/1824964978 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8c80070d20 msgr2=0x7f8c801516f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:02.986 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.971+0000 7f8c86684700 1 --2- 172.21.15.92:0/1824964978 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8c80070d20 0x7f8c801516f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:02.986 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.971+0000 7f8c86684700 1 -- 172.21.15.92:0/1824964978 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c7c00b740 con 0x7f8c80159dd0 2023-08-26T09:26:02.986 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.971+0000 7f8c85e83700 1 --2- 172.21.15.92:0/1824964978 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8c8006e110 0x7f8c80158370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:26:02.986 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.971+0000 7f8c85682700 1 --2- 172.21.15.92:0/1824964978 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8c80070d20 0x7f8c801516f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:26:02.986 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.972+0000 7f8c86684700 1 --2- 172.21.15.92:0/1824964978 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c80159dd0 0x7f8c8014f650 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8c78002230 tx=0x7f8c7800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:02.987 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.972+0000 7f8c767fc700 1 -- 172.21.15.92:0/1824964978 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7800ac20 con 0x7f8c80159dd0 2023-08-26T09:26:02.987 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.972+0000 7f8c767fc700 1 -- 172.21.15.92:0/1824964978 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c7800ada0 con 0x7f8c80159dd0 2023-08-26T09:26:02.987 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.972+0000 7f8c880e7700 1 -- 172.21.15.92:0/1824964978 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c801594f0 con 0x7f8c80159dd0 2023-08-26T09:26:02.987 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.972+0000 7f8c767fc700 1 -- 172.21.15.92:0/1824964978 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c78007310 con 0x7f8c80159dd0 2023-08-26T09:26:02.987 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.972+0000 7f8c880e7700 1 -- 172.21.15.92:0/1824964978 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c80155bb0 con 0x7f8c80159dd0 2023-08-26T09:26:02.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.973+0000 7f8c880e7700 1 -- 172.21.15.92:0/1824964978 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c801538b0 con 0x7f8c80159dd0 2023-08-26T09:26:02.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.973+0000 7f8c767fc700 1 -- 172.21.15.92:0/1824964978 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8c78007470 con 0x7f8c80159dd0 2023-08-26T09:26:02.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.973+0000 7f8c767fc700 1 --2- 172.21.15.92:0/1824964978 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f8c6406a0e0 0x7f8c6406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:02.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.974+0000 7f8c767fc700 1 -- 172.21.15.92:0/1824964978 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f8c78088460 con 0x7f8c80159dd0 2023-08-26T09:26:02.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.974+0000 7f8c85e83700 1 --2- 172.21.15.92:0/1824964978 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f8c6406a0e0 0x7f8c6406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:02.989 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.974+0000 7f8c85e83700 1 --2- 172.21.15.92:0/1824964978 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f8c6406a0e0 0x7f8c6406c5a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c000c00 tx=0x7f8c7c013000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:02.989 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:02.978+0000 7f8c767fc700 1 -- 172.21.15.92:0/1824964978 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8c801538b0 con 0x7f8c80159dd0 2023-08-26T09:26:03.171 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.166+0000 7f8c880e7700 1 -- 172.21.15.92:0/1824964978 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8c801538b0 con 0x7f8c80159dd0 2023-08-26T09:26:03.172 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.167+0000 7f8c767fc700 1 -- 172.21.15.92:0/1824964978 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8c801538b0 con 0x7f8c80159dd0 2023-08-26T09:26:03.172 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 64 2023-08-26T09:26:03.174 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.169+0000 7f8c880e7700 1 -- 172.21.15.92:0/1824964978 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f8c6406a0e0 msgr2=0x7f8c6406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:03.174 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.169+0000 7f8c880e7700 1 --2- 172.21.15.92:0/1824964978 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f8c6406a0e0 0x7f8c6406c5a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c000c00 tx=0x7f8c7c013000 comp rx=0 tx=0).stop 2023-08-26T09:26:03.174 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.169+0000 7f8c880e7700 1 -- 172.21.15.92:0/1824964978 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c80159dd0 msgr2=0x7f8c8014f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:03.174 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.169+0000 7f8c880e7700 1 --2- 172.21.15.92:0/1824964978 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c80159dd0 0x7f8c8014f650 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8c78002230 tx=0x7f8c7800a060 comp rx=0 tx=0).stop 2023-08-26T09:26:03.174 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.169+0000 7f8c880e7700 1 -- 172.21.15.92:0/1824964978 shutdown_connections 2023-08-26T09:26:03.175 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.169+0000 7f8c880e7700 1 --2- 172.21.15.92:0/1824964978 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c80159dd0 0x7f8c8014f650 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:03.175 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.169+0000 7f8c880e7700 1 --2- 172.21.15.92:0/1824964978 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8c8006e110 0x7f8c80158370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:03.175 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.169+0000 7f8c880e7700 1 --2- 172.21.15.92:0/1824964978 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f8c6406a0e0 0x7f8c6406c5a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:03.176 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.169+0000 7f8c880e7700 1 --2- 172.21.15.92:0/1824964978 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8c80070d20 0x7f8c801516f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:03.176 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.169+0000 7f8c880e7700 1 -- 172.21.15.92:0/1824964978 >> 172.21.15.92:0/1824964978 conn(0x7f8c8006b430 msgr2=0x7f8c8015a730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:03.176 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.169+0000 7f8c880e7700 1 -- 172.21.15.92:0/1824964978 shutdown_connections 2023-08-26T09:26:03.176 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.169+0000 7f8c880e7700 1 -- 172.21.15.92:0/1824964978 wait complete. 2023-08-26T09:26:03.186 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-26T09:26:03.309 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.304+0000 7fb9505cf700 1 Processor -- start 2023-08-26T09:26:03.309 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.304+0000 7fb9505cf700 1 -- start start 2023-08-26T09:26:03.311 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.305+0000 7fb9505cf700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb948160b90 0x7fb9480cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:03.312 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.305+0000 7fb9505cf700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fb94806a320 0x7fb94806a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:03.312 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.305+0000 7fb9505cf700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb94806cf70 con 0x7fb94806d8a0 2023-08-26T09:26:03.312 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.305+0000 7fb9505cf700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb94806acf0 con 0x7fb94806a320 2023-08-26T09:26:03.312 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.305+0000 7fb9505cf700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb948160f70 con 0x7fb948160b90 2023-08-26T09:26:03.313 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.305+0000 7fb94eb6c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fb94806a320 0x7fb94806a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:03.313 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.305+0000 7fb94eb6c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fb94806a320 0x7fb94806a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46306/0 (socket says 172.21.15.92:46306) 2023-08-26T09:26:03.313 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.305+0000 7fb94eb6c700 1 -- 172.21.15.92:0/1428670609 learned_addr learned my addr 172.21.15.92:0/1428670609 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:03.313 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.305+0000 7fb94e36b700 1 --2- 172.21.15.92:0/1428670609 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb948160b90 0x7fb9480cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:03.313 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.305+0000 7fb94eb6c700 1 -- 172.21.15.92:0/1428670609 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb948160b90 msgr2=0x7fb9480cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:03.313 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.305+0000 7fb94eb6c700 1 --2- 172.21.15.92:0/1428670609 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb948160b90 0x7fb9480cf780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:03.314 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.305+0000 7fb94eb6c700 1 -- 172.21.15.92:0/1428670609 >> v1:172.21.15.188:6789/0 conn(0x7fb94806d8a0 legacy=0x7fb948161b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:03.314 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.305+0000 7fb94eb6c700 1 -- 172.21.15.92:0/1428670609 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb948161670 con 0x7fb94806a320 2023-08-26T09:26:03.314 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.305+0000 7fb94e36b700 1 --2- 172.21.15.92:0/1428670609 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb948160b90 0x7fb9480cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:26:03.314 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.305+0000 7fb94eb6c700 1 --2- 172.21.15.92:0/1428670609 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb94806a320 0x7fb94806a7b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb940009e80 tx=0x7fb94000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b35827e3f3e7f90f server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:03.314 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.306+0000 7fb94d369700 1 -- 172.21.15.92:0/1428670609 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94000e070 con 0x7fb94806a320 2023-08-26T09:26:03.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.306+0000 7fb94d369700 1 -- 172.21.15.92:0/1428670609 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb94000b980 con 0x7fb94806a320 2023-08-26T09:26:03.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.306+0000 7fb94d369700 1 -- 172.21.15.92:0/1428670609 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94000bd30 con 0x7fb94806a320 2023-08-26T09:26:03.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.306+0000 7fb9505cf700 1 -- 172.21.15.92:0/1428670609 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb94806a320 msgr2=0x7fb94806a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:03.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.306+0000 7fb9505cf700 1 --2- 172.21.15.92:0/1428670609 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb94806a320 0x7fb94806a7b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb940009e80 tx=0x7fb94000b330 comp rx=0 tx=0).stop 2023-08-26T09:26:03.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.306+0000 7fb9505cf700 1 -- 172.21.15.92:0/1428670609 shutdown_connections 2023-08-26T09:26:03.316 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.306+0000 7fb9505cf700 1 --2- 172.21.15.92:0/1428670609 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb94806a320 0x7fb94806a7b0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:03.316 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.306+0000 7fb9505cf700 1 --2- 172.21.15.92:0/1428670609 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb948160b90 0x7fb9480cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:03.316 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.306+0000 7fb9505cf700 1 -- 172.21.15.92:0/1428670609 >> 172.21.15.92:0/1428670609 conn(0x7fb9480cc790 msgr2=0x7fb9480ccb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:03.316 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.306+0000 7fb9505cf700 1 -- 172.21.15.92:0/1428670609 shutdown_connections 2023-08-26T09:26:03.316 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.306+0000 7fb9505cf700 1 -- 172.21.15.92:0/1428670609 wait complete. 2023-08-26T09:26:03.319 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.307+0000 7fb9505cf700 1 Processor -- start 2023-08-26T09:26:03.319 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.307+0000 7fb9505cf700 1 -- start start 2023-08-26T09:26:03.319 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.308+0000 7fb9505cf700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb94806a320 0x7fb9481e7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:03.319 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.308+0000 7fb9505cf700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb94806d8a0 0x7fb948152d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:03.320 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.308+0000 7fb9505cf700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb948160b90 0x7fb9480b1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:03.320 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.308+0000 7fb9505cf700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9481e6bb0 con 0x7fb94806d8a0 2023-08-26T09:26:03.320 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.308+0000 7fb9505cf700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9481e6e90 con 0x7fb94806a320 2023-08-26T09:26:03.320 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.308+0000 7fb9505cf700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9481e7170 con 0x7fb948160b90 2023-08-26T09:26:03.320 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.308+0000 7fb94db6a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb94806d8a0 0x7fb948152d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:03.321 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.308+0000 7fb94db6a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb94806d8a0 0x7fb948152d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46310/0 (socket says 172.21.15.92:46310) 2023-08-26T09:26:03.321 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.308+0000 7fb94db6a700 1 -- 172.21.15.92:0/3295919426 learned_addr learned my addr 172.21.15.92:0/3295919426 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:03.321 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.308+0000 7fb94eb6c700 1 --2- 172.21.15.92:0/3295919426 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb948160b90 0x7fb9480b1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:03.321 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.308+0000 7fb94e36b700 1 --2- 172.21.15.92:0/3295919426 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb94806a320 0x7fb9481e7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:03.321 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.309+0000 7fb94db6a700 1 -- 172.21.15.92:0/3295919426 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb948160b90 msgr2=0x7fb9480b1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:03.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.309+0000 7fb94db6a700 1 --2- 172.21.15.92:0/3295919426 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb948160b90 0x7fb9480b1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:03.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.309+0000 7fb94db6a700 1 -- 172.21.15.92:0/3295919426 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb94806a320 msgr2=0x7fb9481e7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:03.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.309+0000 7fb94db6a700 1 --2- 172.21.15.92:0/3295919426 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb94806a320 0x7fb9481e7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:03.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.309+0000 7fb94db6a700 1 -- 172.21.15.92:0/3295919426 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb940009b30 con 0x7fb94806d8a0 2023-08-26T09:26:03.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.309+0000 7fb94db6a700 1 --2- 172.21.15.92:0/3295919426 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb94806d8a0 0x7fb948152d90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb94400c4e0 tx=0x7fb94400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:03.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.309+0000 7fb93effd700 1 -- 172.21.15.92:0/3295919426 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9440052d0 con 0x7fb94806d8a0 2023-08-26T09:26:03.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.309+0000 7fb93effd700 1 -- 172.21.15.92:0/3295919426 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb944005430 con 0x7fb94806d8a0 2023-08-26T09:26:03.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.309+0000 7fb9505cf700 1 -- 172.21.15.92:0/3295919426 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9481e7450 con 0x7fb94806d8a0 2023-08-26T09:26:03.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.309+0000 7fb93effd700 1 -- 172.21.15.92:0/3295919426 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9440038c0 con 0x7fb94806d8a0 2023-08-26T09:26:03.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.309+0000 7fb9505cf700 1 -- 172.21.15.92:0/3295919426 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9481532d0 con 0x7fb94806d8a0 2023-08-26T09:26:03.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.310+0000 7fb9505cf700 1 -- 172.21.15.92:0/3295919426 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb94804e660 con 0x7fb94806d8a0 2023-08-26T09:26:03.324 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.310+0000 7fb93effd700 1 -- 172.21.15.92:0/3295919426 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb944003a20 con 0x7fb94806d8a0 2023-08-26T09:26:03.324 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.311+0000 7fb93effd700 1 --2- 172.21.15.92:0/3295919426 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb92c06a0e0 0x7fb92c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:03.324 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.311+0000 7fb93effd700 1 -- 172.21.15.92:0/3295919426 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fb944087910 con 0x7fb94806d8a0 2023-08-26T09:26:03.324 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.311+0000 7fb94e36b700 1 --2- 172.21.15.92:0/3295919426 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb92c06a0e0 0x7fb92c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:03.324 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.311+0000 7fb94e36b700 1 --2- 172.21.15.92:0/3295919426 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb92c06a0e0 0x7fb92c06c5a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb93800c940 tx=0x7fb938008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:03.325 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.315+0000 7fb93effd700 1 -- 172.21.15.92:0/3295919426 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb944052fc0 con 0x7fb94806d8a0 2023-08-26T09:26:03.528 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.523+0000 7fb9505cf700 1 -- 172.21.15.92:0/3295919426 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb9480b5c90 con 0x7fb94806d8a0 2023-08-26T09:26:03.528 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.523+0000 7fb93effd700 1 -- 172.21.15.92:0/3295919426 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb9440565e0 con 0x7fb94806d8a0 2023-08-26T09:26:03.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.525+0000 7fb9505cf700 1 -- 172.21.15.92:0/3295919426 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb92c06a0e0 msgr2=0x7fb92c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:03.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.525+0000 7fb9505cf700 1 --2- 172.21.15.92:0/3295919426 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb92c06a0e0 0x7fb92c06c5a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb93800c940 tx=0x7fb938008040 comp rx=0 tx=0).stop 2023-08-26T09:26:03.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.525+0000 7fb9505cf700 1 -- 172.21.15.92:0/3295919426 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb94806d8a0 msgr2=0x7fb948152d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:03.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.525+0000 7fb9505cf700 1 --2- 172.21.15.92:0/3295919426 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb94806d8a0 0x7fb948152d90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb94400c4e0 tx=0x7fb94400c7f0 comp rx=0 tx=0).stop 2023-08-26T09:26:03.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.526+0000 7fb9505cf700 1 -- 172.21.15.92:0/3295919426 shutdown_connections 2023-08-26T09:26:03.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.526+0000 7fb9505cf700 1 --2- 172.21.15.92:0/3295919426 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb92c06a0e0 0x7fb92c06c5a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:03.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.526+0000 7fb9505cf700 1 --2- 172.21.15.92:0/3295919426 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb94806a320 0x7fb9481e7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:03.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.526+0000 7fb9505cf700 1 --2- 172.21.15.92:0/3295919426 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb948160b90 0x7fb9480b1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:03.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.526+0000 7fb9505cf700 1 --2- 172.21.15.92:0/3295919426 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb94806d8a0 0x7fb948152d90 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:03.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.526+0000 7fb9505cf700 1 -- 172.21.15.92:0/3295919426 >> 172.21.15.92:0/3295919426 conn(0x7fb9480cc790 msgr2=0x7fb948071540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:03.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.526+0000 7fb9505cf700 1 -- 172.21.15.92:0/3295919426 shutdown_connections 2023-08-26T09:26:03.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.526+0000 7fb9505cf700 1 -- 172.21.15.92:0/3295919426 wait complete. 2023-08-26T09:26:03.533 INFO:teuthology.orchestra.run.smithi092.stderr:listed 0 entries 2023-08-26T09:26:03.542 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-08-26T09:26:03.543 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-26T09:26:03.564 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-26T09:26:03.684 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.679+0000 7fa95fbd5700 1 Processor -- start 2023-08-26T09:26:03.684 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.679+0000 7fa95fbd5700 1 -- start start 2023-08-26T09:26:03.686 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.680+0000 7fa95fbd5700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa95815a010 0x7fa95806c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:03.687 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.680+0000 7fa95fbd5700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa9580b2f90 0x7fa958066020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:03.687 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.680+0000 7fa95fbd5700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9580aeaf0 con 0x7fa95806b540 2023-08-26T09:26:03.687 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.680+0000 7fa95fbd5700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9580cfc80 con 0x7fa95815a010 2023-08-26T09:26:03.687 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.680+0000 7fa95fbd5700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa95806db00 con 0x7fa9580b2f90 2023-08-26T09:26:03.688 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.680+0000 7fa95d971700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa95815a010 0x7fa95806c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:03.688 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.680+0000 7fa95d971700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa95815a010 0x7fa95806c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46316/0 (socket says 172.21.15.92:46316) 2023-08-26T09:26:03.688 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.680+0000 7fa95d971700 1 -- 172.21.15.92:0/1241237826 learned_addr learned my addr 172.21.15.92:0/1241237826 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:03.688 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.681+0000 7fa95d170700 1 --2- 172.21.15.92:0/1241237826 >> v2:172.21.15.188:3300/0 conn(0x7fa9580b2f90 0x7fa958066020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:03.688 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.681+0000 7fa95d971700 1 -- 172.21.15.92:0/1241237826 >> v2:172.21.15.188:3300/0 conn(0x7fa9580b2f90 msgr2=0x7fa958066020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:03.689 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.681+0000 7fa95d971700 1 --2- 172.21.15.92:0/1241237826 >> v2:172.21.15.188:3300/0 conn(0x7fa9580b2f90 0x7fa958066020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:03.689 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.681+0000 7fa95d971700 1 -- 172.21.15.92:0/1241237826 >> v1:172.21.15.188:6789/0 conn(0x7fa95806b540 legacy=0x7fa95806a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:03.689 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.681+0000 7fa95d971700 1 -- 172.21.15.92:0/1241237826 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa95806dde0 con 0x7fa95815a010 2023-08-26T09:26:03.689 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.681+0000 7fa95d971700 1 --2- 172.21.15.92:0/1241237826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa95815a010 0x7fa95806c210 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa9580678e0 tx=0x7fa948009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9938f14a6df147bf server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:03.689 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.681+0000 7fa95c96f700 1 -- 172.21.15.92:0/1241237826 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa948005e30 con 0x7fa95815a010 2023-08-26T09:26:03.690 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.681+0000 7fa95c96f700 1 -- 172.21.15.92:0/1241237826 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa948006030 con 0x7fa95815a010 2023-08-26T09:26:03.690 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.681+0000 7fa95c96f700 1 -- 172.21.15.92:0/1241237826 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9480063e0 con 0x7fa95815a010 2023-08-26T09:26:03.690 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.681+0000 7fa95fbd5700 1 -- 172.21.15.92:0/1241237826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa95815a010 msgr2=0x7fa95806c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:03.690 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.682+0000 7fa95fbd5700 1 --2- 172.21.15.92:0/1241237826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa95815a010 0x7fa95806c210 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa9580678e0 tx=0x7fa948009bd0 comp rx=0 tx=0).stop 2023-08-26T09:26:03.690 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.682+0000 7fa95fbd5700 1 -- 172.21.15.92:0/1241237826 shutdown_connections 2023-08-26T09:26:03.691 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.682+0000 7fa95fbd5700 1 --2- 172.21.15.92:0/1241237826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa95815a010 0x7fa95806c210 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:03.691 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.682+0000 7fa95fbd5700 1 --2- 172.21.15.92:0/1241237826 >> v2:172.21.15.188:3300/0 conn(0x7fa9580b2f90 0x7fa958066020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:03.691 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.682+0000 7fa95fbd5700 1 -- 172.21.15.92:0/1241237826 >> 172.21.15.92:0/1241237826 conn(0x7fa9580b23c0 msgr2=0x7fa9580b27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:03.691 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.682+0000 7fa95fbd5700 1 -- 172.21.15.92:0/1241237826 shutdown_connections 2023-08-26T09:26:03.691 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.682+0000 7fa95fbd5700 1 -- 172.21.15.92:0/1241237826 wait complete. 2023-08-26T09:26:03.694 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.683+0000 7fa95fbd5700 1 Processor -- start 2023-08-26T09:26:03.694 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.683+0000 7fa95fbd5700 1 -- start start 2023-08-26T09:26:03.694 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.684+0000 7fa95fbd5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa95806b540 0x7fa958158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:03.694 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.684+0000 7fa95fbd5700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa9580b2f90 0x7fa9580c2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:03.694 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.684+0000 7fa95fbd5700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa95815a010 0x7fa9580c6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:03.695 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.684+0000 7fa95fbd5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9580c8e20 con 0x7fa95806b540 2023-08-26T09:26:03.695 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.684+0000 7fa95fbd5700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9580c5510 con 0x7fa95815a010 2023-08-26T09:26:03.695 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.684+0000 7fa95fbd5700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9580c5230 con 0x7fa9580b2f90 2023-08-26T09:26:03.695 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.684+0000 7fa95d971700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa95806b540 0x7fa958158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:03.696 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.684+0000 7fa95d971700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa95806b540 0x7fa958158aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46320/0 (socket says 172.21.15.92:46320) 2023-08-26T09:26:03.696 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.684+0000 7fa95d971700 1 -- 172.21.15.92:0/2365051145 learned_addr learned my addr 172.21.15.92:0/2365051145 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:03.696 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.684+0000 7fa95d971700 1 -- 172.21.15.92:0/2365051145 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa9580b2f90 msgr2=0x7fa9580c2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:03.696 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.684+0000 7fa95d971700 1 --2- 172.21.15.92:0/2365051145 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa9580b2f90 0x7fa9580c2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:03.697 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.684+0000 7fa95d971700 1 -- 172.21.15.92:0/2365051145 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa95815a010 msgr2=0x7fa9580c6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:03.697 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.684+0000 7fa95d971700 1 --2- 172.21.15.92:0/2365051145 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa95815a010 0x7fa9580c6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:03.697 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.684+0000 7fa95d971700 1 -- 172.21.15.92:0/2365051145 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa948009500 con 0x7fa95806b540 2023-08-26T09:26:03.697 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.684+0000 7fa95d971700 1 --2- 172.21.15.92:0/2365051145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa95806b540 0x7fa958158aa0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa948013040 tx=0x7fa948004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:03.697 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.684+0000 7fa94e7fc700 1 -- 172.21.15.92:0/2365051145 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa948004260 con 0x7fa95806b540 2023-08-26T09:26:03.698 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.684+0000 7fa94e7fc700 1 -- 172.21.15.92:0/2365051145 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa948004400 con 0x7fa95806b540 2023-08-26T09:26:03.698 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.684+0000 7fa94e7fc700 1 -- 172.21.15.92:0/2365051145 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9480038e0 con 0x7fa95806b540 2023-08-26T09:26:03.698 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.684+0000 7fa95fbd5700 1 -- 172.21.15.92:0/2365051145 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa958159610 con 0x7fa95806b540 2023-08-26T09:26:03.698 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.684+0000 7fa95fbd5700 1 -- 172.21.15.92:0/2365051145 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9580c9270 con 0x7fa95806b540 2023-08-26T09:26:03.698 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.685+0000 7fa95fbd5700 1 -- 172.21.15.92:0/2365051145 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9580c8bf0 con 0x7fa95806b540 2023-08-26T09:26:03.698 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.686+0000 7fa94e7fc700 1 -- 172.21.15.92:0/2365051145 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa948022070 con 0x7fa95806b540 2023-08-26T09:26:03.699 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.686+0000 7fa94e7fc700 1 --2- 172.21.15.92:0/2365051145 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa93c06a0e0 0x7fa93c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:03.699 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.686+0000 7fa95d170700 1 --2- 172.21.15.92:0/2365051145 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa93c06a0e0 0x7fa93c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:03.699 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.686+0000 7fa94e7fc700 1 -- 172.21.15.92:0/2365051145 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa948089ee0 con 0x7fa95806b540 2023-08-26T09:26:03.699 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.687+0000 7fa95d170700 1 --2- 172.21.15.92:0/2365051145 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa93c06a0e0 0x7fa93c06c5a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa958167ea0 tx=0x7fa954008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:03.700 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.691+0000 7fa94e7fc700 1 -- 172.21.15.92:0/2365051145 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa9580c8bf0 con 0x7fa95806b540 2023-08-26T09:26:03.885 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.880+0000 7fa95fbd5700 1 -- 172.21.15.92:0/2365051145 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9580c8bf0 con 0x7fa95806b540 2023-08-26T09:26:03.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.881+0000 7fa94e7fc700 1 -- 172.21.15.92:0/2365051145 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18304 (secure 0 0 0) 0x7fa9580c8bf0 con 0x7fa95806b540 2023-08-26T09:26:03.887 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:26:03.887 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":22,"fsid":"254a2d31-bd41-4507-8326-1b205ac24377","created":"2023-08-26T09:24:55.352131+0000","modified":"2023-08-26T09:26:02.241818+0000","last_up_change":"2023-08-26T09:25:06.124496+0000","last_in_change":"2023-08-26T09:24:57.840725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-26T09:25:06.650431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-26T09:25:06.973382+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-26T09:25:11.584141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-26T09:25:12.814990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e9e7638-4459-4d8d-8e40-130bcf48df66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6819","nonce":382827192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6824","nonce":382827192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6831","nonce":382827192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6827","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6829","nonce":382827192}]},"public_addr":"172.21.15.92:6819/382827192","cluster_addr":"172.21.15.92:6824/382827192","heartbeat_back_addr":"172.21.15.92:6831/382827192","heartbeat_front_addr":"172.21.15.92:6829/382827192","state":["exists","up"]},{"osd":1,"uuid":"164e68c9-aedd-4df5-9b70-f4b1ec3bda13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6809","nonce":618773438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6811","nonce":618773438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6815","nonce":618773438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6813","nonce":618773438}]},"public_addr":"172.21.15.92:6809/618773438","cluster_addr":"172.21.15.92:6811/618773438","heartbeat_back_addr":"172.21.15.92:6815/618773438","heartbeat_front_addr":"172.21.15.92:6813/618773438","state":["exists","up"]},{"osd":2,"uuid":"8701dfee-629a-4d30-82e4-b8fac340303f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6818","nonce":3697397687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6821","nonce":3697397687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6828","nonce":3697397687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6823","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6825","nonce":3697397687}]},"public_addr":"172.21.15.92:6818/3697397687","cluster_addr":"172.21.15.92:6821/3697397687","heartbeat_back_addr":"172.21.15.92:6828/3697397687","heartbeat_front_addr":"172.21.15.92:6825/3697397687","state":["exists","up"]},{"osd":3,"uuid":"93bdc94d-dc07-495f-995a-a6ad072f0247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6801","nonce":3579846453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6803","nonce":3579846453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6807","nonce":3579846453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6805","nonce":3579846453}]},"public_addr":"172.21.15.92:6801/3579846453","cluster_addr":"172.21.15.92:6803/3579846453","heartbeat_back_addr":"172.21.15.92:6807/3579846453","heartbeat_front_addr":"172.21.15.92:6805/3579846453","state":["exists","up"]},{"osd":4,"uuid":"d9d0ea80-8481-46a7-9677-c338d32cf1d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6809","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6811","nonce":3228383424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6813","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6815","nonce":3228383424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6821","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6823","nonce":3228383424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6817","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6819","nonce":3228383424}]},"public_addr":"172.21.15.188:6811/3228383424","cluster_addr":"172.21.15.188:6815/3228383424","heartbeat_back_addr":"172.21.15.188:6823/3228383424","heartbeat_front_addr":"172.21.15.188:6819/3228383424","state":["exists","up"]},{"osd":5,"uuid":"38d03253-467a-456f-bd5e-5a46532a0b18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6801","nonce":1655821054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6803","nonce":1655821054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6807","nonce":1655821054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6805","nonce":1655821054}]},"public_addr":"172.21.15.188:6801/1655821054","cluster_addr":"172.21.15.188:6803/1655821054","heartbeat_back_addr":"172.21.15.188:6807/1655821054","heartbeat_front_addr":"172.21.15.188:6805/1655821054","state":["exists","up"]},{"osd":6,"uuid":"d61564b5-136f-42e5-a843-626c2017cc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6810","nonce":2069976891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6814","nonce":2069976891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6822","nonce":2069976891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6818","nonce":2069976891}]},"public_addr":"172.21.15.188:6810/2069976891","cluster_addr":"172.21.15.188:6814/2069976891","heartbeat_back_addr":"172.21.15.188:6822/2069976891","heartbeat_front_addr":"172.21.15.188:6818/2069976891","state":["exists","up"]},{"osd":7,"uuid":"fae2949e-0d62-42cd-ba72-08f516084b20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6825","nonce":1882888860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6827","nonce":1882888860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6831","nonce":1882888860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6829","nonce":1882888860}]},"public_addr":"172.21.15.188:6825/1882888860","cluster_addr":"172.21.15.188:6827/1882888860","heartbeat_back_addr":"172.21.15.188:6831/1882888860","heartbeat_front_addr":"172.21.15.188:6829/1882888860","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.038523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.063160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.000857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.975572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.023848+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.765194+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.081365+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:05.110745+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.10","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-26T09:26:03.888 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.884+0000 7fa95fbd5700 1 -- 172.21.15.92:0/2365051145 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa93c06a0e0 msgr2=0x7fa93c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:03.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.884+0000 7fa95fbd5700 1 --2- 172.21.15.92:0/2365051145 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa93c06a0e0 0x7fa93c06c5a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa958167ea0 tx=0x7fa954008040 comp rx=0 tx=0).stop 2023-08-26T09:26:03.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.884+0000 7fa95fbd5700 1 -- 172.21.15.92:0/2365051145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa95806b540 msgr2=0x7fa958158aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:03.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.884+0000 7fa95fbd5700 1 --2- 172.21.15.92:0/2365051145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa95806b540 0x7fa958158aa0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa948013040 tx=0x7fa948004750 comp rx=0 tx=0).stop 2023-08-26T09:26:03.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.884+0000 7fa95fbd5700 1 -- 172.21.15.92:0/2365051145 shutdown_connections 2023-08-26T09:26:03.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.884+0000 7fa95fbd5700 1 --2- 172.21.15.92:0/2365051145 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa93c06a0e0 0x7fa93c06c5a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:03.890 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.884+0000 7fa95fbd5700 1 --2- 172.21.15.92:0/2365051145 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa95815a010 0x7fa9580c6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:03.890 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.884+0000 7fa95fbd5700 1 --2- 172.21.15.92:0/2365051145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa95806b540 0x7fa958158aa0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:03.890 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.884+0000 7fa95fbd5700 1 --2- 172.21.15.92:0/2365051145 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa9580b2f90 0x7fa9580c2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:03.890 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.884+0000 7fa95fbd5700 1 -- 172.21.15.92:0/2365051145 >> 172.21.15.92:0/2365051145 conn(0x7fa9580b23c0 msgr2=0x7fa9580c9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:03.890 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.884+0000 7fa95fbd5700 1 -- 172.21.15.92:0/2365051145 shutdown_connections 2023-08-26T09:26:03.891 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:03.884+0000 7fa95fbd5700 1 -- 172.21.15.92:0/2365051145 wait complete. 2023-08-26T09:26:03.900 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-26T09:25:06.650431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-26T09:25:06.973382+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-26T09:25:11.584141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-26T09:25:12.814990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-26T09:26:03.901 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-26T09:26:04.025 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.021+0000 7f63f241c700 1 Processor -- start 2023-08-26T09:26:04.025 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.021+0000 7f63f241c700 1 -- start start 2023-08-26T09:26:04.027 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.021+0000 7f63f241c700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f63ec06b430 0x7f63ec0ce6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:04.027 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.021+0000 7f63f241c700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63ec072720 con 0x7f63ec15a550 2023-08-26T09:26:04.028 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.021+0000 7f63f241c700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63ec0cdbd0 con 0x7f63ec0ca1b0 2023-08-26T09:26:04.028 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.021+0000 7f63f241c700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec072a00 con 0x7f63ec06b430 2023-08-26T09:26:04.028 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.022+0000 7f63ebfff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f63ec15a550 0x7f63ec0c9aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:58342/0 (socket says 172.21.15.92:58342) 2023-08-26T09:26:04.028 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.022+0000 7f63ebfff700 1 -- 172.21.15.92:0/1308754009 learned_addr learned my addr 172.21.15.92:0/1308754009 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:26:04.029 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.022+0000 7f63eb7fe700 1 --2- 172.21.15.92:0/1308754009 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f63ec06b430 0x7f63ec0ce6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:04.029 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.022+0000 7f63eaffd700 1 -- 172.21.15.92:0/1308754009 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4119687691 0 0) 0x7f63ec072720 con 0x7f63ec15a550 2023-08-26T09:26:04.029 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.022+0000 7f63eaffd700 1 -- 172.21.15.92:0/1308754009 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63d40035b0 con 0x7f63ec15a550 2023-08-26T09:26:04.029 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.022+0000 7f63eb7fe700 1 -- 172.21.15.92:0/1308754009 >> v1:172.21.15.188:6789/0 conn(0x7f63ec0ca1b0 legacy=0x7f63ec071490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:04.029 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.022+0000 7f63eb7fe700 1 -- 172.21.15.92:0/1308754009 >> v1:172.21.15.92:6789/0 conn(0x7f63ec15a550 legacy=0x7f63ec0c9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:04.030 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.022+0000 7f63eaffd700 1 -- 172.21.15.92:0/1308754009 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3836331887 0 0) 0x7f63d40035b0 con 0x7f63ec15a550 2023-08-26T09:26:04.030 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.022+0000 7f63eb7fe700 1 -- 172.21.15.92:0/1308754009 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ec0cdeb0 con 0x7f63ec06b430 2023-08-26T09:26:04.030 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.022+0000 7f63eb7fe700 1 --2- 172.21.15.92:0/1308754009 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f63ec06b430 0x7f63ec0ce6b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f63e0009870 tx=0x7f63e0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f9ae974883ecd4e server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:04.030 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.022+0000 7f63eaffd700 1 -- 172.21.15.92:0/1308754009 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63dc001670 con 0x7f63ec06b430 2023-08-26T09:26:04.030 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.023+0000 7f63eaffd700 1 -- 172.21.15.92:0/1308754009 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e0004030 con 0x7f63ec06b430 2023-08-26T09:26:04.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.023+0000 7f63eaffd700 1 -- 172.21.15.92:0/1308754009 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e00043a0 con 0x7f63ec06b430 2023-08-26T09:26:04.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.023+0000 7f63f241c700 1 -- 172.21.15.92:0/1308754009 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f63ec06b430 msgr2=0x7f63ec0ce6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:04.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.023+0000 7f63f241c700 1 --2- 172.21.15.92:0/1308754009 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f63ec06b430 0x7f63ec0ce6b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f63e0009870 tx=0x7f63e0009b80 comp rx=0 tx=0).stop 2023-08-26T09:26:04.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.023+0000 7f63f241c700 1 -- 172.21.15.92:0/1308754009 shutdown_connections 2023-08-26T09:26:04.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.023+0000 7f63f241c700 1 --2- 172.21.15.92:0/1308754009 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f63ec06b430 0x7f63ec0ce6b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:04.032 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.023+0000 7f63f241c700 1 -- 172.21.15.92:0/1308754009 >> 172.21.15.92:0/1308754009 conn(0x7f63ec0cf450 msgr2=0x7f63ec0cf860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:04.032 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.023+0000 7f63f241c700 1 -- 172.21.15.92:0/1308754009 shutdown_connections 2023-08-26T09:26:04.032 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.023+0000 7f63f241c700 1 -- 172.21.15.92:0/1308754009 wait complete. 2023-08-26T09:26:04.034 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.024+0000 7f63f241c700 1 Processor -- start 2023-08-26T09:26:04.035 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.024+0000 7f63f241c700 1 -- start start 2023-08-26T09:26:04.035 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.025+0000 7f63f241c700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f63ec06b430 0x7f63ec0c8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:04.035 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.025+0000 7f63f241c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63ec0ca1b0 0x7f63ec1f0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:04.035 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.025+0000 7f63f241c700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f63ec15a550 0x7f63ec0c4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:04.035 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.025+0000 7f63f241c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec0c9770 con 0x7f63ec0ca1b0 2023-08-26T09:26:04.036 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.025+0000 7f63f241c700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec0c8850 con 0x7f63ec06b430 2023-08-26T09:26:04.036 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.025+0000 7f63f241c700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec0c8af0 con 0x7f63ec15a550 2023-08-26T09:26:04.036 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.025+0000 7f63eb7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63ec0ca1b0 0x7f63ec1f0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:04.036 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.025+0000 7f63eb7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63ec0ca1b0 0x7f63ec1f0500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46334/0 (socket says 172.21.15.92:46334) 2023-08-26T09:26:04.036 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.025+0000 7f63eb7fe700 1 -- 172.21.15.92:0/2938380258 learned_addr learned my addr 172.21.15.92:0/2938380258 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:04.036 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.025+0000 7f63eb7fe700 1 -- 172.21.15.92:0/2938380258 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f63ec15a550 msgr2=0x7f63ec0c4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:04.037 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.025+0000 7f63eb7fe700 1 --2- 172.21.15.92:0/2938380258 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f63ec15a550 0x7f63ec0c4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:04.037 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.025+0000 7f63eb7fe700 1 -- 172.21.15.92:0/2938380258 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f63ec06b430 msgr2=0x7f63ec0c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:04.037 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.025+0000 7f63ebfff700 1 --2- 172.21.15.92:0/2938380258 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f63ec06b430 0x7f63ec0c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:04.037 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.025+0000 7f63eb7fe700 1 --2- 172.21.15.92:0/2938380258 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f63ec06b430 0x7f63ec0c8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:04.037 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.026+0000 7f63eb7fe700 1 -- 172.21.15.92:0/2938380258 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e00094a0 con 0x7f63ec0ca1b0 2023-08-26T09:26:04.038 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.026+0000 7f63eb7fe700 1 --2- 172.21.15.92:0/2938380258 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63ec0ca1b0 0x7f63ec1f0500 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f63e00090b0 tx=0x7f63e0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:04.038 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.026+0000 7f63e8ff9700 1 -- 172.21.15.92:0/2938380258 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e0011630 con 0x7f63ec0ca1b0 2023-08-26T09:26:04.038 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.026+0000 7f63e8ff9700 1 -- 172.21.15.92:0/2938380258 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e001f070 con 0x7f63ec0ca1b0 2023-08-26T09:26:04.038 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.026+0000 7f63f241c700 1 -- 172.21.15.92:0/2938380258 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63ec0c8dd0 con 0x7f63ec0ca1b0 2023-08-26T09:26:04.038 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.026+0000 7f63e8ff9700 1 -- 172.21.15.92:0/2938380258 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e00119f0 con 0x7f63ec0ca1b0 2023-08-26T09:26:04.039 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.026+0000 7f63f241c700 1 -- 172.21.15.92:0/2938380258 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63ec0c9390 con 0x7f63ec0ca1b0 2023-08-26T09:26:04.039 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.027+0000 7f63f241c700 1 -- 172.21.15.92:0/2938380258 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63ec14d0e0 con 0x7f63ec0ca1b0 2023-08-26T09:26:04.039 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.028+0000 7f63e8ff9700 1 -- 172.21.15.92:0/2938380258 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f63e0011b50 con 0x7f63ec0ca1b0 2023-08-26T09:26:04.039 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.028+0000 7f63e8ff9700 1 --2- 172.21.15.92:0/2938380258 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f63d806a0e0 0x7f63d806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:04.039 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.028+0000 7f63e8ff9700 1 -- 172.21.15.92:0/2938380258 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f63e0021070 con 0x7f63ec0ca1b0 2023-08-26T09:26:04.039 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.028+0000 7f63ebfff700 1 --2- 172.21.15.92:0/2938380258 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f63d806a0e0 0x7f63d806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:04.040 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.028+0000 7f63ebfff700 1 --2- 172.21.15.92:0/2938380258 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f63d806a0e0 0x7f63d806c5a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f63dc001eb0 tx=0x7f63dc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:04.040 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.032+0000 7f63e8ff9700 1 -- 172.21.15.92:0/2938380258 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f63e0055710 con 0x7f63ec0ca1b0 2023-08-26T09:26:04.224 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.221+0000 7f63f241c700 1 -- 172.21.15.92:0/2938380258 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f63ec14d0e0 con 0x7f63ec0ca1b0 2023-08-26T09:26:04.225 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.221+0000 7f63e8ff9700 1 -- 172.21.15.92:0/2938380258 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f63ec14d0e0 con 0x7f63ec0ca1b0 2023-08-26T09:26:04.225 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 8 2023-08-26T09:26:04.227 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.223+0000 7f63f241c700 1 -- 172.21.15.92:0/2938380258 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f63d806a0e0 msgr2=0x7f63d806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:04.228 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.223+0000 7f63f241c700 1 --2- 172.21.15.92:0/2938380258 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f63d806a0e0 0x7f63d806c5a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f63dc001eb0 tx=0x7f63dc009040 comp rx=0 tx=0).stop 2023-08-26T09:26:04.228 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.223+0000 7f63f241c700 1 -- 172.21.15.92:0/2938380258 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63ec0ca1b0 msgr2=0x7f63ec1f0500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:04.228 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.223+0000 7f63f241c700 1 --2- 172.21.15.92:0/2938380258 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63ec0ca1b0 0x7f63ec1f0500 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f63e00090b0 tx=0x7f63e0004750 comp rx=0 tx=0).stop 2023-08-26T09:26:04.228 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.223+0000 7f63f241c700 1 -- 172.21.15.92:0/2938380258 shutdown_connections 2023-08-26T09:26:04.229 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.223+0000 7f63f241c700 1 --2- 172.21.15.92:0/2938380258 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f63d806a0e0 0x7f63d806c5a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:04.229 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.223+0000 7f63f241c700 1 --2- 172.21.15.92:0/2938380258 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f63ec06b430 0x7f63ec0c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:04.229 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.223+0000 7f63f241c700 1 --2- 172.21.15.92:0/2938380258 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f63ec15a550 0x7f63ec0c4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:04.229 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.223+0000 7f63f241c700 1 --2- 172.21.15.92:0/2938380258 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63ec0ca1b0 0x7f63ec1f0500 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:04.230 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.223+0000 7f63f241c700 1 -- 172.21.15.92:0/2938380258 >> 172.21.15.92:0/2938380258 conn(0x7f63ec0cf450 msgr2=0x7f63ec15a930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:04.230 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.223+0000 7f63f241c700 1 -- 172.21.15.92:0/2938380258 shutdown_connections 2023-08-26T09:26:04.230 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.223+0000 7f63f241c700 1 -- 172.21.15.92:0/2938380258 wait complete. 2023-08-26T09:26:04.239 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-26T09:26:04.363 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.359+0000 7fa2dfc91700 1 Processor -- start 2023-08-26T09:26:04.363 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.359+0000 7fa2dfc91700 1 -- start start 2023-08-26T09:26:04.365 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.360+0000 7fa2dfc91700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2d80af390 0x7fa2d8070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:04.366 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.360+0000 7fa2dfc91700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2d80aee50 con 0x7fa2d8071260 2023-08-26T09:26:04.366 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.360+0000 7fa2dfc91700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2d80af130 con 0x7fa2d815d220 2023-08-26T09:26:04.366 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.360+0000 7fa2dfc91700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d80c4cb0 con 0x7fa2d80af390 2023-08-26T09:26:04.366 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.360+0000 7fa2de22e700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fa2d8071260 0x7fa2d806a320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:58358/0 (socket says 172.21.15.92:58358) 2023-08-26T09:26:04.366 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.360+0000 7fa2de22e700 1 -- 172.21.15.92:0/4003044260 learned_addr learned my addr 172.21.15.92:0/4003044260 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:26:04.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.360+0000 7fa2dd22c700 1 --2- 172.21.15.92:0/4003044260 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2d80af390 0x7fa2d8070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:04.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.360+0000 7fa2dca2b700 1 -- 172.21.15.92:0/4003044260 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 598948642 0 0) 0x7fa2d80aee50 con 0x7fa2d8071260 2023-08-26T09:26:04.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.360+0000 7fa2dca2b700 1 -- 172.21.15.92:0/4003044260 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2c40035b0 con 0x7fa2d8071260 2023-08-26T09:26:04.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.360+0000 7fa2dca2b700 1 -- 172.21.15.92:0/4003044260 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1273303006 0 0) 0x7fa2d80af130 con 0x7fa2d815d220 2023-08-26T09:26:04.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.360+0000 7fa2dca2b700 1 -- 172.21.15.92:0/4003044260 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2d80aee50 con 0x7fa2d815d220 2023-08-26T09:26:04.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.361+0000 7fa2dd22c700 1 -- 172.21.15.92:0/4003044260 >> v1:172.21.15.188:6789/0 conn(0x7fa2d815d220 legacy=0x7fa2d806db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:04.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.361+0000 7fa2dca2b700 1 -- 172.21.15.92:0/4003044260 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2158269741 0 0) 0x7fa2c40035b0 con 0x7fa2d8071260 2023-08-26T09:26:04.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.361+0000 7fa2dd22c700 1 -- 172.21.15.92:0/4003044260 >> v1:172.21.15.92:6789/0 conn(0x7fa2d8071260 legacy=0x7fa2d806a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:04.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.361+0000 7fa2dd22c700 1 -- 172.21.15.92:0/4003044260 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d80c4f90 con 0x7fa2d80af390 2023-08-26T09:26:04.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.361+0000 7fa2dd22c700 1 --2- 172.21.15.92:0/4003044260 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2d80af390 0x7fa2d8070d20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa2d4009870 tx=0x7fa2d4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a37c8ba1fd9df25 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:04.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.361+0000 7fa2dca2b700 1 -- 172.21.15.92:0/4003044260 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d00019f0 con 0x7fa2d80af390 2023-08-26T09:26:04.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.361+0000 7fa2dca2b700 1 -- 172.21.15.92:0/4003044260 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d4004030 con 0x7fa2d80af390 2023-08-26T09:26:04.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.361+0000 7fa2dca2b700 1 -- 172.21.15.92:0/4003044260 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d40043c0 con 0x7fa2d80af390 2023-08-26T09:26:04.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.361+0000 7fa2dfc91700 1 -- 172.21.15.92:0/4003044260 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2d80af390 msgr2=0x7fa2d8070d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:04.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.361+0000 7fa2dfc91700 1 --2- 172.21.15.92:0/4003044260 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2d80af390 0x7fa2d8070d20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa2d4009870 tx=0x7fa2d4009b80 comp rx=0 tx=0).stop 2023-08-26T09:26:04.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.362+0000 7fa2dfc91700 1 -- 172.21.15.92:0/4003044260 shutdown_connections 2023-08-26T09:26:04.370 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.362+0000 7fa2dfc91700 1 --2- 172.21.15.92:0/4003044260 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2d80af390 0x7fa2d8070d20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:04.370 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.362+0000 7fa2dfc91700 1 -- 172.21.15.92:0/4003044260 >> 172.21.15.92:0/4003044260 conn(0x7fa2d806b430 msgr2=0x7fa2d806b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:04.370 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.362+0000 7fa2dfc91700 1 -- 172.21.15.92:0/4003044260 shutdown_connections 2023-08-26T09:26:04.370 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.362+0000 7fa2dfc91700 1 -- 172.21.15.92:0/4003044260 wait complete. 2023-08-26T09:26:04.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.363+0000 7fa2dfc91700 1 Processor -- start 2023-08-26T09:26:04.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.363+0000 7fa2dfc91700 1 -- start start 2023-08-26T09:26:04.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.363+0000 7fa2dfc91700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2d8071260 0x7fa2d8157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:04.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.363+0000 7fa2dfc91700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2d80af390 0x7fa2d81539b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:04.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.363+0000 7fa2dfc91700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa2d815d220 0x7fa2d815bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:04.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.363+0000 7fa2dfc91700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d81577d0 con 0x7fa2d8071260 2023-08-26T09:26:04.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.363+0000 7fa2dfc91700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d81f3810 con 0x7fa2d815d220 2023-08-26T09:26:04.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.364+0000 7fa2dfc91700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d81f2c90 con 0x7fa2d80af390 2023-08-26T09:26:04.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.364+0000 7fa2dda2d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2d8071260 0x7fa2d8157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:04.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.364+0000 7fa2dda2d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2d8071260 0x7fa2d8157290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46348/0 (socket says 172.21.15.92:46348) 2023-08-26T09:26:04.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.364+0000 7fa2dda2d700 1 -- 172.21.15.92:0/1655741020 learned_addr learned my addr 172.21.15.92:0/1655741020 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:04.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.364+0000 7fa2de22e700 1 --2- 172.21.15.92:0/1655741020 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa2d815d220 0x7fa2d815bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:04.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.364+0000 7fa2dd22c700 1 --2- 172.21.15.92:0/1655741020 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2d80af390 0x7fa2d81539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:04.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.364+0000 7fa2dda2d700 1 -- 172.21.15.92:0/1655741020 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2d80af390 msgr2=0x7fa2d81539b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:04.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.364+0000 7fa2dda2d700 1 --2- 172.21.15.92:0/1655741020 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2d80af390 0x7fa2d81539b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:04.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.364+0000 7fa2dda2d700 1 -- 172.21.15.92:0/1655741020 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa2d815d220 msgr2=0x7fa2d815bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:04.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.364+0000 7fa2dda2d700 1 --2- 172.21.15.92:0/1655741020 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa2d815d220 0x7fa2d815bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:04.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.364+0000 7fa2dda2d700 1 -- 172.21.15.92:0/1655741020 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d40094a0 con 0x7fa2d8071260 2023-08-26T09:26:04.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.364+0000 7fa2dd22c700 1 --2- 172.21.15.92:0/1655741020 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2d80af390 0x7fa2d81539b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:26:04.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.364+0000 7fa2dda2d700 1 --2- 172.21.15.92:0/1655741020 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2d8071260 0x7fa2d8157290 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa2c800c500 tx=0x7fa2c800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:04.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.364+0000 7fa2ce7fc700 1 -- 172.21.15.92:0/1655741020 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c80052d0 con 0x7fa2d8071260 2023-08-26T09:26:04.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.364+0000 7fa2ce7fc700 1 -- 172.21.15.92:0/1655741020 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c8005450 con 0x7fa2d8071260 2023-08-26T09:26:04.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.364+0000 7fa2dfc91700 1 -- 172.21.15.92:0/1655741020 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2d81f2f70 con 0x7fa2d8071260 2023-08-26T09:26:04.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.364+0000 7fa2ce7fc700 1 -- 172.21.15.92:0/1655741020 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c80038c0 con 0x7fa2d8071260 2023-08-26T09:26:04.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.364+0000 7fa2dfc91700 1 -- 172.21.15.92:0/1655741020 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2d81f3530 con 0x7fa2d8071260 2023-08-26T09:26:04.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.365+0000 7fa2dfc91700 1 -- 172.21.15.92:0/1655741020 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2d80cfbc0 con 0x7fa2d8071260 2023-08-26T09:26:04.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.366+0000 7fa2ce7fc700 1 -- 172.21.15.92:0/1655741020 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa2c8003a20 con 0x7fa2d8071260 2023-08-26T09:26:04.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.366+0000 7fa2ce7fc700 1 --2- 172.21.15.92:0/1655741020 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa2bc06a0e0 0x7fa2bc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:04.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.366+0000 7fa2ce7fc700 1 -- 172.21.15.92:0/1655741020 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa2c80879c0 con 0x7fa2d8071260 2023-08-26T09:26:04.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.366+0000 7fa2dd22c700 1 --2- 172.21.15.92:0/1655741020 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa2bc06a0e0 0x7fa2bc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:04.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.366+0000 7fa2dd22c700 1 --2- 172.21.15.92:0/1655741020 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa2bc06a0e0 0x7fa2bc06c5a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa2d8160780 tx=0x7fa2d4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:04.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.370+0000 7fa2ce7fc700 1 -- 172.21.15.92:0/1655741020 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa2c8053100 con 0x7fa2d8071260 2023-08-26T09:26:04.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.561+0000 7fa2dfc91700 1 -- 172.21.15.92:0/1655741020 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa2d804eeb0 con 0x7fa2d8071260 2023-08-26T09:26:04.565 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.561+0000 7fa2ce7fc700 1 -- 172.21.15.92:0/1655741020 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa2c8017020 con 0x7fa2d8071260 2023-08-26T09:26:04.565 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 1 2023-08-26T09:26:04.567 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.563+0000 7fa2dfc91700 1 -- 172.21.15.92:0/1655741020 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa2bc06a0e0 msgr2=0x7fa2bc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:04.567 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.563+0000 7fa2dfc91700 1 --2- 172.21.15.92:0/1655741020 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa2bc06a0e0 0x7fa2bc06c5a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa2d8160780 tx=0x7fa2d4008030 comp rx=0 tx=0).stop 2023-08-26T09:26:04.568 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.563+0000 7fa2dfc91700 1 -- 172.21.15.92:0/1655741020 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2d8071260 msgr2=0x7fa2d8157290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:04.568 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.563+0000 7fa2dfc91700 1 --2- 172.21.15.92:0/1655741020 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2d8071260 0x7fa2d8157290 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa2c800c500 tx=0x7fa2c800c8c0 comp rx=0 tx=0).stop 2023-08-26T09:26:04.568 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.563+0000 7fa2dfc91700 1 -- 172.21.15.92:0/1655741020 shutdown_connections 2023-08-26T09:26:04.568 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.563+0000 7fa2dfc91700 1 --2- 172.21.15.92:0/1655741020 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa2bc06a0e0 0x7fa2bc06c5a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:04.568 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.563+0000 7fa2dfc91700 1 --2- 172.21.15.92:0/1655741020 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa2d815d220 0x7fa2d815bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:04.569 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.563+0000 7fa2dfc91700 1 --2- 172.21.15.92:0/1655741020 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2d8071260 0x7fa2d8157290 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:04.569 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.563+0000 7fa2dfc91700 1 --2- 172.21.15.92:0/1655741020 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2d80af390 0x7fa2d81539b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:04.569 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.563+0000 7fa2dfc91700 1 -- 172.21.15.92:0/1655741020 >> 172.21.15.92:0/1655741020 conn(0x7fa2d806b430 msgr2=0x7fa2d80b0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:04.569 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.563+0000 7fa2dfc91700 1 -- 172.21.15.92:0/1655741020 shutdown_connections 2023-08-26T09:26:04.569 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.563+0000 7fa2dfc91700 1 -- 172.21.15.92:0/1655741020 wait complete. 2023-08-26T09:26:04.579 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-26T09:26:04.702 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.698+0000 7f338d929700 1 Processor -- start 2023-08-26T09:26:04.702 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.698+0000 7f338d929700 1 -- start start 2023-08-26T09:26:04.704 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.699+0000 7f338d929700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f338815d220 0x7f33880af390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:04.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.699+0000 7f338d929700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f338806db70 0x7f3388070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:04.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.699+0000 7f338d929700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33880aee50 con 0x7f3388071260 2023-08-26T09:26:04.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.699+0000 7f338d929700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33880af130 con 0x7f338815d220 2023-08-26T09:26:04.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.699+0000 7f338d929700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33880c4cb0 con 0x7f338806db70 2023-08-26T09:26:04.706 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.699+0000 7f3386ffd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f338815d220 0x7f33880af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:04.706 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.699+0000 7f3386ffd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f338815d220 0x7f33880af390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46356/0 (socket says 172.21.15.92:46356) 2023-08-26T09:26:04.706 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.699+0000 7f3386ffd700 1 -- 172.21.15.92:0/2423111587 learned_addr learned my addr 172.21.15.92:0/2423111587 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:04.706 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.700+0000 7f3386ffd700 1 -- 172.21.15.92:0/2423111587 >> v2:172.21.15.188:3300/0 conn(0x7f338806db70 msgr2=0x7f3388070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:04.707 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.700+0000 7f33867fc700 1 --2- 172.21.15.92:0/2423111587 >> v2:172.21.15.188:3300/0 conn(0x7f338806db70 0x7f3388070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:04.707 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.700+0000 7f3386ffd700 1 --2- 172.21.15.92:0/2423111587 >> v2:172.21.15.188:3300/0 conn(0x7f338806db70 0x7f3388070d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:04.707 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.700+0000 7f3386ffd700 1 -- 172.21.15.92:0/2423111587 >> v1:172.21.15.188:6789/0 conn(0x7f3388071260 legacy=0x7f3388160d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:04.707 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.700+0000 7f3386ffd700 1 -- 172.21.15.92:0/2423111587 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33880c4f90 con 0x7f338815d220 2023-08-26T09:26:04.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.700+0000 7f3386ffd700 1 --2- 172.21.15.92:0/2423111587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f338815d220 0x7f33880af390 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3388072240 tx=0x7f337c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93fc1d9dca0acd03 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:04.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.700+0000 7f3385ffb700 1 -- 172.21.15.92:0/2423111587 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337c004230 con 0x7f338815d220 2023-08-26T09:26:04.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.700+0000 7f3385ffb700 1 -- 172.21.15.92:0/2423111587 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f337c004390 con 0x7f338815d220 2023-08-26T09:26:04.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.700+0000 7f3385ffb700 1 -- 172.21.15.92:0/2423111587 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337c0036a0 con 0x7f338815d220 2023-08-26T09:26:04.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.700+0000 7f338d929700 1 -- 172.21.15.92:0/2423111587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f338815d220 msgr2=0x7f33880af390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:04.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.700+0000 7f338d929700 1 --2- 172.21.15.92:0/2423111587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f338815d220 0x7f33880af390 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3388072240 tx=0x7f337c009bd0 comp rx=0 tx=0).stop 2023-08-26T09:26:04.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.700+0000 7f338d929700 1 -- 172.21.15.92:0/2423111587 shutdown_connections 2023-08-26T09:26:04.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.700+0000 7f338d929700 1 --2- 172.21.15.92:0/2423111587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f338815d220 0x7f33880af390 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:04.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.700+0000 7f338d929700 1 --2- 172.21.15.92:0/2423111587 >> v2:172.21.15.188:3300/0 conn(0x7f338806db70 0x7f3388070d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:04.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.700+0000 7f338d929700 1 -- 172.21.15.92:0/2423111587 >> 172.21.15.92:0/2423111587 conn(0x7f338806b430 msgr2=0x7f338806b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:04.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.700+0000 7f338d929700 1 -- 172.21.15.92:0/2423111587 shutdown_connections 2023-08-26T09:26:04.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.700+0000 7f338d929700 1 -- 172.21.15.92:0/2423111587 wait complete. 2023-08-26T09:26:04.714 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.702+0000 7f338d929700 1 Processor -- start 2023-08-26T09:26:04.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.702+0000 7f338d929700 1 -- start start 2023-08-26T09:26:04.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.702+0000 7f338d929700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f338806db70 0x7f338814cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:04.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.703+0000 7f338d929700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3388071260 0x7f33880b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:04.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.703+0000 7f338d929700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f338815d220 0x7f33880adcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:04.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.703+0000 7f338d929700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338815b180 con 0x7f3388071260 2023-08-26T09:26:04.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.703+0000 7f338d929700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338815a600 con 0x7f338806db70 2023-08-26T09:26:04.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.703+0000 7f338d929700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f338815a8e0 con 0x7f338815d220 2023-08-26T09:26:04.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.703+0000 7f33867fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3388071260 0x7f33880b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:04.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.703+0000 7f33867fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3388071260 0x7f33880b1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46364/0 (socket says 172.21.15.92:46364) 2023-08-26T09:26:04.717 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.703+0000 7f33867fc700 1 -- 172.21.15.92:0/1929390892 learned_addr learned my addr 172.21.15.92:0/1929390892 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:04.717 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.703+0000 7f3386ffd700 1 --2- 172.21.15.92:0/1929390892 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f338806db70 0x7f338814cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:04.717 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.703+0000 7f33877fe700 1 --2- 172.21.15.92:0/1929390892 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f338815d220 0x7f33880adcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:04.717 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.703+0000 7f33867fc700 1 -- 172.21.15.92:0/1929390892 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f338815d220 msgr2=0x7f33880adcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:04.718 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.703+0000 7f33867fc700 1 --2- 172.21.15.92:0/1929390892 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f338815d220 0x7f33880adcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:04.718 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.703+0000 7f33867fc700 1 -- 172.21.15.92:0/1929390892 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f338806db70 msgr2=0x7f338814cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:04.718 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.703+0000 7f33867fc700 1 --2- 172.21.15.92:0/1929390892 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f338806db70 0x7f338814cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:04.718 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.703+0000 7f33867fc700 1 -- 172.21.15.92:0/1929390892 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f337c009550 con 0x7f3388071260 2023-08-26T09:26:04.718 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.703+0000 7f33867fc700 1 --2- 172.21.15.92:0/1929390892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3388071260 0x7f33880b1e30 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f337800c7f0 tx=0x7f337800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:04.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.703+0000 7f336ffff700 1 -- 172.21.15.92:0/1929390892 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3378011800 con 0x7f3388071260 2023-08-26T09:26:04.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.703+0000 7f336ffff700 1 -- 172.21.15.92:0/1929390892 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3378011960 con 0x7f3388071260 2023-08-26T09:26:04.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.703+0000 7f338d929700 1 -- 172.21.15.92:0/1929390892 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f338815abc0 con 0x7f3388071260 2023-08-26T09:26:04.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.703+0000 7f336ffff700 1 -- 172.21.15.92:0/1929390892 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3378011cf0 con 0x7f3388071260 2023-08-26T09:26:04.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.703+0000 7f338d929700 1 -- 172.21.15.92:0/1929390892 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33880b2370 con 0x7f3388071260 2023-08-26T09:26:04.720 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.704+0000 7f338d929700 1 -- 172.21.15.92:0/1929390892 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33880b3a50 con 0x7f3388071260 2023-08-26T09:26:04.720 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.705+0000 7f336ffff700 1 -- 172.21.15.92:0/1929390892 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3378018360 con 0x7f3388071260 2023-08-26T09:26:04.720 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.705+0000 7f336ffff700 1 --2- 172.21.15.92:0/1929390892 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f337406a0e0 0x7f337406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:04.721 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.705+0000 7f336ffff700 1 -- 172.21.15.92:0/1929390892 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f33780885d0 con 0x7f3388071260 2023-08-26T09:26:04.721 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.705+0000 7f3386ffd700 1 --2- 172.21.15.92:0/1929390892 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f337406a0e0 0x7f337406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:04.721 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.706+0000 7f3386ffd700 1 --2- 172.21.15.92:0/1929390892 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f337406a0e0 0x7f337406c5a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f337c009130 tx=0x7f337c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:04.721 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.709+0000 7f336ffff700 1 -- 172.21.15.92:0/1929390892 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f33880b3a50 con 0x7f3388071260 2023-08-26T09:26:04.901 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.897+0000 7f338d929700 1 -- 172.21.15.92:0/1929390892 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f33880b3a30 con 0x7f3388071260 2023-08-26T09:26:04.902 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.898+0000 7f336ffff700 1 -- 172.21.15.92:0/1929390892 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3378057720 con 0x7f3388071260 2023-08-26T09:26:04.902 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 32 2023-08-26T09:26:04.904 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.900+0000 7f338d929700 1 -- 172.21.15.92:0/1929390892 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f337406a0e0 msgr2=0x7f337406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:04.904 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.900+0000 7f338d929700 1 --2- 172.21.15.92:0/1929390892 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f337406a0e0 0x7f337406c5a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f337c009130 tx=0x7f337c008030 comp rx=0 tx=0).stop 2023-08-26T09:26:04.904 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.900+0000 7f338d929700 1 -- 172.21.15.92:0/1929390892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3388071260 msgr2=0x7f33880b1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:04.904 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.900+0000 7f338d929700 1 --2- 172.21.15.92:0/1929390892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3388071260 0x7f33880b1e30 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f337800c7f0 tx=0x7f337800cbb0 comp rx=0 tx=0).stop 2023-08-26T09:26:04.905 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.900+0000 7f338d929700 1 -- 172.21.15.92:0/1929390892 shutdown_connections 2023-08-26T09:26:04.905 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.900+0000 7f338d929700 1 --2- 172.21.15.92:0/1929390892 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f337406a0e0 0x7f337406c5a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:04.905 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.900+0000 7f338d929700 1 --2- 172.21.15.92:0/1929390892 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f338806db70 0x7f338814cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:04.905 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.900+0000 7f338d929700 1 --2- 172.21.15.92:0/1929390892 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f338815d220 0x7f33880adcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:04.905 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.900+0000 7f338d929700 1 --2- 172.21.15.92:0/1929390892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3388071260 0x7f33880b1e30 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:04.906 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.900+0000 7f338d929700 1 -- 172.21.15.92:0/1929390892 >> 172.21.15.92:0/1929390892 conn(0x7f338806b430 msgr2=0x7f3388154900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:04.906 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.900+0000 7f338d929700 1 -- 172.21.15.92:0/1929390892 shutdown_connections 2023-08-26T09:26:04.906 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:04.900+0000 7f338d929700 1 -- 172.21.15.92:0/1929390892 wait complete. 2023-08-26T09:26:04.916 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-26T09:26:05.039 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.035+0000 7fa2dea38700 1 Processor -- start 2023-08-26T09:26:05.039 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.035+0000 7fa2dea38700 1 -- start start 2023-08-26T09:26:05.042 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.036+0000 7fa2dea38700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2d80af390 0x7fa2d8070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:05.043 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.036+0000 7fa2dea38700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2d80aee50 con 0x7fa2d815d220 2023-08-26T09:26:05.043 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.036+0000 7fa2dea38700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2d80af130 con 0x7fa2d8071260 2023-08-26T09:26:05.043 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.036+0000 7fa2dea38700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d80c4cb0 con 0x7fa2d80af390 2023-08-26T09:26:05.043 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.036+0000 7fa2d7fff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fa2d815d220 0x7fa2d806db70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:58384/0 (socket says 172.21.15.92:58384) 2023-08-26T09:26:05.044 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.036+0000 7fa2d7fff700 1 -- 172.21.15.92:0/3686713200 learned_addr learned my addr 172.21.15.92:0/3686713200 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:26:05.044 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.037+0000 7fa2d6ffd700 1 -- 172.21.15.92:0/3686713200 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2303104956 0 0) 0x7fa2d80aee50 con 0x7fa2d815d220 2023-08-26T09:26:05.044 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.037+0000 7fa2d77fe700 1 --2- 172.21.15.92:0/3686713200 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2d80af390 0x7fa2d8070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:05.044 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.037+0000 7fa2d6ffd700 1 -- 172.21.15.92:0/3686713200 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2c00035b0 con 0x7fa2d815d220 2023-08-26T09:26:05.044 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.037+0000 7fa2d6ffd700 1 -- 172.21.15.92:0/3686713200 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2718989894 0 0) 0x7fa2c00035b0 con 0x7fa2d815d220 2023-08-26T09:26:05.045 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.037+0000 7fa2d6ffd700 1 -- 172.21.15.92:0/3686713200 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2d80af390 msgr2=0x7fa2d8070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:05.045 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.037+0000 7fa2d6ffd700 1 --2- 172.21.15.92:0/3686713200 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2d80af390 0x7fa2d8070d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:05.045 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.037+0000 7fa2d6ffd700 1 -- 172.21.15.92:0/3686713200 >> v1:172.21.15.188:6789/0 conn(0x7fa2d8071260 legacy=0x7fa2d806a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:05.045 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.037+0000 7fa2d6ffd700 1 -- 172.21.15.92:0/3686713200 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d80c4f90 con 0x7fa2d815d220 2023-08-26T09:26:05.045 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.037+0000 7fa2d6ffd700 1 -- 172.21.15.92:0/3686713200 <== mon.0 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1019361464 0 0) 0x7fa2cc001670 con 0x7fa2d815d220 2023-08-26T09:26:05.046 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.037+0000 7fa2d6ffd700 1 -- 172.21.15.92:0/3686713200 >> v1:172.21.15.92:6789/0 conn(0x7fa2d815d220 legacy=0x7fa2d806db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:05.046 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.037+0000 7fa2d6ffd700 1 --2- 172.21.15.92:0/3686713200 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa2c0003a30 0x7fa2c0003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:05.046 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.037+0000 7fa2d6ffd700 1 --2- 172.21.15.92:0/3686713200 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2c0004850 0x7fa2c0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:05.046 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.037+0000 7fa2d6ffd700 1 --2- 172.21.15.92:0/3686713200 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2d80af390 0x7fa2c0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:05.046 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.037+0000 7fa2d6ffd700 1 -- 172.21.15.92:0/3686713200 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d80c4cb0 con 0x7fa2c0004850 2023-08-26T09:26:05.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.037+0000 7fa2d6ffd700 1 -- 172.21.15.92:0/3686713200 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c000bac0 con 0x7fa2c0003a30 2023-08-26T09:26:05.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.037+0000 7fa2d6ffd700 1 -- 172.21.15.92:0/3686713200 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c000bc80 con 0x7fa2d80af390 2023-08-26T09:26:05.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.037+0000 7fa2d77fe700 1 --2- 172.21.15.92:0/3686713200 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2c0004850 0x7fa2c0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:05.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.037+0000 7fa2d7fff700 1 --2- 172.21.15.92:0/3686713200 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa2c0003a30 0x7fa2c0003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:05.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.037+0000 7fa2dcfd5700 1 --2- 172.21.15.92:0/3686713200 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2d80af390 0x7fa2c0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:05.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.037+0000 7fa2d77fe700 1 -- 172.21.15.92:0/3686713200 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2d80af390 msgr2=0x7fa2c0005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:05.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.037+0000 7fa2d77fe700 1 --2- 172.21.15.92:0/3686713200 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2d80af390 0x7fa2c0005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:05.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.037+0000 7fa2d77fe700 1 -- 172.21.15.92:0/3686713200 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa2c0003a30 msgr2=0x7fa2c0003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:05.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.037+0000 7fa2d77fe700 1 --2- 172.21.15.92:0/3686713200 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa2c0003a30 0x7fa2c0003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:05.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.037+0000 7fa2d77fe700 1 -- 172.21.15.92:0/3686713200 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c00035b0 con 0x7fa2c0004850 2023-08-26T09:26:05.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.038+0000 7fa2d77fe700 1 --2- 172.21.15.92:0/3686713200 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2c0004850 0x7fa2c0004cd0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8009b30 tx=0x7fa2c0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcc3150264282fa1 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:05.049 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.038+0000 7fa2d6ffd700 1 -- 172.21.15.92:0/3686713200 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c800e6c0 con 0x7fa2c0004850 2023-08-26T09:26:05.049 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.038+0000 7fa2d6ffd700 1 -- 172.21.15.92:0/3686713200 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c800e820 con 0x7fa2c0004850 2023-08-26T09:26:05.049 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.038+0000 7fa2d6ffd700 1 -- 172.21.15.92:0/3686713200 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c800eb90 con 0x7fa2c0004850 2023-08-26T09:26:05.049 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.038+0000 7fa2dea38700 1 -- 172.21.15.92:0/3686713200 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2c0004850 msgr2=0x7fa2c0004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:05.049 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.038+0000 7fa2dea38700 1 --2- 172.21.15.92:0/3686713200 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2c0004850 0x7fa2c0004cd0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8009b30 tx=0x7fa2c0005880 comp rx=0 tx=0).stop 2023-08-26T09:26:05.050 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.038+0000 7fa2dcfd5700 1 -- 172.21.15.92:0/3686713200 reap_dead start 2023-08-26T09:26:05.050 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.038+0000 7fa2dea38700 1 -- 172.21.15.92:0/3686713200 shutdown_connections 2023-08-26T09:26:05.050 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.038+0000 7fa2dea38700 1 -- 172.21.15.92:0/3686713200 >> 172.21.15.92:0/3686713200 conn(0x7fa2d806b430 msgr2=0x7fa2d806b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:05.050 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.038+0000 7fa2dea38700 1 -- 172.21.15.92:0/3686713200 shutdown_connections 2023-08-26T09:26:05.050 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.038+0000 7fa2dea38700 1 -- 172.21.15.92:0/3686713200 wait complete. 2023-08-26T09:26:05.053 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.040+0000 7fa2dea38700 1 Processor -- start 2023-08-26T09:26:05.053 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.040+0000 7fa2dea38700 1 -- start start 2023-08-26T09:26:05.054 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.040+0000 7fa2dea38700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2c0004850 0x7fa2d8144a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:05.054 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.040+0000 7fa2dea38700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2d81609c0 0x7fa2d8160e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:05.054 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.040+0000 7fa2dea38700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa2d815d8d0 0x7fa2d815dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:05.054 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.040+0000 7fa2dea38700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d8161380 con 0x7fa2d81609c0 2023-08-26T09:26:05.055 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.040+0000 7fa2dea38700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d8156aa0 con 0x7fa2d815d8d0 2023-08-26T09:26:05.055 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.040+0000 7fa2dea38700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d8144f50 con 0x7fa2c0004850 2023-08-26T09:26:05.055 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.041+0000 7fa2d77fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2d81609c0 0x7fa2d8160e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:05.055 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.041+0000 7fa2d77fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2d81609c0 0x7fa2d8160e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46384/0 (socket says 172.21.15.92:46384) 2023-08-26T09:26:05.056 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.041+0000 7fa2d77fe700 1 -- 172.21.15.92:0/207610981 learned_addr learned my addr 172.21.15.92:0/207610981 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:05.056 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.041+0000 7fa2dcfd5700 1 --2- 172.21.15.92:0/207610981 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa2d815d8d0 0x7fa2d815dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:05.056 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.041+0000 7fa2d7fff700 1 --2- 172.21.15.92:0/207610981 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2c0004850 0x7fa2d8144a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:05.056 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.041+0000 7fa2d77fe700 1 -- 172.21.15.92:0/207610981 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2c0004850 msgr2=0x7fa2d8144a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:05.057 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.041+0000 7fa2d77fe700 1 --2- 172.21.15.92:0/207610981 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2c0004850 0x7fa2d8144a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:05.057 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.041+0000 7fa2d77fe700 1 -- 172.21.15.92:0/207610981 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa2d815d8d0 msgr2=0x7fa2d815dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:05.057 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.041+0000 7fa2d77fe700 1 --2- 172.21.15.92:0/207610981 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa2d815d8d0 0x7fa2d815dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:05.058 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.041+0000 7fa2d77fe700 1 -- 172.21.15.92:0/207610981 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d815eee0 con 0x7fa2d81609c0 2023-08-26T09:26:05.058 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.041+0000 7fa2dcfd5700 1 --2- 172.21.15.92:0/207610981 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa2d815d8d0 0x7fa2d815dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:26:05.058 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.041+0000 7fa2d77fe700 1 --2- 172.21.15.92:0/207610981 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2d81609c0 0x7fa2d8160e40 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa2c00047b0 tx=0x7fa2c80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:05.058 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.041+0000 7fa2d4ff9700 1 -- 172.21.15.92:0/207610981 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c800e6c0 con 0x7fa2d81609c0 2023-08-26T09:26:05.058 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.041+0000 7fa2d4ff9700 1 -- 172.21.15.92:0/207610981 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c8003ad0 con 0x7fa2d81609c0 2023-08-26T09:26:05.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.041+0000 7fa2dea38700 1 -- 172.21.15.92:0/207610981 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2d815e640 con 0x7fa2d81609c0 2023-08-26T09:26:05.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.041+0000 7fa2d4ff9700 1 -- 172.21.15.92:0/207610981 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c80045d0 con 0x7fa2d81609c0 2023-08-26T09:26:05.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.041+0000 7fa2dea38700 1 -- 172.21.15.92:0/207610981 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2d815ec00 con 0x7fa2d81609c0 2023-08-26T09:26:05.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.042+0000 7fa2dea38700 1 -- 172.21.15.92:0/207610981 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2d80cfbc0 con 0x7fa2d81609c0 2023-08-26T09:26:05.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.043+0000 7fa2d4ff9700 1 -- 172.21.15.92:0/207610981 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa2c8013470 con 0x7fa2d81609c0 2023-08-26T09:26:05.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.043+0000 7fa2d4ff9700 1 --2- 172.21.15.92:0/207610981 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa2c406a0e0 0x7fa2c406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:05.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.043+0000 7fa2d4ff9700 1 -- 172.21.15.92:0/207610981 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa2c8089dd0 con 0x7fa2d81609c0 2023-08-26T09:26:05.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.043+0000 7fa2d7fff700 1 --2- 172.21.15.92:0/207610981 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa2c406a0e0 0x7fa2c406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:05.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.043+0000 7fa2d7fff700 1 --2- 172.21.15.92:0/207610981 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa2c406a0e0 0x7fa2c406c5a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc001550 tx=0x7fa2cc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:05.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.047+0000 7fa2d4ff9700 1 -- 172.21.15.92:0/207610981 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa2c8055630 con 0x7fa2d81609c0 2023-08-26T09:26:05.242 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.239+0000 7fa2dea38700 1 -- 172.21.15.92:0/207610981 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa2d804eeb0 con 0x7fa2d81609c0 2023-08-26T09:26:05.243 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.239+0000 7fa2d4ff9700 1 -- 172.21.15.92:0/207610981 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa2c8058c50 con 0x7fa2d81609c0 2023-08-26T09:26:05.243 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 64 2023-08-26T09:26:05.245 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.241+0000 7fa2dea38700 1 -- 172.21.15.92:0/207610981 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa2c406a0e0 msgr2=0x7fa2c406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:05.245 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.241+0000 7fa2dea38700 1 --2- 172.21.15.92:0/207610981 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa2c406a0e0 0x7fa2c406c5a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc001550 tx=0x7fa2cc009040 comp rx=0 tx=0).stop 2023-08-26T09:26:05.245 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.241+0000 7fa2dea38700 1 -- 172.21.15.92:0/207610981 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2d81609c0 msgr2=0x7fa2d8160e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:05.246 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.241+0000 7fa2dea38700 1 --2- 172.21.15.92:0/207610981 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2d81609c0 0x7fa2d8160e40 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa2c00047b0 tx=0x7fa2c80047c0 comp rx=0 tx=0).stop 2023-08-26T09:26:05.246 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.241+0000 7fa2dea38700 1 -- 172.21.15.92:0/207610981 shutdown_connections 2023-08-26T09:26:05.246 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.241+0000 7fa2dea38700 1 --2- 172.21.15.92:0/207610981 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa2c406a0e0 0x7fa2c406c5a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:05.246 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.241+0000 7fa2dea38700 1 --2- 172.21.15.92:0/207610981 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa2d815d8d0 0x7fa2d815dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:05.246 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.241+0000 7fa2dea38700 1 --2- 172.21.15.92:0/207610981 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2c0004850 0x7fa2d8144a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:05.246 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.241+0000 7fa2dea38700 1 --2- 172.21.15.92:0/207610981 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2d81609c0 0x7fa2d8160e40 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:05.247 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.241+0000 7fa2dea38700 1 -- 172.21.15.92:0/207610981 >> 172.21.15.92:0/207610981 conn(0x7fa2d806b430 msgr2=0x7fa2d806e590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:05.247 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.241+0000 7fa2dea38700 1 -- 172.21.15.92:0/207610981 shutdown_connections 2023-08-26T09:26:05.247 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.241+0000 7fa2dea38700 1 -- 172.21.15.92:0/207610981 wait complete. 2023-08-26T09:26:05.257 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-26T09:26:05.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.375+0000 7f6097a40700 1 Processor -- start 2023-08-26T09:26:05.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.375+0000 7f6097a40700 1 -- start start 2023-08-26T09:26:05.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.376+0000 7f6097a40700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f609006b450 0x7f609006de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:05.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.376+0000 7f6097a40700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f60900ae590 0x7f60900cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:05.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.376+0000 7f6097a40700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6090159c70 con 0x7f60900cb640 2023-08-26T09:26:05.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.376+0000 7f6097a40700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60900b0ef0 con 0x7f60900ae590 2023-08-26T09:26:05.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.376+0000 7f6097a40700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60900b11d0 con 0x7f609006b450 2023-08-26T09:26:05.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.376+0000 7f6095fdd700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f60900ae590 0x7f60900cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:05.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.376+0000 7f6094fdb700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f609006b450 0x7f609006de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:05.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.376+0000 7f6095fdd700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f60900ae590 0x7f60900cbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.92:35202/0 (socket says 172.21.15.92:35202) 2023-08-26T09:26:05.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.376+0000 7f6095fdd700 1 -- 172.21.15.92:0/1623575391 learned_addr learned my addr 172.21.15.92:0/1623575391 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:05.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.376+0000 7f6094fdb700 1 -- 172.21.15.92:0/1623575391 >> v2:172.21.15.188:3300/0 conn(0x7f60900ae590 msgr2=0x7f60900cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:05.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.376+0000 7f6094fdb700 1 --2- 172.21.15.92:0/1623575391 >> v2:172.21.15.188:3300/0 conn(0x7f60900ae590 0x7f60900cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:05.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.376+0000 7f6094fdb700 1 -- 172.21.15.92:0/1623575391 >> v1:172.21.15.188:6789/0 conn(0x7f60900cb640 legacy=0x7f609006ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:05.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.376+0000 7f6094fdb700 1 -- 172.21.15.92:0/1623575391 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60900b14b0 con 0x7f609006b450 2023-08-26T09:26:05.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.377+0000 7f6094fdb700 1 --2- 172.21.15.92:0/1623575391 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f609006b450 0x7f609006de40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6080009840 tx=0x7f6080009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44f480d88c9d5569 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:05.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.377+0000 7f6087fff700 1 -- 172.21.15.92:0/1623575391 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6080011830 con 0x7f609006b450 2023-08-26T09:26:05.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.377+0000 7f6087fff700 1 -- 172.21.15.92:0/1623575391 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6080011990 con 0x7f609006b450 2023-08-26T09:26:05.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.377+0000 7f6087fff700 1 -- 172.21.15.92:0/1623575391 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6080011d20 con 0x7f609006b450 2023-08-26T09:26:05.387 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.377+0000 7f6097a40700 1 -- 172.21.15.92:0/1623575391 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f609006b450 msgr2=0x7f609006de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:05.387 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.377+0000 7f6097a40700 1 --2- 172.21.15.92:0/1623575391 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f609006b450 0x7f609006de40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6080009840 tx=0x7f6080009b50 comp rx=0 tx=0).stop 2023-08-26T09:26:05.387 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.378+0000 7f6097a40700 1 -- 172.21.15.92:0/1623575391 shutdown_connections 2023-08-26T09:26:05.388 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.378+0000 7f6097a40700 1 --2- 172.21.15.92:0/1623575391 >> v2:172.21.15.188:3300/0 conn(0x7f60900ae590 0x7f60900cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:05.388 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.378+0000 7f6097a40700 1 --2- 172.21.15.92:0/1623575391 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f609006b450 0x7f609006de40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:05.388 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.378+0000 7f6097a40700 1 -- 172.21.15.92:0/1623575391 >> 172.21.15.92:0/1623575391 conn(0x7f60900b23c0 msgr2=0x7f60900b27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:05.388 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.378+0000 7f6097a40700 1 -- 172.21.15.92:0/1623575391 shutdown_connections 2023-08-26T09:26:05.388 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.378+0000 7f6097a40700 1 -- 172.21.15.92:0/1623575391 wait complete. 2023-08-26T09:26:05.389 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.379+0000 7f6097a40700 1 Processor -- start 2023-08-26T09:26:05.389 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.379+0000 7f6097a40700 1 -- start start 2023-08-26T09:26:05.389 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.380+0000 7f6097a40700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f609006b450 0x7f6090159350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:05.389 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.380+0000 7f6097a40700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f60900ae590 0x7f60900ad340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:05.389 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.380+0000 7f6097a40700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f60900cb640 0x7f60900987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:05.390 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.380+0000 7f6097a40700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60900ad9d0 con 0x7f60900ae590 2023-08-26T09:26:05.390 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.380+0000 7f6097a40700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60900c3000 con 0x7f609006b450 2023-08-26T09:26:05.390 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.380+0000 7f6097a40700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60900c32e0 con 0x7f60900cb640 2023-08-26T09:26:05.390 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.380+0000 7f6094fdb700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f60900ae590 0x7f60900ad340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:05.390 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.380+0000 7f6094fdb700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f60900ae590 0x7f60900ad340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46398/0 (socket says 172.21.15.92:46398) 2023-08-26T09:26:05.391 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.380+0000 7f6094fdb700 1 -- 172.21.15.92:0/2437919639 learned_addr learned my addr 172.21.15.92:0/2437919639 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:05.391 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.380+0000 7f6095fdd700 1 --2- 172.21.15.92:0/2437919639 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f60900cb640 0x7f60900987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:05.391 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.380+0000 7f60957dc700 1 --2- 172.21.15.92:0/2437919639 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f609006b450 0x7f6090159350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:05.391 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.381+0000 7f6094fdb700 1 -- 172.21.15.92:0/2437919639 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f60900cb640 msgr2=0x7f60900987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:05.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.381+0000 7f6094fdb700 1 --2- 172.21.15.92:0/2437919639 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f60900cb640 0x7f60900987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:05.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.381+0000 7f6094fdb700 1 -- 172.21.15.92:0/2437919639 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f609006b450 msgr2=0x7f6090159350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:05.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.381+0000 7f6094fdb700 1 --2- 172.21.15.92:0/2437919639 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f609006b450 0x7f6090159350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:05.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.381+0000 7f6094fdb700 1 -- 172.21.15.92:0/2437919639 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60800094a0 con 0x7f60900ae590 2023-08-26T09:26:05.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.381+0000 7f6094fdb700 1 --2- 172.21.15.92:0/2437919639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f60900ae590 0x7f60900ad340 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6080009fd0 tx=0x7f6080004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:05.393 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.381+0000 7f6085ffb700 1 -- 172.21.15.92:0/2437919639 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60800036a0 con 0x7f60900ae590 2023-08-26T09:26:05.393 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.381+0000 7f6085ffb700 1 -- 172.21.15.92:0/2437919639 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f608001f070 con 0x7f60900ae590 2023-08-26T09:26:05.393 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.381+0000 7f6097a40700 1 -- 172.21.15.92:0/2437919639 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60900c35c0 con 0x7f60900ae590 2023-08-26T09:26:05.393 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.381+0000 7f6085ffb700 1 -- 172.21.15.92:0/2437919639 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6080003a60 con 0x7f60900ae590 2023-08-26T09:26:05.393 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.381+0000 7f6097a40700 1 -- 172.21.15.92:0/2437919639 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60900cfd90 con 0x7f60900ae590 2023-08-26T09:26:05.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.382+0000 7f6097a40700 1 -- 172.21.15.92:0/2437919639 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60900c3ae0 con 0x7f60900ae590 2023-08-26T09:26:05.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.382+0000 7f6085ffb700 1 -- 172.21.15.92:0/2437919639 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6080003bc0 con 0x7f60900ae590 2023-08-26T09:26:05.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.383+0000 7f6085ffb700 1 --2- 172.21.15.92:0/2437919639 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f607406a0e0 0x7f607406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:05.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.383+0000 7f6085ffb700 1 -- 172.21.15.92:0/2437919639 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f6080021070 con 0x7f60900ae590 2023-08-26T09:26:05.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.383+0000 7f60957dc700 1 --2- 172.21.15.92:0/2437919639 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f607406a0e0 0x7f607406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:05.395 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.383+0000 7f60957dc700 1 --2- 172.21.15.92:0/2437919639 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f607406a0e0 0x7f607406c5a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f609006be10 tx=0x7f608c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:05.395 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.387+0000 7f6085ffb700 1 -- 172.21.15.92:0/2437919639 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f60800554a0 con 0x7f60900ae590 2023-08-26T09:26:05.599 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.595+0000 7f6097a40700 1 -- 172.21.15.92:0/2437919639 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f60900b1d20 con 0x7f60900ae590 2023-08-26T09:26:05.599 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.595+0000 7f6085ffb700 1 -- 172.21.15.92:0/2437919639 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6080015020 con 0x7f60900ae590 2023-08-26T09:26:05.601 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.597+0000 7f6097a40700 1 -- 172.21.15.92:0/2437919639 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f607406a0e0 msgr2=0x7f607406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:05.601 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.597+0000 7f6097a40700 1 --2- 172.21.15.92:0/2437919639 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f607406a0e0 0x7f607406c5a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f609006be10 tx=0x7f608c009040 comp rx=0 tx=0).stop 2023-08-26T09:26:05.601 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.597+0000 7f6097a40700 1 -- 172.21.15.92:0/2437919639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f60900ae590 msgr2=0x7f60900ad340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:05.602 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.597+0000 7f6097a40700 1 --2- 172.21.15.92:0/2437919639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f60900ae590 0x7f60900ad340 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6080009fd0 tx=0x7f6080004750 comp rx=0 tx=0).stop 2023-08-26T09:26:05.602 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.597+0000 7f6097a40700 1 -- 172.21.15.92:0/2437919639 shutdown_connections 2023-08-26T09:26:05.602 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.597+0000 7f6097a40700 1 --2- 172.21.15.92:0/2437919639 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f607406a0e0 0x7f607406c5a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:05.602 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.597+0000 7f6097a40700 1 --2- 172.21.15.92:0/2437919639 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f609006b450 0x7f6090159350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:05.602 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.597+0000 7f6097a40700 1 --2- 172.21.15.92:0/2437919639 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f60900cb640 0x7f60900987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:05.602 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.597+0000 7f6097a40700 1 --2- 172.21.15.92:0/2437919639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f60900ae590 0x7f60900ad340 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:05.603 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.597+0000 7f6097a40700 1 -- 172.21.15.92:0/2437919639 >> 172.21.15.92:0/2437919639 conn(0x7f60900b23c0 msgr2=0x7f609006a320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:05.603 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.597+0000 7f6097a40700 1 -- 172.21.15.92:0/2437919639 shutdown_connections 2023-08-26T09:26:05.603 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.597+0000 7f6097a40700 1 -- 172.21.15.92:0/2437919639 wait complete. 2023-08-26T09:26:05.603 INFO:teuthology.orchestra.run.smithi092.stderr:listed 0 entries 2023-08-26T09:26:05.613 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi188.front.sepia.ceph.com... 2023-08-26T09:26:05.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:26:05.614 DEBUG:teuthology.orchestra.run.smithi188:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-08-26T09:26:05.663 INFO:teuthology.orchestra.run:waiting for 300 2023-08-26T09:26:05.663 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi188.front.sepia.ceph.com 2023-08-26T09:26:05.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:26:05.664 DEBUG:teuthology.orchestra.run.smithi188:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-08-26T09:26:05.683 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-26T09:26:05.684 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-26T09:26:05.804 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.800+0000 7f4eb8a39700 1 Processor -- start 2023-08-26T09:26:05.805 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.800+0000 7f4eb8a39700 1 -- start start 2023-08-26T09:26:05.807 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.801+0000 7f4eb8a39700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f4eb40d1a60 0x7f4eb40c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:05.807 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.801+0000 7f4eb8a39700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4eb415eae0 0x7f4eb40cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:05.807 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.801+0000 7f4eb8a39700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4eb40cbb50 con 0x7f4eb40cd8e0 2023-08-26T09:26:05.807 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.801+0000 7f4eb8a39700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eb40cffb0 con 0x7f4eb40d1a60 2023-08-26T09:26:05.808 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.801+0000 7f4eb8a39700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb40cbe10 con 0x7f4eb415eae0 2023-08-26T09:26:05.808 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.802+0000 7f4eb2d9d700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4eb415eae0 0x7f4eb40cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:05.808 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.802+0000 7f4eb1d9b700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f4eb40d1a60 0x7f4eb40c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:05.808 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.802+0000 7f4eb259c700 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f4eb40cd8e0 0x7f4eb415e3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.92:53528/0 (socket says 172.21.15.92:53528) 2023-08-26T09:26:05.808 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.802+0000 7f4eb1d9b700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f4eb40d1a60 0x7f4eb40c4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.92:35214/0 (socket says 172.21.15.92:35214) 2023-08-26T09:26:05.809 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.802+0000 7f4eb2d9d700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4eb415eae0 0x7f4eb40cc2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.92:45070/0 (socket says 172.21.15.92:45070) 2023-08-26T09:26:05.809 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.802+0000 7f4eb259c700 1 -- 172.21.15.92:0/3995455164 learned_addr learned my addr 172.21.15.92:0/3995455164 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:26:05.809 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.802+0000 7f4eb2d9d700 1 -- 172.21.15.92:0/3995455164 >> v2:172.21.15.188:3300/0 conn(0x7f4eb40d1a60 msgr2=0x7f4eb40c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:05.809 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.802+0000 7f4eb2d9d700 1 --2- 172.21.15.92:0/3995455164 >> v2:172.21.15.188:3300/0 conn(0x7f4eb40d1a60 0x7f4eb40c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:05.809 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.802+0000 7f4eb2d9d700 1 -- 172.21.15.92:0/3995455164 >> v1:172.21.15.188:6789/0 conn(0x7f4eb40cd8e0 legacy=0x7f4eb415e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:05.810 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.802+0000 7f4eb2d9d700 1 -- 172.21.15.92:0/3995455164 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb40cf730 con 0x7f4eb415eae0 2023-08-26T09:26:05.810 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.802+0000 7f4eb159a700 1 -- 172.21.15.92:0/3995455164 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1712596984 0 0) 0x7f4eb40cbb50 con 0x7f4eb40cd8e0 2023-08-26T09:26:05.810 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.802+0000 7f4eb1d9b700 1 --2- 172.21.15.92:0/3995455164 >> v2:172.21.15.188:3300/0 conn(0x7f4eb40d1a60 0x7f4eb40c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-26T09:26:05.810 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.802+0000 7f4eb2d9d700 1 --2- 172.21.15.92:0/3995455164 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4eb415eae0 0x7f4eb40cc2a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4eac009d90 tx=0x7f4eac00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d4673eaa3b0399e server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:05.810 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.802+0000 7f4eb159a700 1 -- 172.21.15.92:0/3995455164 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eac00e070 con 0x7f4eb415eae0 2023-08-26T09:26:05.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.802+0000 7f4eb159a700 1 -- 172.21.15.92:0/3995455164 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eac00bb20 con 0x7f4eb415eae0 2023-08-26T09:26:05.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.802+0000 7f4eb159a700 1 -- 172.21.15.92:0/3995455164 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eac012430 con 0x7f4eb415eae0 2023-08-26T09:26:05.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.803+0000 7f4eb8a39700 1 -- 172.21.15.92:0/3995455164 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4eb415eae0 msgr2=0x7f4eb40cc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:05.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.803+0000 7f4eb8a39700 1 --2- 172.21.15.92:0/3995455164 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4eb415eae0 0x7f4eb40cc2a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4eac009d90 tx=0x7f4eac00b330 comp rx=0 tx=0).stop 2023-08-26T09:26:05.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.803+0000 7f4eb8a39700 1 -- 172.21.15.92:0/3995455164 shutdown_connections 2023-08-26T09:26:05.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.803+0000 7f4eb8a39700 1 --2- 172.21.15.92:0/3995455164 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4eb415eae0 0x7f4eb40cc2a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:05.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.803+0000 7f4eb8a39700 1 --2- 172.21.15.92:0/3995455164 >> v2:172.21.15.188:3300/0 conn(0x7f4eb40d1a60 0x7f4eb40c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:05.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.803+0000 7f4eb8a39700 1 -- 172.21.15.92:0/3995455164 >> 172.21.15.92:0/3995455164 conn(0x7f4eb40d0f40 msgr2=0x7f4eb40d1350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:05.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.803+0000 7f4eb8a39700 1 -- 172.21.15.92:0/3995455164 shutdown_connections 2023-08-26T09:26:05.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.803+0000 7f4eb8a39700 1 -- 172.21.15.92:0/3995455164 wait complete. 2023-08-26T09:26:05.815 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.804+0000 7f4eb8a39700 1 Processor -- start 2023-08-26T09:26:05.815 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.804+0000 7f4eb8a39700 1 -- start start 2023-08-26T09:26:05.815 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.805+0000 7f4eb8a39700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4eb40cd8e0 0x7f4eb406be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:05.815 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.805+0000 7f4eb8a39700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4eb40d1a60 0x7f4eb40c9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:05.816 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.805+0000 7f4eb8a39700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4eb415eae0 0x7f4eb40b52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:05.816 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.805+0000 7f4eb8a39700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb4152d30 con 0x7f4eb40cd8e0 2023-08-26T09:26:05.816 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.805+0000 7f4eb8a39700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb406c350 con 0x7f4eb40d1a60 2023-08-26T09:26:05.816 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.805+0000 7f4eb8a39700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb40c99b0 con 0x7f4eb415eae0 2023-08-26T09:26:05.816 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.805+0000 7f4eb259c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4eb40cd8e0 0x7f4eb406be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:05.816 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.805+0000 7f4eb259c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4eb40cd8e0 0x7f4eb406be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46410/0 (socket says 172.21.15.92:46410) 2023-08-26T09:26:05.817 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.805+0000 7f4eb259c700 1 -- 172.21.15.92:0/2000498739 learned_addr learned my addr 172.21.15.92:0/2000498739 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:05.817 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.805+0000 7f4eb1d9b700 1 --2- 172.21.15.92:0/2000498739 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4eb40d1a60 0x7f4eb40c9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:05.817 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.805+0000 7f4eb2d9d700 1 --2- 172.21.15.92:0/2000498739 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4eb415eae0 0x7f4eb40b52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:05.817 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.806+0000 7f4eb259c700 1 -- 172.21.15.92:0/2000498739 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4eb415eae0 msgr2=0x7f4eb40b52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:05.817 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.806+0000 7f4eb259c700 1 --2- 172.21.15.92:0/2000498739 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4eb415eae0 0x7f4eb40b52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:05.818 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.806+0000 7f4eb259c700 1 -- 172.21.15.92:0/2000498739 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4eb40d1a60 msgr2=0x7f4eb40c9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:05.818 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.806+0000 7f4eb259c700 1 --2- 172.21.15.92:0/2000498739 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4eb40d1a60 0x7f4eb40c9e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:05.818 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.806+0000 7f4eb259c700 1 -- 172.21.15.92:0/2000498739 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea40094a0 con 0x7f4eb40cd8e0 2023-08-26T09:26:05.818 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.806+0000 7f4eb259c700 1 --2- 172.21.15.92:0/2000498739 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4eb40cd8e0 0x7f4eb406be10 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f4ea800c4b0 tx=0x7f4ea800c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:05.818 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.806+0000 7f4ea2ffd700 1 -- 172.21.15.92:0/2000498739 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea8004cd0 con 0x7f4eb40cd8e0 2023-08-26T09:26:05.819 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.806+0000 7f4ea2ffd700 1 -- 172.21.15.92:0/2000498739 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea8004e50 con 0x7f4eb40cd8e0 2023-08-26T09:26:05.819 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.806+0000 7f4eb8a39700 1 -- 172.21.15.92:0/2000498739 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eac009a70 con 0x7f4eb40cd8e0 2023-08-26T09:26:05.819 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.806+0000 7f4ea2ffd700 1 -- 172.21.15.92:0/2000498739 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea8007310 con 0x7f4eb40cd8e0 2023-08-26T09:26:05.819 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.806+0000 7f4eb8a39700 1 -- 172.21.15.92:0/2000498739 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eb40c9360 con 0x7f4eb40cd8e0 2023-08-26T09:26:05.819 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.807+0000 7f4eb8a39700 1 -- 172.21.15.92:0/2000498739 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eb40c9c90 con 0x7f4eb40cd8e0 2023-08-26T09:26:05.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.807+0000 7f4ea2ffd700 1 -- 172.21.15.92:0/2000498739 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4ea8007470 con 0x7f4eb40cd8e0 2023-08-26T09:26:05.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.808+0000 7f4ea2ffd700 1 --2- 172.21.15.92:0/2000498739 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f4e9406a0e0 0x7f4e9406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:05.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.808+0000 7f4ea2ffd700 1 -- 172.21.15.92:0/2000498739 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f4ea80882c0 con 0x7f4eb40cd8e0 2023-08-26T09:26:05.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.808+0000 7f4eb1d9b700 1 --2- 172.21.15.92:0/2000498739 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f4e9406a0e0 0x7f4e9406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:05.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.808+0000 7f4eb1d9b700 1 --2- 172.21.15.92:0/2000498739 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f4e9406a0e0 0x7f4e9406c5a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4eb406d430 tx=0x7f4ea4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:05.821 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:05.812+0000 7f4ea2ffd700 1 -- 172.21.15.92:0/2000498739 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4ea8053970 con 0x7f4eb40cd8e0 2023-08-26T09:26:06.049 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.045+0000 7f4eb8a39700 1 -- 172.21.15.92:0/2000498739 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4eb404e660 con 0x7f4eb40cd8e0 2023-08-26T09:26:06.050 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.046+0000 7f4ea2ffd700 1 -- 172.21.15.92:0/2000498739 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4863 (secure 0 0 0) 0x7f4ea8056f90 con 0x7f4eb40cd8e0 2023-08-26T09:26:06.050 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:26:06.050 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/856608283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6833","nonce":856608283},{"type":"v1","addr":"172.21.15.188:6835","nonce":856608283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4279,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/33581841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":33581841},{"type":"v1","addr":"172.21.15.92:6837","nonce":33581841}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6834/279535547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":279535547},{"type":"v1","addr":"172.21.15.188:6834","nonce":279535547}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-26T09:25:13.851186+0000","modified":"2023-08-26T09:25:17.482682+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6835/2933877114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2933877114},{"type":"v1","addr":"172.21.15.92:6835","nonce":2933877114}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-26T09:26:06.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.048+0000 7f4eb8a39700 1 -- 172.21.15.92:0/2000498739 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f4e9406a0e0 msgr2=0x7f4e9406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:06.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.048+0000 7f4eb8a39700 1 --2- 172.21.15.92:0/2000498739 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f4e9406a0e0 0x7f4e9406c5a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4eb406d430 tx=0x7f4ea4008040 comp rx=0 tx=0).stop 2023-08-26T09:26:06.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.048+0000 7f4eb8a39700 1 -- 172.21.15.92:0/2000498739 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4eb40cd8e0 msgr2=0x7f4eb406be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:06.053 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.048+0000 7f4eb8a39700 1 --2- 172.21.15.92:0/2000498739 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4eb40cd8e0 0x7f4eb406be10 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f4ea800c4b0 tx=0x7f4ea800c870 comp rx=0 tx=0).stop 2023-08-26T09:26:06.053 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.048+0000 7f4eb8a39700 1 -- 172.21.15.92:0/2000498739 shutdown_connections 2023-08-26T09:26:06.053 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.048+0000 7f4eb8a39700 1 --2- 172.21.15.92:0/2000498739 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4eb415eae0 0x7f4eb40b52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:06.053 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.048+0000 7f4eb8a39700 1 --2- 172.21.15.92:0/2000498739 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4eb40cd8e0 0x7f4eb406be10 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:06.053 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.048+0000 7f4eb8a39700 1 --2- 172.21.15.92:0/2000498739 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f4e9406a0e0 0x7f4e9406c5a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:06.054 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.048+0000 7f4eb8a39700 1 --2- 172.21.15.92:0/2000498739 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4eb40d1a60 0x7f4eb40c9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:06.054 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.048+0000 7f4eb8a39700 1 -- 172.21.15.92:0/2000498739 >> 172.21.15.92:0/2000498739 conn(0x7f4eb40d0f40 msgr2=0x7f4eb40cc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:06.054 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.048+0000 7f4eb8a39700 1 -- 172.21.15.92:0/2000498739 shutdown_connections 2023-08-26T09:26:06.054 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.048+0000 7f4eb8a39700 1 -- 172.21.15.92:0/2000498739 wait complete. 2023-08-26T09:26:06.055 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 7 2023-08-26T09:26:06.064 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-26T09:26:06.184 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.181+0000 7f91f17d5700 1 Processor -- start 2023-08-26T09:26:06.185 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.181+0000 7f91f17d5700 1 -- start start 2023-08-26T09:26:06.187 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.181+0000 7f91f17d5700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f91ec15eaf0 0x7f91ec15eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:06.187 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.181+0000 7f91f17d5700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f91ec0c4270 0x7f91ec165e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:06.187 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.181+0000 7f91f17d5700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91ec0cfc10 con 0x7f91ec15f410 2023-08-26T09:26:06.187 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.181+0000 7f91f17d5700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91ec0caf00 con 0x7f91ec0c4270 2023-08-26T09:26:06.188 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.181+0000 7f91f17d5700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91ec0c9370 con 0x7f91ec15eaf0 2023-08-26T09:26:06.188 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.182+0000 7f91eaffd700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f91ec15eaf0 0x7f91ec15eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:06.188 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.182+0000 7f91eb7fe700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f91ec0c4270 0x7f91ec165e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:06.188 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.182+0000 7f91eaffd700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f91ec15eaf0 0x7f91ec15eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.92:45082/0 (socket says 172.21.15.92:45082) 2023-08-26T09:26:06.188 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.182+0000 7f91eaffd700 1 -- 172.21.15.92:0/62676960 learned_addr learned my addr 172.21.15.92:0/62676960 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:06.189 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.182+0000 7f91ea7fc700 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f91ec15f410 0x7f91ec0c3b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.92:53544/0 (socket says 172.21.15.92:53544) 2023-08-26T09:26:06.189 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.182+0000 7f91eaffd700 1 -- 172.21.15.92:0/62676960 >> v2:172.21.15.188:3300/0 conn(0x7f91ec0c4270 msgr2=0x7f91ec165e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:06.189 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.182+0000 7f91eaffd700 1 --2- 172.21.15.92:0/62676960 >> v2:172.21.15.188:3300/0 conn(0x7f91ec0c4270 0x7f91ec165e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:06.189 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.182+0000 7f91eaffd700 1 -- 172.21.15.92:0/62676960 >> v1:172.21.15.188:6789/0 conn(0x7f91ec15f410 legacy=0x7f91ec0c3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:06.189 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.182+0000 7f91eaffd700 1 -- 172.21.15.92:0/62676960 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91ec0cb1a0 con 0x7f91ec15eaf0 2023-08-26T09:26:06.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.182+0000 7f91eaffd700 1 --2- 172.21.15.92:0/62676960 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f91ec15eaf0 0x7f91ec15eed0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f91dc0098f0 tx=0x7f91dc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99b5a86363b00079 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:06.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.182+0000 7f91e9ffb700 1 -- 172.21.15.92:0/62676960 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91dc011830 con 0x7f91ec15eaf0 2023-08-26T09:26:06.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.182+0000 7f91e9ffb700 1 -- 172.21.15.92:0/62676960 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91dc011990 con 0x7f91ec15eaf0 2023-08-26T09:26:06.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.183+0000 7f91e9ffb700 1 -- 172.21.15.92:0/62676960 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91dc011d20 con 0x7f91ec15eaf0 2023-08-26T09:26:06.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.183+0000 7f91f17d5700 1 -- 172.21.15.92:0/62676960 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f91ec15eaf0 msgr2=0x7f91ec15eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:06.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.183+0000 7f91f17d5700 1 --2- 172.21.15.92:0/62676960 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f91ec15eaf0 0x7f91ec15eed0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f91dc0098f0 tx=0x7f91dc009c00 comp rx=0 tx=0).stop 2023-08-26T09:26:06.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.183+0000 7f91f17d5700 1 -- 172.21.15.92:0/62676960 shutdown_connections 2023-08-26T09:26:06.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.183+0000 7f91f17d5700 1 --2- 172.21.15.92:0/62676960 >> v2:172.21.15.188:3300/0 conn(0x7f91ec0c4270 0x7f91ec165e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:06.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.183+0000 7f91f17d5700 1 --2- 172.21.15.92:0/62676960 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f91ec15eaf0 0x7f91ec15eed0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:06.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.183+0000 7f91f17d5700 1 -- 172.21.15.92:0/62676960 >> 172.21.15.92:0/62676960 conn(0x7f91ec0cec80 msgr2=0x7f91ec0cf090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:06.192 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.183+0000 7f91f17d5700 1 -- 172.21.15.92:0/62676960 shutdown_connections 2023-08-26T09:26:06.192 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.183+0000 7f91f17d5700 1 -- 172.21.15.92:0/62676960 wait complete. 2023-08-26T09:26:06.194 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.184+0000 7f91f17d5700 1 Processor -- start 2023-08-26T09:26:06.195 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.184+0000 7f91f17d5700 1 -- start start 2023-08-26T09:26:06.195 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.185+0000 7f91f17d5700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f91ec0c4270 0x7f91ec15c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:06.195 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.185+0000 7f91f17d5700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f91ec15eaf0 0x7f91ec0ce2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:06.195 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.185+0000 7f91f17d5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91ec15f410 0x7f91ec15dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:06.195 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.185+0000 7f91f17d5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ec15a9c0 con 0x7f91ec15f410 2023-08-26T09:26:06.196 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.185+0000 7f91f17d5700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ec15c9f0 con 0x7f91ec0c4270 2023-08-26T09:26:06.196 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.185+0000 7f91f17d5700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91ec0ccbc0 con 0x7f91ec15eaf0 2023-08-26T09:26:06.196 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.185+0000 7f91eb7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91ec15f410 0x7f91ec15dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:06.196 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.185+0000 7f91eb7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91ec15f410 0x7f91ec15dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46428/0 (socket says 172.21.15.92:46428) 2023-08-26T09:26:06.197 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.185+0000 7f91eb7fe700 1 -- 172.21.15.92:0/4292716721 learned_addr learned my addr 172.21.15.92:0/4292716721 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:06.197 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.185+0000 7f91eaffd700 1 --2- 172.21.15.92:0/4292716721 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f91ec0c4270 0x7f91ec15c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:06.197 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.185+0000 7f91ea7fc700 1 --2- 172.21.15.92:0/4292716721 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f91ec15eaf0 0x7f91ec0ce2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:06.197 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.186+0000 7f91eb7fe700 1 -- 172.21.15.92:0/4292716721 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f91ec15eaf0 msgr2=0x7f91ec0ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:06.197 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.186+0000 7f91eb7fe700 1 --2- 172.21.15.92:0/4292716721 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f91ec15eaf0 0x7f91ec0ce2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:06.198 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.186+0000 7f91eb7fe700 1 -- 172.21.15.92:0/4292716721 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f91ec0c4270 msgr2=0x7f91ec15c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:06.198 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.186+0000 7f91eb7fe700 1 --2- 172.21.15.92:0/4292716721 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f91ec0c4270 0x7f91ec15c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:06.198 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.186+0000 7f91eb7fe700 1 -- 172.21.15.92:0/4292716721 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91dc009550 con 0x7f91ec15f410 2023-08-26T09:26:06.198 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.186+0000 7f91eb7fe700 1 --2- 172.21.15.92:0/4292716721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91ec15f410 0x7f91ec15dd00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f91e400efc0 tx=0x7f91e400c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:06.198 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.186+0000 7f91d37fe700 1 -- 172.21.15.92:0/4292716721 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e400cad0 con 0x7f91ec15f410 2023-08-26T09:26:06.199 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.186+0000 7f91d37fe700 1 -- 172.21.15.92:0/4292716721 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e400f040 con 0x7f91ec15f410 2023-08-26T09:26:06.199 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.186+0000 7f91f17d5700 1 -- 172.21.15.92:0/4292716721 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91ec0ccea0 con 0x7f91ec15f410 2023-08-26T09:26:06.199 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.186+0000 7f91d37fe700 1 -- 172.21.15.92:0/4292716721 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e400ce70 con 0x7f91ec15f410 2023-08-26T09:26:06.199 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.186+0000 7f91f17d5700 1 -- 172.21.15.92:0/4292716721 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91ec0cd460 con 0x7f91ec15f410 2023-08-26T09:26:06.199 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.187+0000 7f91f17d5700 1 -- 172.21.15.92:0/4292716721 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91ec04e660 con 0x7f91ec15f410 2023-08-26T09:26:06.200 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.187+0000 7f91d37fe700 1 -- 172.21.15.92:0/4292716721 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f91e4014480 con 0x7f91ec15f410 2023-08-26T09:26:06.200 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.188+0000 7f91d37fe700 1 --2- 172.21.15.92:0/4292716721 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f91d806a0e0 0x7f91d806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:06.200 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.188+0000 7f91d37fe700 1 -- 172.21.15.92:0/4292716721 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f91e4088ce0 con 0x7f91ec15f410 2023-08-26T09:26:06.200 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.188+0000 7f91eaffd700 1 --2- 172.21.15.92:0/4292716721 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f91d806a0e0 0x7f91d806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:06.200 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.188+0000 7f91eaffd700 1 --2- 172.21.15.92:0/4292716721 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f91d806a0e0 0x7f91d806c5a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f91dc000c00 tx=0x7f91dc008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:06.201 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.192+0000 7f91d37fe700 1 -- 172.21.15.92:0/4292716721 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f91e40544d0 con 0x7f91ec15f410 2023-08-26T09:26:06.387 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.383+0000 7f91f17d5700 1 -- 172.21.15.92:0/4292716721 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91ec0b04e0 con 0x7f91ec15f410 2023-08-26T09:26:06.389 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.385+0000 7f91d37fe700 1 -- 172.21.15.92:0/4292716721 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18304 (secure 0 0 0) 0x7f91e4018090 con 0x7f91ec15f410 2023-08-26T09:26:06.389 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:26:06.390 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":22,"fsid":"254a2d31-bd41-4507-8326-1b205ac24377","created":"2023-08-26T09:24:55.352131+0000","modified":"2023-08-26T09:26:02.241818+0000","last_up_change":"2023-08-26T09:25:06.124496+0000","last_in_change":"2023-08-26T09:24:57.840725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-26T09:25:06.650431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-26T09:25:06.973382+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-26T09:25:11.584141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-26T09:25:12.814990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e9e7638-4459-4d8d-8e40-130bcf48df66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6819","nonce":382827192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6824","nonce":382827192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6831","nonce":382827192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6827","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6829","nonce":382827192}]},"public_addr":"172.21.15.92:6819/382827192","cluster_addr":"172.21.15.92:6824/382827192","heartbeat_back_addr":"172.21.15.92:6831/382827192","heartbeat_front_addr":"172.21.15.92:6829/382827192","state":["exists","up"]},{"osd":1,"uuid":"164e68c9-aedd-4df5-9b70-f4b1ec3bda13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6809","nonce":618773438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6811","nonce":618773438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6815","nonce":618773438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6813","nonce":618773438}]},"public_addr":"172.21.15.92:6809/618773438","cluster_addr":"172.21.15.92:6811/618773438","heartbeat_back_addr":"172.21.15.92:6815/618773438","heartbeat_front_addr":"172.21.15.92:6813/618773438","state":["exists","up"]},{"osd":2,"uuid":"8701dfee-629a-4d30-82e4-b8fac340303f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6818","nonce":3697397687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6821","nonce":3697397687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6828","nonce":3697397687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6823","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6825","nonce":3697397687}]},"public_addr":"172.21.15.92:6818/3697397687","cluster_addr":"172.21.15.92:6821/3697397687","heartbeat_back_addr":"172.21.15.92:6828/3697397687","heartbeat_front_addr":"172.21.15.92:6825/3697397687","state":["exists","up"]},{"osd":3,"uuid":"93bdc94d-dc07-495f-995a-a6ad072f0247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6801","nonce":3579846453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6803","nonce":3579846453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6807","nonce":3579846453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6805","nonce":3579846453}]},"public_addr":"172.21.15.92:6801/3579846453","cluster_addr":"172.21.15.92:6803/3579846453","heartbeat_back_addr":"172.21.15.92:6807/3579846453","heartbeat_front_addr":"172.21.15.92:6805/3579846453","state":["exists","up"]},{"osd":4,"uuid":"d9d0ea80-8481-46a7-9677-c338d32cf1d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6809","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6811","nonce":3228383424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6813","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6815","nonce":3228383424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6821","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6823","nonce":3228383424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6817","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6819","nonce":3228383424}]},"public_addr":"172.21.15.188:6811/3228383424","cluster_addr":"172.21.15.188:6815/3228383424","heartbeat_back_addr":"172.21.15.188:6823/3228383424","heartbeat_front_addr":"172.21.15.188:6819/3228383424","state":["exists","up"]},{"osd":5,"uuid":"38d03253-467a-456f-bd5e-5a46532a0b18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6801","nonce":1655821054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6803","nonce":1655821054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6807","nonce":1655821054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6805","nonce":1655821054}]},"public_addr":"172.21.15.188:6801/1655821054","cluster_addr":"172.21.15.188:6803/1655821054","heartbeat_back_addr":"172.21.15.188:6807/1655821054","heartbeat_front_addr":"172.21.15.188:6805/1655821054","state":["exists","up"]},{"osd":6,"uuid":"d61564b5-136f-42e5-a843-626c2017cc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6810","nonce":2069976891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6814","nonce":2069976891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6822","nonce":2069976891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6818","nonce":2069976891}]},"public_addr":"172.21.15.188:6810/2069976891","cluster_addr":"172.21.15.188:6814/2069976891","heartbeat_back_addr":"172.21.15.188:6822/2069976891","heartbeat_front_addr":"172.21.15.188:6818/2069976891","state":["exists","up"]},{"osd":7,"uuid":"fae2949e-0d62-42cd-ba72-08f516084b20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6825","nonce":1882888860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6827","nonce":1882888860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6831","nonce":1882888860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6829","nonce":1882888860}]},"public_addr":"172.21.15.188:6825/1882888860","cluster_addr":"172.21.15.188:6827/1882888860","heartbeat_back_addr":"172.21.15.188:6831/1882888860","heartbeat_front_addr":"172.21.15.188:6829/1882888860","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.038523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.063160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.000857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.975572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.023848+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.765194+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.081365+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:05.110745+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.10","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-26T09:26:06.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.387+0000 7f91f17d5700 1 -- 172.21.15.92:0/4292716721 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f91d806a0e0 msgr2=0x7f91d806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:06.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.387+0000 7f91f17d5700 1 --2- 172.21.15.92:0/4292716721 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f91d806a0e0 0x7f91d806c5a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f91dc000c00 tx=0x7f91dc008030 comp rx=0 tx=0).stop 2023-08-26T09:26:06.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.387+0000 7f91f17d5700 1 -- 172.21.15.92:0/4292716721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91ec15f410 msgr2=0x7f91ec15dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:06.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.387+0000 7f91f17d5700 1 --2- 172.21.15.92:0/4292716721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91ec15f410 0x7f91ec15dd00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f91e400efc0 tx=0x7f91e400c0c0 comp rx=0 tx=0).stop 2023-08-26T09:26:06.393 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.387+0000 7f91f17d5700 1 -- 172.21.15.92:0/4292716721 shutdown_connections 2023-08-26T09:26:06.393 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.387+0000 7f91f17d5700 1 --2- 172.21.15.92:0/4292716721 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f91d806a0e0 0x7f91d806c5a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:06.393 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.387+0000 7f91f17d5700 1 --2- 172.21.15.92:0/4292716721 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f91ec0c4270 0x7f91ec15c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:06.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.387+0000 7f91f17d5700 1 --2- 172.21.15.92:0/4292716721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91ec15f410 0x7f91ec15dd00 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:06.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.387+0000 7f91f17d5700 1 --2- 172.21.15.92:0/4292716721 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f91ec15eaf0 0x7f91ec0ce2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:06.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.387+0000 7f91f17d5700 1 -- 172.21.15.92:0/4292716721 >> 172.21.15.92:0/4292716721 conn(0x7f91ec0cec80 msgr2=0x7f91ec0af740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:06.395 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.387+0000 7f91f17d5700 1 -- 172.21.15.92:0/4292716721 shutdown_connections 2023-08-26T09:26:06.395 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.387+0000 7f91f17d5700 1 -- 172.21.15.92:0/4292716721 wait complete. 2023-08-26T09:26:06.403 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-26T09:25:06.650431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-26T09:25:06.973382+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-26T09:25:11.584141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-26T09:25:12.814990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-26T09:26:06.404 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-26T09:26:06.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.524+0000 7fa249a1f700 1 Processor -- start 2023-08-26T09:26:06.528 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.524+0000 7fa249a1f700 1 -- start start 2023-08-26T09:26:06.535 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.524+0000 7fa249a1f700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa244159dd0 0x7fa2440cf220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:06.540 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.524+0000 7fa249a1f700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa24406e110 0x7fa24406e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:06.540 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.524+0000 7fa249a1f700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa244070d20 0x7fa2440711b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:06.540 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.525+0000 7fa249a1f700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa24406eab0 con 0x7fa24406e110 2023-08-26T09:26:06.540 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.525+0000 7fa249a1f700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2440c6200 con 0x7fa244070d20 2023-08-26T09:26:06.541 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.525+0000 7fa249a1f700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2440ce740 con 0x7fa244159dd0 2023-08-26T09:26:06.541 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.525+0000 7fa2427fc700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa24406e110 0x7fa24406e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:06.541 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.525+0000 7fa2427fc700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa24406e110 0x7fa24406e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46434/0 (socket says 172.21.15.92:46434) 2023-08-26T09:26:06.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.525+0000 7fa2427fc700 1 -- 172.21.15.92:0/2950500651 learned_addr learned my addr 172.21.15.92:0/2950500651 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:06.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.525+0000 7fa242ffd700 1 --2- 172.21.15.92:0/2950500651 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa244159dd0 0x7fa2440cf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:06.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.525+0000 7fa2437fe700 1 --2- 172.21.15.92:0/2950500651 >> v2:172.21.15.188:3300/0 conn(0x7fa244070d20 0x7fa2440711b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:06.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.525+0000 7fa2427fc700 1 -- 172.21.15.92:0/2950500651 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa244159dd0 msgr2=0x7fa2440cf220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:06.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.525+0000 7fa2427fc700 1 --2- 172.21.15.92:0/2950500651 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa244159dd0 0x7fa2440cf220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:06.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.525+0000 7fa2427fc700 1 -- 172.21.15.92:0/2950500651 >> v2:172.21.15.188:3300/0 conn(0x7fa244070d20 msgr2=0x7fa2440711b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:06.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.525+0000 7fa2427fc700 1 --2- 172.21.15.92:0/2950500651 >> v2:172.21.15.188:3300/0 conn(0x7fa244070d20 0x7fa2440711b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:06.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.525+0000 7fa2427fc700 1 -- 172.21.15.92:0/2950500651 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2440cea20 con 0x7fa24406e110 2023-08-26T09:26:06.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.525+0000 7fa2427fc700 1 --2- 172.21.15.92:0/2950500651 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa24406e110 0x7fa24406e570 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa244072b90 tx=0x7fa22c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2f07e0aaa078974 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:06.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.525+0000 7fa241ffb700 1 -- 172.21.15.92:0/2950500651 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22c00b870 con 0x7fa24406e110 2023-08-26T09:26:06.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.525+0000 7fa241ffb700 1 -- 172.21.15.92:0/2950500651 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22c00b9d0 con 0x7fa24406e110 2023-08-26T09:26:06.551 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.525+0000 7fa241ffb700 1 -- 172.21.15.92:0/2950500651 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22c00bd60 con 0x7fa24406e110 2023-08-26T09:26:06.551 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.526+0000 7fa249a1f700 1 -- 172.21.15.92:0/2950500651 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa24406e110 msgr2=0x7fa24406e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:06.551 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.526+0000 7fa249a1f700 1 --2- 172.21.15.92:0/2950500651 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa24406e110 0x7fa24406e570 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa244072b90 tx=0x7fa22c009bd0 comp rx=0 tx=0).stop 2023-08-26T09:26:06.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.526+0000 7fa249a1f700 1 -- 172.21.15.92:0/2950500651 shutdown_connections 2023-08-26T09:26:06.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.526+0000 7fa249a1f700 1 --2- 172.21.15.92:0/2950500651 >> v2:172.21.15.188:3300/0 conn(0x7fa244070d20 0x7fa2440711b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:06.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.526+0000 7fa249a1f700 1 --2- 172.21.15.92:0/2950500651 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa244159dd0 0x7fa2440cf220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:06.553 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.526+0000 7fa249a1f700 1 --2- 172.21.15.92:0/2950500651 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa24406e110 0x7fa24406e570 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:06.553 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.526+0000 7fa249a1f700 1 -- 172.21.15.92:0/2950500651 >> 172.21.15.92:0/2950500651 conn(0x7fa24406b430 msgr2=0x7fa24406b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:06.553 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.526+0000 7fa249a1f700 1 -- 172.21.15.92:0/2950500651 shutdown_connections 2023-08-26T09:26:06.554 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.526+0000 7fa249a1f700 1 -- 172.21.15.92:0/2950500651 wait complete. 2023-08-26T09:26:06.554 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.527+0000 7fa249a1f700 1 Processor -- start 2023-08-26T09:26:06.554 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.527+0000 7fa249a1f700 1 -- start start 2023-08-26T09:26:06.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.528+0000 7fa249a1f700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa24406e110 0x7fa2441f25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:06.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.528+0000 7fa249a1f700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa244070d20 0x7fa2440cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:06.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.528+0000 7fa249a1f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa244159dd0 0x7fa24414b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:06.556 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.528+0000 7fa249a1f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2441f34e0 con 0x7fa244159dd0 2023-08-26T09:26:06.556 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.528+0000 7fa249a1f700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2440cc530 con 0x7fa244070d20 2023-08-26T09:26:06.556 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.528+0000 7fa249a1f700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2441f2c40 con 0x7fa24406e110 2023-08-26T09:26:06.557 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.528+0000 7fa2437fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa244159dd0 0x7fa24414b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:06.557 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.528+0000 7fa2437fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa244159dd0 0x7fa24414b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46440/0 (socket says 172.21.15.92:46440) 2023-08-26T09:26:06.557 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.528+0000 7fa2437fe700 1 -- 172.21.15.92:0/1029626218 learned_addr learned my addr 172.21.15.92:0/1029626218 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:06.558 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.528+0000 7fa2427fc700 1 --2- 172.21.15.92:0/1029626218 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa244070d20 0x7fa2440cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:06.558 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.528+0000 7fa242ffd700 1 --2- 172.21.15.92:0/1029626218 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa24406e110 0x7fa2441f25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:06.558 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.528+0000 7fa2437fe700 1 -- 172.21.15.92:0/1029626218 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa24406e110 msgr2=0x7fa2441f25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:06.559 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.528+0000 7fa2437fe700 1 --2- 172.21.15.92:0/1029626218 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa24406e110 0x7fa2441f25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:06.559 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.528+0000 7fa2437fe700 1 -- 172.21.15.92:0/1029626218 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa244070d20 msgr2=0x7fa2440cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:06.559 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.528+0000 7fa2437fe700 1 --2- 172.21.15.92:0/1029626218 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa244070d20 0x7fa2440cbff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:06.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.528+0000 7fa2437fe700 1 -- 172.21.15.92:0/1029626218 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa22c009550 con 0x7fa244159dd0 2023-08-26T09:26:06.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.528+0000 7fa242ffd700 1 --2- 172.21.15.92:0/1029626218 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa24406e110 0x7fa2441f25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:26:06.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.528+0000 7fa2427fc700 1 --2- 172.21.15.92:0/1029626218 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa244070d20 0x7fa2440cbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:26:06.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.529+0000 7fa2437fe700 1 --2- 172.21.15.92:0/1029626218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa244159dd0 0x7fa24414b9d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa23c00e810 tx=0x7fa23c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:06.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.529+0000 7fa23bfff700 1 -- 172.21.15.92:0/1029626218 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c013610 con 0x7fa244159dd0 2023-08-26T09:26:06.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.529+0000 7fa23bfff700 1 -- 172.21.15.92:0/1029626218 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa23c013770 con 0x7fa244159dd0 2023-08-26T09:26:06.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.529+0000 7fa249a1f700 1 -- 172.21.15.92:0/1029626218 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2441f2f20 con 0x7fa244159dd0 2023-08-26T09:26:06.562 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.529+0000 7fa23bfff700 1 -- 172.21.15.92:0/1029626218 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c013b20 con 0x7fa244159dd0 2023-08-26T09:26:06.562 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.529+0000 7fa249a1f700 1 -- 172.21.15.92:0/1029626218 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2441f5cd0 con 0x7fa244159dd0 2023-08-26T09:26:06.562 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.530+0000 7fa249a1f700 1 -- 172.21.15.92:0/1029626218 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa24404eeb0 con 0x7fa244159dd0 2023-08-26T09:26:06.563 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.530+0000 7fa23bfff700 1 -- 172.21.15.92:0/1029626218 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa23c013c80 con 0x7fa244159dd0 2023-08-26T09:26:06.563 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.530+0000 7fa23bfff700 1 --2- 172.21.15.92:0/1029626218 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa22406a0e0 0x7fa22406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:06.563 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.530+0000 7fa23bfff700 1 -- 172.21.15.92:0/1029626218 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa23c088220 con 0x7fa244159dd0 2023-08-26T09:26:06.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.530+0000 7fa242ffd700 1 --2- 172.21.15.92:0/1029626218 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa22406a0e0 0x7fa22406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:06.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.531+0000 7fa242ffd700 1 --2- 172.21.15.92:0/1029626218 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa22406a0e0 0x7fa22406c5a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa234003fd0 tx=0x7fa234003a20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:06.565 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.535+0000 7fa23bfff700 1 -- 172.21.15.92:0/1029626218 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa23c0573f0 con 0x7fa244159dd0 2023-08-26T09:26:06.727 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.723+0000 7fa249a1f700 1 -- 172.21.15.92:0/1029626218 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa2440732c0 con 0x7fa244159dd0 2023-08-26T09:26:06.727 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.723+0000 7fa23bfff700 1 -- 172.21.15.92:0/1029626218 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa23c056f80 con 0x7fa244159dd0 2023-08-26T09:26:06.728 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 8 2023-08-26T09:26:06.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.725+0000 7fa249a1f700 1 -- 172.21.15.92:0/1029626218 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa22406a0e0 msgr2=0x7fa22406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:06.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.725+0000 7fa249a1f700 1 --2- 172.21.15.92:0/1029626218 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa22406a0e0 0x7fa22406c5a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa234003fd0 tx=0x7fa234003a20 comp rx=0 tx=0).stop 2023-08-26T09:26:06.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.725+0000 7fa249a1f700 1 -- 172.21.15.92:0/1029626218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa244159dd0 msgr2=0x7fa24414b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:06.731 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.725+0000 7fa249a1f700 1 --2- 172.21.15.92:0/1029626218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa244159dd0 0x7fa24414b9d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa23c00e810 tx=0x7fa23c00ebd0 comp rx=0 tx=0).stop 2023-08-26T09:26:06.731 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.725+0000 7fa249a1f700 1 -- 172.21.15.92:0/1029626218 shutdown_connections 2023-08-26T09:26:06.732 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.725+0000 7fa249a1f700 1 --2- 172.21.15.92:0/1029626218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa244159dd0 0x7fa24414b9d0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:06.732 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.725+0000 7fa249a1f700 1 --2- 172.21.15.92:0/1029626218 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa24406e110 0x7fa2441f25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:06.732 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.725+0000 7fa249a1f700 1 --2- 172.21.15.92:0/1029626218 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa22406a0e0 0x7fa22406c5a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:06.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.725+0000 7fa249a1f700 1 --2- 172.21.15.92:0/1029626218 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa244070d20 0x7fa2440cbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:06.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.725+0000 7fa249a1f700 1 -- 172.21.15.92:0/1029626218 >> 172.21.15.92:0/1029626218 conn(0x7fa24406b430 msgr2=0x7fa24406cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:06.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.726+0000 7fa249a1f700 1 -- 172.21.15.92:0/1029626218 shutdown_connections 2023-08-26T09:26:06.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.726+0000 7fa249a1f700 1 -- 172.21.15.92:0/1029626218 wait complete. 2023-08-26T09:26:06.741 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-26T09:26:06.865 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.861+0000 7fcb9e581700 1 Processor -- start 2023-08-26T09:26:06.865 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.861+0000 7fcb9e581700 1 -- start start 2023-08-26T09:26:06.869 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.862+0000 7fcb9e581700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcb98159dd0 0x7fcb980cf220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:06.870 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.862+0000 7fcb9e581700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb980c6200 con 0x7fcb9806e110 2023-08-26T09:26:06.870 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.862+0000 7fcb9e581700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb980ce740 con 0x7fcb98071430 2023-08-26T09:26:06.870 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.862+0000 7fcb9e581700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb980cea20 con 0x7fcb98159dd0 2023-08-26T09:26:06.870 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.862+0000 7fcb977fe700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fcb9806e110 0x7fcb98070d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:58460/0 (socket says 172.21.15.92:58460) 2023-08-26T09:26:06.870 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.862+0000 7fcb977fe700 1 -- 172.21.15.92:0/2145043429 learned_addr learned my addr 172.21.15.92:0/2145043429 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:26:06.871 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.863+0000 7fcb97fff700 1 --2- 172.21.15.92:0/2145043429 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcb98159dd0 0x7fcb980cf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:06.871 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.863+0000 7fcb96ffd700 1 -- 172.21.15.92:0/2145043429 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3813989919 0 0) 0x7fcb980c6200 con 0x7fcb9806e110 2023-08-26T09:26:06.871 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.863+0000 7fcb96ffd700 1 -- 172.21.15.92:0/2145043429 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb800035b0 con 0x7fcb9806e110 2023-08-26T09:26:06.871 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.863+0000 7fcb96ffd700 1 -- 172.21.15.92:0/2145043429 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2001678849 0 0) 0x7fcb800035b0 con 0x7fcb9806e110 2023-08-26T09:26:06.871 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.863+0000 7fcb96ffd700 1 -- 172.21.15.92:0/2145043429 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcb98159dd0 msgr2=0x7fcb980cf220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:06.872 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.863+0000 7fcb96ffd700 1 --2- 172.21.15.92:0/2145043429 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcb98159dd0 0x7fcb980cf220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:06.872 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.863+0000 7fcb96ffd700 1 -- 172.21.15.92:0/2145043429 >> v1:172.21.15.188:6789/0 conn(0x7fcb98071430 legacy=0x7fcb980c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:06.872 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.863+0000 7fcb96ffd700 1 -- 172.21.15.92:0/2145043429 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb980ced00 con 0x7fcb9806e110 2023-08-26T09:26:06.872 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.863+0000 7fcb96ffd700 1 -- 172.21.15.92:0/2145043429 <== mon.0 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1019361464 0 0) 0x7fcb88001670 con 0x7fcb9806e110 2023-08-26T09:26:06.872 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.863+0000 7fcb96ffd700 1 -- 172.21.15.92:0/2145043429 >> v1:172.21.15.92:6789/0 conn(0x7fcb9806e110 legacy=0x7fcb98070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:06.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.863+0000 7fcb96ffd700 1 --2- 172.21.15.92:0/2145043429 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb80003a30 0x7fcb80003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:06.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.863+0000 7fcb96ffd700 1 --2- 172.21.15.92:0/2145043429 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcb80004850 0x7fcb80004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:06.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.863+0000 7fcb96ffd700 1 --2- 172.21.15.92:0/2145043429 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcb98159dd0 0x7fcb80005250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:06.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.863+0000 7fcb96ffd700 1 -- 172.21.15.92:0/2145043429 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb980cea20 con 0x7fcb80003a30 2023-08-26T09:26:06.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.863+0000 7fcb96ffd700 1 -- 172.21.15.92:0/2145043429 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8000bb40 con 0x7fcb80004850 2023-08-26T09:26:06.874 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.863+0000 7fcb96ffd700 1 -- 172.21.15.92:0/2145043429 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8000bd00 con 0x7fcb98159dd0 2023-08-26T09:26:06.874 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.863+0000 7fcb97fff700 1 --2- 172.21.15.92:0/2145043429 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb80003a30 0x7fcb80003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:06.874 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.863+0000 7fcb977fe700 1 --2- 172.21.15.92:0/2145043429 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcb80004850 0x7fcb80004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:06.874 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.863+0000 7fcb9cb1e700 1 --2- 172.21.15.92:0/2145043429 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcb98159dd0 0x7fcb80005250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:06.874 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.863+0000 7fcb97fff700 1 -- 172.21.15.92:0/2145043429 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcb98159dd0 msgr2=0x7fcb80005250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:06.875 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.863+0000 7fcb97fff700 1 --2- 172.21.15.92:0/2145043429 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcb98159dd0 0x7fcb80005250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:06.875 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.863+0000 7fcb97fff700 1 -- 172.21.15.92:0/2145043429 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcb80004850 msgr2=0x7fcb80004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:06.875 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.863+0000 7fcb97fff700 1 --2- 172.21.15.92:0/2145043429 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcb80004850 0x7fcb80004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:06.875 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.863+0000 7fcb97fff700 1 -- 172.21.15.92:0/2145043429 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb800035b0 con 0x7fcb80003a30 2023-08-26T09:26:06.875 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.863+0000 7fcb9cb1e700 1 --2- 172.21.15.92:0/2145043429 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcb98159dd0 0x7fcb80005250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:26:06.876 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.863+0000 7fcb977fe700 1 --2- 172.21.15.92:0/2145043429 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcb80004850 0x7fcb80004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:26:06.876 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.864+0000 7fcb97fff700 1 --2- 172.21.15.92:0/2145043429 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb80003a30 0x7fcb80003e50 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c009b60 tx=0x7fcb80005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a6a2d3fb7d993b8 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:06.876 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.864+0000 7fcb96ffd700 1 -- 172.21.15.92:0/2145043429 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c00e6c0 con 0x7fcb80003a30 2023-08-26T09:26:06.876 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.864+0000 7fcb96ffd700 1 -- 172.21.15.92:0/2145043429 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb8c00e820 con 0x7fcb80003a30 2023-08-26T09:26:06.876 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.864+0000 7fcb96ffd700 1 -- 172.21.15.92:0/2145043429 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c00eb90 con 0x7fcb80003a30 2023-08-26T09:26:06.877 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.864+0000 7fcb9e581700 1 -- 172.21.15.92:0/2145043429 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb80003a30 msgr2=0x7fcb80003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:06.877 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.864+0000 7fcb9e581700 1 --2- 172.21.15.92:0/2145043429 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb80003a30 0x7fcb80003e50 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c009b60 tx=0x7fcb80005880 comp rx=0 tx=0).stop 2023-08-26T09:26:06.877 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.864+0000 7fcb9cb1e700 1 -- 172.21.15.92:0/2145043429 reap_dead start 2023-08-26T09:26:06.877 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.864+0000 7fcb9e581700 1 -- 172.21.15.92:0/2145043429 shutdown_connections 2023-08-26T09:26:06.877 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.864+0000 7fcb9e581700 1 -- 172.21.15.92:0/2145043429 >> 172.21.15.92:0/2145043429 conn(0x7fcb9806b430 msgr2=0x7fcb9806b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:06.877 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.864+0000 7fcb9e581700 1 -- 172.21.15.92:0/2145043429 shutdown_connections 2023-08-26T09:26:06.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.864+0000 7fcb9e581700 1 -- 172.21.15.92:0/2145043429 wait complete. 2023-08-26T09:26:06.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.865+0000 7fcb9e581700 1 Processor -- start 2023-08-26T09:26:06.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.866+0000 7fcb9e581700 1 -- start start 2023-08-26T09:26:06.881 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.866+0000 7fcb9e581700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcb80003a30 0x7fcb981437f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:06.881 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.866+0000 7fcb9e581700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb980b1fb0 0x7fcb9806a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:06.881 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.866+0000 7fcb9e581700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcb9806a860 0x7fcb98155e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:06.881 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.866+0000 7fcb9e581700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9806ace0 con 0x7fcb980b1fb0 2023-08-26T09:26:06.881 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.866+0000 7fcb9e581700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb980b4660 con 0x7fcb80003a30 2023-08-26T09:26:06.882 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.866+0000 7fcb9e581700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb980b3d30 con 0x7fcb9806a860 2023-08-26T09:26:06.882 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.867+0000 7fcb977fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb980b1fb0 0x7fcb9806a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:06.882 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.867+0000 7fcb977fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb980b1fb0 0x7fcb9806a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46460/0 (socket says 172.21.15.92:46460) 2023-08-26T09:26:06.882 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.867+0000 7fcb977fe700 1 -- 172.21.15.92:0/3823966669 learned_addr learned my addr 172.21.15.92:0/3823966669 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:06.882 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.867+0000 7fcb97fff700 1 --2- 172.21.15.92:0/3823966669 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcb80003a30 0x7fcb981437f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:06.882 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.867+0000 7fcb9cb1e700 1 --2- 172.21.15.92:0/3823966669 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcb9806a860 0x7fcb98155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:06.883 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.867+0000 7fcb977fe700 1 -- 172.21.15.92:0/3823966669 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcb9806a860 msgr2=0x7fcb98155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:06.883 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.867+0000 7fcb977fe700 1 --2- 172.21.15.92:0/3823966669 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcb9806a860 0x7fcb98155e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:06.883 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.867+0000 7fcb977fe700 1 -- 172.21.15.92:0/3823966669 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcb80003a30 msgr2=0x7fcb981437f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:06.883 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.867+0000 7fcb977fe700 1 --2- 172.21.15.92:0/3823966669 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcb80003a30 0x7fcb981437f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:06.883 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.867+0000 7fcb977fe700 1 -- 172.21.15.92:0/3823966669 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb980b4010 con 0x7fcb980b1fb0 2023-08-26T09:26:06.884 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.867+0000 7fcb97fff700 1 --2- 172.21.15.92:0/3823966669 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcb80003a30 0x7fcb981437f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:26:06.884 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.867+0000 7fcb977fe700 1 --2- 172.21.15.92:0/3823966669 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb980b1fb0 0x7fcb9806a320 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fcb8800e870 tx=0x7fcb8800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:06.884 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.867+0000 7fcb94ff9700 1 -- 172.21.15.92:0/3823966669 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8800ee70 con 0x7fcb980b1fb0 2023-08-26T09:26:06.884 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.867+0000 7fcb94ff9700 1 -- 172.21.15.92:0/3823966669 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb8800c7e0 con 0x7fcb980b1fb0 2023-08-26T09:26:06.884 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.867+0000 7fcb9e581700 1 -- 172.21.15.92:0/3823966669 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb980b42f0 con 0x7fcb980b1fb0 2023-08-26T09:26:06.885 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.867+0000 7fcb94ff9700 1 -- 172.21.15.92:0/3823966669 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8800cb50 con 0x7fcb980b1fb0 2023-08-26T09:26:06.885 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.867+0000 7fcb9e581700 1 -- 172.21.15.92:0/3823966669 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb980b2430 con 0x7fcb980b1fb0 2023-08-26T09:26:06.885 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.868+0000 7fcb9e581700 1 -- 172.21.15.92:0/3823966669 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb98061f90 con 0x7fcb980b1fb0 2023-08-26T09:26:06.885 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.868+0000 7fcb94ff9700 1 -- 172.21.15.92:0/3823966669 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcb8800ccb0 con 0x7fcb980b1fb0 2023-08-26T09:26:06.885 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.869+0000 7fcb94ff9700 1 --2- 172.21.15.92:0/3823966669 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fcb8406a0e0 0x7fcb8406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:06.885 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.869+0000 7fcb94ff9700 1 -- 172.21.15.92:0/3823966669 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fcb88088490 con 0x7fcb980b1fb0 2023-08-26T09:26:06.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.869+0000 7fcb97fff700 1 --2- 172.21.15.92:0/3823966669 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fcb8406a0e0 0x7fcb8406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:06.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.869+0000 7fcb97fff700 1 --2- 172.21.15.92:0/3823966669 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fcb8406a0e0 0x7fcb8406c5a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c0090b0 tx=0x7fcb8c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:06.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:06.873+0000 7fcb94ff9700 1 -- 172.21.15.92:0/3823966669 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fcb88057540 con 0x7fcb980b1fb0 2023-08-26T09:26:07.065 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.061+0000 7fcb9e581700 1 -- 172.21.15.92:0/3823966669 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcb9804eeb0 con 0x7fcb980b1fb0 2023-08-26T09:26:07.066 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.062+0000 7fcb94ff9700 1 -- 172.21.15.92:0/3823966669 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcb880570d0 con 0x7fcb980b1fb0 2023-08-26T09:26:07.066 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 1 2023-08-26T09:26:07.067 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.064+0000 7fcb9e581700 1 -- 172.21.15.92:0/3823966669 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fcb8406a0e0 msgr2=0x7fcb8406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:07.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.064+0000 7fcb9e581700 1 --2- 172.21.15.92:0/3823966669 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fcb8406a0e0 0x7fcb8406c5a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c0090b0 tx=0x7fcb8c008030 comp rx=0 tx=0).stop 2023-08-26T09:26:07.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.064+0000 7fcb9e581700 1 -- 172.21.15.92:0/3823966669 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb980b1fb0 msgr2=0x7fcb9806a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:07.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.064+0000 7fcb9e581700 1 --2- 172.21.15.92:0/3823966669 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb980b1fb0 0x7fcb9806a320 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fcb8800e870 tx=0x7fcb8800ec30 comp rx=0 tx=0).stop 2023-08-26T09:26:07.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.064+0000 7fcb9e581700 1 -- 172.21.15.92:0/3823966669 shutdown_connections 2023-08-26T09:26:07.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.064+0000 7fcb9e581700 1 --2- 172.21.15.92:0/3823966669 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fcb8406a0e0 0x7fcb8406c5a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:07.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.064+0000 7fcb9e581700 1 --2- 172.21.15.92:0/3823966669 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcb80003a30 0x7fcb981437f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:07.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.064+0000 7fcb9e581700 1 --2- 172.21.15.92:0/3823966669 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcb9806a860 0x7fcb98155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:07.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.064+0000 7fcb9e581700 1 --2- 172.21.15.92:0/3823966669 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb980b1fb0 0x7fcb9806a320 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:07.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.064+0000 7fcb9e581700 1 -- 172.21.15.92:0/3823966669 >> 172.21.15.92:0/3823966669 conn(0x7fcb9806b430 msgr2=0x7fcb9806cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:07.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.064+0000 7fcb9e581700 1 -- 172.21.15.92:0/3823966669 shutdown_connections 2023-08-26T09:26:07.070 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.064+0000 7fcb9e581700 1 -- 172.21.15.92:0/3823966669 wait complete. 2023-08-26T09:26:07.080 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-26T09:26:07.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.201+0000 7f51153c1700 1 Processor -- start 2023-08-26T09:26:07.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.202+0000 7f51153c1700 1 -- start start 2023-08-26T09:26:07.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.202+0000 7f51153c1700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f51100af390 0x7f5110070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:07.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.202+0000 7f51153c1700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5110071260 0x7f511006a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:07.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.202+0000 7f51153c1700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51100aee50 con 0x7f511015d220 2023-08-26T09:26:07.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.202+0000 7f51153c1700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51100af130 con 0x7f5110071260 2023-08-26T09:26:07.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.202+0000 7f51153c1700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51100c4cb0 con 0x7f51100af390 2023-08-26T09:26:07.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.202+0000 7f510f7fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5110071260 0x7f511006a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:07.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.203+0000 7f510f7fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5110071260 0x7f511006a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46470/0 (socket says 172.21.15.92:46470) 2023-08-26T09:26:07.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.203+0000 7f510f7fe700 1 -- 172.21.15.92:0/1115188642 learned_addr learned my addr 172.21.15.92:0/1115188642 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:07.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.203+0000 7f510e7fc700 1 --2- 172.21.15.92:0/1115188642 >> v2:172.21.15.188:3300/0 conn(0x7f51100af390 0x7f5110070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:07.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.203+0000 7f510f7fe700 1 -- 172.21.15.92:0/1115188642 >> v2:172.21.15.188:3300/0 conn(0x7f51100af390 msgr2=0x7f5110070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:07.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.203+0000 7f510f7fe700 1 --2- 172.21.15.92:0/1115188642 >> v2:172.21.15.188:3300/0 conn(0x7f51100af390 0x7f5110070d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:07.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.203+0000 7f510f7fe700 1 -- 172.21.15.92:0/1115188642 >> v1:172.21.15.188:6789/0 conn(0x7f511015d220 legacy=0x7f511006db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:07.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.203+0000 7f510f7fe700 1 -- 172.21.15.92:0/1115188642 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51100c4f90 con 0x7f5110071260 2023-08-26T09:26:07.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.203+0000 7f510f7fe700 1 --2- 172.21.15.92:0/1115188642 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5110071260 0x7f511006a320 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5110072240 tx=0x7f510800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0430d6803417e2d server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:07.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.203+0000 7f510dffb700 1 -- 172.21.15.92:0/1115188642 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510800e070 con 0x7f5110071260 2023-08-26T09:26:07.213 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.203+0000 7f510dffb700 1 -- 172.21.15.92:0/1115188642 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f510800b9c0 con 0x7f5110071260 2023-08-26T09:26:07.213 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.203+0000 7f510dffb700 1 -- 172.21.15.92:0/1115188642 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510800bd70 con 0x7f5110071260 2023-08-26T09:26:07.213 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.204+0000 7f51153c1700 1 -- 172.21.15.92:0/1115188642 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5110071260 msgr2=0x7f511006a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:07.213 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.204+0000 7f51153c1700 1 --2- 172.21.15.92:0/1115188642 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5110071260 0x7f511006a320 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5110072240 tx=0x7f510800b330 comp rx=0 tx=0).stop 2023-08-26T09:26:07.214 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.204+0000 7f51153c1700 1 -- 172.21.15.92:0/1115188642 shutdown_connections 2023-08-26T09:26:07.214 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.204+0000 7f51153c1700 1 --2- 172.21.15.92:0/1115188642 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5110071260 0x7f511006a320 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:07.214 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.204+0000 7f51153c1700 1 --2- 172.21.15.92:0/1115188642 >> v2:172.21.15.188:3300/0 conn(0x7f51100af390 0x7f5110070d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:07.214 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.204+0000 7f51153c1700 1 -- 172.21.15.92:0/1115188642 >> 172.21.15.92:0/1115188642 conn(0x7f511006b430 msgr2=0x7f511006b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:07.214 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.204+0000 7f51153c1700 1 -- 172.21.15.92:0/1115188642 shutdown_connections 2023-08-26T09:26:07.215 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.204+0000 7f51153c1700 1 -- 172.21.15.92:0/1115188642 wait complete. 2023-08-26T09:26:07.215 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.205+0000 7f51153c1700 1 Processor -- start 2023-08-26T09:26:07.215 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.205+0000 7f51153c1700 1 -- start start 2023-08-26T09:26:07.218 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.206+0000 7f51153c1700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5110071260 0x7f5110144200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:07.218 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.206+0000 7f51153c1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51100af390 0x7f5110158bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:07.218 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.206+0000 7f51153c1700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f511015d220 0x7f511015b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:07.218 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.206+0000 7f51153c1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5110147070 con 0x7f51100af390 2023-08-26T09:26:07.219 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.206+0000 7f51153c1700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51101592b0 con 0x7f511015d220 2023-08-26T09:26:07.219 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.206+0000 7f51153c1700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51100ad060 con 0x7f5110071260 2023-08-26T09:26:07.219 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.206+0000 7f510e7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51100af390 0x7f5110158bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:07.219 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.206+0000 7f510e7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51100af390 0x7f5110158bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46474/0 (socket says 172.21.15.92:46474) 2023-08-26T09:26:07.219 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.206+0000 7f510e7fc700 1 -- 172.21.15.92:0/3415783943 learned_addr learned my addr 172.21.15.92:0/3415783943 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:07.220 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.206+0000 7f510f7fe700 1 --2- 172.21.15.92:0/3415783943 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f511015d220 0x7f511015b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:07.220 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.206+0000 7f510effd700 1 --2- 172.21.15.92:0/3415783943 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5110071260 0x7f5110144200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:07.220 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.206+0000 7f510e7fc700 1 -- 172.21.15.92:0/3415783943 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5110071260 msgr2=0x7f5110144200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:07.220 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.206+0000 7f510e7fc700 1 --2- 172.21.15.92:0/3415783943 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5110071260 0x7f5110144200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:07.221 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.206+0000 7f510e7fc700 1 -- 172.21.15.92:0/3415783943 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f511015d220 msgr2=0x7f511015b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:07.221 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.206+0000 7f510e7fc700 1 --2- 172.21.15.92:0/3415783943 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f511015d220 0x7f511015b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:07.221 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.206+0000 7f510e7fc700 1 -- 172.21.15.92:0/3415783943 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5108009b30 con 0x7f51100af390 2023-08-26T09:26:07.221 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.207+0000 7f510e7fc700 1 --2- 172.21.15.92:0/3415783943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51100af390 0x7f5110158bd0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f510000e810 tx=0x7f510000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:07.221 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.207+0000 7f50f77fe700 1 -- 172.21.15.92:0/3415783943 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510000c070 con 0x7f51100af390 2023-08-26T09:26:07.222 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.207+0000 7f50f77fe700 1 -- 172.21.15.92:0/3415783943 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5100013610 con 0x7f51100af390 2023-08-26T09:26:07.222 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.207+0000 7f51153c1700 1 -- 172.21.15.92:0/3415783943 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51100ad340 con 0x7f51100af390 2023-08-26T09:26:07.222 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.207+0000 7f50f77fe700 1 -- 172.21.15.92:0/3415783943 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51000139c0 con 0x7f51100af390 2023-08-26T09:26:07.222 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.207+0000 7f51153c1700 1 -- 172.21.15.92:0/3415783943 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51100ad900 con 0x7f51100af390 2023-08-26T09:26:07.222 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.208+0000 7f51153c1700 1 -- 172.21.15.92:0/3415783943 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f511004eeb0 con 0x7f51100af390 2023-08-26T09:26:07.223 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.208+0000 7f50f77fe700 1 -- 172.21.15.92:0/3415783943 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5100013b20 con 0x7f51100af390 2023-08-26T09:26:07.223 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.208+0000 7f50f77fe700 1 --2- 172.21.15.92:0/3415783943 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f50fc06a0e0 0x7f50fc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:07.223 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.209+0000 7f50f77fe700 1 -- 172.21.15.92:0/3415783943 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f5100088280 con 0x7f51100af390 2023-08-26T09:26:07.223 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.209+0000 7f510effd700 1 --2- 172.21.15.92:0/3415783943 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f50fc06a0e0 0x7f50fc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:07.224 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.209+0000 7f510effd700 1 --2- 172.21.15.92:0/3415783943 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f50fc06a0e0 0x7f50fc06c5a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5104007fd0 tx=0x7f5104009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:07.224 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.213+0000 7f50f77fe700 1 -- 172.21.15.92:0/3415783943 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f51000573d0 con 0x7f51100af390 2023-08-26T09:26:07.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.406+0000 7f51153c1700 1 -- 172.21.15.92:0/3415783943 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f51100cfa20 con 0x7f51100af390 2023-08-26T09:26:07.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.406+0000 7f50f77fe700 1 -- 172.21.15.92:0/3415783943 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5100056f60 con 0x7f51100af390 2023-08-26T09:26:07.410 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 32 2023-08-26T09:26:07.412 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.408+0000 7f51153c1700 1 -- 172.21.15.92:0/3415783943 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f50fc06a0e0 msgr2=0x7f50fc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:07.413 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.408+0000 7f51153c1700 1 --2- 172.21.15.92:0/3415783943 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f50fc06a0e0 0x7f50fc06c5a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5104007fd0 tx=0x7f5104009040 comp rx=0 tx=0).stop 2023-08-26T09:26:07.413 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.408+0000 7f51153c1700 1 -- 172.21.15.92:0/3415783943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51100af390 msgr2=0x7f5110158bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:07.413 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.408+0000 7f51153c1700 1 --2- 172.21.15.92:0/3415783943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51100af390 0x7f5110158bd0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f510000e810 tx=0x7f510000eb20 comp rx=0 tx=0).stop 2023-08-26T09:26:07.414 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.408+0000 7f51153c1700 1 -- 172.21.15.92:0/3415783943 shutdown_connections 2023-08-26T09:26:07.414 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.408+0000 7f51153c1700 1 --2- 172.21.15.92:0/3415783943 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f50fc06a0e0 0x7f50fc06c5a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:07.414 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.408+0000 7f51153c1700 1 --2- 172.21.15.92:0/3415783943 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f511015d220 0x7f511015b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:07.415 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.408+0000 7f51153c1700 1 --2- 172.21.15.92:0/3415783943 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5110071260 0x7f5110144200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:07.415 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.408+0000 7f51153c1700 1 --2- 172.21.15.92:0/3415783943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51100af390 0x7f5110158bd0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:07.415 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.408+0000 7f51153c1700 1 -- 172.21.15.92:0/3415783943 >> 172.21.15.92:0/3415783943 conn(0x7f511006b430 msgr2=0x7f5110071a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:07.416 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.408+0000 7f51153c1700 1 -- 172.21.15.92:0/3415783943 shutdown_connections 2023-08-26T09:26:07.416 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.408+0000 7f51153c1700 1 -- 172.21.15.92:0/3415783943 wait complete. 2023-08-26T09:26:07.424 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-26T09:26:07.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.545+0000 7f12553e6700 1 Processor -- start 2023-08-26T09:26:07.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.545+0000 7f12553e6700 1 -- start start 2023-08-26T09:26:07.551 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.546+0000 7f12553e6700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f125015d490 0x7f125006b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:07.551 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.546+0000 7f12553e6700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f12500b6250 0x7f12500b66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:07.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.546+0000 7f12553e6700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12500d25d0 con 0x7f12500b1eb0 2023-08-26T09:26:07.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.546+0000 7f12553e6700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12500cdc70 con 0x7f12500b6250 2023-08-26T09:26:07.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.546+0000 7f12553e6700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f125015d870 con 0x7f125015d490 2023-08-26T09:26:07.553 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.546+0000 7f124f7fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f12500b6250 0x7f12500b66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:07.553 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.546+0000 7f124f7fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f12500b6250 0x7f12500b66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46482/0 (socket says 172.21.15.92:46482) 2023-08-26T09:26:07.553 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.546+0000 7f124f7fe700 1 -- 172.21.15.92:0/2568319216 learned_addr learned my addr 172.21.15.92:0/2568319216 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:07.553 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.546+0000 7f124effd700 1 --2- 172.21.15.92:0/2568319216 >> v2:172.21.15.188:3300/0 conn(0x7f125015d490 0x7f125006b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:07.553 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.546+0000 7f124f7fe700 1 -- 172.21.15.92:0/2568319216 >> v2:172.21.15.188:3300/0 conn(0x7f125015d490 msgr2=0x7f125006b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:07.553 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.546+0000 7f124f7fe700 1 --2- 172.21.15.92:0/2568319216 >> v2:172.21.15.188:3300/0 conn(0x7f125015d490 0x7f125006b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:07.554 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.546+0000 7f124f7fe700 1 -- 172.21.15.92:0/2568319216 >> v1:172.21.15.188:6789/0 conn(0x7f12500b1eb0 legacy=0x7f12500ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:07.554 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.546+0000 7f124f7fe700 1 -- 172.21.15.92:0/2568319216 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12500b57e0 con 0x7f12500b6250 2023-08-26T09:26:07.554 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.546+0000 7f124f7fe700 1 --2- 172.21.15.92:0/2568319216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12500b6250 0x7f12500b66e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f1250073f00 tx=0x7f124800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad41e46c4cf24bc6 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:07.554 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.546+0000 7f124dffb700 1 -- 172.21.15.92:0/2568319216 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124800e070 con 0x7f12500b6250 2023-08-26T09:26:07.554 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.547+0000 7f124dffb700 1 -- 172.21.15.92:0/2568319216 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1248003a20 con 0x7f12500b6250 2023-08-26T09:26:07.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.547+0000 7f124dffb700 1 -- 172.21.15.92:0/2568319216 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1248003dd0 con 0x7f12500b6250 2023-08-26T09:26:07.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.547+0000 7f12553e6700 1 -- 172.21.15.92:0/2568319216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12500b6250 msgr2=0x7f12500b66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:07.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.547+0000 7f12553e6700 1 --2- 172.21.15.92:0/2568319216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12500b6250 0x7f12500b66e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f1250073f00 tx=0x7f124800b330 comp rx=0 tx=0).stop 2023-08-26T09:26:07.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.547+0000 7f12553e6700 1 -- 172.21.15.92:0/2568319216 shutdown_connections 2023-08-26T09:26:07.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.547+0000 7f12553e6700 1 --2- 172.21.15.92:0/2568319216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12500b6250 0x7f12500b66e0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:07.556 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.547+0000 7f12553e6700 1 --2- 172.21.15.92:0/2568319216 >> v2:172.21.15.188:3300/0 conn(0x7f125015d490 0x7f125006b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:07.556 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.547+0000 7f12553e6700 1 -- 172.21.15.92:0/2568319216 >> 172.21.15.92:0/2568319216 conn(0x7f125006aac0 msgr2=0x7f125006aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:07.556 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.547+0000 7f12553e6700 1 -- 172.21.15.92:0/2568319216 shutdown_connections 2023-08-26T09:26:07.556 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.547+0000 7f12553e6700 1 -- 172.21.15.92:0/2568319216 wait complete. 2023-08-26T09:26:07.559 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.548+0000 7f12553e6700 1 Processor -- start 2023-08-26T09:26:07.559 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.548+0000 7f12553e6700 1 -- start start 2023-08-26T09:26:07.559 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.549+0000 7f12553e6700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12500b1eb0 0x7f12501f54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:07.559 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.549+0000 7f12553e6700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12500b6250 0x7f12500b4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:07.559 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.549+0000 7f12553e6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f125015d490 0x7f12500b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:07.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.549+0000 7f12553e6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12500c8dd0 con 0x7f125015d490 2023-08-26T09:26:07.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.549+0000 7f12553e6700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12501f5a00 con 0x7f12500b6250 2023-08-26T09:26:07.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.549+0000 7f12553e6700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12500c8250 con 0x7f12500b1eb0 2023-08-26T09:26:07.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.549+0000 7f124f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f125015d490 0x7f12500b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:07.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.549+0000 7f124f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f125015d490 0x7f12500b4fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46488/0 (socket says 172.21.15.92:46488) 2023-08-26T09:26:07.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.549+0000 7f124f7fe700 1 -- 172.21.15.92:0/2516299371 learned_addr learned my addr 172.21.15.92:0/2516299371 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:07.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.549+0000 7f124effd700 1 --2- 172.21.15.92:0/2516299371 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12500b1eb0 0x7f12501f54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:07.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.549+0000 7f124e7fc700 1 --2- 172.21.15.92:0/2516299371 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12500b6250 0x7f12500b4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:07.562 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.550+0000 7f124f7fe700 1 -- 172.21.15.92:0/2516299371 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12500b1eb0 msgr2=0x7f12501f54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:07.562 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.550+0000 7f124f7fe700 1 --2- 172.21.15.92:0/2516299371 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12500b1eb0 0x7f12501f54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:07.562 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.550+0000 7f124f7fe700 1 -- 172.21.15.92:0/2516299371 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12500b6250 msgr2=0x7f12500b4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:07.562 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.550+0000 7f124f7fe700 1 --2- 172.21.15.92:0/2516299371 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12500b6250 0x7f12500b4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:07.562 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.550+0000 7f124f7fe700 1 -- 172.21.15.92:0/2516299371 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1248009b30 con 0x7f125015d490 2023-08-26T09:26:07.563 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.550+0000 7f124f7fe700 1 --2- 172.21.15.92:0/2516299371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f125015d490 0x7f12500b4fd0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1248015040 tx=0x7f1248004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:07.563 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.550+0000 7f12377fe700 1 -- 172.21.15.92:0/2516299371 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12480094d0 con 0x7f125015d490 2023-08-26T09:26:07.563 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.550+0000 7f12377fe700 1 -- 172.21.15.92:0/2516299371 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1248004240 con 0x7f125015d490 2023-08-26T09:26:07.563 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.550+0000 7f12553e6700 1 -- 172.21.15.92:0/2516299371 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12500c8530 con 0x7f125015d490 2023-08-26T09:26:07.563 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.550+0000 7f12377fe700 1 -- 172.21.15.92:0/2516299371 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1248004630 con 0x7f125015d490 2023-08-26T09:26:07.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.550+0000 7f12553e6700 1 -- 172.21.15.92:0/2516299371 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12500c8af0 con 0x7f125015d490 2023-08-26T09:26:07.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.551+0000 7f12377fe700 1 -- 172.21.15.92:0/2516299371 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1248019070 con 0x7f125015d490 2023-08-26T09:26:07.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.551+0000 7f12553e6700 1 -- 172.21.15.92:0/2516299371 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f125004eeb0 con 0x7f125015d490 2023-08-26T09:26:07.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.552+0000 7f12377fe700 1 --2- 172.21.15.92:0/2516299371 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f123c06a0e0 0x7f123c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:07.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.552+0000 7f12377fe700 1 -- 172.21.15.92:0/2516299371 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f1248089340 con 0x7f125015d490 2023-08-26T09:26:07.565 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.552+0000 7f124effd700 1 --2- 172.21.15.92:0/2516299371 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f123c06a0e0 0x7f123c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:07.565 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.552+0000 7f124effd700 1 --2- 172.21.15.92:0/2516299371 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f123c06a0e0 0x7f123c06c5a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1244006b20 tx=0x7f1244008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:07.565 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.556+0000 7f12377fe700 1 -- 172.21.15.92:0/2516299371 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1248058510 con 0x7f125015d490 2023-08-26T09:26:07.748 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.744+0000 7f12553e6700 1 -- 172.21.15.92:0/2516299371 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f12500cd950 con 0x7f125015d490 2023-08-26T09:26:07.748 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.745+0000 7f12377fe700 1 -- 172.21.15.92:0/2516299371 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f12480580a0 con 0x7f125015d490 2023-08-26T09:26:07.749 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 64 2023-08-26T09:26:07.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.747+0000 7f12553e6700 1 -- 172.21.15.92:0/2516299371 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f123c06a0e0 msgr2=0x7f123c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:07.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.747+0000 7f12553e6700 1 --2- 172.21.15.92:0/2516299371 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f123c06a0e0 0x7f123c06c5a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1244006b20 tx=0x7f1244008040 comp rx=0 tx=0).stop 2023-08-26T09:26:07.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.747+0000 7f12553e6700 1 -- 172.21.15.92:0/2516299371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f125015d490 msgr2=0x7f12500b4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:07.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.747+0000 7f12553e6700 1 --2- 172.21.15.92:0/2516299371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f125015d490 0x7f12500b4fd0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1248015040 tx=0x7f1248004ad0 comp rx=0 tx=0).stop 2023-08-26T09:26:07.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.747+0000 7f12553e6700 1 -- 172.21.15.92:0/2516299371 shutdown_connections 2023-08-26T09:26:07.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.747+0000 7f12553e6700 1 --2- 172.21.15.92:0/2516299371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f125015d490 0x7f12500b4fd0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:07.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.747+0000 7f12553e6700 1 --2- 172.21.15.92:0/2516299371 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12500b1eb0 0x7f12501f54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:07.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.747+0000 7f12553e6700 1 --2- 172.21.15.92:0/2516299371 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f123c06a0e0 0x7f123c06c5a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:07.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.747+0000 7f12553e6700 1 --2- 172.21.15.92:0/2516299371 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12500b6250 0x7f12500b4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:07.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.747+0000 7f12553e6700 1 -- 172.21.15.92:0/2516299371 >> 172.21.15.92:0/2516299371 conn(0x7f125006aac0 msgr2=0x7f12500ce040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:07.753 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.747+0000 7f12553e6700 1 -- 172.21.15.92:0/2516299371 shutdown_connections 2023-08-26T09:26:07.753 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.747+0000 7f12553e6700 1 -- 172.21.15.92:0/2516299371 wait complete. 2023-08-26T09:26:07.764 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-26T09:26:07.885 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.881+0000 7effb9328700 1 Processor -- start 2023-08-26T09:26:07.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.882+0000 7effb9328700 1 -- start start 2023-08-26T09:26:07.888 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.882+0000 7effb9328700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7effb40ca620 0x7effb40caa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:07.888 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.882+0000 7effb9328700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7effb415d6c0 0x7effb40cea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:07.888 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.882+0000 7effb9328700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7effb40cef70 0x7effb406a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:07.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.882+0000 7effb9328700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effb40cb4a0 con 0x7effb40ca620 2023-08-26T09:26:07.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.882+0000 7effb9328700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effb40cf4d0 con 0x7effb415d6c0 2023-08-26T09:26:07.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.882+0000 7effb9328700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb40caf40 con 0x7effb40cef70 2023-08-26T09:26:07.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.882+0000 7effb2ffd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7effb40ca620 0x7effb40caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:07.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.882+0000 7effb2ffd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7effb40ca620 0x7effb40caa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46492/0 (socket says 172.21.15.92:46492) 2023-08-26T09:26:07.890 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.882+0000 7effb2ffd700 1 -- 172.21.15.92:0/3966081657 learned_addr learned my addr 172.21.15.92:0/3966081657 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:07.890 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.883+0000 7effb37fe700 1 --2- 172.21.15.92:0/3966081657 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7effb40cef70 0x7effb406a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:07.890 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.883+0000 7effb27fc700 1 --2- 172.21.15.92:0/3966081657 >> v2:172.21.15.188:3300/0 conn(0x7effb415d6c0 0x7effb40cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:07.890 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.883+0000 7effb2ffd700 1 -- 172.21.15.92:0/3966081657 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7effb40cef70 msgr2=0x7effb406a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:07.890 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.883+0000 7effb2ffd700 1 --2- 172.21.15.92:0/3966081657 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7effb40cef70 0x7effb406a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:07.891 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.883+0000 7effb2ffd700 1 -- 172.21.15.92:0/3966081657 >> v2:172.21.15.188:3300/0 conn(0x7effb415d6c0 msgr2=0x7effb40cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:07.891 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.883+0000 7effb2ffd700 1 --2- 172.21.15.92:0/3966081657 >> v2:172.21.15.188:3300/0 conn(0x7effb415d6c0 0x7effb40cea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:07.891 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.883+0000 7effb2ffd700 1 -- 172.21.15.92:0/3966081657 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb40ce3b0 con 0x7effb40ca620 2023-08-26T09:26:07.891 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.883+0000 7effb37fe700 1 --2- 172.21.15.92:0/3966081657 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7effb40cef70 0x7effb406a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:26:07.891 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.883+0000 7effb2ffd700 1 --2- 172.21.15.92:0/3966081657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effb40ca620 0x7effb40caa00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7effb4066a80 tx=0x7effa8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a951ed2dde12e80 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:07.892 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.883+0000 7effb1ffb700 1 -- 172.21.15.92:0/3966081657 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa800b870 con 0x7effb40ca620 2023-08-26T09:26:07.892 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.883+0000 7effb1ffb700 1 -- 172.21.15.92:0/3966081657 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa800b9d0 con 0x7effb40ca620 2023-08-26T09:26:07.892 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.883+0000 7effb1ffb700 1 -- 172.21.15.92:0/3966081657 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa800bd60 con 0x7effb40ca620 2023-08-26T09:26:07.892 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.884+0000 7effb9328700 1 -- 172.21.15.92:0/3966081657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effb40ca620 msgr2=0x7effb40caa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:07.892 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.884+0000 7effb9328700 1 --2- 172.21.15.92:0/3966081657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effb40ca620 0x7effb40caa00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7effb4066a80 tx=0x7effa8009bd0 comp rx=0 tx=0).stop 2023-08-26T09:26:07.893 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.884+0000 7effb9328700 1 -- 172.21.15.92:0/3966081657 shutdown_connections 2023-08-26T09:26:07.893 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.884+0000 7effb9328700 1 --2- 172.21.15.92:0/3966081657 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7effb40cef70 0x7effb406a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:07.893 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.884+0000 7effb9328700 1 --2- 172.21.15.92:0/3966081657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effb40ca620 0x7effb40caa00 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:07.893 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.884+0000 7effb9328700 1 --2- 172.21.15.92:0/3966081657 >> v2:172.21.15.188:3300/0 conn(0x7effb415d6c0 0x7effb40cea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:07.893 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.884+0000 7effb9328700 1 -- 172.21.15.92:0/3966081657 >> 172.21.15.92:0/3966081657 conn(0x7effb40cc7b0 msgr2=0x7effb40ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:07.893 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.884+0000 7effb9328700 1 -- 172.21.15.92:0/3966081657 shutdown_connections 2023-08-26T09:26:07.894 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.884+0000 7effb9328700 1 -- 172.21.15.92:0/3966081657 wait complete. 2023-08-26T09:26:07.896 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.885+0000 7effb9328700 1 Processor -- start 2023-08-26T09:26:07.896 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.885+0000 7effb9328700 1 -- start start 2023-08-26T09:26:07.897 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.886+0000 7effb9328700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7effb40ca620 0x7effb41605b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:07.897 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.886+0000 7effb9328700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7effb40cef70 0x7effb4157340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:07.897 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.886+0000 7effb9328700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effb415d6c0 0x7effb40c6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:07.897 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.886+0000 7effb9328700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb41f63c0 con 0x7effb415d6c0 2023-08-26T09:26:07.897 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.886+0000 7effb9328700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb415f510 con 0x7effb40cef70 2023-08-26T09:26:07.898 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.886+0000 7effb9328700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb415f7f0 con 0x7effb40ca620 2023-08-26T09:26:07.898 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.886+0000 7effb37fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effb415d6c0 0x7effb40c6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:07.898 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.886+0000 7effb37fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effb415d6c0 0x7effb40c6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46502/0 (socket says 172.21.15.92:46502) 2023-08-26T09:26:07.898 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.886+0000 7effb37fe700 1 -- 172.21.15.92:0/2051311668 learned_addr learned my addr 172.21.15.92:0/2051311668 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:07.898 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.886+0000 7effb27fc700 1 --2- 172.21.15.92:0/2051311668 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7effb40cef70 0x7effb4157340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:07.899 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.886+0000 7effb2ffd700 1 --2- 172.21.15.92:0/2051311668 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7effb40ca620 0x7effb41605b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:07.899 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.886+0000 7effb37fe700 1 -- 172.21.15.92:0/2051311668 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7effb40ca620 msgr2=0x7effb41605b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:07.899 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.886+0000 7effb37fe700 1 --2- 172.21.15.92:0/2051311668 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7effb40ca620 0x7effb41605b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:07.899 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.886+0000 7effb37fe700 1 -- 172.21.15.92:0/2051311668 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7effb40cef70 msgr2=0x7effb4157340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:07.899 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.886+0000 7effb37fe700 1 --2- 172.21.15.92:0/2051311668 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7effb40cef70 0x7effb4157340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:07.900 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.886+0000 7effb37fe700 1 -- 172.21.15.92:0/2051311668 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa8009550 con 0x7effb415d6c0 2023-08-26T09:26:07.900 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.886+0000 7effb37fe700 1 --2- 172.21.15.92:0/2051311668 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effb415d6c0 0x7effb40c6e00 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7effac007e10 tx=0x7effac00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:07.900 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.887+0000 7eff9b7fe700 1 -- 172.21.15.92:0/2051311668 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac00dd20 con 0x7effb415d6c0 2023-08-26T09:26:07.900 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.887+0000 7eff9b7fe700 1 -- 172.21.15.92:0/2051311668 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effac00f040 con 0x7effb415d6c0 2023-08-26T09:26:07.900 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.887+0000 7effb9328700 1 -- 172.21.15.92:0/2051311668 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effb415fad0 con 0x7effb415d6c0 2023-08-26T09:26:07.901 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.887+0000 7eff9b7fe700 1 -- 172.21.15.92:0/2051311668 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac003c60 con 0x7effb415d6c0 2023-08-26T09:26:07.901 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.887+0000 7effb9328700 1 -- 172.21.15.92:0/2051311668 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effb4160090 con 0x7effb415d6c0 2023-08-26T09:26:07.901 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.887+0000 7effb9328700 1 -- 172.21.15.92:0/2051311668 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effb41602b0 con 0x7effb415d6c0 2023-08-26T09:26:07.901 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.888+0000 7eff9b7fe700 1 -- 172.21.15.92:0/2051311668 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7effac004030 con 0x7effb415d6c0 2023-08-26T09:26:07.901 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.888+0000 7eff9b7fe700 1 --2- 172.21.15.92:0/2051311668 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7effa006a0e0 0x7effa006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:07.902 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.888+0000 7eff9b7fe700 1 -- 172.21.15.92:0/2051311668 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7effac088570 con 0x7effb415d6c0 2023-08-26T09:26:07.902 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.888+0000 7effb2ffd700 1 --2- 172.21.15.92:0/2051311668 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7effa006a0e0 0x7effa006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:07.902 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.889+0000 7effb2ffd700 1 --2- 172.21.15.92:0/2051311668 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7effa006a0e0 0x7effa006c5a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7effa8009840 tx=0x7effa8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:07.902 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:07.893+0000 7eff9b7fe700 1 -- 172.21.15.92:0/2051311668 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7effac053c20 con 0x7effb415d6c0 2023-08-26T09:26:08.130 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.126+0000 7effb9328700 1 -- 172.21.15.92:0/2051311668 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7effb404e660 con 0x7effb415d6c0 2023-08-26T09:26:08.130 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.126+0000 7eff9b7fe700 1 -- 172.21.15.92:0/2051311668 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4863 (secure 0 0 0) 0x7effac057240 con 0x7effb415d6c0 2023-08-26T09:26:08.131 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:26:08.131 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/856608283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6833","nonce":856608283},{"type":"v1","addr":"172.21.15.188:6835","nonce":856608283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4279,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/33581841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":33581841},{"type":"v1","addr":"172.21.15.92:6837","nonce":33581841}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6834/279535547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":279535547},{"type":"v1","addr":"172.21.15.188:6834","nonce":279535547}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-26T09:25:13.851186+0000","modified":"2023-08-26T09:25:17.482682+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6835/2933877114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2933877114},{"type":"v1","addr":"172.21.15.92:6835","nonce":2933877114}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-26T09:26:08.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.129+0000 7effb9328700 1 -- 172.21.15.92:0/2051311668 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7effa006a0e0 msgr2=0x7effa006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:08.133 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.129+0000 7effb9328700 1 --2- 172.21.15.92:0/2051311668 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7effa006a0e0 0x7effa006c5a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7effa8009840 tx=0x7effa8008030 comp rx=0 tx=0).stop 2023-08-26T09:26:08.133 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.129+0000 7effb9328700 1 -- 172.21.15.92:0/2051311668 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effb415d6c0 msgr2=0x7effb40c6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:08.133 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.129+0000 7effb9328700 1 --2- 172.21.15.92:0/2051311668 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effb415d6c0 0x7effb40c6e00 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7effac007e10 tx=0x7effac00d3b0 comp rx=0 tx=0).stop 2023-08-26T09:26:08.133 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.129+0000 7effb9328700 1 -- 172.21.15.92:0/2051311668 shutdown_connections 2023-08-26T09:26:08.134 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.129+0000 7effb9328700 1 --2- 172.21.15.92:0/2051311668 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effb415d6c0 0x7effb40c6e00 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:08.134 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.129+0000 7effb9328700 1 --2- 172.21.15.92:0/2051311668 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7effb40ca620 0x7effb41605b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:08.134 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.129+0000 7effb9328700 1 --2- 172.21.15.92:0/2051311668 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7effa006a0e0 0x7effa006c5a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:08.134 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.129+0000 7effb9328700 1 --2- 172.21.15.92:0/2051311668 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7effb40cef70 0x7effb4157340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:08.134 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.129+0000 7effb9328700 1 -- 172.21.15.92:0/2051311668 >> 172.21.15.92:0/2051311668 conn(0x7effb40cc7b0 msgr2=0x7effb4070e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:08.135 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.129+0000 7effb9328700 1 -- 172.21.15.92:0/2051311668 shutdown_connections 2023-08-26T09:26:08.135 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.129+0000 7effb9328700 1 -- 172.21.15.92:0/2051311668 wait complete. 2023-08-26T09:26:08.135 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 7 2023-08-26T09:26:08.145 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-26T09:26:08.265 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.261+0000 7fb736c2a700 1 Processor -- start 2023-08-26T09:26:08.265 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.261+0000 7fb736c2a700 1 -- start start 2023-08-26T09:26:08.269 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.261+0000 7fb736c2a700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb73006d2b0 0x7fb7300cb610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:08.269 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.261+0000 7fb736c2a700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb73006f470 con 0x7fb73006ce50 2023-08-26T09:26:08.269 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.262+0000 7fb736c2a700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb73006f750 con 0x7fb73015e770 2023-08-26T09:26:08.269 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.262+0000 7fb736c2a700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb73015eb50 con 0x7fb73006d2b0 2023-08-26T09:26:08.269 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.262+0000 7fb72ffff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fb73006ce50 0x7fb7300caf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:58522/0 (socket says 172.21.15.92:58522) 2023-08-26T09:26:08.270 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.262+0000 7fb72ffff700 1 -- 172.21.15.92:0/3813763563 learned_addr learned my addr 172.21.15.92:0/3813763563 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:26:08.270 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.262+0000 7fb72f7fe700 1 -- 172.21.15.92:0/3813763563 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3868587499 0 0) 0x7fb73006f470 con 0x7fb73006ce50 2023-08-26T09:26:08.270 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.262+0000 7fb7351c7700 1 --2- 172.21.15.92:0/3813763563 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb73006d2b0 0x7fb7300cb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:08.270 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.262+0000 7fb72f7fe700 1 -- 172.21.15.92:0/3813763563 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7200035b0 con 0x7fb73006ce50 2023-08-26T09:26:08.270 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.262+0000 7fb72f7fe700 1 -- 172.21.15.92:0/3813763563 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1501433719 0 0) 0x7fb7200035b0 con 0x7fb73006ce50 2023-08-26T09:26:08.271 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.262+0000 7fb72f7fe700 1 -- 172.21.15.92:0/3813763563 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb73006d2b0 msgr2=0x7fb7300cb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:08.271 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.262+0000 7fb72f7fe700 1 --2- 172.21.15.92:0/3813763563 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb73006d2b0 0x7fb7300cb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:08.271 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.262+0000 7fb72f7fe700 1 -- 172.21.15.92:0/3813763563 >> v1:172.21.15.188:6789/0 conn(0x7fb73015e770 legacy=0x7fb73006ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:08.271 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.262+0000 7fb72f7fe700 1 -- 172.21.15.92:0/3813763563 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7300ca420 con 0x7fb73006ce50 2023-08-26T09:26:08.271 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.262+0000 7fb72f7fe700 1 -- 172.21.15.92:0/3813763563 <== mon.0 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1019361464 0 0) 0x7fb71c001670 con 0x7fb73006ce50 2023-08-26T09:26:08.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.262+0000 7fb72f7fe700 1 -- 172.21.15.92:0/3813763563 >> v1:172.21.15.92:6789/0 conn(0x7fb73006ce50 legacy=0x7fb7300caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:08.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.262+0000 7fb72f7fe700 1 --2- 172.21.15.92:0/3813763563 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb720003a30 0x7fb720003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:08.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.262+0000 7fb72f7fe700 1 --2- 172.21.15.92:0/3813763563 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb73006d2b0 0x7fb720004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:08.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.262+0000 7fb72f7fe700 1 --2- 172.21.15.92:0/3813763563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb720004d90 0x7fb720005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:08.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.262+0000 7fb72f7fe700 1 -- 172.21.15.92:0/3813763563 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb73015eb50 con 0x7fb720004d90 2023-08-26T09:26:08.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.262+0000 7fb72f7fe700 1 -- 172.21.15.92:0/3813763563 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72000ba40 con 0x7fb720003a30 2023-08-26T09:26:08.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.262+0000 7fb72f7fe700 1 -- 172.21.15.92:0/3813763563 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb72000bc00 con 0x7fb73006d2b0 2023-08-26T09:26:08.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.262+0000 7fb7351c7700 1 --2- 172.21.15.92:0/3813763563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb720004d90 0x7fb720005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:08.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.262+0000 7fb7349c6700 1 --2- 172.21.15.92:0/3813763563 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb720003a30 0x7fb720003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:08.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.262+0000 7fb72ffff700 1 --2- 172.21.15.92:0/3813763563 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb73006d2b0 0x7fb720004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:08.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.263+0000 7fb7351c7700 1 -- 172.21.15.92:0/3813763563 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb73006d2b0 msgr2=0x7fb720004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:08.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.263+0000 7fb7351c7700 1 --2- 172.21.15.92:0/3813763563 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb73006d2b0 0x7fb720004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:08.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.263+0000 7fb7351c7700 1 -- 172.21.15.92:0/3813763563 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb720003a30 msgr2=0x7fb720003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:08.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.263+0000 7fb7351c7700 1 --2- 172.21.15.92:0/3813763563 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb720003a30 0x7fb720003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:08.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.263+0000 7fb7351c7700 1 -- 172.21.15.92:0/3813763563 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7200035b0 con 0x7fb720004d90 2023-08-26T09:26:08.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.263+0000 7fb72ffff700 1 --2- 172.21.15.92:0/3813763563 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb73006d2b0 0x7fb720004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:26:08.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.263+0000 7fb7351c7700 1 --2- 172.21.15.92:0/3813763563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb720004d90 0x7fb720005210 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fb728009fc0 tx=0x7fb720005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a58f4adcaebd3040 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:08.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.263+0000 7fb72f7fe700 1 -- 172.21.15.92:0/3813763563 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72800ec30 con 0x7fb720004d90 2023-08-26T09:26:08.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.263+0000 7fb72f7fe700 1 -- 172.21.15.92:0/3813763563 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb72800f040 con 0x7fb720004d90 2023-08-26T09:26:08.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.263+0000 7fb72f7fe700 1 -- 172.21.15.92:0/3813763563 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb728014480 con 0x7fb720004d90 2023-08-26T09:26:08.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.263+0000 7fb736c2a700 1 -- 172.21.15.92:0/3813763563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb720004d90 msgr2=0x7fb720005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:08.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.263+0000 7fb736c2a700 1 --2- 172.21.15.92:0/3813763563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb720004d90 0x7fb720005210 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fb728009fc0 tx=0x7fb720005880 comp rx=0 tx=0).stop 2023-08-26T09:26:08.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.263+0000 7fb7351c7700 1 -- 172.21.15.92:0/3813763563 reap_dead start 2023-08-26T09:26:08.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.264+0000 7fb736c2a700 1 -- 172.21.15.92:0/3813763563 shutdown_connections 2023-08-26T09:26:08.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.264+0000 7fb736c2a700 1 -- 172.21.15.92:0/3813763563 >> 172.21.15.92:0/3813763563 conn(0x7fb7300cc7b0 msgr2=0x7fb7300ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:08.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.264+0000 7fb736c2a700 1 -- 172.21.15.92:0/3813763563 shutdown_connections 2023-08-26T09:26:08.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.264+0000 7fb736c2a700 1 -- 172.21.15.92:0/3813763563 wait complete. 2023-08-26T09:26:08.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.265+0000 7fb736c2a700 1 Processor -- start 2023-08-26T09:26:08.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.265+0000 7fb736c2a700 1 -- start start 2023-08-26T09:26:08.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.266+0000 7fb736c2a700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb7301510e0 0x7fb7300cf320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:08.281 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.266+0000 7fb736c2a700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb7301514c0 0x7fb7301f2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:08.281 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.266+0000 7fb736c2a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7300b0fa0 0x7fb730159670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:08.281 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.266+0000 7fb736c2a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7300cf860 con 0x7fb7300b0fa0 2023-08-26T09:26:08.281 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.266+0000 7fb736c2a700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7301f2c70 con 0x7fb7301510e0 2023-08-26T09:26:08.281 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.266+0000 7fb736c2a700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7300c7e50 con 0x7fb7301514c0 2023-08-26T09:26:08.281 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.266+0000 7fb7351c7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7300b0fa0 0x7fb730159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:08.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.266+0000 7fb7351c7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7300b0fa0 0x7fb730159670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46522/0 (socket says 172.21.15.92:46522) 2023-08-26T09:26:08.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.266+0000 7fb7351c7700 1 -- 172.21.15.92:0/1137043060 learned_addr learned my addr 172.21.15.92:0/1137043060 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:08.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.266+0000 7fb72ffff700 1 --2- 172.21.15.92:0/1137043060 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb7301514c0 0x7fb7301f2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:08.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.266+0000 7fb7351c7700 1 -- 172.21.15.92:0/1137043060 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb7301514c0 msgr2=0x7fb7301f2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:08.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.266+0000 7fb7349c6700 1 --2- 172.21.15.92:0/1137043060 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb7301510e0 0x7fb7300cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:08.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.266+0000 7fb7351c7700 1 --2- 172.21.15.92:0/1137043060 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb7301514c0 0x7fb7301f2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:08.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.266+0000 7fb7351c7700 1 -- 172.21.15.92:0/1137043060 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb7301510e0 msgr2=0x7fb7300cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:08.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.266+0000 7fb7351c7700 1 --2- 172.21.15.92:0/1137043060 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb7301510e0 0x7fb7300cf320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:08.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.266+0000 7fb7351c7700 1 -- 172.21.15.92:0/1137043060 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7300c80a0 con 0x7fb7300b0fa0 2023-08-26T09:26:08.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.266+0000 7fb7349c6700 1 --2- 172.21.15.92:0/1137043060 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb7301510e0 0x7fb7300cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:26:08.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.266+0000 7fb7351c7700 1 --2- 172.21.15.92:0/1137043060 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7300b0fa0 0x7fb730159670 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb728009f60 tx=0x7fb728009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:08.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.266+0000 7fb72d7fa700 1 -- 172.21.15.92:0/1137043060 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb728007000 con 0x7fb7300b0fa0 2023-08-26T09:26:08.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.266+0000 7fb72d7fa700 1 -- 172.21.15.92:0/1137043060 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb728003e30 con 0x7fb7300b0fa0 2023-08-26T09:26:08.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.266+0000 7fb736c2a700 1 -- 172.21.15.92:0/1137043060 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7300c8380 con 0x7fb7300b0fa0 2023-08-26T09:26:08.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.266+0000 7fb72d7fa700 1 -- 172.21.15.92:0/1137043060 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb728015b20 con 0x7fb7300b0fa0 2023-08-26T09:26:08.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.266+0000 7fb736c2a700 1 -- 172.21.15.92:0/1137043060 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7300c8940 con 0x7fb7300b0fa0 2023-08-26T09:26:08.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.267+0000 7fb736c2a700 1 -- 172.21.15.92:0/1137043060 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb73004e660 con 0x7fb7300b0fa0 2023-08-26T09:26:08.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.268+0000 7fb72d7fa700 1 -- 172.21.15.92:0/1137043060 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb728015c80 con 0x7fb7300b0fa0 2023-08-26T09:26:08.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.268+0000 7fb72d7fa700 1 --2- 172.21.15.92:0/1137043060 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb71406a0e0 0x7fb71406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:08.286 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.268+0000 7fb72d7fa700 1 -- 172.21.15.92:0/1137043060 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fb728089790 con 0x7fb7300b0fa0 2023-08-26T09:26:08.286 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.268+0000 7fb7349c6700 1 --2- 172.21.15.92:0/1137043060 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb71406a0e0 0x7fb71406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:08.286 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.269+0000 7fb7349c6700 1 --2- 172.21.15.92:0/1137043060 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb71406a0e0 0x7fb71406c5a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb7240011a0 tx=0x7fb724009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:08.286 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.272+0000 7fb72d7fa700 1 -- 172.21.15.92:0/1137043060 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb728054ed0 con 0x7fb7300b0fa0 2023-08-26T09:26:08.468 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.464+0000 7fb736c2a700 1 -- 172.21.15.92:0/1137043060 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb730071f30 con 0x7fb7300b0fa0 2023-08-26T09:26:08.469 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.465+0000 7fb72d7fa700 1 -- 172.21.15.92:0/1137043060 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18304 (secure 0 0 0) 0x7fb7280584f0 con 0x7fb7300b0fa0 2023-08-26T09:26:08.469 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:26:08.470 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":22,"fsid":"254a2d31-bd41-4507-8326-1b205ac24377","created":"2023-08-26T09:24:55.352131+0000","modified":"2023-08-26T09:26:02.241818+0000","last_up_change":"2023-08-26T09:25:06.124496+0000","last_in_change":"2023-08-26T09:24:57.840725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-26T09:25:06.650431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-26T09:25:06.973382+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-26T09:25:11.584141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-26T09:25:12.814990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e9e7638-4459-4d8d-8e40-130bcf48df66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6819","nonce":382827192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6824","nonce":382827192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6831","nonce":382827192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6827","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6829","nonce":382827192}]},"public_addr":"172.21.15.92:6819/382827192","cluster_addr":"172.21.15.92:6824/382827192","heartbeat_back_addr":"172.21.15.92:6831/382827192","heartbeat_front_addr":"172.21.15.92:6829/382827192","state":["exists","up"]},{"osd":1,"uuid":"164e68c9-aedd-4df5-9b70-f4b1ec3bda13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6809","nonce":618773438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6811","nonce":618773438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6815","nonce":618773438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6813","nonce":618773438}]},"public_addr":"172.21.15.92:6809/618773438","cluster_addr":"172.21.15.92:6811/618773438","heartbeat_back_addr":"172.21.15.92:6815/618773438","heartbeat_front_addr":"172.21.15.92:6813/618773438","state":["exists","up"]},{"osd":2,"uuid":"8701dfee-629a-4d30-82e4-b8fac340303f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6818","nonce":3697397687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6821","nonce":3697397687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6828","nonce":3697397687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6823","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6825","nonce":3697397687}]},"public_addr":"172.21.15.92:6818/3697397687","cluster_addr":"172.21.15.92:6821/3697397687","heartbeat_back_addr":"172.21.15.92:6828/3697397687","heartbeat_front_addr":"172.21.15.92:6825/3697397687","state":["exists","up"]},{"osd":3,"uuid":"93bdc94d-dc07-495f-995a-a6ad072f0247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6801","nonce":3579846453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6803","nonce":3579846453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6807","nonce":3579846453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6805","nonce":3579846453}]},"public_addr":"172.21.15.92:6801/3579846453","cluster_addr":"172.21.15.92:6803/3579846453","heartbeat_back_addr":"172.21.15.92:6807/3579846453","heartbeat_front_addr":"172.21.15.92:6805/3579846453","state":["exists","up"]},{"osd":4,"uuid":"d9d0ea80-8481-46a7-9677-c338d32cf1d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6809","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6811","nonce":3228383424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6813","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6815","nonce":3228383424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6821","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6823","nonce":3228383424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6817","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6819","nonce":3228383424}]},"public_addr":"172.21.15.188:6811/3228383424","cluster_addr":"172.21.15.188:6815/3228383424","heartbeat_back_addr":"172.21.15.188:6823/3228383424","heartbeat_front_addr":"172.21.15.188:6819/3228383424","state":["exists","up"]},{"osd":5,"uuid":"38d03253-467a-456f-bd5e-5a46532a0b18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6801","nonce":1655821054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6803","nonce":1655821054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6807","nonce":1655821054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6805","nonce":1655821054}]},"public_addr":"172.21.15.188:6801/1655821054","cluster_addr":"172.21.15.188:6803/1655821054","heartbeat_back_addr":"172.21.15.188:6807/1655821054","heartbeat_front_addr":"172.21.15.188:6805/1655821054","state":["exists","up"]},{"osd":6,"uuid":"d61564b5-136f-42e5-a843-626c2017cc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6810","nonce":2069976891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6814","nonce":2069976891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6822","nonce":2069976891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6818","nonce":2069976891}]},"public_addr":"172.21.15.188:6810/2069976891","cluster_addr":"172.21.15.188:6814/2069976891","heartbeat_back_addr":"172.21.15.188:6822/2069976891","heartbeat_front_addr":"172.21.15.188:6818/2069976891","state":["exists","up"]},{"osd":7,"uuid":"fae2949e-0d62-42cd-ba72-08f516084b20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6825","nonce":1882888860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6827","nonce":1882888860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6831","nonce":1882888860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6829","nonce":1882888860}]},"public_addr":"172.21.15.188:6825/1882888860","cluster_addr":"172.21.15.188:6827/1882888860","heartbeat_back_addr":"172.21.15.188:6831/1882888860","heartbeat_front_addr":"172.21.15.188:6829/1882888860","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.038523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.063160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.000857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.975572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.023848+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.765194+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.081365+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:05.110745+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.10","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-26T09:26:08.471 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.468+0000 7fb736c2a700 1 -- 172.21.15.92:0/1137043060 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb71406a0e0 msgr2=0x7fb71406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:08.472 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.468+0000 7fb736c2a700 1 --2- 172.21.15.92:0/1137043060 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb71406a0e0 0x7fb71406c5a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb7240011a0 tx=0x7fb724009040 comp rx=0 tx=0).stop 2023-08-26T09:26:08.472 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.468+0000 7fb736c2a700 1 -- 172.21.15.92:0/1137043060 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7300b0fa0 msgr2=0x7fb730159670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:08.472 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.468+0000 7fb736c2a700 1 --2- 172.21.15.92:0/1137043060 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7300b0fa0 0x7fb730159670 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb728009f60 tx=0x7fb728009750 comp rx=0 tx=0).stop 2023-08-26T09:26:08.472 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.468+0000 7fb736c2a700 1 -- 172.21.15.92:0/1137043060 shutdown_connections 2023-08-26T09:26:08.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.468+0000 7fb736c2a700 1 --2- 172.21.15.92:0/1137043060 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb71406a0e0 0x7fb71406c5a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:08.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.468+0000 7fb736c2a700 1 --2- 172.21.15.92:0/1137043060 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb7301510e0 0x7fb7300cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:08.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.468+0000 7fb736c2a700 1 --2- 172.21.15.92:0/1137043060 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7300b0fa0 0x7fb730159670 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:08.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.468+0000 7fb736c2a700 1 --2- 172.21.15.92:0/1137043060 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb7301514c0 0x7fb7301f2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:08.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.468+0000 7fb736c2a700 1 -- 172.21.15.92:0/1137043060 >> 172.21.15.92:0/1137043060 conn(0x7fb7300cc7b0 msgr2=0x7fb730070d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:08.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.468+0000 7fb736c2a700 1 -- 172.21.15.92:0/1137043060 shutdown_connections 2023-08-26T09:26:08.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.468+0000 7fb736c2a700 1 -- 172.21.15.92:0/1137043060 wait complete. 2023-08-26T09:26:08.484 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-26T09:26:08.484 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-26T09:26:08.605 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.601+0000 7fe6bfede700 1 Processor -- start 2023-08-26T09:26:08.605 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.602+0000 7fe6bfede700 1 -- start start 2023-08-26T09:26:08.608 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.602+0000 7fe6bfede700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe6b80aea60 0x7fe6b806d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:08.608 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.602+0000 7fe6bfede700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe6b806a980 0x7fe6b806d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:08.608 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.602+0000 7fe6bfede700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6b806dd60 con 0x7fe6b80cf0f0 2023-08-26T09:26:08.608 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.602+0000 7fe6bfede700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6b8159ea0 con 0x7fe6b80aea60 2023-08-26T09:26:08.608 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.602+0000 7fe6bfede700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6b80cf690 con 0x7fe6b806a980 2023-08-26T09:26:08.609 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.603+0000 7fe6bdc7a700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe6b80aea60 0x7fe6b806d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:08.609 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.603+0000 7fe6be47b700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fe6b80cf0f0 0x7fe6b80cc060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:58544/0 (socket says 172.21.15.92:58544) 2023-08-26T09:26:08.609 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.603+0000 7fe6be47b700 1 -- 172.21.15.92:0/4177177741 learned_addr learned my addr 172.21.15.92:0/4177177741 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:26:08.609 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.603+0000 7fe6bd479700 1 --2- 172.21.15.92:0/4177177741 >> v2:172.21.15.188:3300/0 conn(0x7fe6b806a980 0x7fe6b806d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:08.609 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.603+0000 7fe6bdc7a700 1 -- 172.21.15.92:0/4177177741 >> v2:172.21.15.188:3300/0 conn(0x7fe6b806a980 msgr2=0x7fe6b806d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:08.610 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.603+0000 7fe6bdc7a700 1 --2- 172.21.15.92:0/4177177741 >> v2:172.21.15.188:3300/0 conn(0x7fe6b806a980 0x7fe6b806d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:08.610 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.603+0000 7fe6bdc7a700 1 -- 172.21.15.92:0/4177177741 >> v1:172.21.15.92:6789/0 conn(0x7fe6b80cf0f0 legacy=0x7fe6b80cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:08.610 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.603+0000 7fe6bcc78700 1 -- 172.21.15.92:0/4177177741 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4081763883 0 0) 0x7fe6b806dd60 con 0x7fe6b80cf0f0 2023-08-26T09:26:08.610 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.603+0000 7fe6bdc7a700 1 -- 172.21.15.92:0/4177177741 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b80cf970 con 0x7fe6b80aea60 2023-08-26T09:26:08.610 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.603+0000 7fe6bdc7a700 1 --2- 172.21.15.92:0/4177177741 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6b80aea60 0x7fe6b806d2e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8070e00 tx=0x7fe6a8009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=293e5e3c56409ef2 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:08.611 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.603+0000 7fe6bcc78700 1 -- 172.21.15.92:0/4177177741 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a8005e30 con 0x7fe6b80aea60 2023-08-26T09:26:08.611 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.603+0000 7fe6bcc78700 1 -- 172.21.15.92:0/4177177741 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6a8006030 con 0x7fe6b80aea60 2023-08-26T09:26:08.611 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.603+0000 7fe6bcc78700 1 -- 172.21.15.92:0/4177177741 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a80063c0 con 0x7fe6b80aea60 2023-08-26T09:26:08.611 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.604+0000 7fe6bfede700 1 -- 172.21.15.92:0/4177177741 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6b80aea60 msgr2=0x7fe6b806d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:08.611 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.604+0000 7fe6bfede700 1 --2- 172.21.15.92:0/4177177741 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6b80aea60 0x7fe6b806d2e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8070e00 tx=0x7fe6a8009b00 comp rx=0 tx=0).stop 2023-08-26T09:26:08.612 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.604+0000 7fe6bfede700 1 -- 172.21.15.92:0/4177177741 shutdown_connections 2023-08-26T09:26:08.612 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.604+0000 7fe6bfede700 1 --2- 172.21.15.92:0/4177177741 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6b80aea60 0x7fe6b806d2e0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:08.612 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.604+0000 7fe6bfede700 1 --2- 172.21.15.92:0/4177177741 >> v2:172.21.15.188:3300/0 conn(0x7fe6b806a980 0x7fe6b806d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:08.612 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.604+0000 7fe6bfede700 1 -- 172.21.15.92:0/4177177741 >> 172.21.15.92:0/4177177741 conn(0x7fe6b80b23c0 msgr2=0x7fe6b80b27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:08.612 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.604+0000 7fe6bfede700 1 -- 172.21.15.92:0/4177177741 shutdown_connections 2023-08-26T09:26:08.613 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.604+0000 7fe6bfede700 1 -- 172.21.15.92:0/4177177741 wait complete. 2023-08-26T09:26:08.616 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.605+0000 7fe6bfede700 1 Processor -- start 2023-08-26T09:26:08.616 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.605+0000 7fe6bfede700 1 -- start start 2023-08-26T09:26:08.616 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.606+0000 7fe6bfede700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe6b806a980 0x7fe6b81ee110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:08.616 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.606+0000 7fe6bfede700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6b80aea60 0x7fe6b809cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:08.616 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.606+0000 7fe6bfede700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6b80cf0f0 0x7fe6b80b0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:08.617 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.606+0000 7fe6bfede700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b80aeed0 con 0x7fe6b80cf0f0 2023-08-26T09:26:08.617 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.606+0000 7fe6bfede700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b81ee740 con 0x7fe6b80aea60 2023-08-26T09:26:08.617 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.606+0000 7fe6bfede700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b81eea20 con 0x7fe6b806a980 2023-08-26T09:26:08.617 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.607+0000 7fe6be47b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6b80cf0f0 0x7fe6b80b0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:08.618 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.607+0000 7fe6be47b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6b80cf0f0 0x7fe6b80b0fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46536/0 (socket says 172.21.15.92:46536) 2023-08-26T09:26:08.618 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.607+0000 7fe6be47b700 1 -- 172.21.15.92:0/1689988445 learned_addr learned my addr 172.21.15.92:0/1689988445 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:08.618 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.607+0000 7fe6bdc7a700 1 --2- 172.21.15.92:0/1689988445 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe6b806a980 0x7fe6b81ee110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:08.618 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.607+0000 7fe6bd479700 1 --2- 172.21.15.92:0/1689988445 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6b80aea60 0x7fe6b809cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:08.618 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.607+0000 7fe6be47b700 1 -- 172.21.15.92:0/1689988445 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe6b806a980 msgr2=0x7fe6b81ee110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:08.618 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.607+0000 7fe6be47b700 1 --2- 172.21.15.92:0/1689988445 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe6b806a980 0x7fe6b81ee110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:08.619 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.607+0000 7fe6be47b700 1 -- 172.21.15.92:0/1689988445 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6b80aea60 msgr2=0x7fe6b809cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:08.619 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.607+0000 7fe6be47b700 1 --2- 172.21.15.92:0/1689988445 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6b80aea60 0x7fe6b809cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:08.619 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.607+0000 7fe6be47b700 1 -- 172.21.15.92:0/1689988445 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a8009430 con 0x7fe6b80cf0f0 2023-08-26T09:26:08.619 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.607+0000 7fe6be47b700 1 --2- 172.21.15.92:0/1689988445 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6b80cf0f0 0x7fe6b80b0fe0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0002210 tx=0x7fe6b000c550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:08.619 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.607+0000 7fe6ae7fc700 1 -- 172.21.15.92:0/1689988445 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b00070d0 con 0x7fe6b80cf0f0 2023-08-26T09:26:08.620 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.607+0000 7fe6ae7fc700 1 -- 172.21.15.92:0/1689988445 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6b0007230 con 0x7fe6b80cf0f0 2023-08-26T09:26:08.620 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.607+0000 7fe6bfede700 1 -- 172.21.15.92:0/1689988445 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6b81eed00 con 0x7fe6b80cf0f0 2023-08-26T09:26:08.620 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.607+0000 7fe6ae7fc700 1 -- 172.21.15.92:0/1689988445 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b00075c0 con 0x7fe6b80cf0f0 2023-08-26T09:26:08.620 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.607+0000 7fe6bfede700 1 -- 172.21.15.92:0/1689988445 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6b80b1520 con 0x7fe6b80cf0f0 2023-08-26T09:26:08.620 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.608+0000 7fe6bfede700 1 -- 172.21.15.92:0/1689988445 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6b804e660 con 0x7fe6b80cf0f0 2023-08-26T09:26:08.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.609+0000 7fe6ae7fc700 1 -- 172.21.15.92:0/1689988445 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe6b0007720 con 0x7fe6b80cf0f0 2023-08-26T09:26:08.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.609+0000 7fe6ae7fc700 1 --2- 172.21.15.92:0/1689988445 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fe69c06a0e0 0x7fe69c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:08.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.609+0000 7fe6ae7fc700 1 -- 172.21.15.92:0/1689988445 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fe6b008b2f0 con 0x7fe6b80cf0f0 2023-08-26T09:26:08.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.609+0000 7fe6bdc7a700 1 --2- 172.21.15.92:0/1689988445 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fe69c06a0e0 0x7fe69c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:08.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.609+0000 7fe6bdc7a700 1 --2- 172.21.15.92:0/1689988445 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fe69c06a0e0 0x7fe69c06c5a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8009b40 tx=0x7fe6a8008070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:08.622 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.613+0000 7fe6ae7fc700 1 -- 172.21.15.92:0/1689988445 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe6b0056a50 con 0x7fe6b80cf0f0 2023-08-26T09:26:08.849 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.845+0000 7fe6bfede700 1 -- 172.21.15.92:0/1689988445 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe6b81589c0 con 0x7fe6b80cf0f0 2023-08-26T09:26:08.850 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.846+0000 7fe6ae7fc700 1 -- 172.21.15.92:0/1689988445 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4863 (secure 0 0 0) 0x7fe6b00079d0 con 0x7fe6b80cf0f0 2023-08-26T09:26:08.850 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:26:08.850 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/856608283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6833","nonce":856608283},{"type":"v1","addr":"172.21.15.188:6835","nonce":856608283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4279,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/33581841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":33581841},{"type":"v1","addr":"172.21.15.92:6837","nonce":33581841}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6834/279535547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":279535547},{"type":"v1","addr":"172.21.15.188:6834","nonce":279535547}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-26T09:25:13.851186+0000","modified":"2023-08-26T09:25:17.482682+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6835/2933877114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2933877114},{"type":"v1","addr":"172.21.15.92:6835","nonce":2933877114}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-26T09:26:08.852 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.848+0000 7fe6bfede700 1 -- 172.21.15.92:0/1689988445 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fe69c06a0e0 msgr2=0x7fe69c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:08.852 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.848+0000 7fe6bfede700 1 --2- 172.21.15.92:0/1689988445 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fe69c06a0e0 0x7fe69c06c5a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8009b40 tx=0x7fe6a8008070 comp rx=0 tx=0).stop 2023-08-26T09:26:08.852 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.848+0000 7fe6bfede700 1 -- 172.21.15.92:0/1689988445 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6b80cf0f0 msgr2=0x7fe6b80b0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:08.853 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.848+0000 7fe6bfede700 1 --2- 172.21.15.92:0/1689988445 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6b80cf0f0 0x7fe6b80b0fe0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0002210 tx=0x7fe6b000c550 comp rx=0 tx=0).stop 2023-08-26T09:26:08.853 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.848+0000 7fe6bfede700 1 -- 172.21.15.92:0/1689988445 shutdown_connections 2023-08-26T09:26:08.853 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.848+0000 7fe6bfede700 1 --2- 172.21.15.92:0/1689988445 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6b80cf0f0 0x7fe6b80b0fe0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:08.853 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.848+0000 7fe6bfede700 1 --2- 172.21.15.92:0/1689988445 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe6b806a980 0x7fe6b81ee110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:08.853 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.848+0000 7fe6bfede700 1 --2- 172.21.15.92:0/1689988445 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fe69c06a0e0 0x7fe69c06c5a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:08.854 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.848+0000 7fe6bfede700 1 --2- 172.21.15.92:0/1689988445 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6b80aea60 0x7fe6b809cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:08.854 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.848+0000 7fe6bfede700 1 -- 172.21.15.92:0/1689988445 >> 172.21.15.92:0/1689988445 conn(0x7fe6b80b23c0 msgr2=0x7fe6b8157e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:08.854 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.848+0000 7fe6bfede700 1 -- 172.21.15.92:0/1689988445 shutdown_connections 2023-08-26T09:26:08.854 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.848+0000 7fe6bfede700 1 -- 172.21.15.92:0/1689988445 wait complete. 2023-08-26T09:26:08.855 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 7 2023-08-26T09:26:08.864 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-26T09:26:08.985 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.981+0000 7f0edef16700 1 Processor -- start 2023-08-26T09:26:08.985 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.981+0000 7f0edef16700 1 -- start start 2023-08-26T09:26:08.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.982+0000 7f0edef16700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0ed8159d60 0x7f0ed80ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:08.989 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.982+0000 7f0edef16700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ed815e490 con 0x7f0ed806d630 2023-08-26T09:26:08.989 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.982+0000 7f0edef16700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ed815e770 con 0x7f0ed806e140 2023-08-26T09:26:08.989 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.982+0000 7f0edef16700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed815ea50 con 0x7f0ed8159d60 2023-08-26T09:26:08.989 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.982+0000 7f0edd4b3700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f0ed806d630 0x7f0ed80cad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:58558/0 (socket says 172.21.15.92:58558) 2023-08-26T09:26:08.989 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.982+0000 7f0edd4b3700 1 -- 172.21.15.92:0/2002967685 learned_addr learned my addr 172.21.15.92:0/2002967685 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:26:08.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.982+0000 7f0edccb2700 1 --2- 172.21.15.92:0/2002967685 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0ed8159d60 0x7f0ed80ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:08.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.982+0000 7f0ed77fe700 1 -- 172.21.15.92:0/2002967685 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1427515014 0 0) 0x7f0ed815e490 con 0x7f0ed806d630 2023-08-26T09:26:08.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.982+0000 7f0ed77fe700 1 -- 172.21.15.92:0/2002967685 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ec80035b0 con 0x7f0ed806d630 2023-08-26T09:26:08.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.983+0000 7f0ed77fe700 1 -- 172.21.15.92:0/2002967685 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 392977059 0 0) 0x7f0ec80035b0 con 0x7f0ed806d630 2023-08-26T09:26:08.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.983+0000 7f0ed77fe700 1 -- 172.21.15.92:0/2002967685 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0ed8159d60 msgr2=0x7f0ed80ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:08.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.983+0000 7f0ed77fe700 1 --2- 172.21.15.92:0/2002967685 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0ed8159d60 0x7f0ed80ceb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:08.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.983+0000 7f0ed77fe700 1 -- 172.21.15.92:0/2002967685 >> v1:172.21.15.188:6789/0 conn(0x7f0ed806e140 legacy=0x7f0ed806cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:08.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.983+0000 7f0ed77fe700 1 -- 172.21.15.92:0/2002967685 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed80ce350 con 0x7f0ed806d630 2023-08-26T09:26:08.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.983+0000 7f0ed77fe700 1 -- 172.21.15.92:0/2002967685 <== mon.0 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1019361464 0 0) 0x7f0ed00019f0 con 0x7f0ed806d630 2023-08-26T09:26:08.992 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.983+0000 7f0ed77fe700 1 -- 172.21.15.92:0/2002967685 >> v1:172.21.15.92:6789/0 conn(0x7f0ed806d630 legacy=0x7f0ed80cad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:08.992 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.983+0000 7f0ed77fe700 1 --2- 172.21.15.92:0/2002967685 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ec8003a30 0x7f0ec8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:08.992 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.983+0000 7f0ed77fe700 1 --2- 172.21.15.92:0/2002967685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ec80043e0 0x7f0ec80048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:08.992 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.983+0000 7f0ed77fe700 1 --2- 172.21.15.92:0/2002967685 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0ed8159d60 0x7f0ec8005110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:08.992 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.983+0000 7f0ed77fe700 1 -- 172.21.15.92:0/2002967685 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed815ea50 con 0x7f0ec80043e0 2023-08-26T09:26:08.993 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.983+0000 7f0ed77fe700 1 -- 172.21.15.92:0/2002967685 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec800ba10 con 0x7f0ec8003a30 2023-08-26T09:26:08.993 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.983+0000 7f0ed77fe700 1 -- 172.21.15.92:0/2002967685 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec800bbd0 con 0x7f0ed8159d60 2023-08-26T09:26:08.993 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.983+0000 7f0ed7fff700 1 --2- 172.21.15.92:0/2002967685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ec80043e0 0x7f0ec80048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:08.993 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.983+0000 7f0edccb2700 1 --2- 172.21.15.92:0/2002967685 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ec8003a30 0x7f0ec8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:08.993 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.983+0000 7f0edd4b3700 1 --2- 172.21.15.92:0/2002967685 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0ed8159d60 0x7f0ec8005110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:08.994 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.983+0000 7f0ed7fff700 1 -- 172.21.15.92:0/2002967685 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0ed8159d60 msgr2=0x7f0ec8005110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:08.994 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.983+0000 7f0ed7fff700 1 --2- 172.21.15.92:0/2002967685 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0ed8159d60 0x7f0ec8005110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:08.994 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.983+0000 7f0ed7fff700 1 -- 172.21.15.92:0/2002967685 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ec8003a30 msgr2=0x7f0ec8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:08.994 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.983+0000 7f0ed7fff700 1 --2- 172.21.15.92:0/2002967685 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ec8003a30 0x7f0ec8003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:08.995 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.983+0000 7f0ed7fff700 1 -- 172.21.15.92:0/2002967685 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec80035b0 con 0x7f0ec80043e0 2023-08-26T09:26:08.995 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.983+0000 7f0ed7fff700 1 --2- 172.21.15.92:0/2002967685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ec80043e0 0x7f0ec80048b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0ec40018d0 tx=0x7f0ec8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6338fbd157566b6f server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:08.995 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.984+0000 7f0ed77fe700 1 -- 172.21.15.92:0/2002967685 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec400e8a0 con 0x7f0ec80043e0 2023-08-26T09:26:08.995 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.984+0000 7f0ed77fe700 1 -- 172.21.15.92:0/2002967685 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec400ea00 con 0x7f0ec80043e0 2023-08-26T09:26:08.995 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.984+0000 7f0ed77fe700 1 -- 172.21.15.92:0/2002967685 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec400edb0 con 0x7f0ec80043e0 2023-08-26T09:26:08.996 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.984+0000 7f0edef16700 1 -- 172.21.15.92:0/2002967685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ec80043e0 msgr2=0x7f0ec80048b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:08.996 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.984+0000 7f0edef16700 1 --2- 172.21.15.92:0/2002967685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ec80043e0 0x7f0ec80048b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0ec40018d0 tx=0x7f0ec8005880 comp rx=0 tx=0).stop 2023-08-26T09:26:08.996 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.984+0000 7f0edd4b3700 1 -- 172.21.15.92:0/2002967685 reap_dead start 2023-08-26T09:26:08.996 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.984+0000 7f0edef16700 1 -- 172.21.15.92:0/2002967685 shutdown_connections 2023-08-26T09:26:08.996 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.984+0000 7f0edef16700 1 -- 172.21.15.92:0/2002967685 >> 172.21.15.92:0/2002967685 conn(0x7f0ed80cfd80 msgr2=0x7f0ed80d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:08.997 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.984+0000 7f0edef16700 1 -- 172.21.15.92:0/2002967685 shutdown_connections 2023-08-26T09:26:08.997 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.984+0000 7f0edef16700 1 -- 172.21.15.92:0/2002967685 wait complete. 2023-08-26T09:26:08.999 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.985+0000 7f0edef16700 1 Processor -- start 2023-08-26T09:26:09.000 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.985+0000 7f0edef16700 1 -- start start 2023-08-26T09:26:09.000 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.986+0000 7f0edef16700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ec80043e0 0x7f0ed814a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:09.000 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.986+0000 7f0edef16700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0ed813b230 0x7f0ed81384b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:09.000 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.986+0000 7f0edef16700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ed80b4620 0x7f0ed80b4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:09.000 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.986+0000 7f0edef16700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed8138200 con 0x7f0ec80043e0 2023-08-26T09:26:09.001 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.986+0000 7f0edef16700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed8150970 con 0x7f0ed80b4620 2023-08-26T09:26:09.001 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.986+0000 7f0edef16700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed8150690 con 0x7f0ed813b230 2023-08-26T09:26:09.001 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.986+0000 7f0edccb2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ec80043e0 0x7f0ed814a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:09.001 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.986+0000 7f0edccb2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ec80043e0 0x7f0ed814a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46552/0 (socket says 172.21.15.92:46552) 2023-08-26T09:26:09.001 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.986+0000 7f0edccb2700 1 -- 172.21.15.92:0/2938601249 learned_addr learned my addr 172.21.15.92:0/2938601249 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:09.002 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.986+0000 7f0ed7fff700 1 --2- 172.21.15.92:0/2938601249 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0ed813b230 0x7f0ed81384b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:09.002 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.986+0000 7f0edd4b3700 1 --2- 172.21.15.92:0/2938601249 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ed80b4620 0x7f0ed80b4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:09.002 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.987+0000 7f0edccb2700 1 -- 172.21.15.92:0/2938601249 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0ed813b230 msgr2=0x7f0ed81384b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:09.002 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.987+0000 7f0edccb2700 1 --2- 172.21.15.92:0/2938601249 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0ed813b230 0x7f0ed81384b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:09.002 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.987+0000 7f0edccb2700 1 -- 172.21.15.92:0/2938601249 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ed80b4620 msgr2=0x7f0ed80b4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:09.003 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.987+0000 7f0edccb2700 1 --2- 172.21.15.92:0/2938601249 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ed80b4620 0x7f0ed80b4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:09.003 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.987+0000 7f0edccb2700 1 -- 172.21.15.92:0/2938601249 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed814d710 con 0x7f0ec80043e0 2023-08-26T09:26:09.003 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.987+0000 7f0edccb2700 1 --2- 172.21.15.92:0/2938601249 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ec80043e0 0x7f0ed814a8e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc0119d0 tx=0x7f0ecc011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:09.003 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.987+0000 7f0ed57fa700 1 -- 172.21.15.92:0/2938601249 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc011e70 con 0x7f0ec80043e0 2023-08-26T09:26:09.003 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.987+0000 7f0ed57fa700 1 -- 172.21.15.92:0/2938601249 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ecc00f940 con 0x7f0ec80043e0 2023-08-26T09:26:09.004 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.987+0000 7f0edef16700 1 -- 172.21.15.92:0/2938601249 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ed814d9f0 con 0x7f0ec80043e0 2023-08-26T09:26:09.004 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.987+0000 7f0ed57fa700 1 -- 172.21.15.92:0/2938601249 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc00fcd0 con 0x7f0ec80043e0 2023-08-26T09:26:09.004 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.987+0000 7f0edef16700 1 -- 172.21.15.92:0/2938601249 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ed80b5010 con 0x7f0ec80043e0 2023-08-26T09:26:09.004 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.988+0000 7f0edef16700 1 -- 172.21.15.92:0/2938601249 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ed804e660 con 0x7f0ec80043e0 2023-08-26T09:26:09.004 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.988+0000 7f0ed57fa700 1 -- 172.21.15.92:0/2938601249 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0ecc014440 con 0x7f0ec80043e0 2023-08-26T09:26:09.005 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.989+0000 7f0ed57fa700 1 --2- 172.21.15.92:0/2938601249 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f0ebc06a0e0 0x7f0ebc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:09.005 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.989+0000 7f0ed57fa700 1 -- 172.21.15.92:0/2938601249 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f0ecc088bc0 con 0x7f0ec80043e0 2023-08-26T09:26:09.005 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.989+0000 7f0ed7fff700 1 --2- 172.21.15.92:0/2938601249 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f0ebc06a0e0 0x7f0ebc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:09.005 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.989+0000 7f0ed7fff700 1 --2- 172.21.15.92:0/2938601249 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f0ebc06a0e0 0x7f0ebc06c5a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0ed814d5b0 tx=0x7f0ec401d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:09.005 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:08.993+0000 7f0ed57fa700 1 -- 172.21.15.92:0/2938601249 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0ecc057d00 con 0x7f0ec80043e0 2023-08-26T09:26:09.227 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.223+0000 7f0edef16700 1 -- 172.21.15.92:0/2938601249 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ed806d020 con 0x7f0ec80043e0 2023-08-26T09:26:09.228 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.224+0000 7f0ed57fa700 1 -- 172.21.15.92:0/2938601249 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4863 (secure 0 0 0) 0x7f0ecc057890 con 0x7f0ec80043e0 2023-08-26T09:26:09.228 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:26:09.229 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/856608283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6833","nonce":856608283},{"type":"v1","addr":"172.21.15.188:6835","nonce":856608283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4279,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/33581841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":33581841},{"type":"v1","addr":"172.21.15.92:6837","nonce":33581841}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6834/279535547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":279535547},{"type":"v1","addr":"172.21.15.188:6834","nonce":279535547}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-26T09:25:13.851186+0000","modified":"2023-08-26T09:25:17.482682+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6835/2933877114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2933877114},{"type":"v1","addr":"172.21.15.92:6835","nonce":2933877114}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-26T09:26:09.230 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.226+0000 7f0edef16700 1 -- 172.21.15.92:0/2938601249 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f0ebc06a0e0 msgr2=0x7f0ebc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:09.230 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.226+0000 7f0edef16700 1 --2- 172.21.15.92:0/2938601249 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f0ebc06a0e0 0x7f0ebc06c5a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0ed814d5b0 tx=0x7f0ec401d040 comp rx=0 tx=0).stop 2023-08-26T09:26:09.231 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.226+0000 7f0edef16700 1 -- 172.21.15.92:0/2938601249 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ec80043e0 msgr2=0x7f0ed814a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:09.231 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.226+0000 7f0edef16700 1 --2- 172.21.15.92:0/2938601249 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ec80043e0 0x7f0ed814a8e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc0119d0 tx=0x7f0ecc011ce0 comp rx=0 tx=0).stop 2023-08-26T09:26:09.231 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.226+0000 7f0edef16700 1 -- 172.21.15.92:0/2938601249 shutdown_connections 2023-08-26T09:26:09.231 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.226+0000 7f0edef16700 1 --2- 172.21.15.92:0/2938601249 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f0ebc06a0e0 0x7f0ebc06c5a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:09.231 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.226+0000 7f0edef16700 1 --2- 172.21.15.92:0/2938601249 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ed80b4620 0x7f0ed80b4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:09.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.226+0000 7f0edef16700 1 --2- 172.21.15.92:0/2938601249 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ec80043e0 0x7f0ed814a8e0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:09.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.226+0000 7f0edef16700 1 --2- 172.21.15.92:0/2938601249 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0ed813b230 0x7f0ed81384b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:09.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.226+0000 7f0edef16700 1 -- 172.21.15.92:0/2938601249 >> 172.21.15.92:0/2938601249 conn(0x7f0ed80cfd80 msgr2=0x7f0ed80716d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:09.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.226+0000 7f0edef16700 1 -- 172.21.15.92:0/2938601249 shutdown_connections 2023-08-26T09:26:09.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.226+0000 7f0edef16700 1 -- 172.21.15.92:0/2938601249 wait complete. 2023-08-26T09:26:09.233 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 7 2023-08-26T09:26:09.243 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-26T09:26:09.365 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.362+0000 7f6cd2c61700 1 Processor -- start 2023-08-26T09:26:09.366 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.362+0000 7f6cd2c61700 1 -- start start 2023-08-26T09:26:09.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.362+0000 7f6cd2c61700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f6ccc15d6c0 0x7f6ccc0cea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:09.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.362+0000 7f6cd2c61700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ccc0cf4d0 con 0x7f6ccc0cef70 2023-08-26T09:26:09.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.362+0000 7f6cd2c61700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ccc0ce3b0 con 0x7f6ccc0ca620 2023-08-26T09:26:09.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.362+0000 7f6cd2c61700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ccc0cb4a0 con 0x7f6ccc15d6c0 2023-08-26T09:26:09.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.363+0000 7f6ccbfff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f6ccc15d6c0 0x7f6ccc0cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:09.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.363+0000 7f6cd11fe700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f6ccc0cef70 0x7f6ccc06cd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:58576/0 (socket says 172.21.15.92:58576) 2023-08-26T09:26:09.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.363+0000 7f6cd11fe700 1 -- 172.21.15.92:0/3327017302 learned_addr learned my addr 172.21.15.92:0/3327017302 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:26:09.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.363+0000 7f6ccbfff700 1 -- 172.21.15.92:0/3327017302 >> v1:172.21.15.188:6789/0 conn(0x7f6ccc0ca620 legacy=0x7f6ccc0caa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:09.370 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.363+0000 7f6ccbfff700 1 -- 172.21.15.92:0/3327017302 >> v1:172.21.15.92:6789/0 conn(0x7f6ccc0cef70 legacy=0x7f6ccc06cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:09.370 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.363+0000 7f6ccb7fe700 1 -- 172.21.15.92:0/3327017302 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 322805165 0 0) 0x7f6ccc0cf4d0 con 0x7f6ccc0cef70 2023-08-26T09:26:09.370 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.363+0000 7f6ccbfff700 1 -- 172.21.15.92:0/3327017302 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ccc0ce690 con 0x7f6ccc15d6c0 2023-08-26T09:26:09.370 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.363+0000 7f6ccbfff700 1 --2- 172.21.15.92:0/3327017302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ccc15d6c0 0x7f6ccc0cea30 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8009840 tx=0x7f6cb8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6c846d83228c14c server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:09.370 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.363+0000 7f6ccb7fe700 1 -- 172.21.15.92:0/3327017302 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb8011830 con 0x7f6ccc15d6c0 2023-08-26T09:26:09.371 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.363+0000 7f6ccb7fe700 1 -- 172.21.15.92:0/3327017302 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb8011990 con 0x7f6ccc15d6c0 2023-08-26T09:26:09.371 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.363+0000 7f6ccb7fe700 1 -- 172.21.15.92:0/3327017302 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb8011d20 con 0x7f6ccc15d6c0 2023-08-26T09:26:09.371 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.364+0000 7f6cd2c61700 1 -- 172.21.15.92:0/3327017302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ccc15d6c0 msgr2=0x7f6ccc0cea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:09.371 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.364+0000 7f6cd2c61700 1 --2- 172.21.15.92:0/3327017302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ccc15d6c0 0x7f6ccc0cea30 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8009840 tx=0x7f6cb8009b50 comp rx=0 tx=0).stop 2023-08-26T09:26:09.371 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.364+0000 7f6cd2c61700 1 -- 172.21.15.92:0/3327017302 shutdown_connections 2023-08-26T09:26:09.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.364+0000 7f6cd2c61700 1 --2- 172.21.15.92:0/3327017302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ccc15d6c0 0x7f6ccc0cea30 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:09.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.364+0000 7f6cd2c61700 1 -- 172.21.15.92:0/3327017302 >> 172.21.15.92:0/3327017302 conn(0x7f6ccc0cc7b0 msgr2=0x7f6ccc0ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:09.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.364+0000 7f6cd2c61700 1 -- 172.21.15.92:0/3327017302 shutdown_connections 2023-08-26T09:26:09.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.364+0000 7f6cd2c61700 1 -- 172.21.15.92:0/3327017302 wait complete. 2023-08-26T09:26:09.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.365+0000 7f6cd2c61700 1 Processor -- start 2023-08-26T09:26:09.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.365+0000 7f6cd2c61700 1 -- start start 2023-08-26T09:26:09.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.366+0000 7f6cd2c61700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6ccc0ca620 0x7f6ccc15db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:09.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.366+0000 7f6cd2c61700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ccc0cef70 0x7f6ccc0c6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:09.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.366+0000 7f6cd2c61700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6ccc15d6c0 0x7f6ccc0c7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:09.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.366+0000 7f6cd2c61700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ccc0ace80 con 0x7f6ccc0cef70 2023-08-26T09:26:09.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.366+0000 7f6cd2c61700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ccc0ad160 con 0x7f6ccc15d6c0 2023-08-26T09:26:09.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.366+0000 7f6cd2c61700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ccc0ad440 con 0x7f6ccc0ca620 2023-08-26T09:26:09.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.366+0000 7f6ccbfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ccc0cef70 0x7f6ccc0c6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:09.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.366+0000 7f6ccbfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ccc0cef70 0x7f6ccc0c6ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46568/0 (socket says 172.21.15.92:46568) 2023-08-26T09:26:09.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.366+0000 7f6ccbfff700 1 -- 172.21.15.92:0/2870058233 learned_addr learned my addr 172.21.15.92:0/2870058233 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:09.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.366+0000 7f6ccbfff700 1 -- 172.21.15.92:0/2870058233 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6ccc0ca620 msgr2=0x7f6ccc15db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:09.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.366+0000 7f6ccbfff700 1 --2- 172.21.15.92:0/2870058233 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6ccc0ca620 0x7f6ccc15db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:09.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.366+0000 7f6ccbfff700 1 -- 172.21.15.92:0/2870058233 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6ccc15d6c0 msgr2=0x7f6ccc0c7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:09.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.366+0000 7f6ccbfff700 1 --2- 172.21.15.92:0/2870058233 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6ccc15d6c0 0x7f6ccc0c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:09.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.366+0000 7f6ccbfff700 1 -- 172.21.15.92:0/2870058233 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb80094a0 con 0x7f6ccc0cef70 2023-08-26T09:26:09.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.366+0000 7f6ccbfff700 1 --2- 172.21.15.92:0/2870058233 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ccc0cef70 0x7f6ccc0c6ff0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8014040 tx=0x7f6cb8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:09.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.367+0000 7f6cc97fa700 1 -- 172.21.15.92:0/2870058233 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb801a900 con 0x7f6ccc0cef70 2023-08-26T09:26:09.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.367+0000 7f6cc97fa700 1 -- 172.21.15.92:0/2870058233 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb801aa60 con 0x7f6ccc0cef70 2023-08-26T09:26:09.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.367+0000 7f6cd2c61700 1 -- 172.21.15.92:0/2870058233 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ccc0ad720 con 0x7f6ccc0cef70 2023-08-26T09:26:09.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.367+0000 7f6cc97fa700 1 -- 172.21.15.92:0/2870058233 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb801add0 con 0x7f6ccc0cef70 2023-08-26T09:26:09.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.367+0000 7f6cd2c61700 1 -- 172.21.15.92:0/2870058233 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ccc15e050 con 0x7f6ccc0cef70 2023-08-26T09:26:09.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.368+0000 7f6cd2c61700 1 -- 172.21.15.92:0/2870058233 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ccc15e1e0 con 0x7f6ccc0cef70 2023-08-26T09:26:09.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.368+0000 7f6cc97fa700 1 -- 172.21.15.92:0/2870058233 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6cb8022070 con 0x7f6ccc0cef70 2023-08-26T09:26:09.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.368+0000 7f6cc97fa700 1 --2- 172.21.15.92:0/2870058233 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f6cb006a0e0 0x7f6cb006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:09.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.368+0000 7f6cc97fa700 1 -- 172.21.15.92:0/2870058233 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f6cb8089890 con 0x7f6ccc0cef70 2023-08-26T09:26:09.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.368+0000 7f6cd09fd700 1 --2- 172.21.15.92:0/2870058233 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f6cb006a0e0 0x7f6cb006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:09.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.369+0000 7f6cd09fd700 1 --2- 172.21.15.92:0/2870058233 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f6cb006a0e0 0x7f6cb006c5a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0001690 tx=0x7f6cc0007a00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:09.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.373+0000 7f6cc97fa700 1 -- 172.21.15.92:0/2870058233 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f6ccc15e1e0 con 0x7f6ccc0cef70 2023-08-26T09:26:09.571 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.567+0000 7f6cd2c61700 1 -- 172.21.15.92:0/2870058233 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ccc0adc40 con 0x7f6ccc0cef70 2023-08-26T09:26:09.597 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.569+0000 7f6cc97fa700 1 -- 172.21.15.92:0/2870058233 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18304 (secure 0 0 0) 0x7f6ccc0adc40 con 0x7f6ccc0cef70 2023-08-26T09:26:09.598 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:26:09.598 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":22,"fsid":"254a2d31-bd41-4507-8326-1b205ac24377","created":"2023-08-26T09:24:55.352131+0000","modified":"2023-08-26T09:26:02.241818+0000","last_up_change":"2023-08-26T09:25:06.124496+0000","last_in_change":"2023-08-26T09:24:57.840725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-26T09:25:06.650431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-26T09:25:06.973382+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-26T09:25:11.584141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-26T09:25:12.814990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e9e7638-4459-4d8d-8e40-130bcf48df66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6819","nonce":382827192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6824","nonce":382827192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6831","nonce":382827192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6827","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6829","nonce":382827192}]},"public_addr":"172.21.15.92:6819/382827192","cluster_addr":"172.21.15.92:6824/382827192","heartbeat_back_addr":"172.21.15.92:6831/382827192","heartbeat_front_addr":"172.21.15.92:6829/382827192","state":["exists","up"]},{"osd":1,"uuid":"164e68c9-aedd-4df5-9b70-f4b1ec3bda13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6809","nonce":618773438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6811","nonce":618773438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6815","nonce":618773438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6813","nonce":618773438}]},"public_addr":"172.21.15.92:6809/618773438","cluster_addr":"172.21.15.92:6811/618773438","heartbeat_back_addr":"172.21.15.92:6815/618773438","heartbeat_front_addr":"172.21.15.92:6813/618773438","state":["exists","up"]},{"osd":2,"uuid":"8701dfee-629a-4d30-82e4-b8fac340303f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6818","nonce":3697397687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6821","nonce":3697397687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6828","nonce":3697397687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6823","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6825","nonce":3697397687}]},"public_addr":"172.21.15.92:6818/3697397687","cluster_addr":"172.21.15.92:6821/3697397687","heartbeat_back_addr":"172.21.15.92:6828/3697397687","heartbeat_front_addr":"172.21.15.92:6825/3697397687","state":["exists","up"]},{"osd":3,"uuid":"93bdc94d-dc07-495f-995a-a6ad072f0247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6801","nonce":3579846453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6803","nonce":3579846453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6807","nonce":3579846453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6805","nonce":3579846453}]},"public_addr":"172.21.15.92:6801/3579846453","cluster_addr":"172.21.15.92:6803/3579846453","heartbeat_back_addr":"172.21.15.92:6807/3579846453","heartbeat_front_addr":"172.21.15.92:6805/3579846453","state":["exists","up"]},{"osd":4,"uuid":"d9d0ea80-8481-46a7-9677-c338d32cf1d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6809","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6811","nonce":3228383424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6813","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6815","nonce":3228383424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6821","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6823","nonce":3228383424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6817","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6819","nonce":3228383424}]},"public_addr":"172.21.15.188:6811/3228383424","cluster_addr":"172.21.15.188:6815/3228383424","heartbeat_back_addr":"172.21.15.188:6823/3228383424","heartbeat_front_addr":"172.21.15.188:6819/3228383424","state":["exists","up"]},{"osd":5,"uuid":"38d03253-467a-456f-bd5e-5a46532a0b18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6801","nonce":1655821054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6803","nonce":1655821054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6807","nonce":1655821054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6805","nonce":1655821054}]},"public_addr":"172.21.15.188:6801/1655821054","cluster_addr":"172.21.15.188:6803/1655821054","heartbeat_back_addr":"172.21.15.188:6807/1655821054","heartbeat_front_addr":"172.21.15.188:6805/1655821054","state":["exists","up"]},{"osd":6,"uuid":"d61564b5-136f-42e5-a843-626c2017cc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6810","nonce":2069976891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6814","nonce":2069976891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6822","nonce":2069976891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6818","nonce":2069976891}]},"public_addr":"172.21.15.188:6810/2069976891","cluster_addr":"172.21.15.188:6814/2069976891","heartbeat_back_addr":"172.21.15.188:6822/2069976891","heartbeat_front_addr":"172.21.15.188:6818/2069976891","state":["exists","up"]},{"osd":7,"uuid":"fae2949e-0d62-42cd-ba72-08f516084b20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6825","nonce":1882888860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6827","nonce":1882888860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6831","nonce":1882888860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6829","nonce":1882888860}]},"public_addr":"172.21.15.188:6825/1882888860","cluster_addr":"172.21.15.188:6827/1882888860","heartbeat_back_addr":"172.21.15.188:6831/1882888860","heartbeat_front_addr":"172.21.15.188:6829/1882888860","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.038523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.063160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.000857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.975572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.023848+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.765194+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.081365+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:05.110745+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.10","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-26T09:26:09.600 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.571+0000 7f6cd2c61700 1 -- 172.21.15.92:0/2870058233 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f6cb006a0e0 msgr2=0x7f6cb006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:09.600 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.571+0000 7f6cd2c61700 1 --2- 172.21.15.92:0/2870058233 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f6cb006a0e0 0x7f6cb006c5a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0001690 tx=0x7f6cc0007a00 comp rx=0 tx=0).stop 2023-08-26T09:26:09.600 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.571+0000 7f6cd2c61700 1 -- 172.21.15.92:0/2870058233 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ccc0cef70 msgr2=0x7f6ccc0c6ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:09.600 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.571+0000 7f6cd2c61700 1 --2- 172.21.15.92:0/2870058233 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ccc0cef70 0x7f6ccc0c6ff0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8014040 tx=0x7f6cb8004750 comp rx=0 tx=0).stop 2023-08-26T09:26:09.600 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.571+0000 7f6cd2c61700 1 -- 172.21.15.92:0/2870058233 shutdown_connections 2023-08-26T09:26:09.601 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.571+0000 7f6cd2c61700 1 --2- 172.21.15.92:0/2870058233 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f6cb006a0e0 0x7f6cb006c5a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:09.601 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.571+0000 7f6cd2c61700 1 --2- 172.21.15.92:0/2870058233 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6ccc15d6c0 0x7f6ccc0c7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:09.601 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.571+0000 7f6cd2c61700 1 --2- 172.21.15.92:0/2870058233 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6ccc0ca620 0x7f6ccc15db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:09.601 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.571+0000 7f6cd2c61700 1 --2- 172.21.15.92:0/2870058233 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ccc0cef70 0x7f6ccc0c6ff0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:09.601 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.571+0000 7f6cd2c61700 1 -- 172.21.15.92:0/2870058233 >> 172.21.15.92:0/2870058233 conn(0x7f6ccc0cc7b0 msgr2=0x7f6ccc15a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:09.602 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.571+0000 7f6cd2c61700 1 -- 172.21.15.92:0/2870058233 shutdown_connections 2023-08-26T09:26:09.602 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.571+0000 7f6cd2c61700 1 -- 172.21.15.92:0/2870058233 wait complete. 2023-08-26T09:26:09.603 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-26T09:26:09.724 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.720+0000 7f70ebd0a700 1 Processor -- start 2023-08-26T09:26:09.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.720+0000 7f70ebd0a700 1 -- start start 2023-08-26T09:26:09.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.721+0000 7f70ebd0a700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f70e4160a80 0x7f70e40724b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:09.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.721+0000 7f70ebd0a700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f70e40cc520 0x7f70e406ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:09.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.721+0000 7f70ebd0a700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70e40b1290 con 0x7f70e4066350 2023-08-26T09:26:09.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.721+0000 7f70ebd0a700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70e40b1f10 con 0x7f70e40cc520 2023-08-26T09:26:09.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.721+0000 7f70ebd0a700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e40b1570 con 0x7f70e4160a80 2023-08-26T09:26:09.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.721+0000 7f70e92a5700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f70e4066350 0x7f70e40cbe10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:58588/0 (socket says 172.21.15.92:58588) 2023-08-26T09:26:09.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.721+0000 7f70e92a5700 1 -- 172.21.15.92:0/4280233987 learned_addr learned my addr 172.21.15.92:0/4280233987 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:26:09.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.721+0000 7f70ea2a7700 1 --2- 172.21.15.92:0/4280233987 >> v2:172.21.15.188:3300/0 conn(0x7f70e40cc520 0x7f70e406ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:09.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.721+0000 7f70e8aa4700 1 -- 172.21.15.92:0/4280233987 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2577327473 0 0) 0x7f70e40b1290 con 0x7f70e4066350 2023-08-26T09:26:09.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.721+0000 7f70e9aa6700 1 --2- 172.21.15.92:0/4280233987 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f70e4160a80 0x7f70e40724b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:09.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.722+0000 7f70e8aa4700 1 -- 172.21.15.92:0/4280233987 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70d00035b0 con 0x7f70e4066350 2023-08-26T09:26:09.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.722+0000 7f70e8aa4700 1 -- 172.21.15.92:0/4280233987 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2297455065 0 0) 0x7f70d00035b0 con 0x7f70e4066350 2023-08-26T09:26:09.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.722+0000 7f70e8aa4700 1 -- 172.21.15.92:0/4280233987 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f70e4160a80 msgr2=0x7f70e40724b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:09.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.722+0000 7f70e8aa4700 1 --2- 172.21.15.92:0/4280233987 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f70e4160a80 0x7f70e40724b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:09.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.722+0000 7f70e8aa4700 1 -- 172.21.15.92:0/4280233987 >> v2:172.21.15.188:3300/0 conn(0x7f70e40cc520 msgr2=0x7f70e406ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:09.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.722+0000 7f70e8aa4700 1 --2- 172.21.15.92:0/4280233987 >> v2:172.21.15.188:3300/0 conn(0x7f70e40cc520 0x7f70e406ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:09.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.722+0000 7f70e8aa4700 1 -- 172.21.15.92:0/4280233987 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e40b1850 con 0x7f70e4066350 2023-08-26T09:26:09.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.722+0000 7f70e8aa4700 1 -- 172.21.15.92:0/4280233987 <== mon.0 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1019361464 0 0) 0x7f70e0001670 con 0x7f70e4066350 2023-08-26T09:26:09.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.722+0000 7f70e8aa4700 1 -- 172.21.15.92:0/4280233987 >> v1:172.21.15.92:6789/0 conn(0x7f70e4066350 legacy=0x7f70e40cbe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:09.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.722+0000 7f70e8aa4700 1 --2- 172.21.15.92:0/4280233987 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f70e4160a80 0x7f70d0003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:09.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.722+0000 7f70e8aa4700 1 --2- 172.21.15.92:0/4280233987 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f70d0003f80 0x7f70d0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:09.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.722+0000 7f70e8aa4700 1 --2- 172.21.15.92:0/4280233987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70d0004d90 0x7f70d0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:09.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.722+0000 7f70e8aa4700 1 -- 172.21.15.92:0/4280233987 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e40b1f10 con 0x7f70d0004d90 2023-08-26T09:26:09.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.722+0000 7f70e8aa4700 1 -- 172.21.15.92:0/4280233987 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e40b1570 con 0x7f70d0003f80 2023-08-26T09:26:09.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.722+0000 7f70e8aa4700 1 -- 172.21.15.92:0/4280233987 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d000ba60 con 0x7f70e4160a80 2023-08-26T09:26:09.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.722+0000 7f70ea2a7700 1 --2- 172.21.15.92:0/4280233987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70d0004d90 0x7f70d0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:09.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.722+0000 7f70e9aa6700 1 --2- 172.21.15.92:0/4280233987 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f70e4160a80 0x7f70d0003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:09.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.722+0000 7f70e92a5700 1 --2- 172.21.15.92:0/4280233987 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f70d0003f80 0x7f70d0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:09.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.722+0000 7f70ea2a7700 1 -- 172.21.15.92:0/4280233987 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f70e4160a80 msgr2=0x7f70d0003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:09.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.722+0000 7f70ea2a7700 1 --2- 172.21.15.92:0/4280233987 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f70e4160a80 0x7f70d0003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:09.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.722+0000 7f70ea2a7700 1 -- 172.21.15.92:0/4280233987 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f70d0003f80 msgr2=0x7f70d0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:09.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.722+0000 7f70ea2a7700 1 --2- 172.21.15.92:0/4280233987 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f70d0003f80 0x7f70d0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:09.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.722+0000 7f70ea2a7700 1 -- 172.21.15.92:0/4280233987 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d00035b0 con 0x7f70d0004d90 2023-08-26T09:26:09.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.722+0000 7f70ea2a7700 1 --2- 172.21.15.92:0/4280233987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70d0004d90 0x7f70d0005210 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f70dc009f90 tx=0x7f70d0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2a227ad9d310bab server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:09.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.722+0000 7f70e8aa4700 1 -- 172.21.15.92:0/4280233987 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70dc00ec30 con 0x7f70d0004d90 2023-08-26T09:26:09.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.723+0000 7f70e8aa4700 1 -- 172.21.15.92:0/4280233987 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70dc00f040 con 0x7f70d0004d90 2023-08-26T09:26:09.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.723+0000 7f70e8aa4700 1 -- 172.21.15.92:0/4280233987 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70dc014480 con 0x7f70d0004d90 2023-08-26T09:26:09.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.723+0000 7f70ebd0a700 1 -- 172.21.15.92:0/4280233987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70d0004d90 msgr2=0x7f70d0005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:09.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.723+0000 7f70ebd0a700 1 --2- 172.21.15.92:0/4280233987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70d0004d90 0x7f70d0005210 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f70dc009f90 tx=0x7f70d0005880 comp rx=0 tx=0).stop 2023-08-26T09:26:09.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.723+0000 7f70ea2a7700 1 -- 172.21.15.92:0/4280233987 reap_dead start 2023-08-26T09:26:09.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.723+0000 7f70ebd0a700 1 -- 172.21.15.92:0/4280233987 shutdown_connections 2023-08-26T09:26:09.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.723+0000 7f70ebd0a700 1 -- 172.21.15.92:0/4280233987 >> 172.21.15.92:0/4280233987 conn(0x7f70e40b23c0 msgr2=0x7f70e40b27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:09.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.723+0000 7f70ebd0a700 1 -- 172.21.15.92:0/4280233987 shutdown_connections 2023-08-26T09:26:09.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.723+0000 7f70ebd0a700 1 -- 172.21.15.92:0/4280233987 wait complete. 2023-08-26T09:26:09.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.724+0000 7f70ebd0a700 1 Processor -- start 2023-08-26T09:26:09.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.724+0000 7f70ebd0a700 1 -- start start 2023-08-26T09:26:09.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.725+0000 7f70ebd0a700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f70e40aca50 0x7f70e41f68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:09.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.725+0000 7f70ebd0a700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f70e40afd60 0x7f70e40ace30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:09.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.725+0000 7f70ebd0a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70e409c790 0x7f70e409cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:09.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.725+0000 7f70ebd0a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e41f6de0 con 0x7f70e409c790 2023-08-26T09:26:09.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.725+0000 7f70ebd0a700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e409d150 con 0x7f70e40afd60 2023-08-26T09:26:09.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.725+0000 7f70ebd0a700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e40ad370 con 0x7f70e40aca50 2023-08-26T09:26:09.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.725+0000 7f70ea2a7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70e409c790 0x7f70e409cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:09.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.725+0000 7f70ea2a7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70e409c790 0x7f70e409cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46590/0 (socket says 172.21.15.92:46590) 2023-08-26T09:26:09.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.725+0000 7f70ea2a7700 1 -- 172.21.15.92:0/3233268826 learned_addr learned my addr 172.21.15.92:0/3233268826 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:09.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.725+0000 7f70e92a5700 1 --2- 172.21.15.92:0/3233268826 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f70e40afd60 0x7f70e40ace30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:09.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.725+0000 7f70e9aa6700 1 --2- 172.21.15.92:0/3233268826 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f70e40aca50 0x7f70e41f68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:09.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.726+0000 7f70ea2a7700 1 -- 172.21.15.92:0/3233268826 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f70e40aca50 msgr2=0x7f70e41f68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:09.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.726+0000 7f70ea2a7700 1 --2- 172.21.15.92:0/3233268826 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f70e40aca50 0x7f70e41f68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:09.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.726+0000 7f70ea2a7700 1 -- 172.21.15.92:0/3233268826 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f70e40afd60 msgr2=0x7f70e40ace30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:09.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.726+0000 7f70ea2a7700 1 --2- 172.21.15.92:0/3233268826 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f70e40afd60 0x7f70e40ace30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:09.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.726+0000 7f70ea2a7700 1 -- 172.21.15.92:0/3233268826 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e40aece0 con 0x7f70e409c790 2023-08-26T09:26:09.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.726+0000 7f70ea2a7700 1 --2- 172.21.15.92:0/3233268826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70e409c790 0x7f70e409cc10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f70d0004790 tx=0x7f70dc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:09.746 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.726+0000 7f70da7fc700 1 -- 172.21.15.92:0/3233268826 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70dc007000 con 0x7f70e409c790 2023-08-26T09:26:09.746 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.726+0000 7f70da7fc700 1 -- 172.21.15.92:0/3233268826 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70dc003e30 con 0x7f70e409c790 2023-08-26T09:26:09.746 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.726+0000 7f70da7fc700 1 -- 172.21.15.92:0/3233268826 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70dc015ab0 con 0x7f70e409c790 2023-08-26T09:26:09.746 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.726+0000 7f70ebd0a700 1 -- 172.21.15.92:0/3233268826 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70e40aefc0 con 0x7f70e409c790 2023-08-26T09:26:09.746 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.726+0000 7f70ebd0a700 1 -- 172.21.15.92:0/3233268826 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70e40af580 con 0x7f70e409c790 2023-08-26T09:26:09.747 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.727+0000 7f70ebd0a700 1 -- 172.21.15.92:0/3233268826 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70e404e660 con 0x7f70e409c790 2023-08-26T09:26:09.747 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.727+0000 7f70da7fc700 1 -- 172.21.15.92:0/3233268826 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f70dc015c10 con 0x7f70e409c790 2023-08-26T09:26:09.747 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.727+0000 7f70da7fc700 1 --2- 172.21.15.92:0/3233268826 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f70c806a110 0x7f70c806c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:09.747 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.728+0000 7f70da7fc700 1 -- 172.21.15.92:0/3233268826 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f70dc089270 con 0x7f70e409c790 2023-08-26T09:26:09.747 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.728+0000 7f70e9aa6700 1 --2- 172.21.15.92:0/3233268826 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f70c806a110 0x7f70c806c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:09.748 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.728+0000 7f70e9aa6700 1 --2- 172.21.15.92:0/3233268826 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f70c806a110 0x7f70c806c5d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f70d4009c40 tx=0x7f70d40091c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:09.748 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.732+0000 7f70da7fc700 1 -- 172.21.15.92:0/3233268826 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f70dc054b90 con 0x7f70e409c790 2023-08-26T09:26:09.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.964+0000 7f70ebd0a700 1 -- 172.21.15.92:0/3233268826 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f70e406e310 con 0x7f70e409c790 2023-08-26T09:26:09.968 INFO:tasks.ceph.mon.a.smithi092.stderr:2023-08-26T09:26:09.964+0000 7ff0f8d57700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-26T09:26:09.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.969+0000 7f70da7fc700 1 -- 172.21.15.92:0/3233268826 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7f70dc0581b0 con 0x7f70e409c790 2023-08-26T09:26:09.974 INFO:tasks.ceph.mds.a.smithi092.stderr: -3023> 2023-08-26T09:25:19.530+0000 7f4bdb786700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-26T09:26:09.975 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.971+0000 7f70ebd0a700 1 -- 172.21.15.92:0/3233268826 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f70c806a110 msgr2=0x7f70c806c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:09.975 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.971+0000 7f70ebd0a700 1 --2- 172.21.15.92:0/3233268826 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f70c806a110 0x7f70c806c5d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f70d4009c40 tx=0x7f70d40091c0 comp rx=0 tx=0).stop 2023-08-26T09:26:09.975 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.971+0000 7f70ebd0a700 1 -- 172.21.15.92:0/3233268826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70e409c790 msgr2=0x7f70e409cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:09.976 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.971+0000 7f70ebd0a700 1 --2- 172.21.15.92:0/3233268826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70e409c790 0x7f70e409cc10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f70d0004790 tx=0x7f70dc009750 comp rx=0 tx=0).stop 2023-08-26T09:26:09.976 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.971+0000 7f70ebd0a700 1 -- 172.21.15.92:0/3233268826 shutdown_connections 2023-08-26T09:26:09.976 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.971+0000 7f70ebd0a700 1 --2- 172.21.15.92:0/3233268826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70e409c790 0x7f70e409cc10 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:09.976 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.971+0000 7f70ebd0a700 1 --2- 172.21.15.92:0/3233268826 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f70e40aca50 0x7f70e41f68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:09.976 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.971+0000 7f70ebd0a700 1 --2- 172.21.15.92:0/3233268826 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f70c806a110 0x7f70c806c5d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:09.977 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.971+0000 7f70ebd0a700 1 --2- 172.21.15.92:0/3233268826 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f70e40afd60 0x7f70e40ace30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:09.977 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.971+0000 7f70ebd0a700 1 -- 172.21.15.92:0/3233268826 >> 172.21.15.92:0/3233268826 conn(0x7f70e40b23c0 msgr2=0x7f70e40b27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:09.977 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.971+0000 7f70ebd0a700 1 -- 172.21.15.92:0/3233268826 shutdown_connections 2023-08-26T09:26:09.977 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:09.971+0000 7f70ebd0a700 1 -- 172.21.15.92:0/3233268826 wait complete. 2023-08-26T09:26:09.978 INFO:teuthology.orchestra.run.smithi092.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-26T09:26:09.988 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-26T09:26:10.001 INFO:tasks.ceph.mds.a.smithi092.stdout:starting mds.a at 2023-08-26T09:26:10.111 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.107+0000 7fb6018a3700 1 Processor -- start 2023-08-26T09:26:10.111 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.107+0000 7fb6018a3700 1 -- start start 2023-08-26T09:26:10.114 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.108+0000 7fb6018a3700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fb5fc15d490 0x7fb5fc06b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:10.114 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.108+0000 7fb6018a3700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5fc0b1eb0 0x7fb5fc0ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:10.114 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.108+0000 7fb6018a3700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5fc0d25d0 con 0x7fb5fc0ce5f0 2023-08-26T09:26:10.114 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.108+0000 7fb6018a3700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5fc0cdc70 con 0x7fb5fc15d490 2023-08-26T09:26:10.114 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.108+0000 7fb6018a3700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5fc15d870 con 0x7fb5fc0b1eb0 2023-08-26T09:26:10.115 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.108+0000 7fb5fa7fc700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5fc0b1eb0 0x7fb5fc0ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:10.115 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.108+0000 7fb5faffd700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fb5fc15d490 0x7fb5fc06b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:10.115 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.108+0000 7fb5fa7fc700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5fc0b1eb0 0x7fb5fc0ce0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.92:45272/0 (socket says 172.21.15.92:45272) 2023-08-26T09:26:10.115 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.108+0000 7fb5faffd700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fb5fc15d490 0x7fb5fc06b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.92:35414/0 (socket says 172.21.15.92:35414) 2023-08-26T09:26:10.115 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.108+0000 7fb5fa7fc700 1 -- 172.21.15.92:0/2445660781 learned_addr learned my addr 172.21.15.92:0/2445660781 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:10.116 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.108+0000 7fb5fb7fe700 1 --1- 172.21.15.92:0/2445660781 >> v1:172.21.15.188:6789/0 conn(0x7fb5fc0ce5f0 0x7fb5fc0b6250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.92:53734/0 (socket says 172.21.15.92:53734) 2023-08-26T09:26:10.116 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.109+0000 7fb5faffd700 1 -- 172.21.15.92:0/2445660781 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5fc0b1eb0 msgr2=0x7fb5fc0ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:10.116 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.109+0000 7fb5faffd700 1 --2- 172.21.15.92:0/2445660781 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5fc0b1eb0 0x7fb5fc0ce0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:10.116 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.109+0000 7fb5faffd700 1 -- 172.21.15.92:0/2445660781 >> v1:172.21.15.188:6789/0 conn(0x7fb5fc0ce5f0 legacy=0x7fb5fc0b6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:10.117 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.109+0000 7fb5f9ffb700 1 -- 172.21.15.92:0/2445660781 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1399283281 0 0) 0x7fb5fc0d25d0 con 0x7fb5fc0ce5f0 2023-08-26T09:26:10.117 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.109+0000 7fb5faffd700 1 -- 172.21.15.92:0/2445660781 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5fc0b57e0 con 0x7fb5fc15d490 2023-08-26T09:26:10.117 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.109+0000 7fb5faffd700 1 --2- 172.21.15.92:0/2445660781 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb5fc15d490 0x7fb5fc06b5e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0009840 tx=0x7fb5f0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9342c253baebe81 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:10.117 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.109+0000 7fb5f9ffb700 1 -- 172.21.15.92:0/2445660781 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f0011830 con 0x7fb5fc15d490 2023-08-26T09:26:10.117 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.109+0000 7fb5f9ffb700 1 -- 172.21.15.92:0/2445660781 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f0011990 con 0x7fb5fc15d490 2023-08-26T09:26:10.118 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.109+0000 7fb5f9ffb700 1 -- 172.21.15.92:0/2445660781 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f0011d20 con 0x7fb5fc15d490 2023-08-26T09:26:10.118 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.110+0000 7fb6018a3700 1 -- 172.21.15.92:0/2445660781 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb5fc15d490 msgr2=0x7fb5fc06b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:10.118 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.110+0000 7fb6018a3700 1 --2- 172.21.15.92:0/2445660781 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb5fc15d490 0x7fb5fc06b5e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0009840 tx=0x7fb5f0009b50 comp rx=0 tx=0).stop 2023-08-26T09:26:10.118 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.110+0000 7fb6018a3700 1 -- 172.21.15.92:0/2445660781 shutdown_connections 2023-08-26T09:26:10.118 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.110+0000 7fb6018a3700 1 --2- 172.21.15.92:0/2445660781 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb5fc15d490 0x7fb5fc06b5e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:10.119 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.110+0000 7fb6018a3700 1 --2- 172.21.15.92:0/2445660781 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5fc0b1eb0 0x7fb5fc0ce0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:10.119 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.110+0000 7fb6018a3700 1 -- 172.21.15.92:0/2445660781 >> 172.21.15.92:0/2445660781 conn(0x7fb5fc06aac0 msgr2=0x7fb5fc06aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:10.119 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.110+0000 7fb6018a3700 1 -- 172.21.15.92:0/2445660781 shutdown_connections 2023-08-26T09:26:10.119 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.110+0000 7fb6018a3700 1 -- 172.21.15.92:0/2445660781 wait complete. 2023-08-26T09:26:10.122 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.111+0000 7fb6018a3700 1 Processor -- start 2023-08-26T09:26:10.122 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.111+0000 7fb6018a3700 1 -- start start 2023-08-26T09:26:10.122 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.112+0000 7fb6018a3700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5fc0b1eb0 0x7fb5fc0cbef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:10.123 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.112+0000 7fb6018a3700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb5fc0ce5f0 0x7fb5fc158f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:10.123 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.112+0000 7fb6018a3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5fc15d490 0x7fb5fc15f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:10.123 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.112+0000 7fb6018a3700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5fc1594d0 con 0x7fb5fc15d490 2023-08-26T09:26:10.123 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.112+0000 7fb6018a3700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5fc15f510 con 0x7fb5fc0ce5f0 2023-08-26T09:26:10.123 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.112+0000 7fb6018a3700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5fc158780 con 0x7fb5fc0b1eb0 2023-08-26T09:26:10.124 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.112+0000 7fb5fb7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5fc15d490 0x7fb5fc15f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:10.124 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.112+0000 7fb5fb7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5fc15d490 0x7fb5fc15f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46616/0 (socket says 172.21.15.92:46616) 2023-08-26T09:26:10.124 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.112+0000 7fb5fb7fe700 1 -- 172.21.15.92:0/1876105422 learned_addr learned my addr 172.21.15.92:0/1876105422 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:10.124 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.112+0000 7fb5faffd700 1 --2- 172.21.15.92:0/1876105422 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5fc0b1eb0 0x7fb5fc0cbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:10.124 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.112+0000 7fb5fa7fc700 1 --2- 172.21.15.92:0/1876105422 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb5fc0ce5f0 0x7fb5fc158f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:10.125 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.112+0000 7fb5fb7fe700 1 -- 172.21.15.92:0/1876105422 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5fc0b1eb0 msgr2=0x7fb5fc0cbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:10.125 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.112+0000 7fb5fb7fe700 1 --2- 172.21.15.92:0/1876105422 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5fc0b1eb0 0x7fb5fc0cbef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:10.125 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.112+0000 7fb5fb7fe700 1 -- 172.21.15.92:0/1876105422 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb5fc0ce5f0 msgr2=0x7fb5fc158f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:10.125 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.112+0000 7fb5fb7fe700 1 --2- 172.21.15.92:0/1876105422 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb5fc0ce5f0 0x7fb5fc158f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:10.125 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.112+0000 7fb5fb7fe700 1 -- 172.21.15.92:0/1876105422 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f00094a0 con 0x7fb5fc15d490 2023-08-26T09:26:10.126 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.112+0000 7fb5fa7fc700 1 --2- 172.21.15.92:0/1876105422 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb5fc0ce5f0 0x7fb5fc158f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:26:10.126 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.112+0000 7fb5fb7fe700 1 --2- 172.21.15.92:0/1876105422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5fc15d490 0x7fb5fc15f9a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb5f400cb60 tx=0x7fb5f400ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:10.126 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.112+0000 7fb5e3fff700 1 -- 172.21.15.92:0/1876105422 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f400aaa0 con 0x7fb5fc15d490 2023-08-26T09:26:10.126 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.113+0000 7fb5e3fff700 1 -- 172.21.15.92:0/1876105422 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f400ac00 con 0x7fb5fc15d490 2023-08-26T09:26:10.126 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.113+0000 7fb6018a3700 1 -- 172.21.15.92:0/1876105422 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5fc15ebe0 con 0x7fb5fc15d490 2023-08-26T09:26:10.127 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.113+0000 7fb5e3fff700 1 -- 172.21.15.92:0/1876105422 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f40070d0 con 0x7fb5fc15d490 2023-08-26T09:26:10.127 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.113+0000 7fb6018a3700 1 -- 172.21.15.92:0/1876105422 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5fc15f1a0 con 0x7fb5fc15d490 2023-08-26T09:26:10.127 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.114+0000 7fb6018a3700 1 -- 172.21.15.92:0/1876105422 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5fc04eeb0 con 0x7fb5fc15d490 2023-08-26T09:26:10.127 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.114+0000 7fb5e3fff700 1 -- 172.21.15.92:0/1876105422 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb5f4007230 con 0x7fb5fc15d490 2023-08-26T09:26:10.127 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.114+0000 7fb5e3fff700 1 --2- 172.21.15.92:0/1876105422 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb5e806a0e0 0x7fb5e806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:10.127 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.114+0000 7fb5faffd700 1 --2- 172.21.15.92:0/1876105422 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb5e806a0e0 0x7fb5e806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:10.128 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.114+0000 7fb5e3fff700 1 -- 172.21.15.92:0/1876105422 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6206+0+0 (secure 0 0 0) 0x7fb5f4088140 con 0x7fb5fc15d490 2023-08-26T09:26:10.128 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.115+0000 7fb5faffd700 1 --2- 172.21.15.92:0/1876105422 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb5e806a0e0 0x7fb5e806c5a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0000c00 tx=0x7fb5f0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:10.128 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.119+0000 7fb5e3fff700 1 -- 172.21.15.92:0/1876105422 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb5f4053720 con 0x7fb5fc15d490 2023-08-26T09:26:10.359 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.356+0000 7fb6018a3700 1 -- 172.21.15.92:0/1876105422 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb5fc0b7a50 con 0x7fb5fc15d490 2023-08-26T09:26:10.973 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.969+0000 7fb5e3fff700 1 -- 172.21.15.92:0/1876105422 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb5f4056d40 con 0x7fb5fc15d490 2023-08-26T09:26:10.976 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.972+0000 7fb6018a3700 1 -- 172.21.15.92:0/1876105422 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb5e806a0e0 msgr2=0x7fb5e806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:10.976 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.972+0000 7fb6018a3700 1 --2- 172.21.15.92:0/1876105422 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb5e806a0e0 0x7fb5e806c5a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0000c00 tx=0x7fb5f0008030 comp rx=0 tx=0).stop 2023-08-26T09:26:10.977 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.972+0000 7fb6018a3700 1 -- 172.21.15.92:0/1876105422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5fc15d490 msgr2=0x7fb5fc15f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:10.977 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.972+0000 7fb6018a3700 1 --2- 172.21.15.92:0/1876105422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5fc15d490 0x7fb5fc15f9a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb5f400cb60 tx=0x7fb5f400ce70 comp rx=0 tx=0).stop 2023-08-26T09:26:10.977 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.972+0000 7fb6018a3700 1 -- 172.21.15.92:0/1876105422 shutdown_connections 2023-08-26T09:26:10.977 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.972+0000 7fb6018a3700 1 --2- 172.21.15.92:0/1876105422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5fc15d490 0x7fb5fc15f9a0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:10.977 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.972+0000 7fb6018a3700 1 --2- 172.21.15.92:0/1876105422 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5fc0b1eb0 0x7fb5fc0cbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:10.977 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.972+0000 7fb6018a3700 1 --2- 172.21.15.92:0/1876105422 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb5e806a0e0 0x7fb5e806c5a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:10.978 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.972+0000 7fb6018a3700 1 --2- 172.21.15.92:0/1876105422 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb5fc0ce5f0 0x7fb5fc158f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:10.978 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.972+0000 7fb6018a3700 1 -- 172.21.15.92:0/1876105422 >> 172.21.15.92:0/1876105422 conn(0x7fb5fc06aac0 msgr2=0x7fb5fc15b460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:10.978 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.972+0000 7fb6018a3700 1 -- 172.21.15.92:0/1876105422 shutdown_connections 2023-08-26T09:26:10.978 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:10.972+0000 7fb6018a3700 1 -- 172.21.15.92:0/1876105422 wait complete. 2023-08-26T09:26:10.990 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-26T09:26:11.159 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.155+0000 7f0103066700 1 Processor -- start 2023-08-26T09:26:11.159 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.155+0000 7f0103066700 1 -- start start 2023-08-26T09:26:11.161 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.156+0000 7f0103066700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f00fc06aa30 0x7f00fc161840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:11.162 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.156+0000 7f0103066700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f00fc0cd870 0x7f00fc0ca990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:11.162 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.156+0000 7f0103066700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00fc0cf260 con 0x7f00fc15d2a0 2023-08-26T09:26:11.162 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.156+0000 7f0103066700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00fc161e20 con 0x7f00fc0cd870 2023-08-26T09:26:11.162 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.156+0000 7f0103066700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00fc15d680 con 0x7f00fc06aa30 2023-08-26T09:26:11.163 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.156+0000 7f0100e02700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f00fc15d2a0 0x7f00fc06a320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:58636/0 (socket says 172.21.15.92:58636) 2023-08-26T09:26:11.163 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.156+0000 7f0101603700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f00fc0cd870 0x7f00fc0ca990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:11.163 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.156+0000 7f0100e02700 1 -- 172.21.15.92:0/145089221 learned_addr learned my addr 172.21.15.92:0/145089221 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:26:11.163 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.156+0000 7f00fbfff700 1 --2- 172.21.15.92:0/145089221 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f00fc06aa30 0x7f00fc161840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:11.163 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.157+0000 7f00fb7fe700 1 -- 172.21.15.92:0/145089221 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3339224396 0 0) 0x7f00fc0cf260 con 0x7f00fc15d2a0 2023-08-26T09:26:11.164 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.157+0000 7f00fb7fe700 1 -- 172.21.15.92:0/145089221 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00ec0035b0 con 0x7f00fc15d2a0 2023-08-26T09:26:11.164 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.157+0000 7f0101603700 1 -- 172.21.15.92:0/145089221 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f00fc06aa30 msgr2=0x7f00fc161840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:11.164 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.157+0000 7f0101603700 1 --2- 172.21.15.92:0/145089221 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f00fc06aa30 0x7f00fc161840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:11.164 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.157+0000 7f0101603700 1 -- 172.21.15.92:0/145089221 >> v1:172.21.15.92:6789/0 conn(0x7f00fc15d2a0 legacy=0x7f00fc06a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:11.164 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.157+0000 7f0101603700 1 -- 172.21.15.92:0/145089221 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00fc0cf4e0 con 0x7f00fc0cd870 2023-08-26T09:26:11.164 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.157+0000 7f0101603700 1 --2- 172.21.15.92:0/145089221 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00fc0cd870 0x7f00fc0ca990 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f00f4009d90 tx=0x7f00f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d94b6f0ae9a4298f server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:11.165 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.157+0000 7f00fb7fe700 1 -- 172.21.15.92:0/145089221 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f400e070 con 0x7f00fc0cd870 2023-08-26T09:26:11.165 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.157+0000 7f00fb7fe700 1 -- 172.21.15.92:0/145089221 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f400bb20 con 0x7f00fc0cd870 2023-08-26T09:26:11.165 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.157+0000 7f00fb7fe700 1 -- 172.21.15.92:0/145089221 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f4012430 con 0x7f00fc0cd870 2023-08-26T09:26:11.165 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.158+0000 7f0103066700 1 -- 172.21.15.92:0/145089221 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00fc0cd870 msgr2=0x7f00fc0ca990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:11.165 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.158+0000 7f0103066700 1 --2- 172.21.15.92:0/145089221 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00fc0cd870 0x7f00fc0ca990 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f00f4009d90 tx=0x7f00f400b330 comp rx=0 tx=0).stop 2023-08-26T09:26:11.166 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.158+0000 7f0103066700 1 -- 172.21.15.92:0/145089221 shutdown_connections 2023-08-26T09:26:11.166 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.158+0000 7f0103066700 1 --2- 172.21.15.92:0/145089221 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00fc0cd870 0x7f00fc0ca990 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:11.166 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.158+0000 7f0103066700 1 --2- 172.21.15.92:0/145089221 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f00fc06aa30 0x7f00fc161840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:11.166 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.158+0000 7f0103066700 1 -- 172.21.15.92:0/145089221 >> 172.21.15.92:0/145089221 conn(0x7f00fc0cfca0 msgr2=0x7f00fc0d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:11.166 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.158+0000 7f0103066700 1 -- 172.21.15.92:0/145089221 shutdown_connections 2023-08-26T09:26:11.167 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.158+0000 7f0103066700 1 -- 172.21.15.92:0/145089221 wait complete. 2023-08-26T09:26:11.169 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.159+0000 7f0103066700 1 Processor -- start 2023-08-26T09:26:11.169 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.159+0000 7f0103066700 1 -- start start 2023-08-26T09:26:11.170 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.160+0000 7f0103066700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f00fc06aa30 0x7f00fc15a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:11.170 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.160+0000 7f0103066700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00fc0cd870 0x7f00fc0c5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:11.170 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.160+0000 7f0103066700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f00fc15d2a0 0x7f00fc0b0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:11.170 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.160+0000 7f0103066700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00fc15ed20 con 0x7f00fc0cd870 2023-08-26T09:26:11.170 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.160+0000 7f0103066700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00fc0c4730 con 0x7f00fc15d2a0 2023-08-26T09:26:11.171 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.160+0000 7f0103066700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00fc0c4a10 con 0x7f00fc06aa30 2023-08-26T09:26:11.171 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.160+0000 7f00fbfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00fc0cd870 0x7f00fc0c5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:11.171 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.160+0000 7f00fbfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00fc0cd870 0x7f00fc0c5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46630/0 (socket says 172.21.15.92:46630) 2023-08-26T09:26:11.171 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.160+0000 7f00fbfff700 1 -- 172.21.15.92:0/149294654 learned_addr learned my addr 172.21.15.92:0/149294654 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:11.171 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.160+0000 7f0100e02700 1 --2- 172.21.15.92:0/149294654 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f00fc06aa30 0x7f00fc15a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:11.172 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.160+0000 7f0101603700 1 --2- 172.21.15.92:0/149294654 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f00fc15d2a0 0x7f00fc0b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:11.172 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.160+0000 7f00fbfff700 1 -- 172.21.15.92:0/149294654 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f00fc06aa30 msgr2=0x7f00fc15a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:11.172 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.160+0000 7f00fbfff700 1 --2- 172.21.15.92:0/149294654 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f00fc06aa30 0x7f00fc15a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:11.172 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.160+0000 7f00fbfff700 1 -- 172.21.15.92:0/149294654 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f00fc15d2a0 msgr2=0x7f00fc0b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:11.172 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.160+0000 7f00fbfff700 1 --2- 172.21.15.92:0/149294654 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f00fc15d2a0 0x7f00fc0b0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:11.173 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.160+0000 7f00fbfff700 1 -- 172.21.15.92:0/149294654 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f4009a70 con 0x7f00fc0cd870 2023-08-26T09:26:11.173 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.160+0000 7f00fbfff700 1 --2- 172.21.15.92:0/149294654 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00fc0cd870 0x7f00fc0c5560 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f00e800e9b0 tx=0x7f00e800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:11.173 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.160+0000 7f00f97fa700 1 -- 172.21.15.92:0/149294654 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e8009710 con 0x7f00fc0cd870 2023-08-26T09:26:11.173 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.161+0000 7f00f97fa700 1 -- 172.21.15.92:0/149294654 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e800c850 con 0x7f00fc0cd870 2023-08-26T09:26:11.173 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.161+0000 7f0103066700 1 -- 172.21.15.92:0/149294654 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00fc0c4cf0 con 0x7f00fc0cd870 2023-08-26T09:26:11.173 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.161+0000 7f00f97fa700 1 -- 172.21.15.92:0/149294654 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e800cbc0 con 0x7f00fc0cd870 2023-08-26T09:26:11.174 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.161+0000 7f0103066700 1 -- 172.21.15.92:0/149294654 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00fc15a6b0 con 0x7f00fc0cd870 2023-08-26T09:26:11.174 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.162+0000 7f0103066700 1 -- 172.21.15.92:0/149294654 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00fc15ee60 con 0x7f00fc0cd870 2023-08-26T09:26:11.174 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.162+0000 7f00f97fa700 1 -- 172.21.15.92:0/149294654 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f00e800cd20 con 0x7f00fc0cd870 2023-08-26T09:26:11.174 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.162+0000 7f00f97fa700 1 --2- 172.21.15.92:0/149294654 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f00e006a0e0 0x7f00e006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:11.174 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.162+0000 7f00f97fa700 1 -- 172.21.15.92:0/149294654 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f00e80886f0 con 0x7f00fc0cd870 2023-08-26T09:26:11.175 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.162+0000 7f0100e02700 1 --2- 172.21.15.92:0/149294654 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f00e006a0e0 0x7f00e006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:11.175 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.163+0000 7f0100e02700 1 --2- 172.21.15.92:0/149294654 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f00e006a0e0 0x7f00e006c5a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f00f00011e0 tx=0x7f00f0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:11.175 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.167+0000 7f00f97fa700 1 -- 172.21.15.92:0/149294654 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f00fc15ee60 con 0x7f00fc0cd870 2023-08-26T09:26:11.362 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:11.358+0000 7f0103066700 1 -- 172.21.15.92:0/149294654 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f00fc15ee60 con 0x7f00fc0cd870 2023-08-26T09:26:12.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.299+0000 7f00f97fa700 1 -- 172.21.15.92:0/149294654 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7f00fc15ee60 con 0x7f00fc0cd870 2023-08-26T09:26:12.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.303+0000 7f0103066700 1 -- 172.21.15.92:0/149294654 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f00e006a0e0 msgr2=0x7f00e006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:12.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.303+0000 7f0103066700 1 --2- 172.21.15.92:0/149294654 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f00e006a0e0 0x7f00e006c5a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f00f00011e0 tx=0x7f00f0009040 comp rx=0 tx=0).stop 2023-08-26T09:26:12.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.303+0000 7f0103066700 1 -- 172.21.15.92:0/149294654 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00fc0cd870 msgr2=0x7f00fc0c5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:12.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.303+0000 7f0103066700 1 --2- 172.21.15.92:0/149294654 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00fc0cd870 0x7f00fc0c5560 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f00e800e9b0 tx=0x7f00e800ed70 comp rx=0 tx=0).stop 2023-08-26T09:26:12.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.303+0000 7f0103066700 1 -- 172.21.15.92:0/149294654 shutdown_connections 2023-08-26T09:26:12.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.303+0000 7f0103066700 1 --2- 172.21.15.92:0/149294654 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f00e006a0e0 0x7f00e006c5a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:12.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.303+0000 7f0103066700 1 --2- 172.21.15.92:0/149294654 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f00fc15d2a0 0x7f00fc0b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:12.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.303+0000 7f0103066700 1 --2- 172.21.15.92:0/149294654 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f00fc06aa30 0x7f00fc15a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:12.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.303+0000 7f0103066700 1 --2- 172.21.15.92:0/149294654 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00fc0cd870 0x7f00fc0c5560 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:12.309 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.303+0000 7f0103066700 1 -- 172.21.15.92:0/149294654 >> 172.21.15.92:0/149294654 conn(0x7f00fc0cfca0 msgr2=0x7f00fc0ac8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:12.309 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.303+0000 7f0103066700 1 -- 172.21.15.92:0/149294654 shutdown_connections 2023-08-26T09:26:12.309 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.303+0000 7f0103066700 1 -- 172.21.15.92:0/149294654 wait complete. 2023-08-26T09:26:12.309 INFO:teuthology.orchestra.run.smithi092.stderr:pool 'cephfs_metadata' removed 2023-08-26T09:26:12.322 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-26T09:26:12.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.449+0000 7fa4ec7c2700 1 Processor -- start 2023-08-26T09:26:12.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.449+0000 7fa4ec7c2700 1 -- start start 2023-08-26T09:26:12.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.450+0000 7fa4ec7c2700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4e40b2f80 0x7fa4e415d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:12.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.450+0000 7fa4ec7c2700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa4e40d0730 0x7fa4e406b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:12.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.450+0000 7fa4ec7c2700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4e40b36f0 con 0x7fa4e40cef60 2023-08-26T09:26:12.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.450+0000 7fa4ec7c2700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4e40cf340 con 0x7fa4e40d0730 2023-08-26T09:26:12.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.450+0000 7fa4ec7c2700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e406b4d0 con 0x7fa4e40b2f80 2023-08-26T09:26:12.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.450+0000 7fa4ea55e700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fa4e40cef60 0x7fa4e40b2870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:58650/0 (socket says 172.21.15.92:58650) 2023-08-26T09:26:12.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.450+0000 7fa4ead5f700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa4e40d0730 0x7fa4e406b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:12.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.450+0000 7fa4ea55e700 1 -- 172.21.15.92:0/2566907554 learned_addr learned my addr 172.21.15.92:0/2566907554 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:26:12.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.450+0000 7fa4e9d5d700 1 --2- 172.21.15.92:0/2566907554 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4e40b2f80 0x7fa4e415d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:12.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.450+0000 7fa4ead5f700 1 -- 172.21.15.92:0/2566907554 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4e40b2f80 msgr2=0x7fa4e415d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:12.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.450+0000 7fa4ead5f700 1 --2- 172.21.15.92:0/2566907554 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4e40b2f80 0x7fa4e415d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:12.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.450+0000 7fa4ead5f700 1 -- 172.21.15.92:0/2566907554 >> v1:172.21.15.92:6789/0 conn(0x7fa4e40cef60 legacy=0x7fa4e40b2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:12.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.450+0000 7fa4ead5f700 1 -- 172.21.15.92:0/2566907554 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e415df50 con 0x7fa4e40d0730 2023-08-26T09:26:12.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.450+0000 7fa4e955c700 1 -- 172.21.15.92:0/2566907554 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3542159929 0 0) 0x7fa4e40b36f0 con 0x7fa4e40cef60 2023-08-26T09:26:12.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.450+0000 7fa4ead5f700 1 --2- 172.21.15.92:0/2566907554 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4e40d0730 0x7fa4e406b980 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc009d90 tx=0x7fa4dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=489540d0db50bed1 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:12.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.451+0000 7fa4e955c700 1 -- 172.21.15.92:0/2566907554 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc00e070 con 0x7fa4e40d0730 2023-08-26T09:26:12.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.451+0000 7fa4e955c700 1 -- 172.21.15.92:0/2566907554 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4dc00bb20 con 0x7fa4e40d0730 2023-08-26T09:26:12.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.451+0000 7fa4e955c700 1 -- 172.21.15.92:0/2566907554 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc012430 con 0x7fa4e40d0730 2023-08-26T09:26:12.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.451+0000 7fa4ec7c2700 1 -- 172.21.15.92:0/2566907554 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4e40d0730 msgr2=0x7fa4e406b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:12.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.451+0000 7fa4ec7c2700 1 --2- 172.21.15.92:0/2566907554 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4e40d0730 0x7fa4e406b980 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc009d90 tx=0x7fa4dc00b330 comp rx=0 tx=0).stop 2023-08-26T09:26:12.459 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.451+0000 7fa4ec7c2700 1 -- 172.21.15.92:0/2566907554 shutdown_connections 2023-08-26T09:26:12.459 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.451+0000 7fa4ec7c2700 1 --2- 172.21.15.92:0/2566907554 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4e40d0730 0x7fa4e406b980 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:12.459 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.451+0000 7fa4ec7c2700 1 --2- 172.21.15.92:0/2566907554 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4e40b2f80 0x7fa4e415d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:12.459 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.451+0000 7fa4ec7c2700 1 -- 172.21.15.92:0/2566907554 >> 172.21.15.92:0/2566907554 conn(0x7fa4e406fa30 msgr2=0x7fa4e406fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:12.460 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.451+0000 7fa4ec7c2700 1 -- 172.21.15.92:0/2566907554 shutdown_connections 2023-08-26T09:26:12.460 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.451+0000 7fa4ec7c2700 1 -- 172.21.15.92:0/2566907554 wait complete. 2023-08-26T09:26:12.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.452+0000 7fa4ec7c2700 1 Processor -- start 2023-08-26T09:26:12.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.452+0000 7fa4ec7c2700 1 -- start start 2023-08-26T09:26:12.463 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.453+0000 7fa4ec7c2700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4e40b2f80 0x7fa4e41517e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:12.463 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.453+0000 7fa4ec7c2700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4e40cef60 0x7fa4e4154a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:12.463 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.453+0000 7fa4ec7c2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4e40d0730 0x7fa4e4154f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:12.463 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.453+0000 7fa4ec7c2700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e40b4040 con 0x7fa4e40d0730 2023-08-26T09:26:12.463 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.453+0000 7fa4ec7c2700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e40b3a10 con 0x7fa4e40b2f80 2023-08-26T09:26:12.464 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.453+0000 7fa4ec7c2700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e40ca510 con 0x7fa4e40cef60 2023-08-26T09:26:12.464 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.453+0000 7fa4ead5f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4e40d0730 0x7fa4e4154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:12.464 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.453+0000 7fa4ead5f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4e40d0730 0x7fa4e4154f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46646/0 (socket says 172.21.15.92:46646) 2023-08-26T09:26:12.464 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.453+0000 7fa4ead5f700 1 -- 172.21.15.92:0/157574002 learned_addr learned my addr 172.21.15.92:0/157574002 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:12.464 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.453+0000 7fa4e9d5d700 1 --2- 172.21.15.92:0/157574002 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4e40cef60 0x7fa4e4154a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:12.465 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.453+0000 7fa4ead5f700 1 -- 172.21.15.92:0/157574002 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4e40cef60 msgr2=0x7fa4e4154a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:12.465 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.453+0000 7fa4ead5f700 1 --2- 172.21.15.92:0/157574002 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4e40cef60 0x7fa4e4154a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:12.465 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.453+0000 7fa4ead5f700 1 -- 172.21.15.92:0/157574002 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4e40b2f80 msgr2=0x7fa4e41517e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:12.465 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.453+0000 7fa4ead5f700 1 --2- 172.21.15.92:0/157574002 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4e40b2f80 0x7fa4e41517e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:12.465 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.453+0000 7fa4ead5f700 1 -- 172.21.15.92:0/157574002 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4dc009a70 con 0x7fa4e40d0730 2023-08-26T09:26:12.466 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.454+0000 7fa4ead5f700 1 --2- 172.21.15.92:0/157574002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4e40d0730 0x7fa4e4154f60 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa4e40d1ef0 tx=0x7fa4dc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:12.466 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.454+0000 7fa4daffd700 1 -- 172.21.15.92:0/157574002 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc012430 con 0x7fa4e40d0730 2023-08-26T09:26:12.466 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.454+0000 7fa4daffd700 1 -- 172.21.15.92:0/157574002 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4dc020070 con 0x7fa4e40d0730 2023-08-26T09:26:12.466 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.454+0000 7fa4ec7c2700 1 -- 172.21.15.92:0/157574002 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4e40ca7f0 con 0x7fa4e40d0730 2023-08-26T09:26:12.466 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.454+0000 7fa4daffd700 1 -- 172.21.15.92:0/157574002 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc004280 con 0x7fa4e40d0730 2023-08-26T09:26:12.467 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.454+0000 7fa4ec7c2700 1 -- 172.21.15.92:0/157574002 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4e4151d20 con 0x7fa4e40d0730 2023-08-26T09:26:12.467 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.455+0000 7fa4ec7c2700 1 -- 172.21.15.92:0/157574002 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4e404e660 con 0x7fa4e40d0730 2023-08-26T09:26:12.467 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.455+0000 7fa4daffd700 1 -- 172.21.15.92:0/157574002 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa4dc0043e0 con 0x7fa4e40d0730 2023-08-26T09:26:12.467 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.455+0000 7fa4daffd700 1 --2- 172.21.15.92:0/157574002 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa4c806a0e0 0x7fa4c806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:12.467 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.455+0000 7fa4daffd700 1 -- 172.21.15.92:0/157574002 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5768+0+0 (secure 0 0 0) 0x7fa4dc022070 con 0x7fa4e40d0730 2023-08-26T09:26:12.467 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.456+0000 7fa4ea55e700 1 --2- 172.21.15.92:0/157574002 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa4c806a0e0 0x7fa4c806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:12.468 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.456+0000 7fa4ea55e700 1 --2- 172.21.15.92:0/157574002 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa4c806a0e0 0x7fa4c806c5a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa4e00011e0 tx=0x7fa4e00079b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:12.468 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.460+0000 7fa4daffd700 1 -- 172.21.15.92:0/157574002 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa4dc055e20 con 0x7fa4e40d0730 2023-08-26T09:26:12.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:12.649+0000 7fa4ec7c2700 1 -- 172.21.15.92:0/157574002 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa4e40b6d70 con 0x7fa4e40d0730 2023-08-26T09:26:13.304 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.300+0000 7fa4daffd700 1 -- 172.21.15.92:0/157574002 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa4dc059440 con 0x7fa4e40d0730 2023-08-26T09:26:13.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.304+0000 7fa4ec7c2700 1 -- 172.21.15.92:0/157574002 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa4c806a0e0 msgr2=0x7fa4c806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:13.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.304+0000 7fa4ec7c2700 1 --2- 172.21.15.92:0/157574002 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa4c806a0e0 0x7fa4c806c5a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa4e00011e0 tx=0x7fa4e00079b0 comp rx=0 tx=0).stop 2023-08-26T09:26:13.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.304+0000 7fa4ec7c2700 1 -- 172.21.15.92:0/157574002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4e40d0730 msgr2=0x7fa4e4154f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:13.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.304+0000 7fa4ec7c2700 1 --2- 172.21.15.92:0/157574002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4e40d0730 0x7fa4e4154f60 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa4e40d1ef0 tx=0x7fa4dc004ad0 comp rx=0 tx=0).stop 2023-08-26T09:26:13.309 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.304+0000 7fa4ec7c2700 1 -- 172.21.15.92:0/157574002 shutdown_connections 2023-08-26T09:26:13.309 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.304+0000 7fa4ec7c2700 1 --2- 172.21.15.92:0/157574002 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa4c806a0e0 0x7fa4c806c5a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:13.309 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.304+0000 7fa4ec7c2700 1 --2- 172.21.15.92:0/157574002 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4e40b2f80 0x7fa4e41517e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:13.309 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.304+0000 7fa4ec7c2700 1 --2- 172.21.15.92:0/157574002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4e40d0730 0x7fa4e4154f60 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:13.309 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.304+0000 7fa4ec7c2700 1 --2- 172.21.15.92:0/157574002 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4e40cef60 0x7fa4e4154a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:13.310 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.304+0000 7fa4ec7c2700 1 -- 172.21.15.92:0/157574002 >> 172.21.15.92:0/157574002 conn(0x7fa4e406fa30 msgr2=0x7fa4e406be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:13.310 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.304+0000 7fa4ec7c2700 1 -- 172.21.15.92:0/157574002 shutdown_connections 2023-08-26T09:26:13.310 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.305+0000 7fa4ec7c2700 1 -- 172.21.15.92:0/157574002 wait complete. 2023-08-26T09:26:13.312 INFO:teuthology.orchestra.run.smithi092.stderr:pool 'cephfs_data' removed 2023-08-26T09:26:13.324 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-26T09:26:13.324 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-26T09:26:13.325 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-26T09:26:13.325 INFO:teuthology.orchestra.run:waiting for 300 2023-08-26T09:26:13.325 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-26T09:26:13.326 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-26T09:26:13.326 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-26T09:26:13.326 INFO:teuthology.orchestra.run:waiting for 300 2023-08-26T09:26:13.326 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-26T09:26:13.327 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-26T09:26:13.327 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-26T09:26:13.327 INFO:teuthology.orchestra.run:waiting for 300 2023-08-26T09:26:13.328 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-26T09:26:13.328 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-26T09:26:13.328 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-26T09:26:13.329 INFO:teuthology.orchestra.run:waiting for 300 2023-08-26T09:26:13.334 INFO:tasks.ceph.mds.a:Stopped 2023-08-26T09:26:13.335 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-26T09:26:13.336 INFO:tasks.ceph.mds.c:Stopped 2023-08-26T09:26:13.336 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-26T09:26:13.338 INFO:tasks.ceph.mds.b:Stopped 2023-08-26T09:26:13.339 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-26T09:26:13.340 INFO:tasks.ceph.mds.d:Stopped 2023-08-26T09:26:13.340 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-26T09:26:13.377 INFO:tasks.ceph.mds.a:Started 2023-08-26T09:26:13.377 DEBUG:teuthology.parallel:result is None 2023-08-26T09:26:13.378 INFO:tasks.ceph.mds.c:Started 2023-08-26T09:26:13.378 DEBUG:teuthology.parallel:result is None 2023-08-26T09:26:13.382 INFO:tasks.ceph.mds.b:Started 2023-08-26T09:26:13.383 DEBUG:teuthology.parallel:result is None 2023-08-26T09:26:13.384 INFO:tasks.ceph.mds.d:Started 2023-08-26T09:26:13.384 DEBUG:teuthology.parallel:result is None 2023-08-26T09:26:13.385 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-26T09:26:13.456 INFO:tasks.ceph.mds.a.smithi092.stdout:starting mds.a at 2023-08-26T09:26:13.456 INFO:tasks.ceph.mds.c.smithi092.stdout:starting mds.c at 2023-08-26T09:26:13.469 INFO:tasks.ceph.mds.b.smithi188.stdout:starting mds.b at 2023-08-26T09:26:13.470 INFO:tasks.ceph.mds.d.smithi188.stdout:starting mds.d at 2023-08-26T09:26:13.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.510+0000 7f73f242e700 1 Processor -- start 2023-08-26T09:26:13.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.510+0000 7f73f242e700 1 -- start start 2023-08-26T09:26:13.516 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.511+0000 7f73f242e700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f73ec160b90 0x7f73ec0cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:13.516 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.511+0000 7f73f242e700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f73ec06d8a0 0x7f73ec161b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:13.516 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.511+0000 7f73f242e700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73ec06cf70 con 0x7f73ec06a320 2023-08-26T09:26:13.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.511+0000 7f73f242e700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73ec160f70 con 0x7f73ec160b90 2023-08-26T09:26:13.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.511+0000 7f73f242e700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73ec161670 con 0x7f73ec06d8a0 2023-08-26T09:26:13.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.511+0000 7f73ebfff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f73ec160b90 0x7f73ec0cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:13.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.511+0000 7f73f09cb700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f73ec06a320 0x7f73ec070ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:58696/0 (socket says 172.21.15.92:58696) 2023-08-26T09:26:13.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.511+0000 7f73f09cb700 1 -- 172.21.15.92:0/634355240 learned_addr learned my addr 172.21.15.92:0/634355240 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:26:13.518 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.511+0000 7f73eb7fe700 1 --2- 172.21.15.92:0/634355240 >> v2:172.21.15.188:3300/0 conn(0x7f73ec06d8a0 0x7f73ec161b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:13.518 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.511+0000 7f73ebfff700 1 -- 172.21.15.92:0/634355240 >> v2:172.21.15.188:3300/0 conn(0x7f73ec06d8a0 msgr2=0x7f73ec161b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:13.518 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.511+0000 7f73ebfff700 1 --2- 172.21.15.92:0/634355240 >> v2:172.21.15.188:3300/0 conn(0x7f73ec06d8a0 0x7f73ec161b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:13.518 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.511+0000 7f73ebfff700 1 -- 172.21.15.92:0/634355240 >> v1:172.21.15.92:6789/0 conn(0x7f73ec06a320 legacy=0x7f73ec070ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:13.518 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.511+0000 7f73eaffd700 1 -- 172.21.15.92:0/634355240 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3555368690 0 0) 0x7f73ec06cf70 con 0x7f73ec06a320 2023-08-26T09:26:13.519 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.511+0000 7f73ebfff700 1 -- 172.21.15.92:0/634355240 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73ec162040 con 0x7f73ec160b90 2023-08-26T09:26:13.519 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.511+0000 7f73eb7fe700 1 --2- 172.21.15.92:0/634355240 >> v2:172.21.15.188:3300/0 conn(0x7f73ec06d8a0 0x7f73ec161b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:26:13.519 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.511+0000 7f73ebfff700 1 --2- 172.21.15.92:0/634355240 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73ec160b90 0x7f73ec0cf780 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f73ec06c400 tx=0x7f73dc009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89d30bad55fd3fec server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:13.519 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.511+0000 7f73eaffd700 1 -- 172.21.15.92:0/634355240 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73dc011830 con 0x7f73ec160b90 2023-08-26T09:26:13.519 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.511+0000 7f73eaffd700 1 -- 172.21.15.92:0/634355240 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73dc011990 con 0x7f73ec160b90 2023-08-26T09:26:13.520 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.511+0000 7f73eaffd700 1 -- 172.21.15.92:0/634355240 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73dc011d20 con 0x7f73ec160b90 2023-08-26T09:26:13.520 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.512+0000 7f73f242e700 1 -- 172.21.15.92:0/634355240 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73ec160b90 msgr2=0x7f73ec0cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:13.520 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.512+0000 7f73f242e700 1 --2- 172.21.15.92:0/634355240 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73ec160b90 0x7f73ec0cf780 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f73ec06c400 tx=0x7f73dc009b20 comp rx=0 tx=0).stop 2023-08-26T09:26:13.520 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.512+0000 7f73f242e700 1 -- 172.21.15.92:0/634355240 shutdown_connections 2023-08-26T09:26:13.521 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.512+0000 7f73f242e700 1 --2- 172.21.15.92:0/634355240 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73ec160b90 0x7f73ec0cf780 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:13.521 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.512+0000 7f73f242e700 1 --2- 172.21.15.92:0/634355240 >> v2:172.21.15.188:3300/0 conn(0x7f73ec06d8a0 0x7f73ec161b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:13.521 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.512+0000 7f73f242e700 1 -- 172.21.15.92:0/634355240 >> 172.21.15.92:0/634355240 conn(0x7f73ec0cc790 msgr2=0x7f73ec0ccb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:13.521 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.512+0000 7f73f242e700 1 -- 172.21.15.92:0/634355240 shutdown_connections 2023-08-26T09:26:13.521 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.512+0000 7f73f242e700 1 -- 172.21.15.92:0/634355240 wait complete. 2023-08-26T09:26:13.524 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.513+0000 7f73f242e700 1 Processor -- start 2023-08-26T09:26:13.524 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.513+0000 7f73f242e700 1 -- start start 2023-08-26T09:26:13.524 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.514+0000 7f73f242e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73ec06a320 0x7f73ec15a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:13.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.514+0000 7f73f242e700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f73ec06d8a0 0x7f73ec0b1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:13.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.514+0000 7f73f242e700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f73ec160b90 0x7f73ec0adc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:13.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.514+0000 7f73f242e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec15a920 con 0x7f73ec06a320 2023-08-26T09:26:13.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.514+0000 7f73f242e700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec0b1fc0 con 0x7f73ec160b90 2023-08-26T09:26:13.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.514+0000 7f73f242e700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec0c8000 con 0x7f73ec06d8a0 2023-08-26T09:26:13.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.514+0000 7f73ebfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73ec06a320 0x7f73ec15a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:13.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.514+0000 7f73ebfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73ec06a320 0x7f73ec15a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46684/0 (socket says 172.21.15.92:46684) 2023-08-26T09:26:13.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.514+0000 7f73ebfff700 1 -- 172.21.15.92:0/1515822238 learned_addr learned my addr 172.21.15.92:0/1515822238 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:13.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.514+0000 7f73ebfff700 1 -- 172.21.15.92:0/1515822238 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f73ec06d8a0 msgr2=0x7f73ec0b1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:13.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.514+0000 7f73ebfff700 1 --2- 172.21.15.92:0/1515822238 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f73ec06d8a0 0x7f73ec0b1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:13.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.514+0000 7f73ebfff700 1 -- 172.21.15.92:0/1515822238 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f73ec160b90 msgr2=0x7f73ec0adc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:13.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.514+0000 7f73ebfff700 1 --2- 172.21.15.92:0/1515822238 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f73ec160b90 0x7f73ec0adc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:13.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.514+0000 7f73ebfff700 1 -- 172.21.15.92:0/1515822238 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73dc0094a0 con 0x7f73ec06a320 2023-08-26T09:26:13.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.514+0000 7f73ebfff700 1 --2- 172.21.15.92:0/1515822238 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73ec06a320 0x7f73ec15a3e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f73dc0090b0 tx=0x7f73dc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:13.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.515+0000 7f73e8ff9700 1 -- 172.21.15.92:0/1515822238 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73dc0038a0 con 0x7f73ec06a320 2023-08-26T09:26:13.528 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.515+0000 7f73e8ff9700 1 -- 172.21.15.92:0/1515822238 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73dc01f070 con 0x7f73ec06a320 2023-08-26T09:26:13.528 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.515+0000 7f73f242e700 1 -- 172.21.15.92:0/1515822238 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73ec0c82e0 con 0x7f73ec06a320 2023-08-26T09:26:13.528 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.515+0000 7f73e8ff9700 1 -- 172.21.15.92:0/1515822238 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73dc003c00 con 0x7f73ec06a320 2023-08-26T09:26:13.528 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.515+0000 7f73f242e700 1 -- 172.21.15.92:0/1515822238 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73ec0c88a0 con 0x7f73ec06a320 2023-08-26T09:26:13.528 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.516+0000 7f73f242e700 1 -- 172.21.15.92:0/1515822238 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73ec04e660 con 0x7f73ec06a320 2023-08-26T09:26:13.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.516+0000 7f73e8ff9700 1 -- 172.21.15.92:0/1515822238 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f73dc01a430 con 0x7f73ec06a320 2023-08-26T09:26:13.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.516+0000 7f73e8ff9700 1 --2- 172.21.15.92:0/1515822238 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f73d806a0e0 0x7f73d806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:13.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.516+0000 7f73e8ff9700 1 -- 172.21.15.92:0/1515822238 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f73dc021070 con 0x7f73ec06a320 2023-08-26T09:26:13.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.516+0000 7f73eb7fe700 1 --2- 172.21.15.92:0/1515822238 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f73d806a0e0 0x7f73d806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:13.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.517+0000 7f73eb7fe700 1 --2- 172.21.15.92:0/1515822238 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f73d806a0e0 0x7f73d806c5a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f73e0006fd0 tx=0x7f73e0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:13.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.521+0000 7f73e8ff9700 1 -- 172.21.15.92:0/1515822238 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f73dc055720 con 0x7f73ec06a320 2023-08-26T09:26:13.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:13.730+0000 7f73f242e700 1 -- 172.21.15.92:0/1515822238 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f73ec0b5c90 con 0x7f73ec06a320 2023-08-26T09:26:14.318 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.314+0000 7f73e8ff9700 1 -- 172.21.15.92:0/1515822238 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v27) v1 ==== 97+0+0 (secure 0 0 0) 0x7f73dc058d40 con 0x7f73ec06a320 2023-08-26T09:26:14.321 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.317+0000 7f73f242e700 1 -- 172.21.15.92:0/1515822238 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f73d806a0e0 msgr2=0x7f73d806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:14.321 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.317+0000 7f73f242e700 1 --2- 172.21.15.92:0/1515822238 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f73d806a0e0 0x7f73d806c5a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f73e0006fd0 tx=0x7f73e0008040 comp rx=0 tx=0).stop 2023-08-26T09:26:14.321 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.317+0000 7f73f242e700 1 -- 172.21.15.92:0/1515822238 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73ec06a320 msgr2=0x7f73ec15a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:14.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.317+0000 7f73f242e700 1 --2- 172.21.15.92:0/1515822238 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73ec06a320 0x7f73ec15a3e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f73dc0090b0 tx=0x7f73dc004750 comp rx=0 tx=0).stop 2023-08-26T09:26:14.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.317+0000 7f73f242e700 1 -- 172.21.15.92:0/1515822238 shutdown_connections 2023-08-26T09:26:14.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.317+0000 7f73f242e700 1 --2- 172.21.15.92:0/1515822238 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f73d806a0e0 0x7f73d806c5a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:14.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.317+0000 7f73f242e700 1 --2- 172.21.15.92:0/1515822238 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f73ec160b90 0x7f73ec0adc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:14.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.317+0000 7f73f242e700 1 --2- 172.21.15.92:0/1515822238 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73ec06a320 0x7f73ec15a3e0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:14.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.317+0000 7f73f242e700 1 --2- 172.21.15.92:0/1515822238 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f73ec06d8a0 0x7f73ec0b1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:14.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.317+0000 7f73f242e700 1 -- 172.21.15.92:0/1515822238 >> 172.21.15.92:0/1515822238 conn(0x7f73ec0cc790 msgr2=0x7f73ec0cbc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:14.324 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.317+0000 7f73f242e700 1 -- 172.21.15.92:0/1515822238 shutdown_connections 2023-08-26T09:26:14.324 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.317+0000 7f73f242e700 1 -- 172.21.15.92:0/1515822238 wait complete. 2023-08-26T09:26:14.324 INFO:teuthology.orchestra.run.smithi092.stderr: removed all blocklist entries 2023-08-26T09:26:14.336 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-26T09:26:14.459 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.455+0000 7efc8d9e0700 1 Processor -- start 2023-08-26T09:26:14.459 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.455+0000 7efc8d9e0700 1 -- start start 2023-08-26T09:26:14.468 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.456+0000 7efc8d9e0700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc880b2120 0x7efc880d1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:14.468 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.456+0000 7efc8d9e0700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc8806c1e0 con 0x7efc880cda30 2023-08-26T09:26:14.469 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.456+0000 7efc8d9e0700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc8806c480 con 0x7efc880cde10 2023-08-26T09:26:14.469 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.456+0000 7efc8d9e0700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc8806c760 con 0x7efc880b2120 2023-08-26T09:26:14.469 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.456+0000 7efc86ffd700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7efc880cda30 0x7efc880cb590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:58708/0 (socket says 172.21.15.92:58708) 2023-08-26T09:26:14.470 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.456+0000 7efc86ffd700 1 -- 172.21.15.92:0/3568634975 learned_addr learned my addr 172.21.15.92:0/3568634975 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:26:14.470 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.456+0000 7efc85ffb700 1 -- 172.21.15.92:0/3568634975 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 402316812 0 0) 0x7efc8806c1e0 con 0x7efc880cda30 2023-08-26T09:26:14.470 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.457+0000 7efc85ffb700 1 -- 172.21.15.92:0/3568634975 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc700035b0 con 0x7efc880cda30 2023-08-26T09:26:14.470 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.457+0000 7efc877fe700 1 --2- 172.21.15.92:0/3568634975 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc880b2120 0x7efc880d1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:14.470 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.457+0000 7efc85ffb700 1 -- 172.21.15.92:0/3568634975 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3702854244 0 0) 0x7efc700035b0 con 0x7efc880cda30 2023-08-26T09:26:14.471 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.457+0000 7efc85ffb700 1 -- 172.21.15.92:0/3568634975 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc880b2120 msgr2=0x7efc880d1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:14.471 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.457+0000 7efc85ffb700 1 --2- 172.21.15.92:0/3568634975 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc880b2120 0x7efc880d1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:14.471 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.457+0000 7efc85ffb700 1 -- 172.21.15.92:0/3568634975 >> v1:172.21.15.188:6789/0 conn(0x7efc880cde10 legacy=0x7efc880cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:14.471 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.457+0000 7efc85ffb700 1 -- 172.21.15.92:0/3568634975 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc880cf600 con 0x7efc880cda30 2023-08-26T09:26:14.471 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.457+0000 7efc85ffb700 1 -- 172.21.15.92:0/3568634975 <== mon.0 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1019361464 0 0) 0x7efc7c0017f0 con 0x7efc880cda30 2023-08-26T09:26:14.472 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.457+0000 7efc85ffb700 1 -- 172.21.15.92:0/3568634975 >> v1:172.21.15.92:6789/0 conn(0x7efc880cda30 legacy=0x7efc880cb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:14.472 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.457+0000 7efc85ffb700 1 --2- 172.21.15.92:0/3568634975 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc70003a30 0x7efc70003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:14.472 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.457+0000 7efc85ffb700 1 --2- 172.21.15.92:0/3568634975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc70004850 0x7efc70004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:14.472 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.457+0000 7efc85ffb700 1 --2- 172.21.15.92:0/3568634975 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc880b2120 0x7efc70005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:14.472 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.457+0000 7efc85ffb700 1 -- 172.21.15.92:0/3568634975 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc8806c760 con 0x7efc70004850 2023-08-26T09:26:14.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.457+0000 7efc85ffb700 1 -- 172.21.15.92:0/3568634975 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc7000baf0 con 0x7efc70003a30 2023-08-26T09:26:14.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.457+0000 7efc85ffb700 1 -- 172.21.15.92:0/3568634975 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc7000bcb0 con 0x7efc880b2120 2023-08-26T09:26:14.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.457+0000 7efc867fc700 1 --2- 172.21.15.92:0/3568634975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc70004850 0x7efc70004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:14.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.457+0000 7efc86ffd700 1 --2- 172.21.15.92:0/3568634975 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc70003a30 0x7efc70003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:14.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.457+0000 7efc877fe700 1 --2- 172.21.15.92:0/3568634975 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc880b2120 0x7efc70005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:14.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.457+0000 7efc867fc700 1 -- 172.21.15.92:0/3568634975 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc880b2120 msgr2=0x7efc70005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:14.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.457+0000 7efc867fc700 1 --2- 172.21.15.92:0/3568634975 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc880b2120 0x7efc70005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:14.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.457+0000 7efc867fc700 1 -- 172.21.15.92:0/3568634975 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc70003a30 msgr2=0x7efc70003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:14.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.457+0000 7efc867fc700 1 --2- 172.21.15.92:0/3568634975 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc70003a30 0x7efc70003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:14.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.457+0000 7efc867fc700 1 -- 172.21.15.92:0/3568634975 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc700035b0 con 0x7efc70004850 2023-08-26T09:26:14.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.457+0000 7efc877fe700 1 --2- 172.21.15.92:0/3568634975 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc880b2120 0x7efc70005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:26:14.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.457+0000 7efc867fc700 1 --2- 172.21.15.92:0/3568634975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc70004850 0x7efc70004cd0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7efc78007fd0 tx=0x7efc70005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26bc948632842bc4 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:14.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.457+0000 7efc85ffb700 1 -- 172.21.15.92:0/3568634975 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc780012f0 con 0x7efc70004850 2023-08-26T09:26:14.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.458+0000 7efc85ffb700 1 -- 172.21.15.92:0/3568634975 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc780052f0 con 0x7efc70004850 2023-08-26T09:26:14.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.458+0000 7efc85ffb700 1 -- 172.21.15.92:0/3568634975 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc78006860 con 0x7efc70004850 2023-08-26T09:26:14.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.458+0000 7efc8d9e0700 1 -- 172.21.15.92:0/3568634975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc70004850 msgr2=0x7efc70004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:14.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.458+0000 7efc8d9e0700 1 --2- 172.21.15.92:0/3568634975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc70004850 0x7efc70004cd0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7efc78007fd0 tx=0x7efc70005880 comp rx=0 tx=0).stop 2023-08-26T09:26:14.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.458+0000 7efc877fe700 1 -- 172.21.15.92:0/3568634975 reap_dead start 2023-08-26T09:26:14.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.458+0000 7efc8d9e0700 1 -- 172.21.15.92:0/3568634975 shutdown_connections 2023-08-26T09:26:14.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.458+0000 7efc8d9e0700 1 -- 172.21.15.92:0/3568634975 >> 172.21.15.92:0/3568634975 conn(0x7efc880d0f40 msgr2=0x7efc880d1350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:14.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.458+0000 7efc8d9e0700 1 -- 172.21.15.92:0/3568634975 shutdown_connections 2023-08-26T09:26:14.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.458+0000 7efc8d9e0700 1 -- 172.21.15.92:0/3568634975 wait complete. 2023-08-26T09:26:14.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.459+0000 7efc8d9e0700 1 Processor -- start 2023-08-26T09:26:14.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.460+0000 7efc8d9e0700 1 -- start start 2023-08-26T09:26:14.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.460+0000 7efc8d9e0700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc70004850 0x7efc881545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:14.478 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.460+0000 7efc8d9e0700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc881e6260 0x7efc880b6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:14.478 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.460+0000 7efc8d9e0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc880b5060 0x7efc88159780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:14.478 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.460+0000 7efc8d9e0700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc880b59f0 con 0x7efc880b5060 2023-08-26T09:26:14.478 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.460+0000 7efc8d9e0700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc880b6290 con 0x7efc70004850 2023-08-26T09:26:14.478 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.460+0000 7efc8d9e0700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc881e67d0 con 0x7efc881e6260 2023-08-26T09:26:14.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.460+0000 7efc877fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc880b5060 0x7efc88159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:14.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.460+0000 7efc877fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc880b5060 0x7efc88159780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46710/0 (socket says 172.21.15.92:46710) 2023-08-26T09:26:14.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.460+0000 7efc877fe700 1 -- 172.21.15.92:0/4277044813 learned_addr learned my addr 172.21.15.92:0/4277044813 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:14.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.460+0000 7efc86ffd700 1 --2- 172.21.15.92:0/4277044813 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc70004850 0x7efc881545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:14.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.460+0000 7efc867fc700 1 --2- 172.21.15.92:0/4277044813 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc881e6260 0x7efc880b6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:14.480 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.461+0000 7efc877fe700 1 -- 172.21.15.92:0/4277044813 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc881e6260 msgr2=0x7efc880b6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:14.480 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.461+0000 7efc877fe700 1 --2- 172.21.15.92:0/4277044813 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc881e6260 0x7efc880b6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:14.480 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.461+0000 7efc877fe700 1 -- 172.21.15.92:0/4277044813 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc70004850 msgr2=0x7efc881545a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:14.480 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.461+0000 7efc877fe700 1 --2- 172.21.15.92:0/4277044813 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc70004850 0x7efc881545a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:14.480 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.461+0000 7efc877fe700 1 -- 172.21.15.92:0/4277044813 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc880b5c40 con 0x7efc880b5060 2023-08-26T09:26:14.480 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.461+0000 7efc877fe700 1 --2- 172.21.15.92:0/4277044813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc880b5060 0x7efc88159780 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7efc880ce1f0 tx=0x7efc8000f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:14.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.461+0000 7efc6ffff700 1 -- 172.21.15.92:0/4277044813 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8000fcb0 con 0x7efc880b5060 2023-08-26T09:26:14.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.461+0000 7efc6ffff700 1 -- 172.21.15.92:0/4277044813 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc80011040 con 0x7efc880b5060 2023-08-26T09:26:14.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.461+0000 7efc6ffff700 1 -- 172.21.15.92:0/4277044813 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc80017400 con 0x7efc880b5060 2023-08-26T09:26:14.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.461+0000 7efc8d9e0700 1 -- 172.21.15.92:0/4277044813 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc880b5f20 con 0x7efc880b5060 2023-08-26T09:26:14.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.461+0000 7efc8d9e0700 1 -- 172.21.15.92:0/4277044813 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc88154ed0 con 0x7efc880b5060 2023-08-26T09:26:14.482 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.462+0000 7efc8d9e0700 1 -- 172.21.15.92:0/4277044813 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc880b6440 con 0x7efc880b5060 2023-08-26T09:26:14.482 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.462+0000 7efc6ffff700 1 -- 172.21.15.92:0/4277044813 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7efc800203b0 con 0x7efc880b5060 2023-08-26T09:26:14.482 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.463+0000 7efc6ffff700 1 --2- 172.21.15.92:0/4277044813 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7efc7406a0e0 0x7efc7406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:14.482 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.463+0000 7efc6ffff700 1 -- 172.21.15.92:0/4277044813 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5210+0+0 (secure 0 0 0) 0x7efc80088120 con 0x7efc880b5060 2023-08-26T09:26:14.482 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.463+0000 7efc86ffd700 1 --2- 172.21.15.92:0/4277044813 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7efc7406a0e0 0x7efc7406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:14.482 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.463+0000 7efc86ffd700 1 --2- 172.21.15.92:0/4277044813 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7efc7406a0e0 0x7efc7406c5a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7efc7c001380 tx=0x7efc7c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:14.483 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.467+0000 7efc6ffff700 1 -- 172.21.15.92:0/4277044813 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7efc880b6440 con 0x7efc880b5060 2023-08-26T09:26:14.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.731+0000 7efc8d9e0700 1 -- 172.21.15.92:0/4277044813 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7efc880b6400 con 0x7efc880b5060 2023-08-26T09:26:14.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.731+0000 7efc6ffff700 1 -- 172.21.15.92:0/4277044813 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7efc80053b60 con 0x7efc880b5060 2023-08-26T09:26:14.735 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:26:14.735 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-08-26T09:26:14.736 INFO:teuthology.orchestra.run.smithi092.stdout: "auth_dump": [ 2023-08-26T09:26:14.736 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-08-26T09:26:14.736 INFO:teuthology.orchestra.run.smithi092.stdout: "entity": "mds.a", 2023-08-26T09:26:14.736 INFO:teuthology.orchestra.run.smithi092.stdout: "key": "AQDFxOlkk235EhAAe1bNsrK/sxnN0v9i68Bkig==", 2023-08-26T09:26:14.736 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": { 2023-08-26T09:26:14.737 INFO:teuthology.orchestra.run.smithi092.stdout: "mds": "allow", 2023-08-26T09:26:14.737 INFO:teuthology.orchestra.run.smithi092.stdout: "mgr": "allow *", 2023-08-26T09:26:14.737 INFO:teuthology.orchestra.run.smithi092.stdout: "mon": "allow *", 2023-08-26T09:26:14.737 INFO:teuthology.orchestra.run.smithi092.stdout: "osd": "allow *" 2023-08-26T09:26:14.737 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-08-26T09:26:14.738 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-08-26T09:26:14.738 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-08-26T09:26:14.738 INFO:teuthology.orchestra.run.smithi092.stdout: "entity": "mds.b", 2023-08-26T09:26:14.738 INFO:teuthology.orchestra.run.smithi092.stdout: "key": "AQDFxOlkv0TZHxAA01DhL0Wi2cw9T+kq/8ThKg==", 2023-08-26T09:26:14.738 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": { 2023-08-26T09:26:14.739 INFO:teuthology.orchestra.run.smithi092.stdout: "mds": "allow", 2023-08-26T09:26:14.739 INFO:teuthology.orchestra.run.smithi092.stdout: "mgr": "allow *", 2023-08-26T09:26:14.739 INFO:teuthology.orchestra.run.smithi092.stdout: "mon": "allow *", 2023-08-26T09:26:14.739 INFO:teuthology.orchestra.run.smithi092.stdout: "osd": "allow *" 2023-08-26T09:26:14.739 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-08-26T09:26:14.740 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-08-26T09:26:14.740 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-08-26T09:26:14.740 INFO:teuthology.orchestra.run.smithi092.stdout: "entity": "mds.c", 2023-08-26T09:26:14.740 INFO:teuthology.orchestra.run.smithi092.stdout: "key": "AQDFxOlkb3e9GhAAJJ2EQwJMUjYx+s2CdR6UkQ==", 2023-08-26T09:26:14.740 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": { 2023-08-26T09:26:14.741 INFO:teuthology.orchestra.run.smithi092.stdout: "mds": "allow", 2023-08-26T09:26:14.741 INFO:teuthology.orchestra.run.smithi092.stdout: "mgr": "allow *", 2023-08-26T09:26:14.741 INFO:teuthology.orchestra.run.smithi092.stdout: "mon": "allow *", 2023-08-26T09:26:14.741 INFO:teuthology.orchestra.run.smithi092.stdout: "osd": "allow *" 2023-08-26T09:26:14.741 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-08-26T09:26:14.742 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-08-26T09:26:14.742 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-08-26T09:26:14.742 INFO:teuthology.orchestra.run.smithi092.stdout: "entity": "mds.d", 2023-08-26T09:26:14.742 INFO:teuthology.orchestra.run.smithi092.stdout: "key": "AQDFxOlkiQmDJxAAzcEI8EcI4yzj3M+emnCq0A==", 2023-08-26T09:26:14.742 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": { 2023-08-26T09:26:14.743 INFO:teuthology.orchestra.run.smithi092.stdout: "mds": "allow", 2023-08-26T09:26:14.743 INFO:teuthology.orchestra.run.smithi092.stdout: "mgr": "allow *", 2023-08-26T09:26:14.743 INFO:teuthology.orchestra.run.smithi092.stdout: "mon": "allow *", 2023-08-26T09:26:14.743 INFO:teuthology.orchestra.run.smithi092.stdout: "osd": "allow *" 2023-08-26T09:26:14.743 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-08-26T09:26:14.744 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-08-26T09:26:14.744 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-08-26T09:26:14.744 INFO:teuthology.orchestra.run.smithi092.stdout: "entity": "osd.0", 2023-08-26T09:26:14.744 INFO:teuthology.orchestra.run.smithi092.stdout: "key": "AQDJxOlkeK9ADRAACwlDTi42455SHrVCXIz/aQ==", 2023-08-26T09:26:14.744 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": { 2023-08-26T09:26:14.744 INFO:teuthology.orchestra.run.smithi092.stdout: "mgr": "allow profile osd", 2023-08-26T09:26:14.745 INFO:teuthology.orchestra.run.smithi092.stdout: "mon": "allow profile osd", 2023-08-26T09:26:14.745 INFO:teuthology.orchestra.run.smithi092.stdout: "osd": "allow *" 2023-08-26T09:26:14.745 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-08-26T09:26:14.745 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-08-26T09:26:14.745 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-08-26T09:26:14.746 INFO:teuthology.orchestra.run.smithi092.stdout: "entity": "osd.1", 2023-08-26T09:26:14.746 INFO:teuthology.orchestra.run.smithi092.stdout: "key": "AQDMxOlkW4MVDRAADrZXg1hpegqIRjl8iAdcfg==", 2023-08-26T09:26:14.746 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": { 2023-08-26T09:26:14.746 INFO:teuthology.orchestra.run.smithi092.stdout: "mgr": "allow profile osd", 2023-08-26T09:26:14.746 INFO:teuthology.orchestra.run.smithi092.stdout: "mon": "allow profile osd", 2023-08-26T09:26:14.747 INFO:teuthology.orchestra.run.smithi092.stdout: "osd": "allow *" 2023-08-26T09:26:14.747 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-08-26T09:26:14.747 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-08-26T09:26:14.747 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-08-26T09:26:14.747 INFO:teuthology.orchestra.run.smithi092.stdout: "entity": "osd.2", 2023-08-26T09:26:14.747 INFO:teuthology.orchestra.run.smithi092.stdout: "key": "AQDPxOlk4GyaDRAA6iIWUhxJt/z+ZaO4kNu07Q==", 2023-08-26T09:26:14.748 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": { 2023-08-26T09:26:14.748 INFO:teuthology.orchestra.run.smithi092.stdout: "mgr": "allow profile osd", 2023-08-26T09:26:14.748 INFO:teuthology.orchestra.run.smithi092.stdout: "mon": "allow profile osd", 2023-08-26T09:26:14.748 INFO:teuthology.orchestra.run.smithi092.stdout: "osd": "allow *" 2023-08-26T09:26:14.748 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-08-26T09:26:14.749 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-08-26T09:26:14.749 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-08-26T09:26:14.749 INFO:teuthology.orchestra.run.smithi092.stdout: "entity": "osd.3", 2023-08-26T09:26:14.749 INFO:teuthology.orchestra.run.smithi092.stdout: "key": "AQDSxOlkvxyuDRAAA8dq+1Sszcn6NLWSIX/mVA==", 2023-08-26T09:26:14.749 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": { 2023-08-26T09:26:14.750 INFO:teuthology.orchestra.run.smithi092.stdout: "mgr": "allow profile osd", 2023-08-26T09:26:14.750 INFO:teuthology.orchestra.run.smithi092.stdout: "mon": "allow profile osd", 2023-08-26T09:26:14.750 INFO:teuthology.orchestra.run.smithi092.stdout: "osd": "allow *" 2023-08-26T09:26:14.750 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-08-26T09:26:14.750 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-08-26T09:26:14.750 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-08-26T09:26:14.751 INFO:teuthology.orchestra.run.smithi092.stdout: "entity": "osd.4", 2023-08-26T09:26:14.751 INFO:teuthology.orchestra.run.smithi092.stdout: "key": "AQDYxOlk+UMtFhAAqyFsW/HEORMMyeuWONnRYg==", 2023-08-26T09:26:14.751 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": { 2023-08-26T09:26:14.751 INFO:teuthology.orchestra.run.smithi092.stdout: "mgr": "allow profile osd", 2023-08-26T09:26:14.751 INFO:teuthology.orchestra.run.smithi092.stdout: "mon": "allow profile osd", 2023-08-26T09:26:14.752 INFO:teuthology.orchestra.run.smithi092.stdout: "osd": "allow *" 2023-08-26T09:26:14.752 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-08-26T09:26:14.752 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-08-26T09:26:14.752 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-08-26T09:26:14.752 INFO:teuthology.orchestra.run.smithi092.stdout: "entity": "osd.5", 2023-08-26T09:26:14.753 INFO:teuthology.orchestra.run.smithi092.stdout: "key": "AQDbxOlkMcIUFhAAPD2/0LQyWcChiPvQyG1svQ==", 2023-08-26T09:26:14.753 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": { 2023-08-26T09:26:14.753 INFO:teuthology.orchestra.run.smithi092.stdout: "mgr": "allow profile osd", 2023-08-26T09:26:14.753 INFO:teuthology.orchestra.run.smithi092.stdout: "mon": "allow profile osd", 2023-08-26T09:26:14.753 INFO:teuthology.orchestra.run.smithi092.stdout: "osd": "allow *" 2023-08-26T09:26:14.754 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-08-26T09:26:14.754 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-08-26T09:26:14.754 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-08-26T09:26:14.754 INFO:teuthology.orchestra.run.smithi092.stdout: "entity": "osd.6", 2023-08-26T09:26:14.754 INFO:teuthology.orchestra.run.smithi092.stdout: "key": "AQDexOlki+11FRAAc4uqUkw9hWvTdJinsBD+IQ==", 2023-08-26T09:26:14.755 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": { 2023-08-26T09:26:14.755 INFO:teuthology.orchestra.run.smithi092.stdout: "mgr": "allow profile osd", 2023-08-26T09:26:14.755 INFO:teuthology.orchestra.run.smithi092.stdout: "mon": "allow profile osd", 2023-08-26T09:26:14.755 INFO:teuthology.orchestra.run.smithi092.stdout: "osd": "allow *" 2023-08-26T09:26:14.755 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-08-26T09:26:14.756 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-08-26T09:26:14.756 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-08-26T09:26:14.756 INFO:teuthology.orchestra.run.smithi092.stdout: "entity": "osd.7", 2023-08-26T09:26:14.756 INFO:teuthology.orchestra.run.smithi092.stdout: "key": "AQDhxOlkQmynFRAAytgvtLQ+RGGftMuzxpuhHA==", 2023-08-26T09:26:14.756 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": { 2023-08-26T09:26:14.756 INFO:teuthology.orchestra.run.smithi092.stdout: "mgr": "allow profile osd", 2023-08-26T09:26:14.757 INFO:teuthology.orchestra.run.smithi092.stdout: "mon": "allow profile osd", 2023-08-26T09:26:14.757 INFO:teuthology.orchestra.run.smithi092.stdout: "osd": "allow *" 2023-08-26T09:26:14.757 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-08-26T09:26:14.757 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-08-26T09:26:14.757 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-08-26T09:26:14.758 INFO:teuthology.orchestra.run.smithi092.stdout: "entity": "client.0", 2023-08-26T09:26:14.758 INFO:teuthology.orchestra.run.smithi092.stdout: "key": "AQDFxOlkZDgMLBAA162qALEz2DZ0yz7kRLRfqQ==", 2023-08-26T09:26:14.758 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": { 2023-08-26T09:26:14.758 INFO:teuthology.orchestra.run.smithi092.stdout: "mds": "allow", 2023-08-26T09:26:14.758 INFO:teuthology.orchestra.run.smithi092.stdout: "mgr": "allow r", 2023-08-26T09:26:14.759 INFO:teuthology.orchestra.run.smithi092.stdout: "mon": "allow rw", 2023-08-26T09:26:14.759 INFO:teuthology.orchestra.run.smithi092.stdout: "osd": "allow rwx" 2023-08-26T09:26:14.759 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-08-26T09:26:14.759 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-08-26T09:26:14.759 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-08-26T09:26:14.760 INFO:teuthology.orchestra.run.smithi092.stdout: "entity": "client.1", 2023-08-26T09:26:14.760 INFO:teuthology.orchestra.run.smithi092.stdout: "key": "AQDFxOlkt8gQNRAABU95s0YzWQj0wd3U3wkIAQ==", 2023-08-26T09:26:14.760 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": { 2023-08-26T09:26:14.760 INFO:teuthology.orchestra.run.smithi092.stdout: "mds": "allow", 2023-08-26T09:26:14.760 INFO:teuthology.orchestra.run.smithi092.stdout: "mgr": "allow r", 2023-08-26T09:26:14.761 INFO:teuthology.orchestra.run.smithi092.stdout: "mon": "allow rw", 2023-08-26T09:26:14.761 INFO:teuthology.orchestra.run.smithi092.stdout: "osd": "allow rwx" 2023-08-26T09:26:14.761 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-08-26T09:26:14.761 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-08-26T09:26:14.761 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-08-26T09:26:14.762 INFO:teuthology.orchestra.run.smithi092.stdout: "entity": "client.2", 2023-08-26T09:26:14.762 INFO:teuthology.orchestra.run.smithi092.stdout: "key": "AQDFxOlkLvy8MRAAy1vhw9ohhnRtkbVH9O/28w==", 2023-08-26T09:26:14.762 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": { 2023-08-26T09:26:14.762 INFO:teuthology.orchestra.run.smithi092.stdout: "mds": "allow", 2023-08-26T09:26:14.762 INFO:teuthology.orchestra.run.smithi092.stdout: "mgr": "allow r", 2023-08-26T09:26:14.762 INFO:teuthology.orchestra.run.smithi092.stdout: "mon": "allow rw", 2023-08-26T09:26:14.763 INFO:teuthology.orchestra.run.smithi092.stdout: "osd": "allow rwx" 2023-08-26T09:26:14.763 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-08-26T09:26:14.763 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-08-26T09:26:14.763 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-08-26T09:26:14.763 INFO:teuthology.orchestra.run.smithi092.stdout: "entity": "client.3", 2023-08-26T09:26:14.764 INFO:teuthology.orchestra.run.smithi092.stdout: "key": "AQDFxOlkO+7COhAAVtrhQc0esLhCiYOmoXaeKw==", 2023-08-26T09:26:14.764 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": { 2023-08-26T09:26:14.764 INFO:teuthology.orchestra.run.smithi092.stdout: "mds": "allow", 2023-08-26T09:26:14.764 INFO:teuthology.orchestra.run.smithi092.stdout: "mgr": "allow r", 2023-08-26T09:26:14.765 INFO:teuthology.orchestra.run.smithi092.stdout: "mon": "allow rw", 2023-08-26T09:26:14.765 INFO:teuthology.orchestra.run.smithi092.stdout: "osd": "allow rwx" 2023-08-26T09:26:14.765 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-08-26T09:26:14.765 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-08-26T09:26:14.765 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-08-26T09:26:14.766 INFO:teuthology.orchestra.run.smithi092.stdout: "entity": "client.admin", 2023-08-26T09:26:14.766 INFO:teuthology.orchestra.run.smithi092.stdout: "key": "AQDExOlk7O8eMRAAxQfnRB1TRuC+Si0mb263vg==", 2023-08-26T09:26:14.766 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": { 2023-08-26T09:26:14.766 INFO:teuthology.orchestra.run.smithi092.stdout: "mds": "allow *", 2023-08-26T09:26:14.766 INFO:teuthology.orchestra.run.smithi092.stdout: "mgr": "allow *", 2023-08-26T09:26:14.767 INFO:teuthology.orchestra.run.smithi092.stdout: "mon": "allow *", 2023-08-26T09:26:14.767 INFO:teuthology.orchestra.run.smithi092.stdout: "osd": "allow *" 2023-08-26T09:26:14.767 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-08-26T09:26:14.767 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-08-26T09:26:14.767 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-08-26T09:26:14.768 INFO:teuthology.orchestra.run.smithi092.stdout: "entity": "client.bootstrap-mds", 2023-08-26T09:26:14.768 INFO:teuthology.orchestra.run.smithi092.stdout: "key": "AQDnxOlknmAEFRAAypkhE7BfBzhqBUAOiL56PQ==", 2023-08-26T09:26:14.768 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": { 2023-08-26T09:26:14.768 INFO:teuthology.orchestra.run.smithi092.stdout: "mon": "allow profile bootstrap-mds" 2023-08-26T09:26:14.768 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-08-26T09:26:14.769 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-08-26T09:26:14.769 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-08-26T09:26:14.769 INFO:teuthology.orchestra.run.smithi092.stdout: "entity": "client.bootstrap-mgr", 2023-08-26T09:26:14.769 INFO:teuthology.orchestra.run.smithi092.stdout: "key": "AQDnxOlkvmkEFRAApDRTa1EQmDlA9I18V13+mg==", 2023-08-26T09:26:14.769 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": { 2023-08-26T09:26:14.770 INFO:teuthology.orchestra.run.smithi092.stdout: "mon": "allow profile bootstrap-mgr" 2023-08-26T09:26:14.770 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-08-26T09:26:14.770 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-08-26T09:26:14.770 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-08-26T09:26:14.770 INFO:teuthology.orchestra.run.smithi092.stdout: "entity": "client.bootstrap-osd", 2023-08-26T09:26:14.771 INFO:teuthology.orchestra.run.smithi092.stdout: "key": "AQDnxOlkKnIEFRAA29t9Zqfrmk7VUwnK+EWF8Q==", 2023-08-26T09:26:14.771 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": { 2023-08-26T09:26:14.771 INFO:teuthology.orchestra.run.smithi092.stdout: "mon": "allow profile bootstrap-osd" 2023-08-26T09:26:14.771 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-08-26T09:26:14.771 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-08-26T09:26:14.772 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-08-26T09:26:14.772 INFO:teuthology.orchestra.run.smithi092.stdout: "entity": "client.bootstrap-rbd", 2023-08-26T09:26:14.772 INFO:teuthology.orchestra.run.smithi092.stdout: "key": "AQDnxOlkf3kEFRAASRwOw/R3D5ZE8ESOANzrtA==", 2023-08-26T09:26:14.772 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": { 2023-08-26T09:26:14.772 INFO:teuthology.orchestra.run.smithi092.stdout: "mon": "allow profile bootstrap-rbd" 2023-08-26T09:26:14.773 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-08-26T09:26:14.773 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-08-26T09:26:14.773 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-08-26T09:26:14.773 INFO:teuthology.orchestra.run.smithi092.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-08-26T09:26:14.773 INFO:teuthology.orchestra.run.smithi092.stdout: "key": "AQDnxOlkG4EEFRAAlnXKk/FqpY2Savh6U3vZQA==", 2023-08-26T09:26:14.774 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": { 2023-08-26T09:26:14.774 INFO:teuthology.orchestra.run.smithi092.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-08-26T09:26:14.774 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-08-26T09:26:14.774 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-08-26T09:26:14.774 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-08-26T09:26:14.774 INFO:teuthology.orchestra.run.smithi092.stdout: "entity": "client.bootstrap-rgw", 2023-08-26T09:26:14.775 INFO:teuthology.orchestra.run.smithi092.stdout: "key": "AQDnxOlkx4gEFRAAw8t6RZZGp+uFhgnzx4D9Fw==", 2023-08-26T09:26:14.775 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": { 2023-08-26T09:26:14.775 INFO:teuthology.orchestra.run.smithi092.stdout: "mon": "allow profile bootstrap-rgw" 2023-08-26T09:26:14.775 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-08-26T09:26:14.776 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-08-26T09:26:14.776 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-08-26T09:26:14.776 INFO:teuthology.orchestra.run.smithi092.stdout: "entity": "mgr.x", 2023-08-26T09:26:14.776 INFO:teuthology.orchestra.run.smithi092.stdout: "key": "AQDFxOlkvYaZDxAATYBkNVAiFxi5AYwHi3YpdA==", 2023-08-26T09:26:14.776 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": { 2023-08-26T09:26:14.776 INFO:teuthology.orchestra.run.smithi092.stdout: "mds": "allow *", 2023-08-26T09:26:14.777 INFO:teuthology.orchestra.run.smithi092.stdout: "mon": "allow profile mgr", 2023-08-26T09:26:14.777 INFO:teuthology.orchestra.run.smithi092.stdout: "osd": "allow *" 2023-08-26T09:26:14.777 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-08-26T09:26:14.777 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-08-26T09:26:14.777 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-08-26T09:26:14.778 INFO:teuthology.orchestra.run.smithi092.stdout: "entity": "mgr.y", 2023-08-26T09:26:14.778 INFO:teuthology.orchestra.run.smithi092.stdout: "key": "AQDFxOlkxAAXCxAArEYT91+qQ/8wr0dS3MIr/g==", 2023-08-26T09:26:14.778 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": { 2023-08-26T09:26:14.778 INFO:teuthology.orchestra.run.smithi092.stdout: "mds": "allow *", 2023-08-26T09:26:14.778 INFO:teuthology.orchestra.run.smithi092.stdout: "mon": "allow profile mgr", 2023-08-26T09:26:14.778 INFO:teuthology.orchestra.run.smithi092.stdout: "osd": "allow *" 2023-08-26T09:26:14.779 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-08-26T09:26:14.779 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-08-26T09:26:14.779 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-08-26T09:26:14.779 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-08-26T09:26:14.781 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.733+0000 7efc8d9e0700 1 -- 172.21.15.92:0/4277044813 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7efc7406a0e0 msgr2=0x7efc7406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:14.781 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.733+0000 7efc8d9e0700 1 --2- 172.21.15.92:0/4277044813 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7efc7406a0e0 0x7efc7406c5a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7efc7c001380 tx=0x7efc7c009040 comp rx=0 tx=0).stop 2023-08-26T09:26:14.781 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.733+0000 7efc8d9e0700 1 -- 172.21.15.92:0/4277044813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc880b5060 msgr2=0x7efc88159780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:14.781 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.733+0000 7efc8d9e0700 1 --2- 172.21.15.92:0/4277044813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc880b5060 0x7efc88159780 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7efc880ce1f0 tx=0x7efc8000f3b0 comp rx=0 tx=0).stop 2023-08-26T09:26:14.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.733+0000 7efc8d9e0700 1 -- 172.21.15.92:0/4277044813 shutdown_connections 2023-08-26T09:26:14.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.733+0000 7efc8d9e0700 1 --2- 172.21.15.92:0/4277044813 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7efc7406a0e0 0x7efc7406c5a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:14.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.733+0000 7efc8d9e0700 1 --2- 172.21.15.92:0/4277044813 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc70004850 0x7efc881545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:14.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.733+0000 7efc8d9e0700 1 --2- 172.21.15.92:0/4277044813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc880b5060 0x7efc88159780 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:14.783 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.733+0000 7efc8d9e0700 1 --2- 172.21.15.92:0/4277044813 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc881e6260 0x7efc880b6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:14.783 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.733+0000 7efc8d9e0700 1 -- 172.21.15.92:0/4277044813 >> 172.21.15.92:0/4277044813 conn(0x7efc880d0f40 msgr2=0x7efc8806f550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:14.783 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.733+0000 7efc8d9e0700 1 -- 172.21.15.92:0/4277044813 shutdown_connections 2023-08-26T09:26:14.783 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.733+0000 7efc8d9e0700 1 -- 172.21.15.92:0/4277044813 wait complete. 2023-08-26T09:26:14.784 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-08-26T09:26:14.905 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.901+0000 7fb594e2a700 1 Processor -- start 2023-08-26T09:26:14.905 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.901+0000 7fb594e2a700 1 -- start start 2023-08-26T09:26:14.907 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.902+0000 7fb594e2a700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb59006d8a0 0x7fb5900cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:14.907 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.902+0000 7fb594e2a700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fb59006a320 0x7fb59006a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:14.908 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.902+0000 7fb594e2a700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb59006cf70 con 0x7fb590160b90 2023-08-26T09:26:14.908 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.902+0000 7fb594e2a700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb59006acf0 con 0x7fb59006a320 2023-08-26T09:26:14.908 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.902+0000 7fb594e2a700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb590160f70 con 0x7fb59006d8a0 2023-08-26T09:26:14.908 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.902+0000 7fb58e59c700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fb590160b90 0x7fb590161b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:58728/0 (socket says 172.21.15.92:58728) 2023-08-26T09:26:14.908 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.902+0000 7fb58e59c700 1 -- 172.21.15.92:0/125566447 learned_addr learned my addr 172.21.15.92:0/125566447 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:26:14.909 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.902+0000 7fb58ed9d700 1 --2- 172.21.15.92:0/125566447 >> v2:172.21.15.188:3300/0 conn(0x7fb59006a320 0x7fb59006a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:14.909 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.902+0000 7fb58dd9b700 1 --2- 172.21.15.92:0/125566447 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb59006d8a0 0x7fb5900cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:14.909 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.902+0000 7fb58d59a700 1 -- 172.21.15.92:0/125566447 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4011597895 0 0) 0x7fb59006cf70 con 0x7fb590160b90 2023-08-26T09:26:14.909 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.902+0000 7fb58d59a700 1 -- 172.21.15.92:0/125566447 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5780035b0 con 0x7fb590160b90 2023-08-26T09:26:14.910 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.903+0000 7fb58ed9d700 1 -- 172.21.15.92:0/125566447 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb59006d8a0 msgr2=0x7fb5900cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:14.910 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.903+0000 7fb58ed9d700 1 --2- 172.21.15.92:0/125566447 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb59006d8a0 0x7fb5900cf780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:14.910 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.903+0000 7fb58d59a700 1 -- 172.21.15.92:0/125566447 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2406530636 0 0) 0x7fb5780035b0 con 0x7fb590160b90 2023-08-26T09:26:14.910 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.903+0000 7fb58ed9d700 1 -- 172.21.15.92:0/125566447 >> v1:172.21.15.92:6789/0 conn(0x7fb590160b90 legacy=0x7fb590161b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:14.910 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.903+0000 7fb58ed9d700 1 -- 172.21.15.92:0/125566447 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb590161670 con 0x7fb59006a320 2023-08-26T09:26:14.910 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.903+0000 7fb58ed9d700 1 --2- 172.21.15.92:0/125566447 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb59006a320 0x7fb59006a7b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb588009dc0 tx=0x7fb58800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39acba440f40ec1 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:14.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.903+0000 7fb58d59a700 1 -- 172.21.15.92:0/125566447 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58800e070 con 0x7fb59006a320 2023-08-26T09:26:14.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.903+0000 7fb58d59a700 1 -- 172.21.15.92:0/125566447 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb588003a20 con 0x7fb59006a320 2023-08-26T09:26:14.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.903+0000 7fb58d59a700 1 -- 172.21.15.92:0/125566447 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb584001670 con 0x7fb59006a320 2023-08-26T09:26:14.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.903+0000 7fb594e2a700 1 -- 172.21.15.92:0/125566447 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb59006a320 msgr2=0x7fb59006a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:14.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.904+0000 7fb594e2a700 1 --2- 172.21.15.92:0/125566447 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb59006a320 0x7fb59006a7b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb588009dc0 tx=0x7fb58800b330 comp rx=0 tx=0).stop 2023-08-26T09:26:14.912 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.904+0000 7fb594e2a700 1 -- 172.21.15.92:0/125566447 shutdown_connections 2023-08-26T09:26:14.912 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.904+0000 7fb594e2a700 1 --2- 172.21.15.92:0/125566447 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb59006a320 0x7fb59006a7b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:14.912 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.904+0000 7fb594e2a700 1 --2- 172.21.15.92:0/125566447 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb59006d8a0 0x7fb5900cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:14.912 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.904+0000 7fb594e2a700 1 -- 172.21.15.92:0/125566447 >> 172.21.15.92:0/125566447 conn(0x7fb5900cc790 msgr2=0x7fb5900ccb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:14.912 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.904+0000 7fb594e2a700 1 -- 172.21.15.92:0/125566447 shutdown_connections 2023-08-26T09:26:14.913 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.904+0000 7fb594e2a700 1 -- 172.21.15.92:0/125566447 wait complete. 2023-08-26T09:26:14.915 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.905+0000 7fb594e2a700 1 Processor -- start 2023-08-26T09:26:14.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.905+0000 7fb594e2a700 1 -- start start 2023-08-26T09:26:14.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.906+0000 7fb594e2a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb59006a320 0x7fb5900af9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:14.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.906+0000 7fb594e2a700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb59006d8a0 0x7fb5900c6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:14.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.906+0000 7fb594e2a700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb590160b90 0x7fb5900c7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:14.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.906+0000 7fb594e2a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5901556d0 con 0x7fb59006a320 2023-08-26T09:26:14.917 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.906+0000 7fb594e2a700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5900c79c0 con 0x7fb590160b90 2023-08-26T09:26:14.917 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.906+0000 7fb594e2a700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5900c7ca0 con 0x7fb59006d8a0 2023-08-26T09:26:14.917 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.906+0000 7fb58e59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb59006a320 0x7fb5900af9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:14.917 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.906+0000 7fb58e59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb59006a320 0x7fb5900af9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46720/0 (socket says 172.21.15.92:46720) 2023-08-26T09:26:14.917 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.906+0000 7fb58e59c700 1 -- 172.21.15.92:0/3955391437 learned_addr learned my addr 172.21.15.92:0/3955391437 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:14.918 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.906+0000 7fb58ed9d700 1 --2- 172.21.15.92:0/3955391437 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb590160b90 0x7fb5900c7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:14.918 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.906+0000 7fb58dd9b700 1 --2- 172.21.15.92:0/3955391437 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb59006d8a0 0x7fb5900c6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:14.918 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.906+0000 7fb58e59c700 1 -- 172.21.15.92:0/3955391437 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb59006d8a0 msgr2=0x7fb5900c6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:14.918 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.906+0000 7fb58e59c700 1 --2- 172.21.15.92:0/3955391437 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb59006d8a0 0x7fb5900c6de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:14.918 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.906+0000 7fb58e59c700 1 -- 172.21.15.92:0/3955391437 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb590160b90 msgr2=0x7fb5900c7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:14.919 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.906+0000 7fb58e59c700 1 --2- 172.21.15.92:0/3955391437 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb590160b90 0x7fb5900c7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:14.919 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.906+0000 7fb58e59c700 1 -- 172.21.15.92:0/3955391437 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb588009a70 con 0x7fb59006a320 2023-08-26T09:26:14.919 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.906+0000 7fb58ed9d700 1 --2- 172.21.15.92:0/3955391437 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb590160b90 0x7fb5900c7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:26:14.919 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.906+0000 7fb58e59c700 1 --2- 172.21.15.92:0/3955391437 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb59006a320 0x7fb5900af9c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fb58400c750 tx=0x7fb58400cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:14.919 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.906+0000 7fb57effd700 1 -- 172.21.15.92:0/3955391437 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb584004c80 con 0x7fb59006a320 2023-08-26T09:26:14.920 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.906+0000 7fb57effd700 1 -- 172.21.15.92:0/3955391437 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb584004e00 con 0x7fb59006a320 2023-08-26T09:26:14.920 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.906+0000 7fb594e2a700 1 -- 172.21.15.92:0/3955391437 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5900c7f80 con 0x7fb59006a320 2023-08-26T09:26:14.920 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.906+0000 7fb57effd700 1 -- 172.21.15.92:0/3955391437 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb584007310 con 0x7fb59006a320 2023-08-26T09:26:14.920 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.907+0000 7fb594e2a700 1 -- 172.21.15.92:0/3955391437 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5900c8540 con 0x7fb59006a320 2023-08-26T09:26:14.920 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.907+0000 7fb594e2a700 1 -- 172.21.15.92:0/3955391437 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5900c8760 con 0x7fb59006a320 2023-08-26T09:26:14.921 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.908+0000 7fb57effd700 1 -- 172.21.15.92:0/3955391437 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb584007470 con 0x7fb59006a320 2023-08-26T09:26:14.921 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.908+0000 7fb57effd700 1 --2- 172.21.15.92:0/3955391437 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb57006a0e0 0x7fb57006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:14.921 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.908+0000 7fb57effd700 1 -- 172.21.15.92:0/3955391437 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb584087760 con 0x7fb59006a320 2023-08-26T09:26:14.921 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.908+0000 7fb58dd9b700 1 --2- 172.21.15.92:0/3955391437 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb57006a0e0 0x7fb57006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:14.922 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.909+0000 7fb58dd9b700 1 --2- 172.21.15.92:0/3955391437 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb57006a0e0 0x7fb57006c5a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb5900b59f0 tx=0x7fb580008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:14.922 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:14.913+0000 7fb57effd700 1 -- 172.21.15.92:0/3955391437 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb5840531a0 con 0x7fb59006a320 2023-08-26T09:26:15.185 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.181+0000 7fb594e2a700 1 -- 172.21.15.92:0/3955391437 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fb59004e660 con 0x7fb59006a320 2023-08-26T09:26:15.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.186+0000 7fb57effd700 1 -- 172.21.15.92:0/3955391437 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb5840567c0 con 0x7fb59006a320 2023-08-26T09:26:15.192 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.189+0000 7fb594e2a700 1 -- 172.21.15.92:0/3955391437 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb57006a0e0 msgr2=0x7fb57006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:15.193 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.189+0000 7fb594e2a700 1 --2- 172.21.15.92:0/3955391437 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb57006a0e0 0x7fb57006c5a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb5900b59f0 tx=0x7fb580008040 comp rx=0 tx=0).stop 2023-08-26T09:26:15.193 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.189+0000 7fb594e2a700 1 -- 172.21.15.92:0/3955391437 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb59006a320 msgr2=0x7fb5900af9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:15.193 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.189+0000 7fb594e2a700 1 --2- 172.21.15.92:0/3955391437 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb59006a320 0x7fb5900af9c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fb58400c750 tx=0x7fb58400cb10 comp rx=0 tx=0).stop 2023-08-26T09:26:15.193 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.189+0000 7fb594e2a700 1 -- 172.21.15.92:0/3955391437 shutdown_connections 2023-08-26T09:26:15.193 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.189+0000 7fb594e2a700 1 --2- 172.21.15.92:0/3955391437 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb57006a0e0 0x7fb57006c5a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:15.194 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.189+0000 7fb594e2a700 1 --2- 172.21.15.92:0/3955391437 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb590160b90 0x7fb5900c7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:15.194 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.189+0000 7fb594e2a700 1 --2- 172.21.15.92:0/3955391437 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb59006a320 0x7fb5900af9c0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:15.194 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.189+0000 7fb594e2a700 1 --2- 172.21.15.92:0/3955391437 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb59006d8a0 0x7fb5900c6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:15.194 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.189+0000 7fb594e2a700 1 -- 172.21.15.92:0/3955391437 >> 172.21.15.92:0/3955391437 conn(0x7fb5900cc790 msgr2=0x7fb5900ae2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:15.194 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.189+0000 7fb594e2a700 1 -- 172.21.15.92:0/3955391437 shutdown_connections 2023-08-26T09:26:15.195 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.189+0000 7fb594e2a700 1 -- 172.21.15.92:0/3955391437 wait complete. 2023-08-26T09:26:15.204 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-08-26T09:26:15.329 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.325+0000 7fabca517700 1 Processor -- start 2023-08-26T09:26:15.329 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.325+0000 7fabca517700 1 -- start start 2023-08-26T09:26:15.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.326+0000 7fabca517700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fabc415d170 0x7fabc406be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:15.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.326+0000 7fabca517700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fabc406b640 0x7fabc406c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:15.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.326+0000 7fabca517700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabc40d0110 con 0x7fabc40d1770 2023-08-26T09:26:15.332 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.326+0000 7fabca517700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabc40d05a0 con 0x7fabc415d170 2023-08-26T09:26:15.332 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.326+0000 7fabca517700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabc40ce360 con 0x7fabc406b640 2023-08-26T09:26:15.332 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.326+0000 7fabc3fff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fabc415d170 0x7fabc406be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:15.332 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.326+0000 7fabc3fff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fabc415d170 0x7fabc406be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46730/0 (socket says 172.21.15.92:46730) 2023-08-26T09:26:15.332 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.326+0000 7fabc3fff700 1 -- 172.21.15.92:0/1051364236 learned_addr learned my addr 172.21.15.92:0/1051364236 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:15.333 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.326+0000 7fabc3fff700 1 -- 172.21.15.92:0/1051364236 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fabc406b640 msgr2=0x7fabc406c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:15.333 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.326+0000 7fabc3fff700 1 --2- 172.21.15.92:0/1051364236 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fabc406b640 0x7fabc406c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:15.333 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.326+0000 7fabc3fff700 1 -- 172.21.15.92:0/1051364236 >> v1:172.21.15.188:6789/0 conn(0x7fabc40d1770 legacy=0x7fabc40b1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:15.333 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.326+0000 7fabc3fff700 1 -- 172.21.15.92:0/1051364236 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc40cf500 con 0x7fabc415d170 2023-08-26T09:26:15.333 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.326+0000 7fabc3fff700 1 --2- 172.21.15.92:0/1051364236 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabc415d170 0x7fabc406be40 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fabb4006fd0 tx=0x7fabb4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=797e28fdad73984a server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:15.334 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.326+0000 7fabc2ffd700 1 -- 172.21.15.92:0/1051364236 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb4005e30 con 0x7fabc415d170 2023-08-26T09:26:15.334 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.326+0000 7fabc2ffd700 1 -- 172.21.15.92:0/1051364236 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb4006030 con 0x7fabc415d170 2023-08-26T09:26:15.334 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.326+0000 7fabc2ffd700 1 -- 172.21.15.92:0/1051364236 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb40063c0 con 0x7fabc415d170 2023-08-26T09:26:15.334 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.327+0000 7fabca517700 1 -- 172.21.15.92:0/1051364236 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabc415d170 msgr2=0x7fabc406be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:15.334 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.327+0000 7fabca517700 1 --2- 172.21.15.92:0/1051364236 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabc415d170 0x7fabc406be40 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fabb4006fd0 tx=0x7fabb4009bd0 comp rx=0 tx=0).stop 2023-08-26T09:26:15.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.327+0000 7fabca517700 1 -- 172.21.15.92:0/1051364236 shutdown_connections 2023-08-26T09:26:15.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.327+0000 7fabca517700 1 --2- 172.21.15.92:0/1051364236 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabc415d170 0x7fabc406be40 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:15.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.327+0000 7fabca517700 1 --2- 172.21.15.92:0/1051364236 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fabc406b640 0x7fabc406c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:15.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.327+0000 7fabca517700 1 -- 172.21.15.92:0/1051364236 >> 172.21.15.92:0/1051364236 conn(0x7fabc409a1b0 msgr2=0x7fabc40d0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:15.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.327+0000 7fabca517700 1 -- 172.21.15.92:0/1051364236 shutdown_connections 2023-08-26T09:26:15.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.327+0000 7fabca517700 1 -- 172.21.15.92:0/1051364236 wait complete. 2023-08-26T09:26:15.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.328+0000 7fabca517700 1 Processor -- start 2023-08-26T09:26:15.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.328+0000 7fabca517700 1 -- start start 2023-08-26T09:26:15.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.329+0000 7fabca517700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabc406b640 0x7fabc4151700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:15.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.329+0000 7fabca517700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fabc40d1770 0x7fabc40b2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:15.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.329+0000 7fabca517700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fabc415d170 0x7fabc40b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:15.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.329+0000 7fabca517700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc4151c40 con 0x7fabc406b640 2023-08-26T09:26:15.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.329+0000 7fabca517700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc4152360 con 0x7fabc40d1770 2023-08-26T09:26:15.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.329+0000 7fabca517700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabc4156200 con 0x7fabc415d170 2023-08-26T09:26:15.340 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.329+0000 7fabc3fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabc406b640 0x7fabc4151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:15.340 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.329+0000 7fabc3fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabc406b640 0x7fabc4151700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46736/0 (socket says 172.21.15.92:46736) 2023-08-26T09:26:15.340 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.329+0000 7fabc3fff700 1 -- 172.21.15.92:0/4242260346 learned_addr learned my addr 172.21.15.92:0/4242260346 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:15.340 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.329+0000 7fabc8ab4700 1 --2- 172.21.15.92:0/4242260346 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fabc415d170 0x7fabc40b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:15.340 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.329+0000 7fabc37fe700 1 --2- 172.21.15.92:0/4242260346 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fabc40d1770 0x7fabc40b2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:15.341 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.330+0000 7fabc3fff700 1 -- 172.21.15.92:0/4242260346 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fabc415d170 msgr2=0x7fabc40b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:15.341 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.330+0000 7fabc3fff700 1 --2- 172.21.15.92:0/4242260346 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fabc415d170 0x7fabc40b31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:15.341 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.330+0000 7fabc3fff700 1 -- 172.21.15.92:0/4242260346 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fabc40d1770 msgr2=0x7fabc40b2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:15.341 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.330+0000 7fabc3fff700 1 --2- 172.21.15.92:0/4242260346 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fabc40d1770 0x7fabc40b2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:15.341 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.330+0000 7fabc3fff700 1 -- 172.21.15.92:0/4242260346 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb4009500 con 0x7fabc406b640 2023-08-26T09:26:15.342 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.330+0000 7fabc3fff700 1 --2- 172.21.15.92:0/4242260346 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabc406b640 0x7fabc4151700 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fabb4009c10 tx=0x7fabb4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:15.342 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.330+0000 7fabc0ff9700 1 -- 172.21.15.92:0/4242260346 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb4006870 con 0x7fabc406b640 2023-08-26T09:26:15.342 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.330+0000 7fabc0ff9700 1 -- 172.21.15.92:0/4242260346 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb4020070 con 0x7fabc406b640 2023-08-26T09:26:15.342 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.330+0000 7fabca517700 1 -- 172.21.15.92:0/4242260346 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabc41564e0 con 0x7fabc406b640 2023-08-26T09:26:15.342 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.330+0000 7fabc0ff9700 1 -- 172.21.15.92:0/4242260346 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb4025670 con 0x7fabc406b640 2023-08-26T09:26:15.343 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.330+0000 7fabca517700 1 -- 172.21.15.92:0/4242260346 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabc4151ff0 con 0x7fabc406b640 2023-08-26T09:26:15.343 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.331+0000 7fabca517700 1 -- 172.21.15.92:0/4242260346 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabc40cd2b0 con 0x7fabc406b640 2023-08-26T09:26:15.343 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.331+0000 7fabc0ff9700 1 -- 172.21.15.92:0/4242260346 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fabb4022030 con 0x7fabc406b640 2023-08-26T09:26:15.343 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.332+0000 7fabc0ff9700 1 --2- 172.21.15.92:0/4242260346 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fabb006a0e0 0x7fabb006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:15.343 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.332+0000 7fabc0ff9700 1 -- 172.21.15.92:0/4242260346 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fabb40897d0 con 0x7fabc406b640 2023-08-26T09:26:15.344 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.332+0000 7fabc37fe700 1 --2- 172.21.15.92:0/4242260346 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fabb006a0e0 0x7fabb006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:15.344 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.332+0000 7fabc37fe700 1 --2- 172.21.15.92:0/4242260346 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fabb006a0e0 0x7fabb006c5a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fabc409eba0 tx=0x7fabb8009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:15.344 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.336+0000 7fabc0ff9700 1 -- 172.21.15.92:0/4242260346 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fabb40552a0 con 0x7fabc406b640 2023-08-26T09:26:15.606 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.602+0000 7fabca517700 1 -- 172.21.15.92:0/4242260346 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fabc40c7d80 con 0x7fabc406b640 2023-08-26T09:26:15.609 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.606+0000 7fabc0ff9700 1 -- 172.21.15.92:0/4242260346 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fabb40588c0 con 0x7fabc406b640 2023-08-26T09:26:15.612 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.608+0000 7fabca517700 1 -- 172.21.15.92:0/4242260346 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fabb006a0e0 msgr2=0x7fabb006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:15.612 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.608+0000 7fabca517700 1 --2- 172.21.15.92:0/4242260346 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fabb006a0e0 0x7fabb006c5a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fabc409eba0 tx=0x7fabb8009190 comp rx=0 tx=0).stop 2023-08-26T09:26:15.613 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.608+0000 7fabca517700 1 -- 172.21.15.92:0/4242260346 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabc406b640 msgr2=0x7fabc4151700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:15.613 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.608+0000 7fabca517700 1 --2- 172.21.15.92:0/4242260346 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabc406b640 0x7fabc4151700 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fabb4009c10 tx=0x7fabb4004750 comp rx=0 tx=0).stop 2023-08-26T09:26:15.613 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.608+0000 7fabca517700 1 -- 172.21.15.92:0/4242260346 shutdown_connections 2023-08-26T09:26:15.613 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.608+0000 7fabca517700 1 --2- 172.21.15.92:0/4242260346 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fabc415d170 0x7fabc40b31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:15.613 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.608+0000 7fabca517700 1 --2- 172.21.15.92:0/4242260346 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabc406b640 0x7fabc4151700 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:15.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.608+0000 7fabca517700 1 --2- 172.21.15.92:0/4242260346 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fabb006a0e0 0x7fabb006c5a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:15.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.608+0000 7fabca517700 1 --2- 172.21.15.92:0/4242260346 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fabc40d1770 0x7fabc40b2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:15.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.608+0000 7fabca517700 1 -- 172.21.15.92:0/4242260346 >> 172.21.15.92:0/4242260346 conn(0x7fabc409a1b0 msgr2=0x7fabc406f510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:15.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.608+0000 7fabca517700 1 -- 172.21.15.92:0/4242260346 shutdown_connections 2023-08-26T09:26:15.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.608+0000 7fabca517700 1 -- 172.21.15.92:0/4242260346 wait complete. 2023-08-26T09:26:15.624 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-08-26T09:26:15.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.741+0000 7effce1b0700 1 Processor -- start 2023-08-26T09:26:15.746 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.742+0000 7effce1b0700 1 -- start start 2023-08-26T09:26:15.749 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.742+0000 7effce1b0700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7effc8160b90 0x7effc80cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:15.749 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.742+0000 7effce1b0700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7effc806a320 0x7effc806a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:15.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.742+0000 7effce1b0700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effc806cf70 con 0x7effc806d8a0 2023-08-26T09:26:15.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.742+0000 7effce1b0700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effc806ad10 con 0x7effc8160b90 2023-08-26T09:26:15.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.742+0000 7effce1b0700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc8160f70 con 0x7effc806a320 2023-08-26T09:26:15.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.742+0000 7effc6ffd700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7effc806d8a0 0x7effc8161b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:58758/0 (socket says 172.21.15.92:58758) 2023-08-26T09:26:15.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.743+0000 7effc6ffd700 1 -- 172.21.15.92:0/2084616899 learned_addr learned my addr 172.21.15.92:0/2084616899 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:26:15.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.743+0000 7effc77fe700 1 --2- 172.21.15.92:0/2084616899 >> v2:172.21.15.188:3300/0 conn(0x7effc8160b90 0x7effc80cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:15.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.743+0000 7effc7fff700 1 --2- 172.21.15.92:0/2084616899 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7effc806a320 0x7effc806a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:15.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.743+0000 7effc67fc700 1 -- 172.21.15.92:0/2084616899 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1339172317 0 0) 0x7effc806cf70 con 0x7effc806d8a0 2023-08-26T09:26:15.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.743+0000 7effc67fc700 1 -- 172.21.15.92:0/2084616899 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effb40035b0 con 0x7effc806d8a0 2023-08-26T09:26:15.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.743+0000 7effc67fc700 1 -- 172.21.15.92:0/2084616899 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3684942230 0 0) 0x7effb40035b0 con 0x7effc806d8a0 2023-08-26T09:26:15.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.743+0000 7effc67fc700 1 -- 172.21.15.92:0/2084616899 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7effc806a320 msgr2=0x7effc806a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:15.753 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.743+0000 7effc67fc700 1 --2- 172.21.15.92:0/2084616899 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7effc806a320 0x7effc806a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:15.753 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.743+0000 7effc67fc700 1 -- 172.21.15.92:0/2084616899 >> v2:172.21.15.188:3300/0 conn(0x7effc8160b90 msgr2=0x7effc80cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:15.753 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.743+0000 7effc67fc700 1 --2- 172.21.15.92:0/2084616899 >> v2:172.21.15.188:3300/0 conn(0x7effc8160b90 0x7effc80cf780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:15.753 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.743+0000 7effc67fc700 1 -- 172.21.15.92:0/2084616899 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc8161670 con 0x7effc806d8a0 2023-08-26T09:26:15.753 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.743+0000 7effc67fc700 1 -- 172.21.15.92:0/2084616899 <== mon.0 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1019361464 0 0) 0x7effb8001670 con 0x7effc806d8a0 2023-08-26T09:26:15.754 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.743+0000 7effc67fc700 1 -- 172.21.15.92:0/2084616899 >> v1:172.21.15.92:6789/0 conn(0x7effc806d8a0 legacy=0x7effc8161b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:15.755 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.743+0000 7effc67fc700 1 --2- 172.21.15.92:0/2084616899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effb4003a30 0x7effb4003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:15.755 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.743+0000 7effc67fc700 1 --2- 172.21.15.92:0/2084616899 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7effc806a320 0x7effb4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:15.755 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.743+0000 7effc67fc700 1 --2- 172.21.15.92:0/2084616899 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7effb4004d90 0x7effb4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:15.755 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.743+0000 7effc67fc700 1 -- 172.21.15.92:0/2084616899 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc806ad10 con 0x7effb4003a30 2023-08-26T09:26:15.755 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.743+0000 7effc67fc700 1 -- 172.21.15.92:0/2084616899 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc8160f70 con 0x7effb4004d90 2023-08-26T09:26:15.756 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.743+0000 7effc67fc700 1 -- 172.21.15.92:0/2084616899 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb400ba10 con 0x7effc806a320 2023-08-26T09:26:15.756 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.743+0000 7effc77fe700 1 --2- 172.21.15.92:0/2084616899 >> v2:172.21.15.188:3300/0 conn(0x7effc8160b90 0x7effc80cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-26T09:26:15.756 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.743+0000 7effc6ffd700 1 --2- 172.21.15.92:0/2084616899 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7effc806a320 0x7effb4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:15.756 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.743+0000 7effc77fe700 1 --2- 172.21.15.92:0/2084616899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effb4003a30 0x7effb4003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:15.756 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.743+0000 7effc7fff700 1 --2- 172.21.15.92:0/2084616899 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7effb4004d90 0x7effb4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:15.757 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.744+0000 7effc77fe700 1 -- 172.21.15.92:0/2084616899 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7effc806a320 msgr2=0x7effb4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:15.757 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.744+0000 7effc77fe700 1 --2- 172.21.15.92:0/2084616899 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7effc806a320 0x7effb4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:15.757 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.744+0000 7effc77fe700 1 -- 172.21.15.92:0/2084616899 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7effb4004d90 msgr2=0x7effb4005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:15.757 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.744+0000 7effc77fe700 1 --2- 172.21.15.92:0/2084616899 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7effb4004d90 0x7effb4005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:15.758 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.744+0000 7effc77fe700 1 -- 172.21.15.92:0/2084616899 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb40035b0 con 0x7effb4003a30 2023-08-26T09:26:15.758 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.744+0000 7effc77fe700 1 --2- 172.21.15.92:0/2084616899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effb4003a30 0x7effb4003e50 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7effb0009d10 tx=0x7effb4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd2e4b1b7fd42b67 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:15.758 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.744+0000 7effc67fc700 1 -- 172.21.15.92:0/2084616899 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb0009e60 con 0x7effb4003a30 2023-08-26T09:26:15.758 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.744+0000 7effc67fc700 1 -- 172.21.15.92:0/2084616899 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb0004030 con 0x7effb4003a30 2023-08-26T09:26:15.758 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.744+0000 7effc67fc700 1 -- 172.21.15.92:0/2084616899 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb00043a0 con 0x7effb4003a30 2023-08-26T09:26:15.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.744+0000 7effce1b0700 1 -- 172.21.15.92:0/2084616899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effb4003a30 msgr2=0x7effb4003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:15.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.744+0000 7effce1b0700 1 --2- 172.21.15.92:0/2084616899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effb4003a30 0x7effb4003e50 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7effb0009d10 tx=0x7effb4005880 comp rx=0 tx=0).stop 2023-08-26T09:26:15.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.744+0000 7effc7fff700 1 -- 172.21.15.92:0/2084616899 reap_dead start 2023-08-26T09:26:15.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.744+0000 7effce1b0700 1 -- 172.21.15.92:0/2084616899 shutdown_connections 2023-08-26T09:26:15.760 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.744+0000 7effce1b0700 1 -- 172.21.15.92:0/2084616899 >> 172.21.15.92:0/2084616899 conn(0x7effc80cc790 msgr2=0x7effc80ccb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:15.760 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.744+0000 7effce1b0700 1 -- 172.21.15.92:0/2084616899 shutdown_connections 2023-08-26T09:26:15.760 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.744+0000 7effce1b0700 1 -- 172.21.15.92:0/2084616899 wait complete. 2023-08-26T09:26:15.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.746+0000 7effce1b0700 1 Processor -- start 2023-08-26T09:26:15.764 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.746+0000 7effce1b0700 1 -- start start 2023-08-26T09:26:15.764 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.747+0000 7effce1b0700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7effb4003a30 0x7effc80b1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:15.764 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.747+0000 7effce1b0700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7effc80c5fc0 0x7effc81f2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:15.764 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.747+0000 7effce1b0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effc80c6440 0x7effc81f3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:15.764 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.747+0000 7effce1b0700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc80c4250 con 0x7effc80c6440 2023-08-26T09:26:15.765 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.747+0000 7effce1b0700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc80c44a0 con 0x7effb4003a30 2023-08-26T09:26:15.765 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.747+0000 7effce1b0700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc80c4780 con 0x7effc80c5fc0 2023-08-26T09:26:15.765 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.747+0000 7effc7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effc80c6440 0x7effc81f3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:15.765 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.747+0000 7effc7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effc80c6440 0x7effc81f3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46758/0 (socket says 172.21.15.92:46758) 2023-08-26T09:26:15.765 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.747+0000 7effc7fff700 1 -- 172.21.15.92:0/762979634 learned_addr learned my addr 172.21.15.92:0/762979634 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:15.766 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.747+0000 7effc77fe700 1 --2- 172.21.15.92:0/762979634 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7effb4003a30 0x7effc80b1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:15.766 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.747+0000 7effc6ffd700 1 --2- 172.21.15.92:0/762979634 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7effc80c5fc0 0x7effc81f2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:15.766 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.747+0000 7effc7fff700 1 -- 172.21.15.92:0/762979634 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7effc80c5fc0 msgr2=0x7effc81f2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:15.766 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.747+0000 7effc7fff700 1 --2- 172.21.15.92:0/762979634 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7effc80c5fc0 0x7effc81f2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:15.766 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.747+0000 7effc7fff700 1 -- 172.21.15.92:0/762979634 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7effb4003a30 msgr2=0x7effc80b1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:15.767 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.747+0000 7effc7fff700 1 --2- 172.21.15.92:0/762979634 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7effb4003a30 0x7effc80b1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:15.767 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.747+0000 7effc7fff700 1 -- 172.21.15.92:0/762979634 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc80c4a60 con 0x7effc80c6440 2023-08-26T09:26:15.767 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.747+0000 7effc6ffd700 1 --2- 172.21.15.92:0/762979634 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7effc80c5fc0 0x7effc81f2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:26:15.767 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.747+0000 7effc7fff700 1 --2- 172.21.15.92:0/762979634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effc80c6440 0x7effc81f3100 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7effc8068520 tx=0x7effc0011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:15.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.747+0000 7effbffff700 1 -- 172.21.15.92:0/762979634 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc000e040 con 0x7effc80c6440 2023-08-26T09:26:15.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.747+0000 7effbffff700 1 -- 172.21.15.92:0/762979634 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc000f040 con 0x7effc80c6440 2023-08-26T09:26:15.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.747+0000 7effce1b0700 1 -- 172.21.15.92:0/762979634 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effc80c4d40 con 0x7effc80c6440 2023-08-26T09:26:15.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.747+0000 7effbffff700 1 -- 172.21.15.92:0/762979634 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc000f8f0 con 0x7effc80c6440 2023-08-26T09:26:15.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.747+0000 7effce1b0700 1 -- 172.21.15.92:0/762979634 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effc81f3980 con 0x7effc80c6440 2023-08-26T09:26:15.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.748+0000 7effce1b0700 1 -- 172.21.15.92:0/762979634 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effc804e660 con 0x7effc80c6440 2023-08-26T09:26:15.769 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.749+0000 7effbffff700 1 -- 172.21.15.92:0/762979634 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7effc000fa50 con 0x7effc80c6440 2023-08-26T09:26:15.769 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.749+0000 7effbffff700 1 --2- 172.21.15.92:0/762979634 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7effa806a0e0 0x7effa806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:15.769 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.749+0000 7effbffff700 1 -- 172.21.15.92:0/762979634 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5210+0+0 (secure 0 0 0) 0x7effc0088750 con 0x7effc80c6440 2023-08-26T09:26:15.769 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.749+0000 7effc77fe700 1 --2- 172.21.15.92:0/762979634 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7effa806a0e0 0x7effa806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:15.769 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.749+0000 7effc77fe700 1 --2- 172.21.15.92:0/762979634 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7effa806a0e0 0x7effa806c5a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7effb00090b0 tx=0x7effb001d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:15.770 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:15.753+0000 7effbffff700 1 -- 172.21.15.92:0/762979634 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7effc0054190 con 0x7effc80c6440 2023-08-26T09:26:16.025 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.021+0000 7effce1b0700 1 -- 172.21.15.92:0/762979634 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7effc80c5260 con 0x7effc80c6440 2023-08-26T09:26:16.028 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.025+0000 7effbffff700 1 -- 172.21.15.92:0/762979634 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7effc0007330 con 0x7effc80c6440 2023-08-26T09:26:16.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.027+0000 7effce1b0700 1 -- 172.21.15.92:0/762979634 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7effa806a0e0 msgr2=0x7effa806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:16.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.027+0000 7effce1b0700 1 --2- 172.21.15.92:0/762979634 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7effa806a0e0 0x7effa806c5a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7effb00090b0 tx=0x7effb001d040 comp rx=0 tx=0).stop 2023-08-26T09:26:16.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.027+0000 7effce1b0700 1 -- 172.21.15.92:0/762979634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effc80c6440 msgr2=0x7effc81f3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:16.032 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.027+0000 7effce1b0700 1 --2- 172.21.15.92:0/762979634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effc80c6440 0x7effc81f3100 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7effc8068520 tx=0x7effc0011ed0 comp rx=0 tx=0).stop 2023-08-26T09:26:16.032 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.027+0000 7effce1b0700 1 -- 172.21.15.92:0/762979634 shutdown_connections 2023-08-26T09:26:16.032 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.027+0000 7effce1b0700 1 --2- 172.21.15.92:0/762979634 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7effa806a0e0 0x7effa806c5a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:16.032 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.027+0000 7effce1b0700 1 --2- 172.21.15.92:0/762979634 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7effb4003a30 0x7effc80b1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:16.032 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.027+0000 7effce1b0700 1 --2- 172.21.15.92:0/762979634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effc80c6440 0x7effc81f3100 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:16.033 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.027+0000 7effce1b0700 1 --2- 172.21.15.92:0/762979634 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7effc80c5fc0 0x7effc81f2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:16.033 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.027+0000 7effce1b0700 1 -- 172.21.15.92:0/762979634 >> 172.21.15.92:0/762979634 conn(0x7effc80cc790 msgr2=0x7effc80cba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:16.033 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.027+0000 7effce1b0700 1 -- 172.21.15.92:0/762979634 shutdown_connections 2023-08-26T09:26:16.034 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.027+0000 7effce1b0700 1 -- 172.21.15.92:0/762979634 wait complete. 2023-08-26T09:26:16.043 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-08-26T09:26:16.164 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.160+0000 7f4798788700 1 Processor -- start 2023-08-26T09:26:16.164 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.160+0000 7f4798788700 1 -- start start 2023-08-26T09:26:16.170 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.161+0000 7f4798788700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f47900b3480 0x7f47900d0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:16.170 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.161+0000 7f4798788700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f479015f9b0 con 0x7f47900d05c0 2023-08-26T09:26:16.171 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.161+0000 7f4798788700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f479015edc0 con 0x7f4790152100 2023-08-26T09:26:16.171 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.161+0000 7f4798788700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47900d0a30 con 0x7f47900b3480 2023-08-26T09:26:16.171 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.161+0000 7f4796d25700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f47900d05c0 0x7f47900b5cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:58780/0 (socket says 172.21.15.92:58780) 2023-08-26T09:26:16.171 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.161+0000 7f4796d25700 1 -- 172.21.15.92:0/4016284242 learned_addr learned my addr 172.21.15.92:0/4016284242 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:26:16.172 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.161+0000 7f4795522700 1 -- 172.21.15.92:0/4016284242 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 809704817 0 0) 0x7f479015f9b0 con 0x7f47900d05c0 2023-08-26T09:26:16.172 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.162+0000 7f4795522700 1 -- 172.21.15.92:0/4016284242 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f477c0035b0 con 0x7f47900d05c0 2023-08-26T09:26:16.172 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.162+0000 7f4795d23700 1 --2- 172.21.15.92:0/4016284242 >> v2:172.21.15.188:3300/0 conn(0x7f47900b3480 0x7f47900d0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:16.172 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.162+0000 7f4795522700 1 -- 172.21.15.92:0/4016284242 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3273759979 0 0) 0x7f477c0035b0 con 0x7f47900d05c0 2023-08-26T09:26:16.172 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.162+0000 7f4795522700 1 -- 172.21.15.92:0/4016284242 >> v2:172.21.15.188:3300/0 conn(0x7f47900b3480 msgr2=0x7f47900d0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:16.172 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.162+0000 7f4795522700 1 --2- 172.21.15.92:0/4016284242 >> v2:172.21.15.188:3300/0 conn(0x7f47900b3480 0x7f47900d0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:16.173 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.162+0000 7f4795522700 1 -- 172.21.15.92:0/4016284242 >> v1:172.21.15.188:6789/0 conn(0x7f4790152100 legacy=0x7f47900cb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:16.173 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.162+0000 7f4795522700 1 -- 172.21.15.92:0/4016284242 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479015f080 con 0x7f47900d05c0 2023-08-26T09:26:16.173 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.162+0000 7f4795522700 1 -- 172.21.15.92:0/4016284242 <== mon.0 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1019361464 0 0) 0x7f47880019f0 con 0x7f47900d05c0 2023-08-26T09:26:16.173 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.162+0000 7f4795522700 1 -- 172.21.15.92:0/4016284242 >> v1:172.21.15.92:6789/0 conn(0x7f47900d05c0 legacy=0x7f47900b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:16.173 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.162+0000 7f4795522700 1 --2- 172.21.15.92:0/4016284242 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f477c003a00 0x7f477c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:16.174 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.162+0000 7f4795522700 1 --2- 172.21.15.92:0/4016284242 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f477c004850 0x7f477c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:16.174 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.162+0000 7f4795522700 1 --2- 172.21.15.92:0/4016284242 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f477c005210 0x7f477c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:16.174 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.162+0000 7f4795522700 1 -- 172.21.15.92:0/4016284242 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47900d0a30 con 0x7f477c004850 2023-08-26T09:26:16.174 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.162+0000 7f4795522700 1 -- 172.21.15.92:0/4016284242 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477c00c0b0 con 0x7f477c005210 2023-08-26T09:26:16.174 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.162+0000 7f4795522700 1 -- 172.21.15.92:0/4016284242 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f477c00c270 con 0x7f477c003a00 2023-08-26T09:26:16.175 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.162+0000 7f4795d23700 1 --2- 172.21.15.92:0/4016284242 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f477c004850 0x7f477c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:16.175 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.162+0000 7f4796d25700 1 --2- 172.21.15.92:0/4016284242 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f477c005210 0x7f477c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:16.175 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.162+0000 7f4796524700 1 --2- 172.21.15.92:0/4016284242 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f477c003a00 0x7f477c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:16.175 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.162+0000 7f4795d23700 1 -- 172.21.15.92:0/4016284242 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f477c003a00 msgr2=0x7f477c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:16.175 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.162+0000 7f4795d23700 1 --2- 172.21.15.92:0/4016284242 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f477c003a00 0x7f477c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:16.176 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.162+0000 7f4795d23700 1 -- 172.21.15.92:0/4016284242 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f477c005210 msgr2=0x7f477c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:16.176 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.162+0000 7f4795d23700 1 --2- 172.21.15.92:0/4016284242 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f477c005210 0x7f477c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:16.176 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.162+0000 7f4796d25700 1 -- 172.21.15.92:0/4016284242 reap_dead start 2023-08-26T09:26:16.176 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.162+0000 7f4795d23700 1 -- 172.21.15.92:0/4016284242 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f477c0035b0 con 0x7f477c004850 2023-08-26T09:26:16.176 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.162+0000 7f4796524700 1 --2- 172.21.15.92:0/4016284242 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f477c003a00 0x7f477c003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:26:16.177 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.162+0000 7f4795d23700 1 --2- 172.21.15.92:0/4016284242 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f477c004850 0x7f477c004cd0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f478c009b60 tx=0x7f477c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf6b8434b9e9afb server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:16.177 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.163+0000 7f4795522700 1 -- 172.21.15.92:0/4016284242 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478c00e6c0 con 0x7f477c004850 2023-08-26T09:26:16.177 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.163+0000 7f4795522700 1 -- 172.21.15.92:0/4016284242 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478c00e820 con 0x7f477c004850 2023-08-26T09:26:16.177 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.163+0000 7f4795522700 1 -- 172.21.15.92:0/4016284242 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478c00eb90 con 0x7f477c004850 2023-08-26T09:26:16.177 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.163+0000 7f4798788700 1 -- 172.21.15.92:0/4016284242 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f477c004850 msgr2=0x7f477c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:16.177 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.163+0000 7f4798788700 1 --2- 172.21.15.92:0/4016284242 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f477c004850 0x7f477c004cd0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f478c009b60 tx=0x7f477c005880 comp rx=0 tx=0).stop 2023-08-26T09:26:16.178 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.163+0000 7f4798788700 1 -- 172.21.15.92:0/4016284242 shutdown_connections 2023-08-26T09:26:16.178 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.163+0000 7f4798788700 1 --2- 172.21.15.92:0/4016284242 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f477c004850 0x7f477c004cd0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:16.178 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.163+0000 7f4798788700 1 -- 172.21.15.92:0/4016284242 >> 172.21.15.92:0/4016284242 conn(0x7f479006faa0 msgr2=0x7f479006fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:16.178 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.163+0000 7f4798788700 1 -- 172.21.15.92:0/4016284242 shutdown_connections 2023-08-26T09:26:16.178 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.163+0000 7f4798788700 1 -- 172.21.15.92:0/4016284242 wait complete. 2023-08-26T09:26:16.179 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.164+0000 7f4798788700 1 Processor -- start 2023-08-26T09:26:16.179 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.164+0000 7f4798788700 1 -- start start 2023-08-26T09:26:16.179 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.165+0000 7f4798788700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f477c004850 0x7f47900c9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:16.179 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.165+0000 7f4798788700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47901f3860 0x7f479014f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:16.179 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.165+0000 7f4798788700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f479015c5e0 0x7f479015a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:16.180 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.165+0000 7f4798788700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47900caa20 con 0x7f47901f3860 2023-08-26T09:26:16.180 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.165+0000 7f4798788700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47900ca180 con 0x7f477c004850 2023-08-26T09:26:16.180 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.165+0000 7f4798788700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47900ca460 con 0x7f479015c5e0 2023-08-26T09:26:16.180 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.165+0000 7f4795d23700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47901f3860 0x7f479014f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:16.181 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.165+0000 7f4795d23700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47901f3860 0x7f479014f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46776/0 (socket says 172.21.15.92:46776) 2023-08-26T09:26:16.181 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.165+0000 7f4795d23700 1 -- 172.21.15.92:0/3504788820 learned_addr learned my addr 172.21.15.92:0/3504788820 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:16.181 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.165+0000 7f4796524700 1 --2- 172.21.15.92:0/3504788820 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f477c004850 0x7f47900c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:16.181 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.165+0000 7f4796d25700 1 --2- 172.21.15.92:0/3504788820 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f479015c5e0 0x7f479015a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:16.181 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.166+0000 7f4795d23700 1 -- 172.21.15.92:0/3504788820 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f479015c5e0 msgr2=0x7f479015a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:16.182 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.166+0000 7f4795d23700 1 --2- 172.21.15.92:0/3504788820 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f479015c5e0 0x7f479015a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:16.182 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.166+0000 7f4795d23700 1 -- 172.21.15.92:0/3504788820 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f477c004850 msgr2=0x7f47900c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:16.182 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.166+0000 7f4795d23700 1 --2- 172.21.15.92:0/3504788820 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f477c004850 0x7f47900c9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:16.182 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.166+0000 7f4795d23700 1 -- 172.21.15.92:0/3504788820 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47900ca740 con 0x7f47901f3860 2023-08-26T09:26:16.182 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.166+0000 7f4796d25700 1 --2- 172.21.15.92:0/3504788820 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f479015c5e0 0x7f479015a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:26:16.182 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.166+0000 7f4796524700 1 --2- 172.21.15.92:0/3504788820 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f477c004850 0x7f47900c9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:26:16.183 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.166+0000 7f4795d23700 1 --2- 172.21.15.92:0/3504788820 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47901f3860 0x7f479014f250 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f477c00c080 tx=0x7f478c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:16.183 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.166+0000 7f4786ffd700 1 -- 172.21.15.92:0/3504788820 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478c00e6c0 con 0x7f47901f3860 2023-08-26T09:26:16.183 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.166+0000 7f4786ffd700 1 -- 172.21.15.92:0/3504788820 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478c003ad0 con 0x7f47901f3860 2023-08-26T09:26:16.183 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.166+0000 7f4798788700 1 -- 172.21.15.92:0/3504788820 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f479006b5b0 con 0x7f47901f3860 2023-08-26T09:26:16.183 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.166+0000 7f4786ffd700 1 -- 172.21.15.92:0/3504788820 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478c003e80 con 0x7f47901f3860 2023-08-26T09:26:16.184 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.166+0000 7f4798788700 1 -- 172.21.15.92:0/3504788820 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f479014f790 con 0x7f47901f3860 2023-08-26T09:26:16.184 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.167+0000 7f4798788700 1 -- 172.21.15.92:0/3504788820 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f479006b740 con 0x7f47901f3860 2023-08-26T09:26:16.185 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.167+0000 7f4786ffd700 1 -- 172.21.15.92:0/3504788820 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f478c013470 con 0x7f47901f3860 2023-08-26T09:26:16.185 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.167+0000 7f4786ffd700 1 --2- 172.21.15.92:0/3504788820 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f477406a0e0 0x7f477406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:16.185 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.168+0000 7f4786ffd700 1 -- 172.21.15.92:0/3504788820 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f478c089bf0 con 0x7f47901f3860 2023-08-26T09:26:16.185 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.168+0000 7f4796524700 1 --2- 172.21.15.92:0/3504788820 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f477406a0e0 0x7f477406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:16.186 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.168+0000 7f4796524700 1 --2- 172.21.15.92:0/3504788820 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f477406a0e0 0x7f477406c5a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4780000c00 tx=0x7f4780009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:16.186 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.172+0000 7f4786ffd700 1 -- 172.21.15.92:0/3504788820 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f478c0557e0 con 0x7f47901f3860 2023-08-26T09:26:16.444 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.440+0000 7f4798788700 1 -- 172.21.15.92:0/3504788820 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f479004e660 con 0x7f47901f3860 2023-08-26T09:26:16.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.446+0000 7f4786ffd700 1 -- 172.21.15.92:0/3504788820 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f478c0170a0 con 0x7f47901f3860 2023-08-26T09:26:16.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.448+0000 7f4798788700 1 -- 172.21.15.92:0/3504788820 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f477406a0e0 msgr2=0x7f477406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:16.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.448+0000 7f4798788700 1 --2- 172.21.15.92:0/3504788820 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f477406a0e0 0x7f477406c5a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4780000c00 tx=0x7f4780009040 comp rx=0 tx=0).stop 2023-08-26T09:26:16.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.448+0000 7f4798788700 1 -- 172.21.15.92:0/3504788820 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47901f3860 msgr2=0x7f479014f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:16.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.448+0000 7f4798788700 1 --2- 172.21.15.92:0/3504788820 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47901f3860 0x7f479014f250 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f477c00c080 tx=0x7f478c0047c0 comp rx=0 tx=0).stop 2023-08-26T09:26:16.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.448+0000 7f4798788700 1 -- 172.21.15.92:0/3504788820 shutdown_connections 2023-08-26T09:26:16.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.448+0000 7f4798788700 1 --2- 172.21.15.92:0/3504788820 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f477406a0e0 0x7f477406c5a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:16.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.448+0000 7f4798788700 1 --2- 172.21.15.92:0/3504788820 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f477c004850 0x7f47900c9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:16.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.448+0000 7f4798788700 1 --2- 172.21.15.92:0/3504788820 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f479015c5e0 0x7f479015a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:16.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.448+0000 7f4798788700 1 --2- 172.21.15.92:0/3504788820 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47901f3860 0x7f479014f250 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:16.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.448+0000 7f4798788700 1 -- 172.21.15.92:0/3504788820 >> 172.21.15.92:0/3504788820 conn(0x7f479006faa0 msgr2=0x7f47900cf2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:16.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.448+0000 7f4798788700 1 -- 172.21.15.92:0/3504788820 shutdown_connections 2023-08-26T09:26:16.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.448+0000 7f4798788700 1 -- 172.21.15.92:0/3504788820 wait complete. 2023-08-26T09:26:16.463 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-08-26T09:26:16.585 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.581+0000 7fc221697700 1 Processor -- start 2023-08-26T09:26:16.585 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.581+0000 7fc221697700 1 -- start start 2023-08-26T09:26:16.590 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.582+0000 7fc221697700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc21c0cbc90 0x7fc21c06e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:16.591 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.582+0000 7fc221697700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fc21c070f40 0x7fc21c06da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:16.591 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.582+0000 7fc221697700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc21c0d0c40 con 0x7fc21c0aee90 2023-08-26T09:26:16.591 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.582+0000 7fc221697700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc21c0713b0 con 0x7fc21c070f40 2023-08-26T09:26:16.591 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.582+0000 7fc221697700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c0cd9b0 con 0x7fc21c0cbc90 2023-08-26T09:26:16.592 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.582+0000 7fc21a7fc700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fc21c0aee90 0x7fc21c0cf2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:58798/0 (socket says 172.21.15.92:58798) 2023-08-26T09:26:16.592 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.582+0000 7fc21a7fc700 1 -- 172.21.15.92:0/3103612387 learned_addr learned my addr 172.21.15.92:0/3103612387 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:26:16.592 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.582+0000 7fc219ffb700 1 -- 172.21.15.92:0/3103612387 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1089153581 0 0) 0x7fc21c0d0c40 con 0x7fc21c0aee90 2023-08-26T09:26:16.592 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.582+0000 7fc219ffb700 1 -- 172.21.15.92:0/3103612387 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2040035b0 con 0x7fc21c0aee90 2023-08-26T09:26:16.593 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.582+0000 7fc21b7fe700 1 --2- 172.21.15.92:0/3103612387 >> v2:172.21.15.188:3300/0 conn(0x7fc21c070f40 0x7fc21c06da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:16.593 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.582+0000 7fc21affd700 1 --2- 172.21.15.92:0/3103612387 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc21c0cbc90 0x7fc21c06e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:16.593 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.582+0000 7fc219ffb700 1 -- 172.21.15.92:0/3103612387 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 352558908 0 0) 0x7fc2040035b0 con 0x7fc21c0aee90 2023-08-26T09:26:16.594 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.582+0000 7fc219ffb700 1 -- 172.21.15.92:0/3103612387 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc21c0cbc90 msgr2=0x7fc21c06e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:16.594 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.582+0000 7fc219ffb700 1 --2- 172.21.15.92:0/3103612387 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc21c0cbc90 0x7fc21c06e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:16.594 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.582+0000 7fc219ffb700 1 -- 172.21.15.92:0/3103612387 >> v2:172.21.15.188:3300/0 conn(0x7fc21c070f40 msgr2=0x7fc21c06da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:16.595 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.582+0000 7fc219ffb700 1 --2- 172.21.15.92:0/3103612387 >> v2:172.21.15.188:3300/0 conn(0x7fc21c070f40 0x7fc21c06da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:16.595 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.582+0000 7fc219ffb700 1 -- 172.21.15.92:0/3103612387 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc21c0cdc90 con 0x7fc21c0aee90 2023-08-26T09:26:16.595 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.582+0000 7fc219ffb700 1 -- 172.21.15.92:0/3103612387 <== mon.0 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1019361464 0 0) 0x7fc20c001670 con 0x7fc21c0aee90 2023-08-26T09:26:16.596 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.582+0000 7fc219ffb700 1 -- 172.21.15.92:0/3103612387 >> v1:172.21.15.92:6789/0 conn(0x7fc21c0aee90 legacy=0x7fc21c0cf2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:16.596 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.582+0000 7fc219ffb700 1 --2- 172.21.15.92:0/3103612387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc204003a00 0x7fc204003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:16.596 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.582+0000 7fc219ffb700 1 --2- 172.21.15.92:0/3103612387 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc204004850 0x7fc204004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:16.597 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.582+0000 7fc219ffb700 1 --2- 172.21.15.92:0/3103612387 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc21c0cbc90 0x7fc204005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:16.597 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.582+0000 7fc219ffb700 1 -- 172.21.15.92:0/3103612387 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c0713b0 con 0x7fc204003a00 2023-08-26T09:26:16.597 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.582+0000 7fc219ffb700 1 -- 172.21.15.92:0/3103612387 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c0cd9b0 con 0x7fc204004850 2023-08-26T09:26:16.598 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.582+0000 7fc219ffb700 1 -- 172.21.15.92:0/3103612387 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc20400bb70 con 0x7fc21c0cbc90 2023-08-26T09:26:16.598 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.583+0000 7fc21b7fe700 1 --2- 172.21.15.92:0/3103612387 >> v2:172.21.15.188:3300/0 conn(0x7fc21c070f40 0x7fc21c06da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:26:16.599 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.583+0000 7fc21affd700 1 --2- 172.21.15.92:0/3103612387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc204003a00 0x7fc204003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:16.599 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.583+0000 7fc21a7fc700 1 --2- 172.21.15.92:0/3103612387 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc204004850 0x7fc204004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:16.599 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.583+0000 7fc21b7fe700 1 --2- 172.21.15.92:0/3103612387 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc21c0cbc90 0x7fc204005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:16.600 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.583+0000 7fc21affd700 1 -- 172.21.15.92:0/3103612387 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc21c0cbc90 msgr2=0x7fc204005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:16.600 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.583+0000 7fc21affd700 1 --2- 172.21.15.92:0/3103612387 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc21c0cbc90 0x7fc204005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:16.600 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.583+0000 7fc21affd700 1 -- 172.21.15.92:0/3103612387 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc204004850 msgr2=0x7fc204004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:16.600 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.583+0000 7fc21affd700 1 --2- 172.21.15.92:0/3103612387 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc204004850 0x7fc204004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:16.600 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.583+0000 7fc21affd700 1 -- 172.21.15.92:0/3103612387 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2040035b0 con 0x7fc204003a00 2023-08-26T09:26:16.601 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.583+0000 7fc21a7fc700 1 --2- 172.21.15.92:0/3103612387 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc204004850 0x7fc204004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:26:16.601 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.583+0000 7fc21affd700 1 --2- 172.21.15.92:0/3103612387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc204003a00 0x7fc204003e20 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc210009860 tx=0x7fc204005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8f2756a882f41c7 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:16.601 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.583+0000 7fc219ffb700 1 -- 172.21.15.92:0/3103612387 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21000c070 con 0x7fc204003a00 2023-08-26T09:26:16.601 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.583+0000 7fc219ffb700 1 -- 172.21.15.92:0/3103612387 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc210013610 con 0x7fc204003a00 2023-08-26T09:26:16.601 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.583+0000 7fc219ffb700 1 -- 172.21.15.92:0/3103612387 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2100139a0 con 0x7fc204003a00 2023-08-26T09:26:16.602 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.584+0000 7fc221697700 1 -- 172.21.15.92:0/3103612387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc204003a00 msgr2=0x7fc204003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:16.602 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.584+0000 7fc221697700 1 --2- 172.21.15.92:0/3103612387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc204003a00 0x7fc204003e20 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc210009860 tx=0x7fc204005880 comp rx=0 tx=0).stop 2023-08-26T09:26:16.602 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.584+0000 7fc21b7fe700 1 -- 172.21.15.92:0/3103612387 reap_dead start 2023-08-26T09:26:16.602 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.584+0000 7fc221697700 1 -- 172.21.15.92:0/3103612387 shutdown_connections 2023-08-26T09:26:16.602 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.584+0000 7fc221697700 1 -- 172.21.15.92:0/3103612387 >> 172.21.15.92:0/3103612387 conn(0x7fc21c0cfd40 msgr2=0x7fc21c0d0150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:16.603 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.584+0000 7fc221697700 1 -- 172.21.15.92:0/3103612387 shutdown_connections 2023-08-26T09:26:16.603 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.584+0000 7fc221697700 1 -- 172.21.15.92:0/3103612387 wait complete. 2023-08-26T09:26:16.603 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.585+0000 7fc221697700 1 Processor -- start 2023-08-26T09:26:16.603 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.585+0000 7fc221697700 1 -- start start 2023-08-26T09:26:16.603 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.586+0000 7fc221697700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc204003a00 0x7fc21c14b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:16.604 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.586+0000 7fc221697700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc21c06a320 0x7fc21c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:16.604 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.586+0000 7fc221697700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc21c0c9690 0x7fc21c0c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:16.604 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.586+0000 7fc221697700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c06ace0 con 0x7fc21c06a320 2023-08-26T09:26:16.604 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.586+0000 7fc221697700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c0b0950 con 0x7fc21c0c9690 2023-08-26T09:26:16.604 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.586+0000 7fc221697700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c0ca050 con 0x7fc204003a00 2023-08-26T09:26:16.605 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.586+0000 7fc21a7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc21c06a320 0x7fc21c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:16.605 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.586+0000 7fc21a7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc21c06a320 0x7fc21c06a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46796/0 (socket says 172.21.15.92:46796) 2023-08-26T09:26:16.605 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.586+0000 7fc21a7fc700 1 -- 172.21.15.92:0/769645049 learned_addr learned my addr 172.21.15.92:0/769645049 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:16.605 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.586+0000 7fc21a7fc700 1 -- 172.21.15.92:0/769645049 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc204003a00 msgr2=0x7fc21c14b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:16.605 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.586+0000 7fc21a7fc700 1 --2- 172.21.15.92:0/769645049 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc204003a00 0x7fc21c14b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:16.606 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.586+0000 7fc21a7fc700 1 -- 172.21.15.92:0/769645049 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc21c0c9690 msgr2=0x7fc21c0c9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:16.606 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.586+0000 7fc21a7fc700 1 --2- 172.21.15.92:0/769645049 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc21c0c9690 0x7fc21c0c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:16.606 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.586+0000 7fc21a7fc700 1 -- 172.21.15.92:0/769645049 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc21c0c70c0 con 0x7fc21c06a320 2023-08-26T09:26:16.606 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.586+0000 7fc21a7fc700 1 --2- 172.21.15.92:0/769645049 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc21c06a320 0x7fc21c06a7a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fc20c00e8f0 tx=0x7fc20c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:16.606 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.586+0000 7fc2037fe700 1 -- 172.21.15.92:0/769645049 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20c00ee90 con 0x7fc21c06a320 2023-08-26T09:26:16.607 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.586+0000 7fc2037fe700 1 -- 172.21.15.92:0/769645049 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc20c00c760 con 0x7fc21c06a320 2023-08-26T09:26:16.607 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.586+0000 7fc221697700 1 -- 172.21.15.92:0/769645049 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc21c0ca300 con 0x7fc21c06a320 2023-08-26T09:26:16.607 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.586+0000 7fc2037fe700 1 -- 172.21.15.92:0/769645049 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20c00caf0 con 0x7fc21c06a320 2023-08-26T09:26:16.607 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.587+0000 7fc221697700 1 -- 172.21.15.92:0/769645049 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc21c0ca8c0 con 0x7fc21c06a320 2023-08-26T09:26:16.609 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.587+0000 7fc221697700 1 -- 172.21.15.92:0/769645049 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc21c0b0ae0 con 0x7fc21c06a320 2023-08-26T09:26:16.609 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.588+0000 7fc2037fe700 1 -- 172.21.15.92:0/769645049 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc20c00cc50 con 0x7fc21c06a320 2023-08-26T09:26:16.610 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.588+0000 7fc2037fe700 1 --2- 172.21.15.92:0/769645049 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fc20806a0e0 0x7fc20806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:16.611 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.588+0000 7fc2037fe700 1 -- 172.21.15.92:0/769645049 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc20c088000 con 0x7fc21c06a320 2023-08-26T09:26:16.611 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.588+0000 7fc21affd700 1 --2- 172.21.15.92:0/769645049 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fc20806a0e0 0x7fc20806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:16.611 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.589+0000 7fc21affd700 1 --2- 172.21.15.92:0/769645049 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fc20806a0e0 0x7fc20806c5a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc210000c00 tx=0x7fc210013000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:16.611 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.593+0000 7fc2037fe700 1 -- 172.21.15.92:0/769645049 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc20c053ad0 con 0x7fc21c06a320 2023-08-26T09:26:16.864 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.860+0000 7fc221697700 1 -- 172.21.15.92:0/769645049 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fc21c04e660 con 0x7fc21c06a320 2023-08-26T09:26:16.869 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.865+0000 7fc2037fe700 1 -- 172.21.15.92:0/769645049 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc20c0570f0 con 0x7fc21c06a320 2023-08-26T09:26:16.871 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.867+0000 7fc221697700 1 -- 172.21.15.92:0/769645049 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fc20806a0e0 msgr2=0x7fc20806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:16.872 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.867+0000 7fc221697700 1 --2- 172.21.15.92:0/769645049 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fc20806a0e0 0x7fc20806c5a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc210000c00 tx=0x7fc210013000 comp rx=0 tx=0).stop 2023-08-26T09:26:16.872 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.867+0000 7fc221697700 1 -- 172.21.15.92:0/769645049 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc21c06a320 msgr2=0x7fc21c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:16.872 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.867+0000 7fc221697700 1 --2- 172.21.15.92:0/769645049 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc21c06a320 0x7fc21c06a7a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fc20c00e8f0 tx=0x7fc20c00ecb0 comp rx=0 tx=0).stop 2023-08-26T09:26:16.872 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.867+0000 7fc221697700 1 -- 172.21.15.92:0/769645049 shutdown_connections 2023-08-26T09:26:16.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.867+0000 7fc221697700 1 --2- 172.21.15.92:0/769645049 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fc20806a0e0 0x7fc20806c5a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:16.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.867+0000 7fc221697700 1 --2- 172.21.15.92:0/769645049 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc21c0c9690 0x7fc21c0c9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:16.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.867+0000 7fc221697700 1 --2- 172.21.15.92:0/769645049 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc204003a00 0x7fc21c14b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:16.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.867+0000 7fc221697700 1 --2- 172.21.15.92:0/769645049 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc21c06a320 0x7fc21c06a7a0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:16.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.867+0000 7fc221697700 1 -- 172.21.15.92:0/769645049 >> 172.21.15.92:0/769645049 conn(0x7fc21c0cfd40 msgr2=0x7fc21c15ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:16.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.868+0000 7fc221697700 1 -- 172.21.15.92:0/769645049 shutdown_connections 2023-08-26T09:26:16.874 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:16.868+0000 7fc221697700 1 -- 172.21.15.92:0/769645049 wait complete. 2023-08-26T09:26:16.884 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-08-26T09:26:17.006 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.002+0000 7f166ea48700 1 Processor -- start 2023-08-26T09:26:17.006 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.002+0000 7f166ea48700 1 -- start start 2023-08-26T09:26:17.009 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.003+0000 7f166ea48700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f1668160b90 0x7f16680cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:17.010 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.003+0000 7f166ea48700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f166806d8a0 0x7f1668161b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:17.010 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.003+0000 7f166ea48700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f166806cf70 con 0x7f166806a320 2023-08-26T09:26:17.010 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.003+0000 7f166ea48700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1668160f70 con 0x7f1668160b90 2023-08-26T09:26:17.010 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.003+0000 7f166ea48700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1668161670 con 0x7f166806d8a0 2023-08-26T09:26:17.011 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.003+0000 7f166cfe5700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f166806a320 0x7f1668070ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:58820/0 (socket says 172.21.15.92:58820) 2023-08-26T09:26:17.011 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.003+0000 7f166cfe5700 1 -- 172.21.15.92:0/3699620464 learned_addr learned my addr 172.21.15.92:0/3699620464 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:26:17.012 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.003+0000 7f1667fff700 1 --2- 172.21.15.92:0/3699620464 >> v2:172.21.15.188:3300/0 conn(0x7f1668160b90 0x7f16680cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:17.012 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.003+0000 7f1666ffd700 1 -- 172.21.15.92:0/3699620464 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3861703373 0 0) 0x7f166806cf70 con 0x7f166806a320 2023-08-26T09:26:17.012 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.003+0000 7f16677fe700 1 --2- 172.21.15.92:0/3699620464 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f166806d8a0 0x7f1668161b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:17.012 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.003+0000 7f1666ffd700 1 -- 172.21.15.92:0/3699620464 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16500035b0 con 0x7f166806a320 2023-08-26T09:26:17.012 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.003+0000 7f1666ffd700 1 -- 172.21.15.92:0/3699620464 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1464245222 0 0) 0x7f16500035b0 con 0x7f166806a320 2023-08-26T09:26:17.013 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.003+0000 7f1666ffd700 1 -- 172.21.15.92:0/3699620464 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f166806d8a0 msgr2=0x7f1668161b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:17.013 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.003+0000 7f1666ffd700 1 --2- 172.21.15.92:0/3699620464 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f166806d8a0 0x7f1668161b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:17.013 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.003+0000 7f1666ffd700 1 -- 172.21.15.92:0/3699620464 >> v2:172.21.15.188:3300/0 conn(0x7f1668160b90 msgr2=0x7f16680cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:17.013 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.003+0000 7f1666ffd700 1 --2- 172.21.15.92:0/3699620464 >> v2:172.21.15.188:3300/0 conn(0x7f1668160b90 0x7f16680cf780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:17.013 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.003+0000 7f1666ffd700 1 -- 172.21.15.92:0/3699620464 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1668162040 con 0x7f166806a320 2023-08-26T09:26:17.014 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.003+0000 7f1666ffd700 1 -- 172.21.15.92:0/3699620464 <== mon.0 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1019361464 0 0) 0x7f16600019f0 con 0x7f166806a320 2023-08-26T09:26:17.014 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.004+0000 7f1666ffd700 1 -- 172.21.15.92:0/3699620464 >> v1:172.21.15.92:6789/0 conn(0x7f166806a320 legacy=0x7f1668070ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:17.014 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.004+0000 7f1666ffd700 1 --2- 172.21.15.92:0/3699620464 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1650003a00 0x7f1650003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:17.014 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.004+0000 7f1666ffd700 1 --2- 172.21.15.92:0/3699620464 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f166806d8a0 0x7f1650004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:17.014 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.004+0000 7f1666ffd700 1 --2- 172.21.15.92:0/3699620464 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1650004d90 0x7f1650005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:17.015 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.004+0000 7f1666ffd700 1 -- 172.21.15.92:0/3699620464 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1668160f70 con 0x7f1650004d90 2023-08-26T09:26:17.015 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.004+0000 7f1666ffd700 1 -- 172.21.15.92:0/3699620464 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1668161670 con 0x7f1650003a00 2023-08-26T09:26:17.015 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.004+0000 7f1666ffd700 1 -- 172.21.15.92:0/3699620464 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f165000ba10 con 0x7f166806d8a0 2023-08-26T09:26:17.015 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.004+0000 7f166cfe5700 1 --2- 172.21.15.92:0/3699620464 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1650004d90 0x7f1650005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:17.015 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.004+0000 7f1667fff700 1 --2- 172.21.15.92:0/3699620464 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1650003a00 0x7f1650003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:17.015 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.004+0000 7f16677fe700 1 --2- 172.21.15.92:0/3699620464 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f166806d8a0 0x7f1650004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:17.016 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.004+0000 7f166cfe5700 1 -- 172.21.15.92:0/3699620464 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f166806d8a0 msgr2=0x7f1650004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:17.016 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.004+0000 7f166cfe5700 1 --2- 172.21.15.92:0/3699620464 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f166806d8a0 0x7f1650004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:17.016 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.004+0000 7f166cfe5700 1 -- 172.21.15.92:0/3699620464 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1650003a00 msgr2=0x7f1650003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:17.016 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.004+0000 7f166cfe5700 1 --2- 172.21.15.92:0/3699620464 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1650003a00 0x7f1650003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:17.016 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.004+0000 7f166cfe5700 1 -- 172.21.15.92:0/3699620464 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16500035b0 con 0x7f1650004d90 2023-08-26T09:26:17.017 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.004+0000 7f166cfe5700 1 --2- 172.21.15.92:0/3699620464 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1650004d90 0x7f1650005210 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f166000a8d0 tx=0x7f1650005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4298c49d6d037fa server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:17.017 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.004+0000 7f1666ffd700 1 -- 172.21.15.92:0/3699620464 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166000a340 con 0x7f1650004d90 2023-08-26T09:26:17.017 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.004+0000 7f1666ffd700 1 -- 172.21.15.92:0/3699620464 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1660012600 con 0x7f1650004d90 2023-08-26T09:26:17.017 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.004+0000 7f1666ffd700 1 -- 172.21.15.92:0/3699620464 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16600129b0 con 0x7f1650004d90 2023-08-26T09:26:17.017 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.005+0000 7f166ea48700 1 -- 172.21.15.92:0/3699620464 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1650004d90 msgr2=0x7f1650005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:17.018 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.005+0000 7f166ea48700 1 --2- 172.21.15.92:0/3699620464 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1650004d90 0x7f1650005210 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f166000a8d0 tx=0x7f1650005880 comp rx=0 tx=0).stop 2023-08-26T09:26:17.018 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.005+0000 7f166cfe5700 1 -- 172.21.15.92:0/3699620464 reap_dead start 2023-08-26T09:26:17.018 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.005+0000 7f166ea48700 1 -- 172.21.15.92:0/3699620464 shutdown_connections 2023-08-26T09:26:17.018 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.005+0000 7f166ea48700 1 -- 172.21.15.92:0/3699620464 >> 172.21.15.92:0/3699620464 conn(0x7f16680cc790 msgr2=0x7f16680ccb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:17.018 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.005+0000 7f166ea48700 1 -- 172.21.15.92:0/3699620464 shutdown_connections 2023-08-26T09:26:17.019 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.005+0000 7f166ea48700 1 -- 172.21.15.92:0/3699620464 wait complete. 2023-08-26T09:26:17.019 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.006+0000 7f166ea48700 1 Processor -- start 2023-08-26T09:26:17.019 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.006+0000 7f166ea48700 1 -- start start 2023-08-26T09:26:17.021 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.007+0000 7f166ea48700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1668157750 0x7f16680b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:17.022 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.007+0000 7f166ea48700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f16680b4930 0x7f16680cb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:17.022 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.007+0000 7f166ea48700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f16680cba00 0x7f16680b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:17.022 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.007+0000 7f166ea48700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16680cbe80 con 0x7f1668157750 2023-08-26T09:26:17.022 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.007+0000 7f166ea48700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16680b4f00 con 0x7f16680b4930 2023-08-26T09:26:17.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.007+0000 7f166ea48700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1668157b30 con 0x7f16680cba00 2023-08-26T09:26:17.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.007+0000 7f1667fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1668157750 0x7f16680b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:17.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.007+0000 7f1667fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1668157750 0x7f16680b43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46814/0 (socket says 172.21.15.92:46814) 2023-08-26T09:26:17.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.007+0000 7f1667fff700 1 -- 172.21.15.92:0/3029715189 learned_addr learned my addr 172.21.15.92:0/3029715189 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:17.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.007+0000 7f1667fff700 1 -- 172.21.15.92:0/3029715189 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f16680cba00 msgr2=0x7f16680b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:17.024 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.007+0000 7f1667fff700 1 --2- 172.21.15.92:0/3029715189 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f16680cba00 0x7f16680b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:17.024 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.007+0000 7f1667fff700 1 -- 172.21.15.92:0/3029715189 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f16680b4930 msgr2=0x7f16680cb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:17.024 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.007+0000 7f1667fff700 1 --2- 172.21.15.92:0/3029715189 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f16680b4930 0x7f16680cb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:17.024 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.007+0000 7f1667fff700 1 -- 172.21.15.92:0/3029715189 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16680c6f80 con 0x7f1668157750 2023-08-26T09:26:17.024 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.007+0000 7f1667fff700 1 --2- 172.21.15.92:0/3029715189 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1668157750 0x7f16680b43f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f165c011a50 tx=0x7f165c011e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:17.025 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.008+0000 7f1664ff9700 1 -- 172.21.15.92:0/3029715189 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165c00f940 con 0x7f1668157750 2023-08-26T09:26:17.025 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.008+0000 7f1664ff9700 1 -- 172.21.15.92:0/3029715189 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f165c00fac0 con 0x7f1668157750 2023-08-26T09:26:17.025 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.008+0000 7f166ea48700 1 -- 172.21.15.92:0/3029715189 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16680c7260 con 0x7f1668157750 2023-08-26T09:26:17.025 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.008+0000 7f1664ff9700 1 -- 172.21.15.92:0/3029715189 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165c00fe70 con 0x7f1668157750 2023-08-26T09:26:17.025 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.008+0000 7f166ea48700 1 -- 172.21.15.92:0/3029715189 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16680c7820 con 0x7f1668157750 2023-08-26T09:26:17.025 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.009+0000 7f166ea48700 1 -- 172.21.15.92:0/3029715189 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16680c7b90 con 0x7f1668157750 2023-08-26T09:26:17.026 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.009+0000 7f1664ff9700 1 -- 172.21.15.92:0/3029715189 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f165c014440 con 0x7f1668157750 2023-08-26T09:26:17.026 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.009+0000 7f1664ff9700 1 --2- 172.21.15.92:0/3029715189 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f165406a0e0 0x7f165406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:17.026 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.009+0000 7f1664ff9700 1 -- 172.21.15.92:0/3029715189 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f165c088a10 con 0x7f1668157750 2023-08-26T09:26:17.026 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.009+0000 7f16677fe700 1 --2- 172.21.15.92:0/3029715189 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f165406a0e0 0x7f165406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:17.026 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.010+0000 7f16677fe700 1 --2- 172.21.15.92:0/3029715189 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f165406a0e0 0x7f165406c5a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f16680b5980 tx=0x7f1658009670 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:17.027 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.014+0000 7f1664ff9700 1 -- 172.21.15.92:0/3029715189 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f165c057ee0 con 0x7f1668157750 2023-08-26T09:26:17.287 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.282+0000 7f166ea48700 1 -- 172.21.15.92:0/3029715189 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f166804e660 con 0x7f1668157750 2023-08-26T09:26:17.292 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.288+0000 7f1664ff9700 1 -- 172.21.15.92:0/3029715189 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f165c057a70 con 0x7f1668157750 2023-08-26T09:26:17.295 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.290+0000 7f166ea48700 1 -- 172.21.15.92:0/3029715189 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f165406a0e0 msgr2=0x7f165406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:17.295 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.290+0000 7f166ea48700 1 --2- 172.21.15.92:0/3029715189 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f165406a0e0 0x7f165406c5a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f16680b5980 tx=0x7f1658009670 comp rx=0 tx=0).stop 2023-08-26T09:26:17.295 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.290+0000 7f166ea48700 1 -- 172.21.15.92:0/3029715189 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1668157750 msgr2=0x7f16680b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:17.295 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.290+0000 7f166ea48700 1 --2- 172.21.15.92:0/3029715189 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1668157750 0x7f16680b43f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f165c011a50 tx=0x7f165c011e10 comp rx=0 tx=0).stop 2023-08-26T09:26:17.295 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.290+0000 7f166ea48700 1 -- 172.21.15.92:0/3029715189 shutdown_connections 2023-08-26T09:26:17.296 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.290+0000 7f166ea48700 1 --2- 172.21.15.92:0/3029715189 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f16680cba00 0x7f16680b07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:17.296 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.290+0000 7f166ea48700 1 --2- 172.21.15.92:0/3029715189 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1668157750 0x7f16680b43f0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:17.297 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.290+0000 7f166ea48700 1 --2- 172.21.15.92:0/3029715189 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f165406a0e0 0x7f165406c5a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:17.297 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.290+0000 7f166ea48700 1 --2- 172.21.15.92:0/3029715189 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f16680b4930 0x7f16680cb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:17.297 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.290+0000 7f166ea48700 1 -- 172.21.15.92:0/3029715189 >> 172.21.15.92:0/3029715189 conn(0x7f16680cc790 msgr2=0x7f16680ae350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:17.298 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.290+0000 7f166ea48700 1 -- 172.21.15.92:0/3029715189 shutdown_connections 2023-08-26T09:26:17.298 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.290+0000 7f166ea48700 1 -- 172.21.15.92:0/3029715189 wait complete. 2023-08-26T09:26:17.307 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-26T09:26:17.428 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.423+0000 7f1dd38ac700 1 Processor -- start 2023-08-26T09:26:17.428 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.424+0000 7f1dd38ac700 1 -- start start 2023-08-26T09:26:17.430 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.424+0000 7f1dd38ac700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f1dcc0ca620 0x7f1dcc0caa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:17.431 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.424+0000 7f1dd38ac700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f1dcc15d6c0 0x7f1dcc0cea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:17.431 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.424+0000 7f1dd38ac700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dcc0cf4d0 con 0x7f1dcc0cef70 2023-08-26T09:26:17.431 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.424+0000 7f1dd38ac700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dcc0cb4a0 con 0x7f1dcc0ca620 2023-08-26T09:26:17.431 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.424+0000 7f1dd38ac700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dcc0caf40 con 0x7f1dcc15d6c0 2023-08-26T09:26:17.432 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.424+0000 7f1dd1648700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f1dcc0ca620 0x7f1dcc0caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:17.432 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.424+0000 7f1dd1e49700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f1dcc0cef70 0x7f1dcc06a320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:58836/0 (socket says 172.21.15.92:58836) 2023-08-26T09:26:17.432 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.424+0000 7f1dd1e49700 1 -- 172.21.15.92:0/2571993517 learned_addr learned my addr 172.21.15.92:0/2571993517 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:26:17.432 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.425+0000 7f1dd0e47700 1 --2- 172.21.15.92:0/2571993517 >> v2:172.21.15.188:3300/0 conn(0x7f1dcc15d6c0 0x7f1dcc0cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:17.432 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.425+0000 7f1dd1648700 1 -- 172.21.15.92:0/2571993517 >> v2:172.21.15.188:3300/0 conn(0x7f1dcc15d6c0 msgr2=0x7f1dcc0cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:17.432 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.425+0000 7f1dd1648700 1 --2- 172.21.15.92:0/2571993517 >> v2:172.21.15.188:3300/0 conn(0x7f1dcc15d6c0 0x7f1dcc0cea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:17.433 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.425+0000 7f1dd1648700 1 -- 172.21.15.92:0/2571993517 >> v1:172.21.15.92:6789/0 conn(0x7f1dcc0cef70 legacy=0x7f1dcc06a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:17.433 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.425+0000 7f1dd1648700 1 -- 172.21.15.92:0/2571993517 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dcc0ce3b0 con 0x7f1dcc0ca620 2023-08-26T09:26:17.433 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.425+0000 7f1dc3fff700 1 -- 172.21.15.92:0/2571993517 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 939169837 0 0) 0x7f1dcc0cf4d0 con 0x7f1dcc0cef70 2023-08-26T09:26:17.433 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.425+0000 7f1dd1648700 1 --2- 172.21.15.92:0/2571993517 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1dcc0ca620 0x7f1dcc0caa00 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc066a80 tx=0x7f1dbc009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60e143b446c459a6 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:17.433 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.425+0000 7f1dc3fff700 1 -- 172.21.15.92:0/2571993517 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc011830 con 0x7f1dcc0ca620 2023-08-26T09:26:17.434 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.425+0000 7f1dc3fff700 1 -- 172.21.15.92:0/2571993517 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dbc011990 con 0x7f1dcc0ca620 2023-08-26T09:26:17.434 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.425+0000 7f1dc3fff700 1 -- 172.21.15.92:0/2571993517 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc011d20 con 0x7f1dcc0ca620 2023-08-26T09:26:17.434 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.426+0000 7f1dd38ac700 1 -- 172.21.15.92:0/2571993517 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1dcc0ca620 msgr2=0x7f1dcc0caa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:17.434 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.426+0000 7f1dd38ac700 1 --2- 172.21.15.92:0/2571993517 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1dcc0ca620 0x7f1dcc0caa00 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc066a80 tx=0x7f1dbc009b20 comp rx=0 tx=0).stop 2023-08-26T09:26:17.434 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.426+0000 7f1dd38ac700 1 -- 172.21.15.92:0/2571993517 shutdown_connections 2023-08-26T09:26:17.435 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.426+0000 7f1dd38ac700 1 --2- 172.21.15.92:0/2571993517 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1dcc0ca620 0x7f1dcc0caa00 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:17.435 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.426+0000 7f1dd38ac700 1 --2- 172.21.15.92:0/2571993517 >> v2:172.21.15.188:3300/0 conn(0x7f1dcc15d6c0 0x7f1dcc0cea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:17.435 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.426+0000 7f1dd38ac700 1 -- 172.21.15.92:0/2571993517 >> 172.21.15.92:0/2571993517 conn(0x7f1dcc0cc7b0 msgr2=0x7f1dcc0ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:17.435 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.426+0000 7f1dd38ac700 1 -- 172.21.15.92:0/2571993517 shutdown_connections 2023-08-26T09:26:17.435 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.426+0000 7f1dd38ac700 1 -- 172.21.15.92:0/2571993517 wait complete. 2023-08-26T09:26:17.438 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.427+0000 7f1dd38ac700 1 Processor -- start 2023-08-26T09:26:17.439 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.427+0000 7f1dd38ac700 1 -- start start 2023-08-26T09:26:17.439 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.428+0000 7f1dd38ac700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1dcc0ca620 0x7f1dcc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:17.440 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.428+0000 7f1dd38ac700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1dcc0cef70 0x7f1dcc0c6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:17.440 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.428+0000 7f1dd38ac700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1dcc15d6c0 0x7f1dcc0c5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:17.440 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.428+0000 7f1dd38ac700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc0c74f0 con 0x7f1dcc15d6c0 2023-08-26T09:26:17.440 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.428+0000 7f1dd38ac700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc0c9bd0 con 0x7f1dcc0ca620 2023-08-26T09:26:17.440 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.428+0000 7f1dd38ac700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc06e5b0 con 0x7f1dcc0cef70 2023-08-26T09:26:17.441 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.428+0000 7f1dd1e49700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1dcc15d6c0 0x7f1dcc0c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:17.441 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.428+0000 7f1dd1e49700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1dcc15d6c0 0x7f1dcc0c5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46832/0 (socket says 172.21.15.92:46832) 2023-08-26T09:26:17.441 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.428+0000 7f1dd1e49700 1 -- 172.21.15.92:0/3656285330 learned_addr learned my addr 172.21.15.92:0/3656285330 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:17.441 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.429+0000 7f1dd0e47700 1 --2- 172.21.15.92:0/3656285330 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1dcc0cef70 0x7f1dcc0c6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:17.441 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.429+0000 7f1dd1648700 1 --2- 172.21.15.92:0/3656285330 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1dcc0ca620 0x7f1dcc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:17.441 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.429+0000 7f1dd1e49700 1 -- 172.21.15.92:0/3656285330 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1dcc0cef70 msgr2=0x7f1dcc0c6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:17.442 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.429+0000 7f1dd1e49700 1 --2- 172.21.15.92:0/3656285330 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1dcc0cef70 0x7f1dcc0c6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:17.442 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.429+0000 7f1dd1e49700 1 -- 172.21.15.92:0/3656285330 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1dcc0ca620 msgr2=0x7f1dcc06d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:17.442 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.429+0000 7f1dd1e49700 1 --2- 172.21.15.92:0/3656285330 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1dcc0ca620 0x7f1dcc06d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:17.442 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.429+0000 7f1dd1e49700 1 -- 172.21.15.92:0/3656285330 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dbc0094a0 con 0x7f1dcc15d6c0 2023-08-26T09:26:17.442 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.429+0000 7f1dd0e47700 1 --2- 172.21.15.92:0/3656285330 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1dcc0cef70 0x7f1dcc0c6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:26:17.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.429+0000 7f1dd1e49700 1 --2- 172.21.15.92:0/3656285330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1dcc15d6c0 0x7f1dcc0c5590 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f1dc400ccd0 tx=0x7f1dc400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:17.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.429+0000 7f1dc1ffb700 1 -- 172.21.15.92:0/3656285330 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc400ad40 con 0x7f1dcc15d6c0 2023-08-26T09:26:17.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.429+0000 7f1dc1ffb700 1 -- 172.21.15.92:0/3656285330 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc40070d0 con 0x7f1dcc15d6c0 2023-08-26T09:26:17.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.429+0000 7f1dd38ac700 1 -- 172.21.15.92:0/3656285330 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dcc0c5ad0 con 0x7f1dcc15d6c0 2023-08-26T09:26:17.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.429+0000 7f1dc1ffb700 1 -- 172.21.15.92:0/3656285330 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc400aea0 con 0x7f1dcc15d6c0 2023-08-26T09:26:17.444 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.429+0000 7f1dd38ac700 1 -- 172.21.15.92:0/3656285330 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dcc06dc80 con 0x7f1dcc15d6c0 2023-08-26T09:26:17.444 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.430+0000 7f1dd38ac700 1 -- 172.21.15.92:0/3656285330 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dcc04e660 con 0x7f1dcc15d6c0 2023-08-26T09:26:17.444 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.431+0000 7f1dc1ffb700 1 -- 172.21.15.92:0/3656285330 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1dc4007480 con 0x7f1dcc15d6c0 2023-08-26T09:26:17.444 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.431+0000 7f1dc1ffb700 1 --2- 172.21.15.92:0/3656285330 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f1db006a0e0 0x7f1db006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:17.444 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.431+0000 7f1dc1ffb700 1 -- 172.21.15.92:0/3656285330 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1dc40880b0 con 0x7f1dcc15d6c0 2023-08-26T09:26:17.445 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.431+0000 7f1dd1648700 1 --2- 172.21.15.92:0/3656285330 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f1db006a0e0 0x7f1db006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:17.445 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.431+0000 7f1dd1648700 1 --2- 172.21.15.92:0/3656285330 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f1db006a0e0 0x7f1db006c5a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc0090b0 tx=0x7f1dbc008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:17.445 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.435+0000 7f1dc1ffb700 1 -- 172.21.15.92:0/3656285330 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1dc4053b80 con 0x7f1dcc15d6c0 2023-08-26T09:26:17.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.623+0000 7f1dd38ac700 1 -- 172.21.15.92:0/3656285330 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1dcc06e6f0 con 0x7f1dcc15d6c0 2023-08-26T09:26:17.629 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.624+0000 7f1dc1ffb700 1 -- 172.21.15.92:0/3656285330 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+14569 (secure 0 0 0) 0x7f1dc40571a0 con 0x7f1dcc15d6c0 2023-08-26T09:26:17.629 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:26:17.630 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":29,"fsid":"254a2d31-bd41-4507-8326-1b205ac24377","created":"2023-08-26T09:24:55.352131+0000","modified":"2023-08-26T09:26:14.324204+0000","last_up_change":"2023-08-26T09:25:06.124496+0000","last_in_change":"2023-08-26T09:24:57.840725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-26T09:25:06.650431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-26T09:25:06.973382+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e9e7638-4459-4d8d-8e40-130bcf48df66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6819","nonce":382827192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6824","nonce":382827192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6831","nonce":382827192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6827","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6829","nonce":382827192}]},"public_addr":"172.21.15.92:6819/382827192","cluster_addr":"172.21.15.92:6824/382827192","heartbeat_back_addr":"172.21.15.92:6831/382827192","heartbeat_front_addr":"172.21.15.92:6829/382827192","state":["exists","up"]},{"osd":1,"uuid":"164e68c9-aedd-4df5-9b70-f4b1ec3bda13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6809","nonce":618773438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6811","nonce":618773438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6815","nonce":618773438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6813","nonce":618773438}]},"public_addr":"172.21.15.92:6809/618773438","cluster_addr":"172.21.15.92:6811/618773438","heartbeat_back_addr":"172.21.15.92:6815/618773438","heartbeat_front_addr":"172.21.15.92:6813/618773438","state":["exists","up"]},{"osd":2,"uuid":"8701dfee-629a-4d30-82e4-b8fac340303f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6818","nonce":3697397687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6821","nonce":3697397687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6828","nonce":3697397687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6823","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6825","nonce":3697397687}]},"public_addr":"172.21.15.92:6818/3697397687","cluster_addr":"172.21.15.92:6821/3697397687","heartbeat_back_addr":"172.21.15.92:6828/3697397687","heartbeat_front_addr":"172.21.15.92:6825/3697397687","state":["exists","up"]},{"osd":3,"uuid":"93bdc94d-dc07-495f-995a-a6ad072f0247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6801","nonce":3579846453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6803","nonce":3579846453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6807","nonce":3579846453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6805","nonce":3579846453}]},"public_addr":"172.21.15.92:6801/3579846453","cluster_addr":"172.21.15.92:6803/3579846453","heartbeat_back_addr":"172.21.15.92:6807/3579846453","heartbeat_front_addr":"172.21.15.92:6805/3579846453","state":["exists","up"]},{"osd":4,"uuid":"d9d0ea80-8481-46a7-9677-c338d32cf1d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6809","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6811","nonce":3228383424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6813","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6815","nonce":3228383424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6821","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6823","nonce":3228383424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6817","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6819","nonce":3228383424}]},"public_addr":"172.21.15.188:6811/3228383424","cluster_addr":"172.21.15.188:6815/3228383424","heartbeat_back_addr":"172.21.15.188:6823/3228383424","heartbeat_front_addr":"172.21.15.188:6819/3228383424","state":["exists","up"]},{"osd":5,"uuid":"38d03253-467a-456f-bd5e-5a46532a0b18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6801","nonce":1655821054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6803","nonce":1655821054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6807","nonce":1655821054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6805","nonce":1655821054}]},"public_addr":"172.21.15.188:6801/1655821054","cluster_addr":"172.21.15.188:6803/1655821054","heartbeat_back_addr":"172.21.15.188:6807/1655821054","heartbeat_front_addr":"172.21.15.188:6805/1655821054","state":["exists","up"]},{"osd":6,"uuid":"d61564b5-136f-42e5-a843-626c2017cc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6810","nonce":2069976891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6814","nonce":2069976891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6822","nonce":2069976891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6818","nonce":2069976891}]},"public_addr":"172.21.15.188:6810/2069976891","cluster_addr":"172.21.15.188:6814/2069976891","heartbeat_back_addr":"172.21.15.188:6822/2069976891","heartbeat_front_addr":"172.21.15.188:6818/2069976891","state":["exists","up"]},{"osd":7,"uuid":"fae2949e-0d62-42cd-ba72-08f516084b20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6825","nonce":1882888860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6827","nonce":1882888860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6831","nonce":1882888860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6829","nonce":1882888860}]},"public_addr":"172.21.15.188:6825/1882888860","cluster_addr":"172.21.15.188:6827/1882888860","heartbeat_back_addr":"172.21.15.188:6831/1882888860","heartbeat_front_addr":"172.21.15.188:6829/1882888860","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.038523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.063160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.000857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.975572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.023848+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.765194+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.081365+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:05.110745+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-26T09:26:17.632 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.626+0000 7f1dd38ac700 1 -- 172.21.15.92:0/3656285330 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f1db006a0e0 msgr2=0x7f1db006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:17.632 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.626+0000 7f1dd38ac700 1 --2- 172.21.15.92:0/3656285330 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f1db006a0e0 0x7f1db006c5a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc0090b0 tx=0x7f1dbc008030 comp rx=0 tx=0).stop 2023-08-26T09:26:17.632 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.626+0000 7f1dd38ac700 1 -- 172.21.15.92:0/3656285330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1dcc15d6c0 msgr2=0x7f1dcc0c5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:17.632 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.626+0000 7f1dd38ac700 1 --2- 172.21.15.92:0/3656285330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1dcc15d6c0 0x7f1dcc0c5590 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f1dc400ccd0 tx=0x7f1dc400a340 comp rx=0 tx=0).stop 2023-08-26T09:26:17.632 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.626+0000 7f1dd38ac700 1 -- 172.21.15.92:0/3656285330 shutdown_connections 2023-08-26T09:26:17.633 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.626+0000 7f1dd38ac700 1 --2- 172.21.15.92:0/3656285330 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f1db006a0e0 0x7f1db006c5a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:17.633 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.626+0000 7f1dd38ac700 1 --2- 172.21.15.92:0/3656285330 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1dcc0ca620 0x7f1dcc06d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:17.633 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.626+0000 7f1dd38ac700 1 --2- 172.21.15.92:0/3656285330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1dcc15d6c0 0x7f1dcc0c5590 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:17.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.626+0000 7f1dd38ac700 1 --2- 172.21.15.92:0/3656285330 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1dcc0cef70 0x7f1dcc0c6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:17.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.626+0000 7f1dd38ac700 1 -- 172.21.15.92:0/3656285330 >> 172.21.15.92:0/3656285330 conn(0x7f1dcc0cc7b0 msgr2=0x7f1dcc159840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:17.635 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.626+0000 7f1dd38ac700 1 -- 172.21.15.92:0/3656285330 shutdown_connections 2023-08-26T09:26:17.635 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.626+0000 7f1dd38ac700 1 -- 172.21.15.92:0/3656285330 wait complete. 2023-08-26T09:26:17.643 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-26T09:25:06.650431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-26T09:25:06.973382+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-26T09:26:17.644 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-26T09:26:17.767 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.762+0000 7f5afdf15700 1 Processor -- start 2023-08-26T09:26:17.767 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.762+0000 7f5afdf15700 1 -- start start 2023-08-26T09:26:17.769 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.763+0000 7f5afdf15700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5af80c4c10 0x7f5af806a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:17.770 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.763+0000 7f5afdf15700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5af806a860 0x7f5af80ca3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:17.770 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.763+0000 7f5afdf15700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5af806b1a0 con 0x7f5af8144ae0 2023-08-26T09:26:17.770 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.763+0000 7f5afdf15700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5af806acf0 con 0x7f5af806a860 2023-08-26T09:26:17.770 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.763+0000 7f5afdf15700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af8144ec0 con 0x7f5af80c4c10 2023-08-26T09:26:17.771 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.763+0000 7f5af7fff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5af806a860 0x7f5af80ca3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:17.771 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.763+0000 7f5af7fff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5af806a860 0x7f5af80ca3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46836/0 (socket says 172.21.15.92:46836) 2023-08-26T09:26:17.771 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.763+0000 7f5af7fff700 1 -- 172.21.15.92:0/2519272036 learned_addr learned my addr 172.21.15.92:0/2519272036 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:17.771 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.764+0000 7f5af6ffd700 1 --2- 172.21.15.92:0/2519272036 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5af80c4c10 0x7f5af806a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:17.771 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.764+0000 7f5af7fff700 1 -- 172.21.15.92:0/2519272036 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5af80c4c10 msgr2=0x7f5af806a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:17.772 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.764+0000 7f5af7fff700 1 --2- 172.21.15.92:0/2519272036 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5af80c4c10 0x7f5af806a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:17.772 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.764+0000 7f5af7fff700 1 -- 172.21.15.92:0/2519272036 >> v1:172.21.15.188:6789/0 conn(0x7f5af8144ae0 legacy=0x7f5af80c6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:17.772 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.764+0000 7f5af7fff700 1 -- 172.21.15.92:0/2519272036 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af806ea00 con 0x7f5af806a860 2023-08-26T09:26:17.772 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.764+0000 7f5af7fff700 1 --2- 172.21.15.92:0/2519272036 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af806a860 0x7f5af80ca3a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f5af0009e50 tx=0x7f5af000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f82b3b25dbc9aa9 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:17.772 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.764+0000 7f5af67fc700 1 -- 172.21.15.92:0/2519272036 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af000e070 con 0x7f5af806a860 2023-08-26T09:26:17.772 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.764+0000 7f5af67fc700 1 -- 172.21.15.92:0/2519272036 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af0003a20 con 0x7f5af806a860 2023-08-26T09:26:17.773 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.764+0000 7f5af67fc700 1 -- 172.21.15.92:0/2519272036 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af0003dd0 con 0x7f5af806a860 2023-08-26T09:26:17.773 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.765+0000 7f5afdf15700 1 -- 172.21.15.92:0/2519272036 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af806a860 msgr2=0x7f5af80ca3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:17.773 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.765+0000 7f5afdf15700 1 --2- 172.21.15.92:0/2519272036 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af806a860 0x7f5af80ca3a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f5af0009e50 tx=0x7f5af000b330 comp rx=0 tx=0).stop 2023-08-26T09:26:17.773 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.765+0000 7f5afdf15700 1 -- 172.21.15.92:0/2519272036 shutdown_connections 2023-08-26T09:26:17.773 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.765+0000 7f5afdf15700 1 --2- 172.21.15.92:0/2519272036 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af806a860 0x7f5af80ca3a0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:17.774 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.765+0000 7f5afdf15700 1 --2- 172.21.15.92:0/2519272036 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5af80c4c10 0x7f5af806a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:17.774 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.765+0000 7f5afdf15700 1 -- 172.21.15.92:0/2519272036 >> 172.21.15.92:0/2519272036 conn(0x7f5af806b430 msgr2=0x7f5af806b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:17.774 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.765+0000 7f5afdf15700 1 -- 172.21.15.92:0/2519272036 shutdown_connections 2023-08-26T09:26:17.774 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.765+0000 7f5afdf15700 1 -- 172.21.15.92:0/2519272036 wait complete. 2023-08-26T09:26:17.777 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.766+0000 7f5afdf15700 1 Processor -- start 2023-08-26T09:26:17.778 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.766+0000 7f5afdf15700 1 -- start start 2023-08-26T09:26:17.778 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.767+0000 7f5afdf15700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5af806a860 0x7f5af80b4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:17.778 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.767+0000 7f5afdf15700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5af80c4c10 0x7f5af81327e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:17.778 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.767+0000 7f5afdf15700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af8144ae0 0x7f5af80b2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:17.778 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.767+0000 7f5afdf15700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af8132d20 con 0x7f5af8144ae0 2023-08-26T09:26:17.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.767+0000 7f5afdf15700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af80b5240 con 0x7f5af806a860 2023-08-26T09:26:17.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.767+0000 7f5afdf15700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af80b5520 con 0x7f5af80c4c10 2023-08-26T09:26:17.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.767+0000 7f5af7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af8144ae0 0x7f5af80b2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:17.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.767+0000 7f5af7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af8144ae0 0x7f5af80b2d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46846/0 (socket says 172.21.15.92:46846) 2023-08-26T09:26:17.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.767+0000 7f5af7fff700 1 -- 172.21.15.92:0/888789315 learned_addr learned my addr 172.21.15.92:0/888789315 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:17.784 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.767+0000 7f5af6ffd700 1 --2- 172.21.15.92:0/888789315 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5af80c4c10 0x7f5af81327e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:17.784 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.767+0000 7f5af77fe700 1 --2- 172.21.15.92:0/888789315 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5af806a860 0x7f5af80b4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:17.784 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.767+0000 7f5af7fff700 1 -- 172.21.15.92:0/888789315 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5af80c4c10 msgr2=0x7f5af81327e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:17.784 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.767+0000 7f5af7fff700 1 --2- 172.21.15.92:0/888789315 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5af80c4c10 0x7f5af81327e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:17.784 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.767+0000 7f5af7fff700 1 -- 172.21.15.92:0/888789315 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5af806a860 msgr2=0x7f5af80b4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:17.785 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.767+0000 7f5af7fff700 1 --2- 172.21.15.92:0/888789315 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5af806a860 0x7f5af80b4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:17.785 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.767+0000 7f5af7fff700 1 -- 172.21.15.92:0/888789315 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af0009b30 con 0x7f5af8144ae0 2023-08-26T09:26:17.785 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.767+0000 7f5af77fe700 1 --2- 172.21.15.92:0/888789315 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5af806a860 0x7f5af80b4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:26:17.785 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.767+0000 7f5af7fff700 1 --2- 172.21.15.92:0/888789315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af8144ae0 0x7f5af80b2d90 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f5af806f8d0 tx=0x7f5af0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:17.785 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.767+0000 7f5adffff700 1 -- 172.21.15.92:0/888789315 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af00094d0 con 0x7f5af8144ae0 2023-08-26T09:26:17.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.767+0000 7f5adffff700 1 -- 172.21.15.92:0/888789315 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af0004240 con 0x7f5af8144ae0 2023-08-26T09:26:17.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.768+0000 7f5afdf15700 1 -- 172.21.15.92:0/888789315 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5af80b5800 con 0x7f5af8144ae0 2023-08-26T09:26:17.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.768+0000 7f5adffff700 1 -- 172.21.15.92:0/888789315 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af00045f0 con 0x7f5af8144ae0 2023-08-26T09:26:17.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.768+0000 7f5afdf15700 1 -- 172.21.15.92:0/888789315 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5af80b5dc0 con 0x7f5af8144ae0 2023-08-26T09:26:17.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.768+0000 7f5afdf15700 1 -- 172.21.15.92:0/888789315 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5af80b5f50 con 0x7f5af8144ae0 2023-08-26T09:26:17.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.769+0000 7f5adffff700 1 -- 172.21.15.92:0/888789315 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5af0019070 con 0x7f5af8144ae0 2023-08-26T09:26:17.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.769+0000 7f5adffff700 1 --2- 172.21.15.92:0/888789315 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f5ae406a0e0 0x7f5ae406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:17.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.769+0000 7f5adffff700 1 -- 172.21.15.92:0/888789315 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5af0089100 con 0x7f5af8144ae0 2023-08-26T09:26:17.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.769+0000 7f5af77fe700 1 --2- 172.21.15.92:0/888789315 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f5ae406a0e0 0x7f5ae406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:17.788 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.770+0000 7f5af77fe700 1 --2- 172.21.15.92:0/888789315 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f5ae406a0e0 0x7f5ae406c5a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5aec006fd0 tx=0x7f5aec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:17.788 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.774+0000 7f5adffff700 1 -- 172.21.15.92:0/888789315 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5af0058660 con 0x7f5af8144ae0 2023-08-26T09:26:17.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.963+0000 7f5afdf15700 1 -- 172.21.15.92:0/888789315 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5af804eeb0 con 0x7f5af8144ae0 2023-08-26T09:26:17.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.963+0000 7f5adffff700 1 -- 172.21.15.92:0/888789315 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5af00581f0 con 0x7f5af8144ae0 2023-08-26T09:26:17.969 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 8 2023-08-26T09:26:17.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.965+0000 7f5afdf15700 1 -- 172.21.15.92:0/888789315 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f5ae406a0e0 msgr2=0x7f5ae406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:17.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.965+0000 7f5afdf15700 1 --2- 172.21.15.92:0/888789315 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f5ae406a0e0 0x7f5ae406c5a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5aec006fd0 tx=0x7f5aec008040 comp rx=0 tx=0).stop 2023-08-26T09:26:17.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.965+0000 7f5afdf15700 1 -- 172.21.15.92:0/888789315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af8144ae0 msgr2=0x7f5af80b2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:17.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.965+0000 7f5afdf15700 1 --2- 172.21.15.92:0/888789315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af8144ae0 0x7f5af80b2d90 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f5af806f8d0 tx=0x7f5af0004ad0 comp rx=0 tx=0).stop 2023-08-26T09:26:17.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.965+0000 7f5afdf15700 1 -- 172.21.15.92:0/888789315 shutdown_connections 2023-08-26T09:26:17.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.965+0000 7f5afdf15700 1 --2- 172.21.15.92:0/888789315 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f5ae406a0e0 0x7f5ae406c5a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:17.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.965+0000 7f5afdf15700 1 --2- 172.21.15.92:0/888789315 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5af806a860 0x7f5af80b4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:17.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.965+0000 7f5afdf15700 1 --2- 172.21.15.92:0/888789315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af8144ae0 0x7f5af80b2d90 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:17.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.965+0000 7f5afdf15700 1 --2- 172.21.15.92:0/888789315 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5af80c4c10 0x7f5af81327e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:17.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.965+0000 7f5afdf15700 1 -- 172.21.15.92:0/888789315 >> 172.21.15.92:0/888789315 conn(0x7f5af806b430 msgr2=0x7f5af8142240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:17.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.965+0000 7f5afdf15700 1 -- 172.21.15.92:0/888789315 shutdown_connections 2023-08-26T09:26:17.973 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:17.965+0000 7f5afdf15700 1 -- 172.21.15.92:0/888789315 wait complete. 2023-08-26T09:26:17.982 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-26T09:26:18.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.100+0000 7f2474b9e700 1 Processor -- start 2023-08-26T09:26:18.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.100+0000 7f2474b9e700 1 -- start start 2023-08-26T09:26:18.107 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.101+0000 7f2474b9e700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f2470159dd0 0x7f24700cf220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:18.107 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.101+0000 7f2474b9e700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2470071430 0x7f247006e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:18.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.101+0000 7f2474b9e700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24700c6200 con 0x7f247006e110 2023-08-26T09:26:18.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.101+0000 7f2474b9e700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f247006eae0 con 0x7f2470159dd0 2023-08-26T09:26:18.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.101+0000 7f2474b9e700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24700ce740 con 0x7f2470071430 2023-08-26T09:26:18.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.102+0000 7f246e59c700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f2470159dd0 0x7f24700cf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:18.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.102+0000 7f246ed9d700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2470071430 0x7f247006e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:18.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.102+0000 7f246ed9d700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2470071430 0x7f247006e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.92:45518/0 (socket says 172.21.15.92:45518) 2023-08-26T09:26:18.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.102+0000 7f246e59c700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f2470159dd0 0x7f24700cf220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.92:35658/0 (socket says 172.21.15.92:35658) 2023-08-26T09:26:18.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.102+0000 7f246ed9d700 1 -- 172.21.15.92:0/2698480561 learned_addr learned my addr 172.21.15.92:0/2698480561 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:18.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.102+0000 7f246e59c700 1 -- 172.21.15.92:0/2698480561 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2470071430 msgr2=0x7f247006e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:18.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.102+0000 7f246e59c700 1 --2- 172.21.15.92:0/2698480561 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2470071430 0x7f247006e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:18.110 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.102+0000 7f246e59c700 1 -- 172.21.15.92:0/2698480561 >> v1:172.21.15.188:6789/0 conn(0x7f247006e110 legacy=0x7f2470070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:18.110 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.102+0000 7f246e59c700 1 -- 172.21.15.92:0/2698480561 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24700cea20 con 0x7f2470159dd0 2023-08-26T09:26:18.110 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.102+0000 7f246d59a700 1 -- 172.21.15.92:0/2698480561 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1306159987 0 0) 0x7f24700c6200 con 0x7f247006e110 2023-08-26T09:26:18.110 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.102+0000 7f246ed9d700 1 --2- 172.21.15.92:0/2698480561 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2470071430 0x7f247006e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-26T09:26:18.110 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.102+0000 7f246e59c700 1 --2- 172.21.15.92:0/2698480561 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2470159dd0 0x7f24700cf220 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2464009840 tx=0x7f2464009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4ae5ec974eb4945 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:18.110 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.103+0000 7f246d59a700 1 -- 172.21.15.92:0/2698480561 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2464011830 con 0x7f2470159dd0 2023-08-26T09:26:18.111 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.103+0000 7f246d59a700 1 -- 172.21.15.92:0/2698480561 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2464011990 con 0x7f2470159dd0 2023-08-26T09:26:18.111 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.103+0000 7f246d59a700 1 -- 172.21.15.92:0/2698480561 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2464011d20 con 0x7f2470159dd0 2023-08-26T09:26:18.114 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.103+0000 7f2474b9e700 1 -- 172.21.15.92:0/2698480561 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2470159dd0 msgr2=0x7f24700cf220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:18.114 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.103+0000 7f2474b9e700 1 --2- 172.21.15.92:0/2698480561 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2470159dd0 0x7f24700cf220 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2464009840 tx=0x7f2464009b50 comp rx=0 tx=0).stop 2023-08-26T09:26:18.114 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.103+0000 7f2474b9e700 1 -- 172.21.15.92:0/2698480561 shutdown_connections 2023-08-26T09:26:18.115 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.103+0000 7f2474b9e700 1 --2- 172.21.15.92:0/2698480561 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2470071430 0x7f247006e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:18.115 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.103+0000 7f2474b9e700 1 --2- 172.21.15.92:0/2698480561 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2470159dd0 0x7f24700cf220 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:18.115 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.103+0000 7f2474b9e700 1 -- 172.21.15.92:0/2698480561 >> 172.21.15.92:0/2698480561 conn(0x7f247006b430 msgr2=0x7f247006b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:18.115 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.103+0000 7f2474b9e700 1 -- 172.21.15.92:0/2698480561 shutdown_connections 2023-08-26T09:26:18.115 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.103+0000 7f2474b9e700 1 -- 172.21.15.92:0/2698480561 wait complete. 2023-08-26T09:26:18.116 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.104+0000 7f2474b9e700 1 Processor -- start 2023-08-26T09:26:18.116 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.105+0000 7f2474b9e700 1 -- start start 2023-08-26T09:26:18.116 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.105+0000 7f2474b9e700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f247006e110 0x7f2470151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:18.116 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.105+0000 7f2474b9e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2470071430 0x7f24700c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:18.116 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.105+0000 7f2474b9e700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2470159dd0 0x7f24700c92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:18.117 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.105+0000 7f2474b9e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24701f3900 con 0x7f2470071430 2023-08-26T09:26:18.117 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.105+0000 7f2474b9e700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24701ef810 con 0x7f247006e110 2023-08-26T09:26:18.117 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.105+0000 7f2474b9e700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24701efaf0 con 0x7f2470159dd0 2023-08-26T09:26:18.117 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.105+0000 7f246dd9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2470071430 0x7f24700c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:18.117 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.105+0000 7f246dd9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2470071430 0x7f24700c8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46858/0 (socket says 172.21.15.92:46858) 2023-08-26T09:26:18.117 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.105+0000 7f246dd9b700 1 -- 172.21.15.92:0/3656954256 learned_addr learned my addr 172.21.15.92:0/3656954256 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:18.118 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.106+0000 7f246e59c700 1 --2- 172.21.15.92:0/3656954256 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f247006e110 0x7f2470151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:18.118 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.106+0000 7f246ed9d700 1 --2- 172.21.15.92:0/3656954256 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2470159dd0 0x7f24700c92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:18.118 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.106+0000 7f246dd9b700 1 -- 172.21.15.92:0/3656954256 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2470159dd0 msgr2=0x7f24700c92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:18.118 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.106+0000 7f246dd9b700 1 --2- 172.21.15.92:0/3656954256 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2470159dd0 0x7f24700c92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:18.118 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.106+0000 7f246dd9b700 1 -- 172.21.15.92:0/3656954256 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f247006e110 msgr2=0x7f2470151c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:18.119 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.106+0000 7f246dd9b700 1 --2- 172.21.15.92:0/3656954256 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f247006e110 0x7f2470151c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:18.119 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.106+0000 7f246dd9b700 1 -- 172.21.15.92:0/3656954256 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2468009b30 con 0x7f2470071430 2023-08-26T09:26:18.119 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.106+0000 7f246ed9d700 1 --2- 172.21.15.92:0/3656954256 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2470159dd0 0x7f24700c92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:26:18.119 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.106+0000 7f246dd9b700 1 --2- 172.21.15.92:0/3656954256 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2470071430 0x7f24700c8da0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f246000c550 tx=0x7f246000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:18.119 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.106+0000 7f245effd700 1 -- 172.21.15.92:0/3656954256 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24600054e0 con 0x7f2470071430 2023-08-26T09:26:18.120 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.106+0000 7f245effd700 1 -- 172.21.15.92:0/3656954256 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2460003680 con 0x7f2470071430 2023-08-26T09:26:18.120 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.106+0000 7f2474b9e700 1 -- 172.21.15.92:0/3656954256 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24640094a0 con 0x7f2470071430 2023-08-26T09:26:18.120 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.106+0000 7f245effd700 1 -- 172.21.15.92:0/3656954256 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2460003a30 con 0x7f2470071430 2023-08-26T09:26:18.120 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.106+0000 7f2474b9e700 1 -- 172.21.15.92:0/3656954256 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24701ef4c0 con 0x7f2470071430 2023-08-26T09:26:18.120 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.107+0000 7f2474b9e700 1 -- 172.21.15.92:0/3656954256 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24701f0010 con 0x7f2470071430 2023-08-26T09:26:18.121 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.108+0000 7f245effd700 1 -- 172.21.15.92:0/3656954256 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2460003b90 con 0x7f2470071430 2023-08-26T09:26:18.121 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.108+0000 7f245effd700 1 --2- 172.21.15.92:0/3656954256 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f245006a0e0 0x7f245006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:18.121 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.108+0000 7f245effd700 1 -- 172.21.15.92:0/3656954256 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2460087620 con 0x7f2470071430 2023-08-26T09:26:18.121 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.108+0000 7f246e59c700 1 --2- 172.21.15.92:0/3656954256 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f245006a0e0 0x7f245006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:18.121 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.109+0000 7f246e59c700 1 --2- 172.21.15.92:0/3656954256 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f245006a0e0 0x7f245006c5a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f24640090b0 tx=0x7f2464008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:18.122 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.112+0000 7f245effd700 1 -- 172.21.15.92:0/3656954256 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f24701f0010 con 0x7f2470071430 2023-08-26T09:26:18.306 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.301+0000 7f2474b9e700 1 -- 172.21.15.92:0/3656954256 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f24701f0010 con 0x7f2470071430 2023-08-26T09:26:18.306 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.302+0000 7f245effd700 1 -- 172.21.15.92:0/3656954256 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f24701f0010 con 0x7f2470071430 2023-08-26T09:26:18.307 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 1 2023-08-26T09:26:18.309 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.303+0000 7f2474b9e700 1 -- 172.21.15.92:0/3656954256 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f245006a0e0 msgr2=0x7f245006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:18.309 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.303+0000 7f2474b9e700 1 --2- 172.21.15.92:0/3656954256 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f245006a0e0 0x7f245006c5a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f24640090b0 tx=0x7f2464008030 comp rx=0 tx=0).stop 2023-08-26T09:26:18.309 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.303+0000 7f2474b9e700 1 -- 172.21.15.92:0/3656954256 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2470071430 msgr2=0x7f24700c8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:18.310 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.303+0000 7f2474b9e700 1 --2- 172.21.15.92:0/3656954256 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2470071430 0x7f24700c8da0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f246000c550 tx=0x7f246000c860 comp rx=0 tx=0).stop 2023-08-26T09:26:18.310 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.304+0000 7f2474b9e700 1 -- 172.21.15.92:0/3656954256 shutdown_connections 2023-08-26T09:26:18.310 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.304+0000 7f2474b9e700 1 --2- 172.21.15.92:0/3656954256 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f245006a0e0 0x7f245006c5a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:18.310 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.304+0000 7f2474b9e700 1 --2- 172.21.15.92:0/3656954256 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f247006e110 0x7f2470151c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:18.310 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.304+0000 7f2474b9e700 1 --2- 172.21.15.92:0/3656954256 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2470159dd0 0x7f24700c92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:18.311 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.304+0000 7f2474b9e700 1 --2- 172.21.15.92:0/3656954256 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2470071430 0x7f24700c8da0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:18.311 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.304+0000 7f2474b9e700 1 -- 172.21.15.92:0/3656954256 >> 172.21.15.92:0/3656954256 conn(0x7f247006b430 msgr2=0x7f247015a600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:18.311 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.304+0000 7f2474b9e700 1 -- 172.21.15.92:0/3656954256 shutdown_connections 2023-08-26T09:26:18.311 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.304+0000 7f2474b9e700 1 -- 172.21.15.92:0/3656954256 wait complete. 2023-08-26T09:26:18.321 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-26T09:26:18.441 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.436+0000 7fecd6c87700 1 Processor -- start 2023-08-26T09:26:18.441 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.436+0000 7fecd6c87700 1 -- start start 2023-08-26T09:26:18.444 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.437+0000 7fecd6c87700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fecd00cf420 0x7fecd00ae810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:18.444 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.437+0000 7fecd6c87700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fecd00cf8d0 0x7fecd00aed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:18.444 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.437+0000 7fecd6c87700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecd00ada50 con 0x7fecd00cd7f0 2023-08-26T09:26:18.444 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.437+0000 7fecd6c87700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecd00add30 con 0x7fecd00cf420 2023-08-26T09:26:18.444 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.437+0000 7fecd6c87700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd00ae010 con 0x7fecd00cf8d0 2023-08-26T09:26:18.445 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.437+0000 7feccffff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fecd00cf420 0x7fecd00ae810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:18.445 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.437+0000 7fecd4a23700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fecd00cd7f0 0x7fecd00cdbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:58878/0 (socket says 172.21.15.92:58878) 2023-08-26T09:26:18.445 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.437+0000 7feccffff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fecd00cf420 0x7fecd00ae810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46866/0 (socket says 172.21.15.92:46866) 2023-08-26T09:26:18.445 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.437+0000 7fecd4a23700 1 -- 172.21.15.92:0/1037539252 learned_addr learned my addr 172.21.15.92:0/1037539252 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:26:18.445 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.437+0000 7fecd5224700 1 --2- 172.21.15.92:0/1037539252 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fecd00cf8d0 0x7fecd00aed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:18.446 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.437+0000 7feccffff700 1 -- 172.21.15.92:0/1037539252 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fecd00cf8d0 msgr2=0x7fecd00aed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:18.446 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.437+0000 7feccffff700 1 --2- 172.21.15.92:0/1037539252 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fecd00cf8d0 0x7fecd00aed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:18.446 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.438+0000 7feccffff700 1 -- 172.21.15.92:0/1037539252 >> v1:172.21.15.92:6789/0 conn(0x7fecd00cd7f0 legacy=0x7fecd00cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:18.446 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.438+0000 7feccf7fe700 1 -- 172.21.15.92:0/1037539252 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3550288609 0 0) 0x7fecd00ada50 con 0x7fecd00cd7f0 2023-08-26T09:26:18.446 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.438+0000 7feccffff700 1 -- 172.21.15.92:0/1037539252 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd00ae2f0 con 0x7fecd00cf420 2023-08-26T09:26:18.447 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.438+0000 7feccffff700 1 --2- 172.21.15.92:0/1037539252 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fecd00cf420 0x7fecd00ae810 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fecbc009840 tx=0x7fecbc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c79a9e37d1ab7fc6 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:18.447 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.438+0000 7feccf7fe700 1 -- 172.21.15.92:0/1037539252 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecbc011830 con 0x7fecd00cf420 2023-08-26T09:26:18.447 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.438+0000 7feccf7fe700 1 -- 172.21.15.92:0/1037539252 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecbc011990 con 0x7fecd00cf420 2023-08-26T09:26:18.447 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.438+0000 7feccf7fe700 1 -- 172.21.15.92:0/1037539252 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecbc011d20 con 0x7fecd00cf420 2023-08-26T09:26:18.447 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.438+0000 7fecd6c87700 1 -- 172.21.15.92:0/1037539252 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fecd00cf420 msgr2=0x7fecd00ae810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:18.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.438+0000 7fecd6c87700 1 --2- 172.21.15.92:0/1037539252 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fecd00cf420 0x7fecd00ae810 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fecbc009840 tx=0x7fecbc009b50 comp rx=0 tx=0).stop 2023-08-26T09:26:18.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.438+0000 7fecd6c87700 1 -- 172.21.15.92:0/1037539252 shutdown_connections 2023-08-26T09:26:18.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.438+0000 7fecd6c87700 1 --2- 172.21.15.92:0/1037539252 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fecd00cf8d0 0x7fecd00aed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:18.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.438+0000 7fecd6c87700 1 --2- 172.21.15.92:0/1037539252 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fecd00cf420 0x7fecd00ae810 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:18.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.438+0000 7fecd6c87700 1 -- 172.21.15.92:0/1037539252 >> 172.21.15.92:0/1037539252 conn(0x7fecd009a150 msgr2=0x7fecd00d0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:18.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.438+0000 7fecd6c87700 1 -- 172.21.15.92:0/1037539252 shutdown_connections 2023-08-26T09:26:18.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.438+0000 7fecd6c87700 1 -- 172.21.15.92:0/1037539252 wait complete. 2023-08-26T09:26:18.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.440+0000 7fecd6c87700 1 Processor -- start 2023-08-26T09:26:18.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.440+0000 7fecd6c87700 1 -- start start 2023-08-26T09:26:18.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.441+0000 7fecd6c87700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fecd00cd7f0 0x7fecd0148a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:18.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.441+0000 7fecd6c87700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fecd00cf420 0x7fecd015d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:18.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.441+0000 7fecd6c87700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fecd00cf8d0 0x7fecd015d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:18.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.441+0000 7fecd6c87700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd00c48c0 con 0x7fecd00cf8d0 2023-08-26T09:26:18.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.441+0000 7fecd6c87700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd0148f90 con 0x7fecd00cd7f0 2023-08-26T09:26:18.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.441+0000 7fecd6c87700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd00b5e70 con 0x7fecd00cf420 2023-08-26T09:26:18.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.441+0000 7fecd5224700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fecd00cf8d0 0x7fecd015d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:18.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.441+0000 7fecd5224700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fecd00cf8d0 0x7fecd015d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46874/0 (socket says 172.21.15.92:46874) 2023-08-26T09:26:18.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.441+0000 7fecd5224700 1 -- 172.21.15.92:0/566553096 learned_addr learned my addr 172.21.15.92:0/566553096 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:18.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.441+0000 7fecd4a23700 1 --2- 172.21.15.92:0/566553096 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fecd00cd7f0 0x7fecd0148a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:18.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.441+0000 7feccffff700 1 --2- 172.21.15.92:0/566553096 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fecd00cf420 0x7fecd015d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:18.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.442+0000 7fecd5224700 1 -- 172.21.15.92:0/566553096 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fecd00cf420 msgr2=0x7fecd015d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:18.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.442+0000 7fecd5224700 1 --2- 172.21.15.92:0/566553096 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fecd00cf420 0x7fecd015d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:18.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.442+0000 7fecd5224700 1 -- 172.21.15.92:0/566553096 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fecd00cd7f0 msgr2=0x7fecd0148a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:18.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.442+0000 7fecd5224700 1 --2- 172.21.15.92:0/566553096 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fecd00cd7f0 0x7fecd0148a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:18.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.442+0000 7fecd5224700 1 -- 172.21.15.92:0/566553096 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecbc0094a0 con 0x7fecd00cf8d0 2023-08-26T09:26:18.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.442+0000 7fecd5224700 1 --2- 172.21.15.92:0/566553096 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fecd00cf8d0 0x7fecd015d660 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fecc800cda0 tx=0x7fecc800a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:18.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.442+0000 7feccd7fa700 1 -- 172.21.15.92:0/566553096 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc8003a20 con 0x7fecd00cf8d0 2023-08-26T09:26:18.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.442+0000 7feccd7fa700 1 -- 172.21.15.92:0/566553096 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc8003b80 con 0x7fecd00cf8d0 2023-08-26T09:26:18.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.442+0000 7fecd6c87700 1 -- 172.21.15.92:0/566553096 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecd00b6150 con 0x7fecd00cf8d0 2023-08-26T09:26:18.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.442+0000 7feccd7fa700 1 -- 172.21.15.92:0/566553096 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc8004020 con 0x7fecd00cf8d0 2023-08-26T09:26:18.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.442+0000 7fecd6c87700 1 -- 172.21.15.92:0/566553096 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecd00b6710 con 0x7fecd00cf8d0 2023-08-26T09:26:18.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.443+0000 7fecd6c87700 1 -- 172.21.15.92:0/566553096 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecd00c4a30 con 0x7fecd00cf8d0 2023-08-26T09:26:18.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.443+0000 7feccd7fa700 1 -- 172.21.15.92:0/566553096 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fecc8004180 con 0x7fecd00cf8d0 2023-08-26T09:26:18.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.444+0000 7feccd7fa700 1 --2- 172.21.15.92:0/566553096 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fecb406a0e0 0x7fecb406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:18.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.444+0000 7feccd7fa700 1 -- 172.21.15.92:0/566553096 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fecc8012070 con 0x7fecd00cf8d0 2023-08-26T09:26:18.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.444+0000 7fecd4a23700 1 --2- 172.21.15.92:0/566553096 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fecb406a0e0 0x7fecb406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:18.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.444+0000 7fecd4a23700 1 --2- 172.21.15.92:0/566553096 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fecb406a0e0 0x7fecb406c5a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fecc4007fd0 tx=0x7fecc4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:18.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.448+0000 7feccd7fa700 1 -- 172.21.15.92:0/566553096 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fecc8054310 con 0x7fecd00cf8d0 2023-08-26T09:26:18.645 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.640+0000 7fecd6c87700 1 -- 172.21.15.92:0/566553096 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fecd004e660 con 0x7fecd00cf8d0 2023-08-26T09:26:18.645 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.641+0000 7feccd7fa700 1 -- 172.21.15.92:0/566553096 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v29) v1 ==== 84+0+126 (secure 0 0 0) 0x7fecc8057930 con 0x7fecd00cf8d0 2023-08-26T09:26:18.646 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:26:18.646 INFO:teuthology.orchestra.run.smithi092.stdout:[ 2023-08-26T09:26:18.646 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-08-26T09:26:18.646 INFO:teuthology.orchestra.run.smithi092.stdout: "poolnum": 1, 2023-08-26T09:26:18.646 INFO:teuthology.orchestra.run.smithi092.stdout: "poolname": "rbd" 2023-08-26T09:26:18.646 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-08-26T09:26:18.647 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-08-26T09:26:18.647 INFO:teuthology.orchestra.run.smithi092.stdout: "poolnum": 2, 2023-08-26T09:26:18.647 INFO:teuthology.orchestra.run.smithi092.stdout: "poolname": ".mgr" 2023-08-26T09:26:18.647 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-08-26T09:26:18.648 INFO:teuthology.orchestra.run.smithi092.stdout:] 2023-08-26T09:26:18.648 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.642+0000 7fecd6c87700 1 -- 172.21.15.92:0/566553096 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fecb406a0e0 msgr2=0x7fecb406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:18.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.643+0000 7fecd6c87700 1 --2- 172.21.15.92:0/566553096 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fecb406a0e0 0x7fecb406c5a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fecc4007fd0 tx=0x7fecc4009040 comp rx=0 tx=0).stop 2023-08-26T09:26:18.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.643+0000 7fecd6c87700 1 -- 172.21.15.92:0/566553096 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fecd00cf8d0 msgr2=0x7fecd015d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:18.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.643+0000 7fecd6c87700 1 --2- 172.21.15.92:0/566553096 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fecd00cf8d0 0x7fecd015d660 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fecc800cda0 tx=0x7fecc800a570 comp rx=0 tx=0).stop 2023-08-26T09:26:18.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.643+0000 7fecd6c87700 1 -- 172.21.15.92:0/566553096 shutdown_connections 2023-08-26T09:26:18.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.643+0000 7fecd6c87700 1 --2- 172.21.15.92:0/566553096 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fecb406a0e0 0x7fecb406c5a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:18.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.643+0000 7fecd6c87700 1 --2- 172.21.15.92:0/566553096 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fecd00cd7f0 0x7fecd0148a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:18.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.643+0000 7fecd6c87700 1 --2- 172.21.15.92:0/566553096 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fecd00cf8d0 0x7fecd015d660 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:18.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.643+0000 7fecd6c87700 1 --2- 172.21.15.92:0/566553096 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fecd00cf420 0x7fecd015d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:18.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.643+0000 7fecd6c87700 1 -- 172.21.15.92:0/566553096 >> 172.21.15.92:0/566553096 conn(0x7fecd009a150 msgr2=0x7fecd00cba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:18.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.643+0000 7fecd6c87700 1 -- 172.21.15.92:0/566553096 shutdown_connections 2023-08-26T09:26:18.651 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.643+0000 7fecd6c87700 1 -- 172.21.15.92:0/566553096 wait complete. 2023-08-26T09:26:18.659 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-26T09:26:18.660 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-26T09:26:18.784 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.779+0000 7ff49a24b700 1 Processor -- start 2023-08-26T09:26:18.785 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.779+0000 7ff49a24b700 1 -- start start 2023-08-26T09:26:18.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.780+0000 7ff49a24b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff494070e60 0x7ff4940712e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:18.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.780+0000 7ff49a24b700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff49415a290 con 0x7ff49406c8c0 2023-08-26T09:26:18.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.780+0000 7ff49a24b700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4940cb610 con 0x7ff494159eb0 2023-08-26T09:26:18.788 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.780+0000 7ff49a24b700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff494071820 con 0x7ff494070e60 2023-08-26T09:26:18.788 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.780+0000 7ff492ffd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff494070e60 0x7ff4940712e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:18.788 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.780+0000 7ff493fff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7ff49406c8c0 0x7ff49406ccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:58896/0 (socket says 172.21.15.92:58896) 2023-08-26T09:26:18.788 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.780+0000 7ff492ffd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff494070e60 0x7ff4940712e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46880/0 (socket says 172.21.15.92:46880) 2023-08-26T09:26:18.788 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.780+0000 7ff493fff700 1 -- 172.21.15.92:0/3848942499 learned_addr learned my addr 172.21.15.92:0/3848942499 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:26:18.788 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.781+0000 7ff492ffd700 1 -- 172.21.15.92:0/3848942499 >> v1:172.21.15.188:6789/0 conn(0x7ff494159eb0 legacy=0x7ff4940caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:18.789 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.781+0000 7ff492ffd700 1 -- 172.21.15.92:0/3848942499 >> v1:172.21.15.92:6789/0 conn(0x7ff49406c8c0 legacy=0x7ff49406ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:18.789 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.781+0000 7ff492ffd700 1 -- 172.21.15.92:0/3848942499 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4940cb8f0 con 0x7ff494070e60 2023-08-26T09:26:18.789 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.781+0000 7ff4927fc700 1 -- 172.21.15.92:0/3848942499 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1562049970 0 0) 0x7ff49415a290 con 0x7ff49406c8c0 2023-08-26T09:26:18.789 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.781+0000 7ff492ffd700 1 --2- 172.21.15.92:0/3848942499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff494070e60 0x7ff4940712e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff484009840 tx=0x7ff484009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d6ee228bfc8bab2 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:18.789 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.781+0000 7ff4927fc700 1 -- 172.21.15.92:0/3848942499 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff484011830 con 0x7ff494070e60 2023-08-26T09:26:18.790 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.781+0000 7ff4927fc700 1 -- 172.21.15.92:0/3848942499 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff484011990 con 0x7ff494070e60 2023-08-26T09:26:18.790 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.781+0000 7ff4927fc700 1 -- 172.21.15.92:0/3848942499 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff484011d20 con 0x7ff494070e60 2023-08-26T09:26:18.790 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.782+0000 7ff49a24b700 1 -- 172.21.15.92:0/3848942499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff494070e60 msgr2=0x7ff4940712e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:18.790 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.782+0000 7ff49a24b700 1 --2- 172.21.15.92:0/3848942499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff494070e60 0x7ff4940712e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff484009840 tx=0x7ff484009b50 comp rx=0 tx=0).stop 2023-08-26T09:26:18.790 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.782+0000 7ff49a24b700 1 -- 172.21.15.92:0/3848942499 shutdown_connections 2023-08-26T09:26:18.791 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.782+0000 7ff49a24b700 1 --2- 172.21.15.92:0/3848942499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff494070e60 0x7ff4940712e0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:18.791 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.782+0000 7ff49a24b700 1 -- 172.21.15.92:0/3848942499 >> 172.21.15.92:0/3848942499 conn(0x7ff4940cfca0 msgr2=0x7ff4940d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:18.791 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.782+0000 7ff49a24b700 1 -- 172.21.15.92:0/3848942499 shutdown_connections 2023-08-26T09:26:18.791 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.782+0000 7ff49a24b700 1 -- 172.21.15.92:0/3848942499 wait complete. 2023-08-26T09:26:18.794 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.783+0000 7ff49a24b700 1 Processor -- start 2023-08-26T09:26:18.794 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.783+0000 7ff49a24b700 1 -- start start 2023-08-26T09:26:18.794 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.784+0000 7ff49a24b700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff49406c8c0 0x7ff49414fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:18.795 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.784+0000 7ff49a24b700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff494070e60 0x7ff4940a8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:18.795 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.784+0000 7ff49a24b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff494159eb0 0x7ff4941491b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:18.795 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.784+0000 7ff49a24b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49414cfa0 con 0x7ff494159eb0 2023-08-26T09:26:18.795 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.784+0000 7ff49a24b700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49414d240 con 0x7ff49406c8c0 2023-08-26T09:26:18.796 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.784+0000 7ff49a24b700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4940a9730 con 0x7ff494070e60 2023-08-26T09:26:18.796 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.784+0000 7ff493fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff494159eb0 0x7ff4941491b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:18.796 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.784+0000 7ff493fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff494159eb0 0x7ff4941491b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46888/0 (socket says 172.21.15.92:46888) 2023-08-26T09:26:18.796 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.784+0000 7ff493fff700 1 -- 172.21.15.92:0/2195176643 learned_addr learned my addr 172.21.15.92:0/2195176643 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:18.796 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.784+0000 7ff492ffd700 1 --2- 172.21.15.92:0/2195176643 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff494070e60 0x7ff4940a8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:18.797 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.784+0000 7ff4937fe700 1 --2- 172.21.15.92:0/2195176643 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff49406c8c0 0x7ff49414fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:18.797 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.784+0000 7ff493fff700 1 -- 172.21.15.92:0/2195176643 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff494070e60 msgr2=0x7ff4940a8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:18.797 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.784+0000 7ff493fff700 1 --2- 172.21.15.92:0/2195176643 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff494070e60 0x7ff4940a8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:18.797 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.784+0000 7ff493fff700 1 -- 172.21.15.92:0/2195176643 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff49406c8c0 msgr2=0x7ff49414fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:18.797 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.784+0000 7ff493fff700 1 --2- 172.21.15.92:0/2195176643 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff49406c8c0 0x7ff49414fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:18.798 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.784+0000 7ff493fff700 1 -- 172.21.15.92:0/2195176643 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4840094a0 con 0x7ff494159eb0 2023-08-26T09:26:18.798 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.784+0000 7ff493fff700 1 --2- 172.21.15.92:0/2195176643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff494159eb0 0x7ff4941491b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff48c00cba0 tx=0x7ff48c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:18.798 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.784+0000 7ff47bfff700 1 -- 172.21.15.92:0/2195176643 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48c00ab80 con 0x7ff494159eb0 2023-08-26T09:26:18.798 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.784+0000 7ff47bfff700 1 -- 172.21.15.92:0/2195176643 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff48c00ad00 con 0x7ff494159eb0 2023-08-26T09:26:18.798 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.784+0000 7ff49a24b700 1 -- 172.21.15.92:0/2195176643 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4940a9a10 con 0x7ff494159eb0 2023-08-26T09:26:18.799 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.785+0000 7ff47bfff700 1 -- 172.21.15.92:0/2195176643 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48c007310 con 0x7ff494159eb0 2023-08-26T09:26:18.799 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.785+0000 7ff49a24b700 1 -- 172.21.15.92:0/2195176643 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4940a9420 con 0x7ff494159eb0 2023-08-26T09:26:18.799 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.785+0000 7ff49a24b700 1 -- 172.21.15.92:0/2195176643 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff49414d3b0 con 0x7ff494159eb0 2023-08-26T09:26:18.799 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.786+0000 7ff47bfff700 1 -- 172.21.15.92:0/2195176643 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff48c007470 con 0x7ff494159eb0 2023-08-26T09:26:18.799 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.786+0000 7ff47bfff700 1 --2- 172.21.15.92:0/2195176643 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7ff48006a0e0 0x7ff48006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:18.800 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.786+0000 7ff47bfff700 1 -- 172.21.15.92:0/2195176643 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff48c088060 con 0x7ff494159eb0 2023-08-26T09:26:18.800 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.786+0000 7ff4937fe700 1 --2- 172.21.15.92:0/2195176643 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7ff48006a0e0 0x7ff48006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:18.800 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.787+0000 7ff4937fe700 1 --2- 172.21.15.92:0/2195176643 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7ff48006a0e0 0x7ff48006c5a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff488000f60 tx=0x7ff488009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:18.800 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.791+0000 7ff47bfff700 1 -- 172.21.15.92:0/2195176643 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff48c0ba990 con 0x7ff494159eb0 2023-08-26T09:26:18.886 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:26:18.890 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:26:18.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:18.984+0000 7ff49a24b700 1 -- 172.21.15.92:0/2195176643 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff49404e660 con 0x7ff494159eb0 2023-08-26T09:26:19.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.332+0000 7ff47bfff700 1 -- 172.21.15.92:0/2195176643 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v30) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff48c0180b0 con 0x7ff494159eb0 2023-08-26T09:26:19.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.334+0000 7ff49a24b700 1 -- 172.21.15.92:0/2195176643 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7ff48006a0e0 msgr2=0x7ff48006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:19.340 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.334+0000 7ff49a24b700 1 --2- 172.21.15.92:0/2195176643 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7ff48006a0e0 0x7ff48006c5a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff488000f60 tx=0x7ff488009040 comp rx=0 tx=0).stop 2023-08-26T09:26:19.340 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.334+0000 7ff49a24b700 1 -- 172.21.15.92:0/2195176643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff494159eb0 msgr2=0x7ff4941491b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:19.340 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.334+0000 7ff49a24b700 1 --2- 172.21.15.92:0/2195176643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff494159eb0 0x7ff4941491b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff48c00cba0 tx=0x7ff48c00cf60 comp rx=0 tx=0).stop 2023-08-26T09:26:19.340 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.335+0000 7ff49a24b700 1 -- 172.21.15.92:0/2195176643 shutdown_connections 2023-08-26T09:26:19.340 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.335+0000 7ff49a24b700 1 --2- 172.21.15.92:0/2195176643 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7ff48006a0e0 0x7ff48006c5a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:19.341 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.335+0000 7ff49a24b700 1 --2- 172.21.15.92:0/2195176643 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff49406c8c0 0x7ff49414fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:19.341 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.335+0000 7ff49a24b700 1 --2- 172.21.15.92:0/2195176643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff494159eb0 0x7ff4941491b0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:19.341 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.335+0000 7ff49a24b700 1 --2- 172.21.15.92:0/2195176643 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff494070e60 0x7ff4940a8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:19.341 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.335+0000 7ff49a24b700 1 -- 172.21.15.92:0/2195176643 >> 172.21.15.92:0/2195176643 conn(0x7ff4940cfca0 msgr2=0x7ff4940c9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:19.342 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.335+0000 7ff49a24b700 1 -- 172.21.15.92:0/2195176643 shutdown_connections 2023-08-26T09:26:19.342 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.335+0000 7ff49a24b700 1 -- 172.21.15.92:0/2195176643 wait complete. 2023-08-26T09:26:19.342 INFO:teuthology.orchestra.run.smithi092.stderr:pool 'cephfs_metadata' created 2023-08-26T09:26:19.355 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-26T09:26:19.483 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.478+0000 7f970f5ca700 1 Processor -- start 2023-08-26T09:26:19.483 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.478+0000 7f970f5ca700 1 -- start start 2023-08-26T09:26:19.485 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.479+0000 7f970f5ca700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f97080b28d0 0x7f97080b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:19.485 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.479+0000 7f970f5ca700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f97080ce450 0x7f9708161930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:19.486 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.479+0000 7f970f5ca700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f970815e9b0 con 0x7f970815da10 2023-08-26T09:26:19.486 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.479+0000 7f970f5ca700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97081614a0 con 0x7f97080b28d0 2023-08-26T09:26:19.486 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.479+0000 7f970f5ca700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97080b31f0 con 0x7f97080ce450 2023-08-26T09:26:19.486 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.479+0000 7f970d366700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f97080b28d0 0x7f97080b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:19.487 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.479+0000 7f970d366700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f97080b28d0 0x7f97080b2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46892/0 (socket says 172.21.15.92:46892) 2023-08-26T09:26:19.487 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.479+0000 7f970d366700 1 -- 172.21.15.92:0/2698943940 learned_addr learned my addr 172.21.15.92:0/2698943940 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:19.487 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.479+0000 7f970cb65700 1 --2- 172.21.15.92:0/2698943940 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f97080ce450 0x7f9708161930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:19.487 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.479+0000 7f970d366700 1 -- 172.21.15.92:0/2698943940 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f97080ce450 msgr2=0x7f9708161930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:19.487 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.479+0000 7f970d366700 1 --2- 172.21.15.92:0/2698943940 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f97080ce450 0x7f9708161930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:19.488 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.479+0000 7f970d366700 1 -- 172.21.15.92:0/2698943940 >> v1:172.21.15.188:6789/0 conn(0x7f970815da10 legacy=0x7f970815ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:19.488 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.479+0000 7f970d366700 1 -- 172.21.15.92:0/2698943940 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f970815e3f0 con 0x7f97080b28d0 2023-08-26T09:26:19.488 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.480+0000 7f970d366700 1 --2- 172.21.15.92:0/2698943940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97080b28d0 0x7f97080b2cb0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f96f80098f0 tx=0x7f96f8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47825db1e1a239c1 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:19.488 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.480+0000 7f96fffff700 1 -- 172.21.15.92:0/2698943940 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f8004230 con 0x7f97080b28d0 2023-08-26T09:26:19.488 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.480+0000 7f96fffff700 1 -- 172.21.15.92:0/2698943940 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96f8004390 con 0x7f97080b28d0 2023-08-26T09:26:19.489 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.480+0000 7f96fffff700 1 -- 172.21.15.92:0/2698943940 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f80036a0 con 0x7f97080b28d0 2023-08-26T09:26:19.489 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.480+0000 7f970f5ca700 1 -- 172.21.15.92:0/2698943940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97080b28d0 msgr2=0x7f97080b2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:19.489 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.480+0000 7f970f5ca700 1 --2- 172.21.15.92:0/2698943940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97080b28d0 0x7f97080b2cb0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f96f80098f0 tx=0x7f96f8009c00 comp rx=0 tx=0).stop 2023-08-26T09:26:19.489 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.480+0000 7f970f5ca700 1 -- 172.21.15.92:0/2698943940 shutdown_connections 2023-08-26T09:26:19.490 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.480+0000 7f970f5ca700 1 --2- 172.21.15.92:0/2698943940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97080b28d0 0x7f97080b2cb0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:19.490 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.480+0000 7f970f5ca700 1 --2- 172.21.15.92:0/2698943940 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f97080ce450 0x7f9708161930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:19.490 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.480+0000 7f970f5ca700 1 -- 172.21.15.92:0/2698943940 >> 172.21.15.92:0/2698943940 conn(0x7f97080cd8d0 msgr2=0x7f97080cdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:19.490 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.480+0000 7f970f5ca700 1 -- 172.21.15.92:0/2698943940 shutdown_connections 2023-08-26T09:26:19.490 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.480+0000 7f970f5ca700 1 -- 172.21.15.92:0/2698943940 wait complete. 2023-08-26T09:26:19.493 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.481+0000 7f970f5ca700 1 Processor -- start 2023-08-26T09:26:19.493 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.482+0000 7f970f5ca700 1 -- start start 2023-08-26T09:26:19.494 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.482+0000 7f970f5ca700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f97080b28d0 0x7f97080c4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:19.494 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.482+0000 7f970f5ca700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97080ce450 0x7f97081e9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:19.495 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.482+0000 7f970f5ca700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f970815da10 0x7f97080af240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:19.495 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.482+0000 7f970f5ca700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97081e9870 con 0x7f97080ce450 2023-08-26T09:26:19.495 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.482+0000 7f970f5ca700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97080b6910 con 0x7f970815da10 2023-08-26T09:26:19.496 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.482+0000 7f970f5ca700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97081e8290 con 0x7f97080b28d0 2023-08-26T09:26:19.496 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.482+0000 7f970cb65700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97080ce450 0x7f97081e9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:19.496 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.482+0000 7f970cb65700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97080ce450 0x7f97081e9330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46896/0 (socket says 172.21.15.92:46896) 2023-08-26T09:26:19.497 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.482+0000 7f970cb65700 1 -- 172.21.15.92:0/221655665 learned_addr learned my addr 172.21.15.92:0/221655665 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:19.497 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.482+0000 7f970d366700 1 --2- 172.21.15.92:0/221655665 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f97080b28d0 0x7f97080c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:19.497 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.482+0000 7f970db67700 1 --2- 172.21.15.92:0/221655665 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f970815da10 0x7f97080af240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:19.498 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.483+0000 7f970cb65700 1 -- 172.21.15.92:0/221655665 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f97080b28d0 msgr2=0x7f97080c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:19.498 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.483+0000 7f970cb65700 1 --2- 172.21.15.92:0/221655665 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f97080b28d0 0x7f97080c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:19.499 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.483+0000 7f970cb65700 1 -- 172.21.15.92:0/221655665 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f970815da10 msgr2=0x7f97080af240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:19.499 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.483+0000 7f970cb65700 1 --2- 172.21.15.92:0/221655665 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f970815da10 0x7f97080af240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:19.499 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.483+0000 7f970cb65700 1 -- 172.21.15.92:0/221655665 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f8009550 con 0x7f97080ce450 2023-08-26T09:26:19.499 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.483+0000 7f970cb65700 1 --2- 172.21.15.92:0/221655665 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97080ce450 0x7f97081e9330 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f970400d800 tx=0x7f970400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:19.500 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.483+0000 7f96fdffb700 1 -- 172.21.15.92:0/221655665 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97040126b0 con 0x7f97080ce450 2023-08-26T09:26:19.500 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.483+0000 7f96fdffb700 1 -- 172.21.15.92:0/221655665 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9704012810 con 0x7f97080ce450 2023-08-26T09:26:19.501 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.483+0000 7f970f5ca700 1 -- 172.21.15.92:0/221655665 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97081e8570 con 0x7f97080ce450 2023-08-26T09:26:19.501 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.483+0000 7f96fdffb700 1 -- 172.21.15.92:0/221655665 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9704012ba0 con 0x7f97080ce450 2023-08-26T09:26:19.501 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.483+0000 7f970f5ca700 1 -- 172.21.15.92:0/221655665 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97081e8b30 con 0x7f97080ce450 2023-08-26T09:26:19.502 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.484+0000 7f970f5ca700 1 -- 172.21.15.92:0/221655665 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f970804eeb0 con 0x7f97080ce450 2023-08-26T09:26:19.502 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.484+0000 7f96fdffb700 1 -- 172.21.15.92:0/221655665 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9704012d00 con 0x7f97080ce450 2023-08-26T09:26:19.502 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.485+0000 7f96fdffb700 1 --2- 172.21.15.92:0/221655665 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f96ec06a0e0 0x7f96ec06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:19.502 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.485+0000 7f96fdffb700 1 -- 172.21.15.92:0/221655665 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f97040883e0 con 0x7f97080ce450 2023-08-26T09:26:19.502 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.485+0000 7f970d366700 1 --2- 172.21.15.92:0/221655665 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f96ec06a0e0 0x7f96ec06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:19.503 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.485+0000 7f970d366700 1 --2- 172.21.15.92:0/221655665 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f96ec06a0e0 0x7f96ec06c5a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f96f8009130 tx=0x7f96f8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:19.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.489+0000 7f96fdffb700 1 -- 172.21.15.92:0/221655665 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f97040577d0 con 0x7f97080ce450 2023-08-26T09:26:19.681 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:19.677+0000 7f970f5ca700 1 -- 172.21.15.92:0/221655665 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f97080b37f0 con 0x7f97080ce450 2023-08-26T09:26:20.340 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.334+0000 7f96fdffb700 1 -- 172.21.15.92:0/221655665 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v31) v1 ==== 170+0+0 (secure 0 0 0) 0x7f9704057360 con 0x7f97080ce450 2023-08-26T09:26:20.346 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.339+0000 7f970f5ca700 1 -- 172.21.15.92:0/221655665 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f96ec06a0e0 msgr2=0x7f96ec06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:20.346 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.339+0000 7f970f5ca700 1 --2- 172.21.15.92:0/221655665 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f96ec06a0e0 0x7f96ec06c5a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f96f8009130 tx=0x7f96f8008030 comp rx=0 tx=0).stop 2023-08-26T09:26:20.346 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.339+0000 7f970f5ca700 1 -- 172.21.15.92:0/221655665 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97080ce450 msgr2=0x7f97081e9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:20.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.339+0000 7f970f5ca700 1 --2- 172.21.15.92:0/221655665 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97080ce450 0x7f97081e9330 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f970400d800 tx=0x7f970400db10 comp rx=0 tx=0).stop 2023-08-26T09:26:20.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.345+0000 7f970f5ca700 1 -- 172.21.15.92:0/221655665 shutdown_connections 2023-08-26T09:26:20.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.345+0000 7f970f5ca700 1 --2- 172.21.15.92:0/221655665 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f96ec06a0e0 0x7f96ec06c5a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:20.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.345+0000 7f970f5ca700 1 --2- 172.21.15.92:0/221655665 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f970815da10 0x7f97080af240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:20.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.345+0000 7f970f5ca700 1 --2- 172.21.15.92:0/221655665 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f97080b28d0 0x7f97080c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:20.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.345+0000 7f970f5ca700 1 --2- 172.21.15.92:0/221655665 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97080ce450 0x7f97081e9330 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:20.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.345+0000 7f970f5ca700 1 -- 172.21.15.92:0/221655665 >> 172.21.15.92:0/221655665 conn(0x7f97080cd8d0 msgr2=0x7f97080d07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:20.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.346+0000 7f970f5ca700 1 -- 172.21.15.92:0/221655665 shutdown_connections 2023-08-26T09:26:20.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.346+0000 7f970f5ca700 1 -- 172.21.15.92:0/221655665 wait complete. 2023-08-26T09:26:20.355 INFO:teuthology.orchestra.run.smithi092.stderr:pool 'cephfs_data' created 2023-08-26T09:26:20.370 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-26T09:26:20.500 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.495+0000 7f90ec2b3700 1 Processor -- start 2023-08-26T09:26:20.500 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.495+0000 7f90ec2b3700 1 -- start start 2023-08-26T09:26:20.509 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.496+0000 7f90ec2b3700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f90e40af390 0x7f90e4070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:20.509 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.496+0000 7f90ec2b3700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90e40aee50 con 0x7f90e415d220 2023-08-26T09:26:20.509 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.496+0000 7f90ec2b3700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90e40af130 con 0x7f90e4071260 2023-08-26T09:26:20.510 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.496+0000 7f90ec2b3700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90e40c4cb0 con 0x7f90e40af390 2023-08-26T09:26:20.510 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.496+0000 7f90ea04f700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f90e415d220 0x7f90e406db70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:58916/0 (socket says 172.21.15.92:58916) 2023-08-26T09:26:20.510 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.496+0000 7f90ea04f700 1 -- 172.21.15.92:0/763211652 learned_addr learned my addr 172.21.15.92:0/763211652 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:26:20.511 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.496+0000 7f90e904d700 1 -- 172.21.15.92:0/763211652 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2226374728 0 0) 0x7f90e40aee50 con 0x7f90e415d220 2023-08-26T09:26:20.511 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.496+0000 7f90e904d700 1 -- 172.21.15.92:0/763211652 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90d00035b0 con 0x7f90e415d220 2023-08-26T09:26:20.511 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.496+0000 7f90e984e700 1 --2- 172.21.15.92:0/763211652 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f90e40af390 0x7f90e4070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:20.512 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.497+0000 7f90e904d700 1 -- 172.21.15.92:0/763211652 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2787982556 0 0) 0x7f90d00035b0 con 0x7f90e415d220 2023-08-26T09:26:20.512 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.497+0000 7f90e904d700 1 -- 172.21.15.92:0/763211652 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f90e40af390 msgr2=0x7f90e4070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:20.512 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.497+0000 7f90e904d700 1 --2- 172.21.15.92:0/763211652 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f90e40af390 0x7f90e4070d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:20.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.497+0000 7f90e904d700 1 -- 172.21.15.92:0/763211652 >> v1:172.21.15.188:6789/0 conn(0x7f90e4071260 legacy=0x7f90e406a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:20.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.497+0000 7f90e904d700 1 -- 172.21.15.92:0/763211652 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e40c4f90 con 0x7f90e415d220 2023-08-26T09:26:20.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.497+0000 7f90e904d700 1 -- 172.21.15.92:0/763211652 <== mon.0 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1019361464 0 0) 0x7f90d4001670 con 0x7f90e415d220 2023-08-26T09:26:20.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.497+0000 7f90e904d700 1 -- 172.21.15.92:0/763211652 >> v1:172.21.15.92:6789/0 conn(0x7f90e415d220 legacy=0x7f90e406db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:20.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.497+0000 7f90e904d700 1 --2- 172.21.15.92:0/763211652 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f90e40af390 0x7f90d0003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:20.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.497+0000 7f90e904d700 1 --2- 172.21.15.92:0/763211652 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f90d0003fb0 0x7f90d0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:20.515 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.497+0000 7f90e904d700 1 --2- 172.21.15.92:0/763211652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90d0004d90 0x7f90d0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:20.515 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.497+0000 7f90e904d700 1 -- 172.21.15.92:0/763211652 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e40c4cb0 con 0x7f90d0004d90 2023-08-26T09:26:20.515 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.497+0000 7f90e904d700 1 -- 172.21.15.92:0/763211652 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d000baf0 con 0x7f90d0003fb0 2023-08-26T09:26:20.515 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.497+0000 7f90e904d700 1 -- 172.21.15.92:0/763211652 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d000bcb0 con 0x7f90e40af390 2023-08-26T09:26:20.516 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.497+0000 7f90ea850700 1 --2- 172.21.15.92:0/763211652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90d0004d90 0x7f90d0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:20.516 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.497+0000 7f90ea04f700 1 --2- 172.21.15.92:0/763211652 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f90e40af390 0x7f90d0003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:20.516 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.497+0000 7f90e984e700 1 --2- 172.21.15.92:0/763211652 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f90d0003fb0 0x7f90d0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:20.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.497+0000 7f90ea850700 1 -- 172.21.15.92:0/763211652 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f90e40af390 msgr2=0x7f90d0003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:20.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.497+0000 7f90ea850700 1 --2- 172.21.15.92:0/763211652 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f90e40af390 0x7f90d0003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:20.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.497+0000 7f90ea850700 1 -- 172.21.15.92:0/763211652 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f90d0003fb0 msgr2=0x7f90d0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:20.518 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.497+0000 7f90ea850700 1 --2- 172.21.15.92:0/763211652 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f90d0003fb0 0x7f90d0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:20.518 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.497+0000 7f90ea850700 1 -- 172.21.15.92:0/763211652 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d00035b0 con 0x7f90d0004d90 2023-08-26T09:26:20.518 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.497+0000 7f90ea850700 1 --2- 172.21.15.92:0/763211652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90d0004d90 0x7f90d0005210 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f90dc00c190 tx=0x7f90d0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63f4f1653c5624f8 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:20.518 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.497+0000 7f90e904d700 1 -- 172.21.15.92:0/763211652 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc001db0 con 0x7f90d0004d90 2023-08-26T09:26:20.519 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.497+0000 7f90e904d700 1 -- 172.21.15.92:0/763211652 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90dc00ccd0 con 0x7f90d0004d90 2023-08-26T09:26:20.519 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.497+0000 7f90e904d700 1 -- 172.21.15.92:0/763211652 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc003c40 con 0x7f90d0004d90 2023-08-26T09:26:20.519 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.498+0000 7f90ec2b3700 1 -- 172.21.15.92:0/763211652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90d0004d90 msgr2=0x7f90d0005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:20.520 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.498+0000 7f90ec2b3700 1 --2- 172.21.15.92:0/763211652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90d0004d90 0x7f90d0005210 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f90dc00c190 tx=0x7f90d0005880 comp rx=0 tx=0).stop 2023-08-26T09:26:20.520 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.498+0000 7f90ea850700 1 -- 172.21.15.92:0/763211652 reap_dead start 2023-08-26T09:26:20.520 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.498+0000 7f90ec2b3700 1 -- 172.21.15.92:0/763211652 shutdown_connections 2023-08-26T09:26:20.521 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.498+0000 7f90ec2b3700 1 -- 172.21.15.92:0/763211652 >> 172.21.15.92:0/763211652 conn(0x7f90e406b430 msgr2=0x7f90e406b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:20.521 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.498+0000 7f90ec2b3700 1 -- 172.21.15.92:0/763211652 shutdown_connections 2023-08-26T09:26:20.521 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.498+0000 7f90ec2b3700 1 -- 172.21.15.92:0/763211652 wait complete. 2023-08-26T09:26:20.521 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.499+0000 7f90ec2b3700 1 Processor -- start 2023-08-26T09:26:20.522 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.499+0000 7f90ec2b3700 1 -- start start 2023-08-26T09:26:20.522 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.500+0000 7f90ec2b3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90d0004d90 0x7f90e414db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:20.522 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.500+0000 7f90ec2b3700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f90e414e270 0x7f90e414e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:20.523 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.500+0000 7f90ec2b3700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f90e4153ea0 0x7f90e4154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:20.523 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.500+0000 7f90ec2b3700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e4154870 con 0x7f90d0004d90 2023-08-26T09:26:20.523 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.500+0000 7f90ec2b3700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e414e0b0 con 0x7f90e4153ea0 2023-08-26T09:26:20.523 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.500+0000 7f90ec2b3700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90e4152730 con 0x7f90e414e270 2023-08-26T09:26:20.524 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.500+0000 7f90ea04f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90d0004d90 0x7f90e414db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:20.524 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.500+0000 7f90ea04f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90d0004d90 0x7f90e414db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46914/0 (socket says 172.21.15.92:46914) 2023-08-26T09:26:20.524 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.500+0000 7f90ea04f700 1 -- 172.21.15.92:0/3508964807 learned_addr learned my addr 172.21.15.92:0/3508964807 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:20.524 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.500+0000 7f90e984e700 1 --2- 172.21.15.92:0/3508964807 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f90e414e270 0x7f90e414e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:20.524 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.500+0000 7f90ea850700 1 --2- 172.21.15.92:0/3508964807 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f90e4153ea0 0x7f90e4154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:20.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.500+0000 7f90ea04f700 1 -- 172.21.15.92:0/3508964807 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f90e414e270 msgr2=0x7f90e414e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:20.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.500+0000 7f90ea04f700 1 --2- 172.21.15.92:0/3508964807 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f90e414e270 0x7f90e414e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:20.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.500+0000 7f90ea04f700 1 -- 172.21.15.92:0/3508964807 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f90e4153ea0 msgr2=0x7f90e4154330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:20.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.500+0000 7f90ea04f700 1 --2- 172.21.15.92:0/3508964807 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f90e4153ea0 0x7f90e4154330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:20.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.500+0000 7f90ea04f700 1 -- 172.21.15.92:0/3508964807 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e4152a10 con 0x7f90d0004d90 2023-08-26T09:26:20.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.500+0000 7f90e984e700 1 --2- 172.21.15.92:0/3508964807 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f90e414e270 0x7f90e414e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:26:20.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.500+0000 7f90ea850700 1 --2- 172.21.15.92:0/3508964807 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f90e4153ea0 0x7f90e4154330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:26:20.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.501+0000 7f90ea04f700 1 --2- 172.21.15.92:0/3508964807 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90d0004d90 0x7f90e414db70 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f90d4000f60 tx=0x7f90d4007690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:20.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.501+0000 7f90daffd700 1 -- 172.21.15.92:0/3508964807 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d400f850 con 0x7f90d0004d90 2023-08-26T09:26:20.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.501+0000 7f90daffd700 1 -- 172.21.15.92:0/3508964807 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d400f9d0 con 0x7f90d0004d90 2023-08-26T09:26:20.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.501+0000 7f90ec2b3700 1 -- 172.21.15.92:0/3508964807 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90e4152cf0 con 0x7f90d0004d90 2023-08-26T09:26:20.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.501+0000 7f90daffd700 1 -- 172.21.15.92:0/3508964807 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d400fd80 con 0x7f90d0004d90 2023-08-26T09:26:20.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.501+0000 7f90ec2b3700 1 -- 172.21.15.92:0/3508964807 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90e41532b0 con 0x7f90d0004d90 2023-08-26T09:26:20.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.502+0000 7f90ec2b3700 1 -- 172.21.15.92:0/3508964807 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90e404eeb0 con 0x7f90d0004d90 2023-08-26T09:26:20.528 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.502+0000 7f90daffd700 1 -- 172.21.15.92:0/3508964807 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f90d401d460 con 0x7f90d0004d90 2023-08-26T09:26:20.528 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.503+0000 7f90daffd700 1 --2- 172.21.15.92:0/3508964807 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f90c806a0e0 0x7f90c806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:20.528 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.503+0000 7f90e984e700 1 --2- 172.21.15.92:0/3508964807 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f90c806a0e0 0x7f90c806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:20.528 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.503+0000 7f90daffd700 1 -- 172.21.15.92:0/3508964807 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f90d40886c0 con 0x7f90d0004d90 2023-08-26T09:26:20.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.503+0000 7f90e984e700 1 --2- 172.21.15.92:0/3508964807 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f90c806a0e0 0x7f90c806c5a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f90e0009c60 tx=0x7f90e0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:20.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.507+0000 7f90daffd700 1 -- 172.21.15.92:0/3508964807 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f90d4053e00 con 0x7f90d0004d90 2023-08-26T09:26:20.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:20.740+0000 7f90ec2b3700 1 -- 172.21.15.92:0/3508964807 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f90e406d2c0 con 0x7f90d0004d90 2023-08-26T09:26:21.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.364+0000 7f90daffd700 1 -- 172.21.15.92:0/3508964807 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f90d4057420 con 0x7f90d0004d90 2023-08-26T09:26:21.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.370+0000 7f90ec2b3700 1 -- 172.21.15.92:0/3508964807 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f90c806a0e0 msgr2=0x7f90c806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:21.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.370+0000 7f90ec2b3700 1 --2- 172.21.15.92:0/3508964807 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f90c806a0e0 0x7f90c806c5a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f90e0009c60 tx=0x7f90e0008040 comp rx=0 tx=0).stop 2023-08-26T09:26:21.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.370+0000 7f90ec2b3700 1 -- 172.21.15.92:0/3508964807 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90d0004d90 msgr2=0x7f90e414db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:21.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.370+0000 7f90ec2b3700 1 --2- 172.21.15.92:0/3508964807 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90d0004d90 0x7f90e414db70 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f90d4000f60 tx=0x7f90d4007690 comp rx=0 tx=0).stop 2023-08-26T09:26:21.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.370+0000 7f90ec2b3700 1 -- 172.21.15.92:0/3508964807 shutdown_connections 2023-08-26T09:26:21.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.370+0000 7f90ec2b3700 1 --2- 172.21.15.92:0/3508964807 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f90c806a0e0 0x7f90c806c5a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:21.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.370+0000 7f90ec2b3700 1 --2- 172.21.15.92:0/3508964807 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f90e4153ea0 0x7f90e4154330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:21.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.370+0000 7f90ec2b3700 1 --2- 172.21.15.92:0/3508964807 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90d0004d90 0x7f90e414db70 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:21.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.370+0000 7f90ec2b3700 1 --2- 172.21.15.92:0/3508964807 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f90e414e270 0x7f90e414e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:21.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.370+0000 7f90ec2b3700 1 -- 172.21.15.92:0/3508964807 >> 172.21.15.92:0/3508964807 conn(0x7f90e406b430 msgr2=0x7f90e40af770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:21.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.370+0000 7f90ec2b3700 1 -- 172.21.15.92:0/3508964807 shutdown_connections 2023-08-26T09:26:21.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.370+0000 7f90ec2b3700 1 -- 172.21.15.92:0/3508964807 wait complete. 2023-08-26T09:26:21.377 INFO:teuthology.orchestra.run.smithi092.stderr:new fs with metadata pool 5 and data pool 6 2023-08-26T09:26:21.389 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-26T09:26:21.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.509+0000 7f2abe6da700 1 Processor -- start 2023-08-26T09:26:21.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.509+0000 7f2abe6da700 1 -- start start 2023-08-26T09:26:21.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.510+0000 7f2abe6da700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f2ab80ca620 0x7f2ab80caa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:21.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.510+0000 7f2abe6da700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f2ab806cd60 0x7f2ab806d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:21.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.510+0000 7f2abe6da700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ab80cf4d0 con 0x7f2ab815d6c0 2023-08-26T09:26:21.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.510+0000 7f2abe6da700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ab80cb4a0 con 0x7f2ab80ca620 2023-08-26T09:26:21.518 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.510+0000 7f2abe6da700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ab80caf40 con 0x7f2ab806cd60 2023-08-26T09:26:21.518 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.510+0000 7f2ab7fff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f2ab80ca620 0x7f2ab80caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:21.518 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.510+0000 7f2ab7fff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f2ab80ca620 0x7f2ab80caa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46938/0 (socket says 172.21.15.92:46938) 2023-08-26T09:26:21.518 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.511+0000 7f2ab7fff700 1 -- 172.21.15.92:0/3352242154 learned_addr learned my addr 172.21.15.92:0/3352242154 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:21.518 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.511+0000 7f2abcc77700 1 --2- 172.21.15.92:0/3352242154 >> v2:172.21.15.188:3300/0 conn(0x7f2ab806cd60 0x7f2ab806d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:21.519 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.511+0000 7f2ab7fff700 1 -- 172.21.15.92:0/3352242154 >> v2:172.21.15.188:3300/0 conn(0x7f2ab806cd60 msgr2=0x7f2ab806d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:21.519 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.511+0000 7f2ab7fff700 1 --2- 172.21.15.92:0/3352242154 >> v2:172.21.15.188:3300/0 conn(0x7f2ab806cd60 0x7f2ab806d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:21.519 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.511+0000 7f2ab7fff700 1 -- 172.21.15.92:0/3352242154 >> v1:172.21.15.188:6789/0 conn(0x7f2ab815d6c0 legacy=0x7f2ab80cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:21.519 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.511+0000 7f2ab7fff700 1 -- 172.21.15.92:0/3352242154 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab80ce3b0 con 0x7f2ab80ca620 2023-08-26T09:26:21.519 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.511+0000 7f2ab7fff700 1 --2- 172.21.15.92:0/3352242154 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ab80ca620 0x7f2ab80caa00 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8068480 tx=0x7f2aac009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8489cd16d3f5347 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:21.520 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.511+0000 7f2ab6ffd700 1 -- 172.21.15.92:0/3352242154 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aac011830 con 0x7f2ab80ca620 2023-08-26T09:26:21.520 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.511+0000 7f2ab6ffd700 1 -- 172.21.15.92:0/3352242154 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aac011990 con 0x7f2ab80ca620 2023-08-26T09:26:21.520 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.511+0000 7f2ab6ffd700 1 -- 172.21.15.92:0/3352242154 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aac011d20 con 0x7f2ab80ca620 2023-08-26T09:26:21.520 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.512+0000 7f2abe6da700 1 -- 172.21.15.92:0/3352242154 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ab80ca620 msgr2=0x7f2ab80caa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:21.520 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.512+0000 7f2abe6da700 1 --2- 172.21.15.92:0/3352242154 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ab80ca620 0x7f2ab80caa00 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8068480 tx=0x7f2aac009bd0 comp rx=0 tx=0).stop 2023-08-26T09:26:21.521 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.512+0000 7f2abe6da700 1 -- 172.21.15.92:0/3352242154 shutdown_connections 2023-08-26T09:26:21.521 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.512+0000 7f2abe6da700 1 --2- 172.21.15.92:0/3352242154 >> v2:172.21.15.188:3300/0 conn(0x7f2ab806cd60 0x7f2ab806d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:21.521 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.512+0000 7f2abe6da700 1 --2- 172.21.15.92:0/3352242154 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ab80ca620 0x7f2ab80caa00 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:21.521 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.512+0000 7f2abe6da700 1 -- 172.21.15.92:0/3352242154 >> 172.21.15.92:0/3352242154 conn(0x7f2ab80cc7b0 msgr2=0x7f2ab80ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:21.522 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.512+0000 7f2abe6da700 1 -- 172.21.15.92:0/3352242154 shutdown_connections 2023-08-26T09:26:21.522 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.512+0000 7f2abe6da700 1 -- 172.21.15.92:0/3352242154 wait complete. 2023-08-26T09:26:21.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.513+0000 7f2abe6da700 1 Processor -- start 2023-08-26T09:26:21.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.513+0000 7f2abe6da700 1 -- start start 2023-08-26T09:26:21.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.514+0000 7f2abe6da700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2ab806cd60 0x7f2ab8150360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:21.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.514+0000 7f2abe6da700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ab80ca620 0x7f2ab815b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:21.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.514+0000 7f2abe6da700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2ab815d6c0 0x7f2ab80c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:21.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.514+0000 7f2abe6da700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab815bda0 con 0x7f2ab80ca620 2023-08-26T09:26:21.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.514+0000 7f2abe6da700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab81e6210 con 0x7f2ab815d6c0 2023-08-26T09:26:21.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.514+0000 7f2abe6da700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab81e64f0 con 0x7f2ab806cd60 2023-08-26T09:26:21.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.514+0000 7f2ab77fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ab80ca620 0x7f2ab815b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:21.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.514+0000 7f2ab77fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ab80ca620 0x7f2ab815b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46946/0 (socket says 172.21.15.92:46946) 2023-08-26T09:26:21.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.514+0000 7f2ab77fe700 1 -- 172.21.15.92:0/1153807854 learned_addr learned my addr 172.21.15.92:0/1153807854 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:21.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.514+0000 7f2abcc77700 1 --2- 172.21.15.92:0/1153807854 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2ab815d6c0 0x7f2ab80c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:21.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.514+0000 7f2ab7fff700 1 --2- 172.21.15.92:0/1153807854 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2ab806cd60 0x7f2ab8150360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:21.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.514+0000 7f2ab77fe700 1 -- 172.21.15.92:0/1153807854 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2ab806cd60 msgr2=0x7f2ab8150360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:21.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.514+0000 7f2ab77fe700 1 --2- 172.21.15.92:0/1153807854 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2ab806cd60 0x7f2ab8150360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:21.528 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.514+0000 7f2ab77fe700 1 -- 172.21.15.92:0/1153807854 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2ab815d6c0 msgr2=0x7f2ab80c7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:21.528 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.514+0000 7f2ab77fe700 1 --2- 172.21.15.92:0/1153807854 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2ab815d6c0 0x7f2ab80c7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:21.528 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.514+0000 7f2ab77fe700 1 -- 172.21.15.92:0/1153807854 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aac009550 con 0x7f2ab80ca620 2023-08-26T09:26:21.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.514+0000 7f2abcc77700 1 --2- 172.21.15.92:0/1153807854 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2ab815d6c0 0x7f2ab80c7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:26:21.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.514+0000 7f2ab77fe700 1 --2- 172.21.15.92:0/1153807854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ab80ca620 0x7f2ab815b4a0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f2aa800c430 tx=0x7f2aa800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:21.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.514+0000 7f2ab4ff9700 1 -- 172.21.15.92:0/1153807854 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa80052d0 con 0x7f2ab80ca620 2023-08-26T09:26:21.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.514+0000 7f2ab4ff9700 1 -- 172.21.15.92:0/1153807854 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aa8005450 con 0x7f2ab80ca620 2023-08-26T09:26:21.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.514+0000 7f2abe6da700 1 -- 172.21.15.92:0/1153807854 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ab81e67d0 con 0x7f2ab80ca620 2023-08-26T09:26:21.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.514+0000 7f2ab4ff9700 1 -- 172.21.15.92:0/1153807854 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa8006aa0 con 0x7f2ab80ca620 2023-08-26T09:26:21.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.514+0000 7f2abe6da700 1 -- 172.21.15.92:0/1153807854 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ab815b9e0 con 0x7f2ab80ca620 2023-08-26T09:26:21.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.515+0000 7f2abe6da700 1 -- 172.21.15.92:0/1153807854 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ab81e6cf0 con 0x7f2ab80ca620 2023-08-26T09:26:21.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.517+0000 7f2ab4ff9700 1 -- 172.21.15.92:0/1153807854 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2aa8003680 con 0x7f2ab80ca620 2023-08-26T09:26:21.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.517+0000 7f2ab4ff9700 1 --2- 172.21.15.92:0/1153807854 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f2aa406a0e0 0x7f2aa406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:21.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.517+0000 7f2ab4ff9700 1 -- 172.21.15.92:0/1153807854 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2aa8087d90 con 0x7f2ab80ca620 2023-08-26T09:26:21.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.517+0000 7f2ab7fff700 1 --2- 172.21.15.92:0/1153807854 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f2aa406a0e0 0x7f2aa406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:21.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.517+0000 7f2ab7fff700 1 --2- 172.21.15.92:0/1153807854 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f2aa406a0e0 0x7f2aa406c5a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2aac009c10 tx=0x7f2aac008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:21.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.521+0000 7f2ab4ff9700 1 -- 172.21.15.92:0/1153807854 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2aa80535f0 con 0x7f2ab80ca620 2023-08-26T09:26:21.714 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.709+0000 7f2abe6da700 1 -- 172.21.15.92:0/1153807854 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ab81e6cf0 con 0x7f2ab80ca620 2023-08-26T09:26:21.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.711+0000 7f2ab4ff9700 1 -- 172.21.15.92:0/1153807854 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+18294 (secure 0 0 0) 0x7f2ab81e6cf0 con 0x7f2ab80ca620 2023-08-26T09:26:21.716 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:26:21.716 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":32,"fsid":"254a2d31-bd41-4507-8326-1b205ac24377","created":"2023-08-26T09:24:55.352131+0000","modified":"2023-08-26T09:26:20.741830+0000","last_up_change":"2023-08-26T09:25:06.124496+0000","last_in_change":"2023-08-26T09:24:57.840725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-26T09:25:06.650431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-26T09:25:06.973382+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-26T09:26:19.003923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-26T09:26:19.696549+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e9e7638-4459-4d8d-8e40-130bcf48df66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6819","nonce":382827192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6824","nonce":382827192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6831","nonce":382827192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6827","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6829","nonce":382827192}]},"public_addr":"172.21.15.92:6819/382827192","cluster_addr":"172.21.15.92:6824/382827192","heartbeat_back_addr":"172.21.15.92:6831/382827192","heartbeat_front_addr":"172.21.15.92:6829/382827192","state":["exists","up"]},{"osd":1,"uuid":"164e68c9-aedd-4df5-9b70-f4b1ec3bda13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6809","nonce":618773438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6811","nonce":618773438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6815","nonce":618773438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6813","nonce":618773438}]},"public_addr":"172.21.15.92:6809/618773438","cluster_addr":"172.21.15.92:6811/618773438","heartbeat_back_addr":"172.21.15.92:6815/618773438","heartbeat_front_addr":"172.21.15.92:6813/618773438","state":["exists","up"]},{"osd":2,"uuid":"8701dfee-629a-4d30-82e4-b8fac340303f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6818","nonce":3697397687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6821","nonce":3697397687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6828","nonce":3697397687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6823","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6825","nonce":3697397687}]},"public_addr":"172.21.15.92:6818/3697397687","cluster_addr":"172.21.15.92:6821/3697397687","heartbeat_back_addr":"172.21.15.92:6828/3697397687","heartbeat_front_addr":"172.21.15.92:6825/3697397687","state":["exists","up"]},{"osd":3,"uuid":"93bdc94d-dc07-495f-995a-a6ad072f0247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6801","nonce":3579846453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6803","nonce":3579846453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6807","nonce":3579846453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6805","nonce":3579846453}]},"public_addr":"172.21.15.92:6801/3579846453","cluster_addr":"172.21.15.92:6803/3579846453","heartbeat_back_addr":"172.21.15.92:6807/3579846453","heartbeat_front_addr":"172.21.15.92:6805/3579846453","state":["exists","up"]},{"osd":4,"uuid":"d9d0ea80-8481-46a7-9677-c338d32cf1d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6809","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6811","nonce":3228383424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6813","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6815","nonce":3228383424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6821","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6823","nonce":3228383424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6817","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6819","nonce":3228383424}]},"public_addr":"172.21.15.188:6811/3228383424","cluster_addr":"172.21.15.188:6815/3228383424","heartbeat_back_addr":"172.21.15.188:6823/3228383424","heartbeat_front_addr":"172.21.15.188:6819/3228383424","state":["exists","up"]},{"osd":5,"uuid":"38d03253-467a-456f-bd5e-5a46532a0b18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6801","nonce":1655821054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6803","nonce":1655821054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6807","nonce":1655821054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6805","nonce":1655821054}]},"public_addr":"172.21.15.188:6801/1655821054","cluster_addr":"172.21.15.188:6803/1655821054","heartbeat_back_addr":"172.21.15.188:6807/1655821054","heartbeat_front_addr":"172.21.15.188:6805/1655821054","state":["exists","up"]},{"osd":6,"uuid":"d61564b5-136f-42e5-a843-626c2017cc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6810","nonce":2069976891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6814","nonce":2069976891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6822","nonce":2069976891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6818","nonce":2069976891}]},"public_addr":"172.21.15.188:6810/2069976891","cluster_addr":"172.21.15.188:6814/2069976891","heartbeat_back_addr":"172.21.15.188:6822/2069976891","heartbeat_front_addr":"172.21.15.188:6818/2069976891","state":["exists","up"]},{"osd":7,"uuid":"fae2949e-0d62-42cd-ba72-08f516084b20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6825","nonce":1882888860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6827","nonce":1882888860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6831","nonce":1882888860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6829","nonce":1882888860}]},"public_addr":"172.21.15.188:6825/1882888860","cluster_addr":"172.21.15.188:6827/1882888860","heartbeat_back_addr":"172.21.15.188:6831/1882888860","heartbeat_front_addr":"172.21.15.188:6829/1882888860","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.038523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.063160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.000857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.975572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.023848+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.765194+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.081365+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:05.110745+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-26T09:26:21.718 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.713+0000 7f2abe6da700 1 -- 172.21.15.92:0/1153807854 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f2aa406a0e0 msgr2=0x7f2aa406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:21.718 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.713+0000 7f2abe6da700 1 --2- 172.21.15.92:0/1153807854 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f2aa406a0e0 0x7f2aa406c5a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2aac009c10 tx=0x7f2aac008030 comp rx=0 tx=0).stop 2023-08-26T09:26:21.718 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.713+0000 7f2abe6da700 1 -- 172.21.15.92:0/1153807854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ab80ca620 msgr2=0x7f2ab815b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:21.718 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.713+0000 7f2abe6da700 1 --2- 172.21.15.92:0/1153807854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ab80ca620 0x7f2ab815b4a0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f2aa800c430 tx=0x7f2aa800c7f0 comp rx=0 tx=0).stop 2023-08-26T09:26:21.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.713+0000 7f2abe6da700 1 -- 172.21.15.92:0/1153807854 shutdown_connections 2023-08-26T09:26:21.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.713+0000 7f2abe6da700 1 --2- 172.21.15.92:0/1153807854 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f2aa406a0e0 0x7f2aa406c5a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:21.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.713+0000 7f2abe6da700 1 --2- 172.21.15.92:0/1153807854 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2ab815d6c0 0x7f2ab80c7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:21.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.713+0000 7f2abe6da700 1 --2- 172.21.15.92:0/1153807854 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2ab806cd60 0x7f2ab8150360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:21.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.713+0000 7f2abe6da700 1 --2- 172.21.15.92:0/1153807854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ab80ca620 0x7f2ab815b4a0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:21.720 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.713+0000 7f2abe6da700 1 -- 172.21.15.92:0/1153807854 >> 172.21.15.92:0/1153807854 conn(0x7f2ab80cc7b0 msgr2=0x7f2ab806d470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:21.720 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.713+0000 7f2abe6da700 1 -- 172.21.15.92:0/1153807854 shutdown_connections 2023-08-26T09:26:21.720 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.713+0000 7f2abe6da700 1 -- 172.21.15.92:0/1153807854 wait complete. 2023-08-26T09:26:21.730 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-26T09:26:21.850 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.846+0000 7f0c8fd40700 1 Processor -- start 2023-08-26T09:26:21.851 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.846+0000 7f0c8fd40700 1 -- start start 2023-08-26T09:26:21.853 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.847+0000 7f0c8fd40700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0c880cbff0 0x7f0c880cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:21.853 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.847+0000 7f0c8fd40700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c880cf7e0 con 0x7f0c8815a090 2023-08-26T09:26:21.853 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.847+0000 7f0c8fd40700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c880caec0 con 0x7f0c8806f4e0 2023-08-26T09:26:21.853 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.847+0000 7f0c8fd40700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c880cb160 con 0x7f0c880cbff0 2023-08-26T09:26:21.854 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.847+0000 7f0c8e2dd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0c880cbff0 0x7f0c880cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:21.854 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.847+0000 7f0c8dadc700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f0c8815a090 0x7f0c880cd900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:58966/0 (socket says 172.21.15.92:58966) 2023-08-26T09:26:21.854 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.847+0000 7f0c8dadc700 1 -- 172.21.15.92:0/3062130585 learned_addr learned my addr 172.21.15.92:0/3062130585 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:26:21.854 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.847+0000 7f0c8e2dd700 1 -- 172.21.15.92:0/3062130585 >> v1:172.21.15.188:6789/0 conn(0x7f0c8806f4e0 legacy=0x7f0c880cb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:21.855 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.847+0000 7f0c8e2dd700 1 -- 172.21.15.92:0/3062130585 >> v1:172.21.15.92:6789/0 conn(0x7f0c8815a090 legacy=0x7f0c880cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:21.855 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.847+0000 7f0c8e2dd700 1 -- 172.21.15.92:0/3062130585 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c880cb440 con 0x7f0c880cbff0 2023-08-26T09:26:21.855 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.847+0000 7f0c8cada700 1 -- 172.21.15.92:0/3062130585 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3629427780 0 0) 0x7f0c880cf7e0 con 0x7f0c8815a090 2023-08-26T09:26:21.855 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.847+0000 7f0c8e2dd700 1 --2- 172.21.15.92:0/3062130585 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c880cbff0 0x7f0c880cd2d0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0c80009d90 tx=0x7f0c8000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4c816c9a582795f server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:21.855 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.847+0000 7f0c8cada700 1 -- 172.21.15.92:0/3062130585 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8000e070 con 0x7f0c880cbff0 2023-08-26T09:26:21.856 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.847+0000 7f0c8cada700 1 -- 172.21.15.92:0/3062130585 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c8000bbd0 con 0x7f0c880cbff0 2023-08-26T09:26:21.856 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.847+0000 7f0c8cada700 1 -- 172.21.15.92:0/3062130585 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c80012430 con 0x7f0c880cbff0 2023-08-26T09:26:21.856 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.848+0000 7f0c8fd40700 1 -- 172.21.15.92:0/3062130585 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c880cbff0 msgr2=0x7f0c880cd2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:21.856 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.848+0000 7f0c8fd40700 1 --2- 172.21.15.92:0/3062130585 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c880cbff0 0x7f0c880cd2d0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0c80009d90 tx=0x7f0c8000b330 comp rx=0 tx=0).stop 2023-08-26T09:26:21.856 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.848+0000 7f0c8fd40700 1 -- 172.21.15.92:0/3062130585 shutdown_connections 2023-08-26T09:26:21.857 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.848+0000 7f0c8fd40700 1 --2- 172.21.15.92:0/3062130585 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c880cbff0 0x7f0c880cd2d0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:21.857 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.848+0000 7f0c8fd40700 1 -- 172.21.15.92:0/3062130585 >> 172.21.15.92:0/3062130585 conn(0x7f0c880cc7b0 msgr2=0x7f0c880ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:21.857 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.848+0000 7f0c8fd40700 1 -- 172.21.15.92:0/3062130585 shutdown_connections 2023-08-26T09:26:21.857 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.848+0000 7f0c8fd40700 1 -- 172.21.15.92:0/3062130585 wait complete. 2023-08-26T09:26:21.860 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.849+0000 7f0c8fd40700 1 Processor -- start 2023-08-26T09:26:21.860 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.849+0000 7f0c8fd40700 1 -- start start 2023-08-26T09:26:21.860 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.850+0000 7f0c8fd40700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c8806f4e0 0x7f0c880b29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:21.860 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.850+0000 7f0c8fd40700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c880cbff0 0x7f0c8814cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:21.861 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.850+0000 7f0c8fd40700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c8815a090 0x7f0c880c9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:21.861 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.850+0000 7f0c8fd40700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c88150810 con 0x7f0c880cbff0 2023-08-26T09:26:21.861 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.850+0000 7f0c8fd40700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c880b3080 con 0x7f0c8815a090 2023-08-26T09:26:21.861 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.850+0000 7f0c8fd40700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c880b3360 con 0x7f0c8806f4e0 2023-08-26T09:26:21.861 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.850+0000 7f0c8d2db700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c880cbff0 0x7f0c8814cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:21.862 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.850+0000 7f0c8d2db700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c880cbff0 0x7f0c8814cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46958/0 (socket says 172.21.15.92:46958) 2023-08-26T09:26:21.862 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.850+0000 7f0c8d2db700 1 -- 172.21.15.92:0/258991245 learned_addr learned my addr 172.21.15.92:0/258991245 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:21.862 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.850+0000 7f0c8e2dd700 1 --2- 172.21.15.92:0/258991245 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c8815a090 0x7f0c880c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:21.862 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.850+0000 7f0c8dadc700 1 --2- 172.21.15.92:0/258991245 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c8806f4e0 0x7f0c880b29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:21.863 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.850+0000 7f0c8d2db700 1 -- 172.21.15.92:0/258991245 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c8806f4e0 msgr2=0x7f0c880b29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:21.863 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.850+0000 7f0c8d2db700 1 --2- 172.21.15.92:0/258991245 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c8806f4e0 0x7f0c880b29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:21.863 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.850+0000 7f0c8d2db700 1 -- 172.21.15.92:0/258991245 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c8815a090 msgr2=0x7f0c880c9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:21.863 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.850+0000 7f0c8d2db700 1 --2- 172.21.15.92:0/258991245 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c8815a090 0x7f0c880c9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:21.863 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.850+0000 7f0c8d2db700 1 -- 172.21.15.92:0/258991245 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c80009a70 con 0x7f0c880cbff0 2023-08-26T09:26:21.864 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.851+0000 7f0c8d2db700 1 --2- 172.21.15.92:0/258991245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c880cbff0 0x7f0c8814cbb0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f0c7800c450 tx=0x7f0c7800c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:21.864 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.851+0000 7f0c7e7fc700 1 -- 172.21.15.92:0/258991245 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c780052d0 con 0x7f0c880cbff0 2023-08-26T09:26:21.864 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.851+0000 7f0c7e7fc700 1 -- 172.21.15.92:0/258991245 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c78005430 con 0x7f0c880cbff0 2023-08-26T09:26:21.864 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.851+0000 7f0c8fd40700 1 -- 172.21.15.92:0/258991245 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c880b3640 con 0x7f0c880cbff0 2023-08-26T09:26:21.864 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.851+0000 7f0c7e7fc700 1 -- 172.21.15.92:0/258991245 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c780038c0 con 0x7f0c880cbff0 2023-08-26T09:26:21.865 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.851+0000 7f0c8fd40700 1 -- 172.21.15.92:0/258991245 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c880b3c00 con 0x7f0c880cbff0 2023-08-26T09:26:21.865 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.852+0000 7f0c8fd40700 1 -- 172.21.15.92:0/258991245 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c8804e660 con 0x7f0c880cbff0 2023-08-26T09:26:21.865 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.852+0000 7f0c7e7fc700 1 -- 172.21.15.92:0/258991245 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0c78003a20 con 0x7f0c880cbff0 2023-08-26T09:26:21.865 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.852+0000 7f0c7e7fc700 1 --2- 172.21.15.92:0/258991245 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f0c6c06a0e0 0x7f0c6c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:21.865 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.853+0000 7f0c8dadc700 1 --2- 172.21.15.92:0/258991245 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f0c6c06a0e0 0x7f0c6c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:21.866 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.853+0000 7f0c7e7fc700 1 -- 172.21.15.92:0/258991245 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0c780877d0 con 0x7f0c880cbff0 2023-08-26T09:26:21.866 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.853+0000 7f0c8dadc700 1 --2- 172.21.15.92:0/258991245 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f0c6c06a0e0 0x7f0c6c06c5a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0c84007b10 tx=0x7f0c84007a60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:21.866 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:21.857+0000 7f0c7e7fc700 1 -- 172.21.15.92:0/258991245 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0c78052f50 con 0x7f0c880cbff0 2023-08-26T09:26:22.053 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.049+0000 7f0c8fd40700 1 -- 172.21.15.92:0/258991245 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c880b3dc0 con 0x7f0c880cbff0 2023-08-26T09:26:22.055 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.050+0000 7f0c7e7fc700 1 -- 172.21.15.92:0/258991245 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+18294 (secure 0 0 0) 0x7f0c7800ce60 con 0x7f0c880cbff0 2023-08-26T09:26:22.055 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:26:22.055 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":32,"fsid":"254a2d31-bd41-4507-8326-1b205ac24377","created":"2023-08-26T09:24:55.352131+0000","modified":"2023-08-26T09:26:20.741830+0000","last_up_change":"2023-08-26T09:25:06.124496+0000","last_in_change":"2023-08-26T09:24:57.840725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-26T09:25:06.650431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-26T09:25:06.973382+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-26T09:26:19.003923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-26T09:26:19.696549+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e9e7638-4459-4d8d-8e40-130bcf48df66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6819","nonce":382827192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6824","nonce":382827192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6831","nonce":382827192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6827","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6829","nonce":382827192}]},"public_addr":"172.21.15.92:6819/382827192","cluster_addr":"172.21.15.92:6824/382827192","heartbeat_back_addr":"172.21.15.92:6831/382827192","heartbeat_front_addr":"172.21.15.92:6829/382827192","state":["exists","up"]},{"osd":1,"uuid":"164e68c9-aedd-4df5-9b70-f4b1ec3bda13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6809","nonce":618773438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6811","nonce":618773438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6815","nonce":618773438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6813","nonce":618773438}]},"public_addr":"172.21.15.92:6809/618773438","cluster_addr":"172.21.15.92:6811/618773438","heartbeat_back_addr":"172.21.15.92:6815/618773438","heartbeat_front_addr":"172.21.15.92:6813/618773438","state":["exists","up"]},{"osd":2,"uuid":"8701dfee-629a-4d30-82e4-b8fac340303f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6818","nonce":3697397687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6821","nonce":3697397687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6828","nonce":3697397687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6823","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6825","nonce":3697397687}]},"public_addr":"172.21.15.92:6818/3697397687","cluster_addr":"172.21.15.92:6821/3697397687","heartbeat_back_addr":"172.21.15.92:6828/3697397687","heartbeat_front_addr":"172.21.15.92:6825/3697397687","state":["exists","up"]},{"osd":3,"uuid":"93bdc94d-dc07-495f-995a-a6ad072f0247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6801","nonce":3579846453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6803","nonce":3579846453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6807","nonce":3579846453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6805","nonce":3579846453}]},"public_addr":"172.21.15.92:6801/3579846453","cluster_addr":"172.21.15.92:6803/3579846453","heartbeat_back_addr":"172.21.15.92:6807/3579846453","heartbeat_front_addr":"172.21.15.92:6805/3579846453","state":["exists","up"]},{"osd":4,"uuid":"d9d0ea80-8481-46a7-9677-c338d32cf1d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6809","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6811","nonce":3228383424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6813","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6815","nonce":3228383424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6821","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6823","nonce":3228383424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6817","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6819","nonce":3228383424}]},"public_addr":"172.21.15.188:6811/3228383424","cluster_addr":"172.21.15.188:6815/3228383424","heartbeat_back_addr":"172.21.15.188:6823/3228383424","heartbeat_front_addr":"172.21.15.188:6819/3228383424","state":["exists","up"]},{"osd":5,"uuid":"38d03253-467a-456f-bd5e-5a46532a0b18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6801","nonce":1655821054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6803","nonce":1655821054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6807","nonce":1655821054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6805","nonce":1655821054}]},"public_addr":"172.21.15.188:6801/1655821054","cluster_addr":"172.21.15.188:6803/1655821054","heartbeat_back_addr":"172.21.15.188:6807/1655821054","heartbeat_front_addr":"172.21.15.188:6805/1655821054","state":["exists","up"]},{"osd":6,"uuid":"d61564b5-136f-42e5-a843-626c2017cc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6810","nonce":2069976891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6814","nonce":2069976891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6822","nonce":2069976891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6818","nonce":2069976891}]},"public_addr":"172.21.15.188:6810/2069976891","cluster_addr":"172.21.15.188:6814/2069976891","heartbeat_back_addr":"172.21.15.188:6822/2069976891","heartbeat_front_addr":"172.21.15.188:6818/2069976891","state":["exists","up"]},{"osd":7,"uuid":"fae2949e-0d62-42cd-ba72-08f516084b20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6825","nonce":1882888860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6827","nonce":1882888860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6831","nonce":1882888860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6829","nonce":1882888860}]},"public_addr":"172.21.15.188:6825/1882888860","cluster_addr":"172.21.15.188:6827/1882888860","heartbeat_back_addr":"172.21.15.188:6831/1882888860","heartbeat_front_addr":"172.21.15.188:6829/1882888860","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.038523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.063160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.000857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.975572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.023848+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.765194+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.081365+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:05.110745+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-26T09:26:22.057 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.052+0000 7f0c8fd40700 1 -- 172.21.15.92:0/258991245 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f0c6c06a0e0 msgr2=0x7f0c6c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:22.057 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.052+0000 7f0c8fd40700 1 --2- 172.21.15.92:0/258991245 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f0c6c06a0e0 0x7f0c6c06c5a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0c84007b10 tx=0x7f0c84007a60 comp rx=0 tx=0).stop 2023-08-26T09:26:22.057 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.052+0000 7f0c8fd40700 1 -- 172.21.15.92:0/258991245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c880cbff0 msgr2=0x7f0c8814cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:22.058 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.052+0000 7f0c8fd40700 1 --2- 172.21.15.92:0/258991245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c880cbff0 0x7f0c8814cbb0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f0c7800c450 tx=0x7f0c7800c760 comp rx=0 tx=0).stop 2023-08-26T09:26:22.058 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.052+0000 7f0c8fd40700 1 -- 172.21.15.92:0/258991245 shutdown_connections 2023-08-26T09:26:22.058 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.052+0000 7f0c8fd40700 1 --2- 172.21.15.92:0/258991245 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f0c6c06a0e0 0x7f0c6c06c5a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:22.058 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.052+0000 7f0c8fd40700 1 --2- 172.21.15.92:0/258991245 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c8815a090 0x7f0c880c9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:22.058 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.052+0000 7f0c8fd40700 1 --2- 172.21.15.92:0/258991245 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c8806f4e0 0x7f0c880b29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:22.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.052+0000 7f0c8fd40700 1 --2- 172.21.15.92:0/258991245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c880cbff0 0x7f0c8814cbb0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:22.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.052+0000 7f0c8fd40700 1 -- 172.21.15.92:0/258991245 >> 172.21.15.92:0/258991245 conn(0x7f0c880cc7b0 msgr2=0x7f0c8806eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:22.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.052+0000 7f0c8fd40700 1 -- 172.21.15.92:0/258991245 shutdown_connections 2023-08-26T09:26:22.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.052+0000 7f0c8fd40700 1 -- 172.21.15.92:0/258991245 wait complete. 2023-08-26T09:26:22.069 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-26T09:26:22.194 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.189+0000 7f44c38b5700 1 Processor -- start 2023-08-26T09:26:22.194 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.190+0000 7f44c38b5700 1 -- start start 2023-08-26T09:26:22.196 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.190+0000 7f44c38b5700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f44bc0ae740 0x7f44bc071710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:22.196 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.190+0000 7f44c38b5700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44bc066020 0x7f44bc0ca900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:22.197 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.190+0000 7f44c38b5700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44bc071fb0 con 0x7f44bc066480 2023-08-26T09:26:22.197 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.190+0000 7f44c38b5700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44bc0c9b40 con 0x7f44bc0ae740 2023-08-26T09:26:22.197 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.190+0000 7f44c38b5700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc0c9e20 con 0x7f44bc066020 2023-08-26T09:26:22.197 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.191+0000 7f44c0e50700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44bc066020 0x7f44bc0ca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:22.197 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.191+0000 7f44c1651700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f44bc0ae740 0x7f44bc071710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:22.198 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.191+0000 7f44c1651700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f44bc0ae740 0x7f44bc071710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.92:35774/0 (socket says 172.21.15.92:35774) 2023-08-26T09:26:22.198 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.191+0000 7f44c0e50700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44bc066020 0x7f44bc0ca900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.92:45630/0 (socket says 172.21.15.92:45630) 2023-08-26T09:26:22.198 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.191+0000 7f44c1651700 1 -- 172.21.15.92:0/35553626 learned_addr learned my addr 172.21.15.92:0/35553626 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:22.198 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.191+0000 7f44c1e52700 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f44bc066480 0x7f44bc0cd9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.92:54094/0 (socket says 172.21.15.92:54094) 2023-08-26T09:26:22.198 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.191+0000 7f44c0e50700 1 -- 172.21.15.92:0/35553626 >> v2:172.21.15.188:3300/0 conn(0x7f44bc0ae740 msgr2=0x7f44bc071710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:22.198 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.191+0000 7f44c0e50700 1 --2- 172.21.15.92:0/35553626 >> v2:172.21.15.188:3300/0 conn(0x7f44bc0ae740 0x7f44bc071710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:22.199 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.191+0000 7f44c0e50700 1 -- 172.21.15.92:0/35553626 >> v1:172.21.15.188:6789/0 conn(0x7f44bc066480 legacy=0x7f44bc0cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:22.199 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.191+0000 7f44c0e50700 1 -- 172.21.15.92:0/35553626 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44bc0ca100 con 0x7f44bc066020 2023-08-26T09:26:22.199 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.191+0000 7f44c1651700 1 --2- 172.21.15.92:0/35553626 >> v2:172.21.15.188:3300/0 conn(0x7f44bc0ae740 0x7f44bc071710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-26T09:26:22.199 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.191+0000 7f44c0e50700 1 --2- 172.21.15.92:0/35553626 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44bc066020 0x7f44bc0ca900 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f44b8009840 tx=0x7f44b8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ddd18e01da418699 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:22.200 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.191+0000 7f44b3fff700 1 -- 172.21.15.92:0/35553626 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b8011830 con 0x7f44bc066020 2023-08-26T09:26:22.200 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.192+0000 7f44b3fff700 1 -- 172.21.15.92:0/35553626 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b8011990 con 0x7f44bc066020 2023-08-26T09:26:22.200 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.192+0000 7f44b3fff700 1 -- 172.21.15.92:0/35553626 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b8011d20 con 0x7f44bc066020 2023-08-26T09:26:22.203 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.192+0000 7f44c38b5700 1 -- 172.21.15.92:0/35553626 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44bc066020 msgr2=0x7f44bc0ca900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:22.203 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.192+0000 7f44c38b5700 1 --2- 172.21.15.92:0/35553626 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44bc066020 0x7f44bc0ca900 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f44b8009840 tx=0x7f44b8009b50 comp rx=0 tx=0).stop 2023-08-26T09:26:22.203 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.192+0000 7f44c38b5700 1 -- 172.21.15.92:0/35553626 shutdown_connections 2023-08-26T09:26:22.204 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.192+0000 7f44c38b5700 1 --2- 172.21.15.92:0/35553626 >> v2:172.21.15.188:3300/0 conn(0x7f44bc0ae740 0x7f44bc071710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:22.204 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.192+0000 7f44c38b5700 1 --2- 172.21.15.92:0/35553626 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44bc066020 0x7f44bc0ca900 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:22.204 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.192+0000 7f44c38b5700 1 -- 172.21.15.92:0/35553626 >> 172.21.15.92:0/35553626 conn(0x7f44bc0cf450 msgr2=0x7f44bc0cf860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:22.204 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.192+0000 7f44c38b5700 1 -- 172.21.15.92:0/35553626 shutdown_connections 2023-08-26T09:26:22.204 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.192+0000 7f44c38b5700 1 -- 172.21.15.92:0/35553626 wait complete. 2023-08-26T09:26:22.205 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.193+0000 7f44c38b5700 1 Processor -- start 2023-08-26T09:26:22.205 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.193+0000 7f44c38b5700 1 -- start start 2023-08-26T09:26:22.205 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.194+0000 7f44c38b5700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44bc066020 0x7f44bc0c8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:22.206 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.194+0000 7f44c38b5700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44bc066480 0x7f44bc151aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:22.206 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.194+0000 7f44c38b5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f44bc0ae740 0x7f44bc0adef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:22.206 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.194+0000 7f44c38b5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc0adad0 con 0x7f44bc0ae740 2023-08-26T09:26:22.206 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.194+0000 7f44c38b5700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc151fe0 con 0x7f44bc066480 2023-08-26T09:26:22.206 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.194+0000 7f44c38b5700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc0ace50 con 0x7f44bc066020 2023-08-26T09:26:22.207 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.194+0000 7f44c1e52700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f44bc0ae740 0x7f44bc0adef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:22.207 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.194+0000 7f44c1e52700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f44bc0ae740 0x7f44bc0adef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46976/0 (socket says 172.21.15.92:46976) 2023-08-26T09:26:22.207 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.194+0000 7f44c1e52700 1 -- 172.21.15.92:0/3162982483 learned_addr learned my addr 172.21.15.92:0/3162982483 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:22.207 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.194+0000 7f44c1651700 1 --2- 172.21.15.92:0/3162982483 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44bc066020 0x7f44bc0c8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:22.207 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.194+0000 7f44c0e50700 1 --2- 172.21.15.92:0/3162982483 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44bc066480 0x7f44bc151aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:22.207 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.195+0000 7f44c1e52700 1 -- 172.21.15.92:0/3162982483 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44bc066020 msgr2=0x7f44bc0c8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:22.208 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.195+0000 7f44c1e52700 1 --2- 172.21.15.92:0/3162982483 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44bc066020 0x7f44bc0c8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:22.208 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.195+0000 7f44c1e52700 1 -- 172.21.15.92:0/3162982483 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44bc066480 msgr2=0x7f44bc151aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:22.208 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.195+0000 7f44c1e52700 1 --2- 172.21.15.92:0/3162982483 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44bc066480 0x7f44bc151aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:22.208 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.195+0000 7f44c1e52700 1 -- 172.21.15.92:0/3162982483 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44ac009550 con 0x7f44bc0ae740 2023-08-26T09:26:22.208 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.195+0000 7f44c1651700 1 --2- 172.21.15.92:0/3162982483 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44bc066020 0x7f44bc0c8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-26T09:26:22.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.195+0000 7f44c1e52700 1 --2- 172.21.15.92:0/3162982483 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f44bc0ae740 0x7f44bc0adef0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f44b400cbd0 tx=0x7f44b400cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:22.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.195+0000 7f44b1ffb700 1 -- 172.21.15.92:0/3162982483 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b400aaa0 con 0x7f44bc0ae740 2023-08-26T09:26:22.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.195+0000 7f44b1ffb700 1 -- 172.21.15.92:0/3162982483 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b400ac00 con 0x7f44bc0ae740 2023-08-26T09:26:22.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.195+0000 7f44b1ffb700 1 -- 172.21.15.92:0/3162982483 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b4007070 con 0x7f44bc0ae740 2023-08-26T09:26:22.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.195+0000 7f44c38b5700 1 -- 172.21.15.92:0/3162982483 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44b80094a0 con 0x7f44bc0ae740 2023-08-26T09:26:22.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.195+0000 7f44c38b5700 1 -- 172.21.15.92:0/3162982483 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44bc0ad410 con 0x7f44bc0ae740 2023-08-26T09:26:22.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.196+0000 7f44c38b5700 1 -- 172.21.15.92:0/3162982483 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44bc04eeb0 con 0x7f44bc0ae740 2023-08-26T09:26:22.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.196+0000 7f44b1ffb700 1 -- 172.21.15.92:0/3162982483 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f44b40071d0 con 0x7f44bc0ae740 2023-08-26T09:26:22.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.197+0000 7f44b1ffb700 1 --2- 172.21.15.92:0/3162982483 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f44a006a0e0 0x7f44a006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:22.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.197+0000 7f44c1651700 1 --2- 172.21.15.92:0/3162982483 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f44a006a0e0 0x7f44a006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:22.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.197+0000 7f44b1ffb700 1 -- 172.21.15.92:0/3162982483 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f44b4088150 con 0x7f44bc0ae740 2023-08-26T09:26:22.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.197+0000 7f44c1651700 1 --2- 172.21.15.92:0/3162982483 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f44a006a0e0 0x7f44a006c5a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f44ac006d30 tx=0x7f44ac0092c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:22.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.201+0000 7f44b1ffb700 1 -- 172.21.15.92:0/3162982483 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f44b4053900 con 0x7f44bc0ae740 2023-08-26T09:26:22.446 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:22.441+0000 7f44c38b5700 1 -- 172.21.15.92:0/3162982483 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f44bc0c2d60 con 0x7f44bc0ae740 2023-08-26T09:26:23.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.370+0000 7f44b1ffb700 1 -- 172.21.15.92:0/3162982483 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7f44b4056f20 con 0x7f44bc0ae740 2023-08-26T09:26:23.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.373+0000 7f44c38b5700 1 -- 172.21.15.92:0/3162982483 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f44a006a0e0 msgr2=0x7f44a006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:23.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.373+0000 7f44c38b5700 1 --2- 172.21.15.92:0/3162982483 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f44a006a0e0 0x7f44a006c5a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f44ac006d30 tx=0x7f44ac0092c0 comp rx=0 tx=0).stop 2023-08-26T09:26:23.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.373+0000 7f44c38b5700 1 -- 172.21.15.92:0/3162982483 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f44bc0ae740 msgr2=0x7f44bc0adef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:23.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.373+0000 7f44c38b5700 1 --2- 172.21.15.92:0/3162982483 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f44bc0ae740 0x7f44bc0adef0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f44b400cbd0 tx=0x7f44b400cee0 comp rx=0 tx=0).stop 2023-08-26T09:26:23.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.373+0000 7f44c38b5700 1 -- 172.21.15.92:0/3162982483 shutdown_connections 2023-08-26T09:26:23.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.373+0000 7f44c38b5700 1 --2- 172.21.15.92:0/3162982483 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f44bc0ae740 0x7f44bc0adef0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:23.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.373+0000 7f44c38b5700 1 --2- 172.21.15.92:0/3162982483 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44bc066020 0x7f44bc0c8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:23.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.373+0000 7f44c38b5700 1 --2- 172.21.15.92:0/3162982483 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f44a006a0e0 0x7f44a006c5a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:23.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.373+0000 7f44c38b5700 1 --2- 172.21.15.92:0/3162982483 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44bc066480 0x7f44bc151aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:23.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.373+0000 7f44c38b5700 1 -- 172.21.15.92:0/3162982483 >> 172.21.15.92:0/3162982483 conn(0x7f44bc0cf450 msgr2=0x7f44bc0afe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:23.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.373+0000 7f44c38b5700 1 -- 172.21.15.92:0/3162982483 shutdown_connections 2023-08-26T09:26:23.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.373+0000 7f44c38b5700 1 -- 172.21.15.92:0/3162982483 wait complete. 2023-08-26T09:26:23.392 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-26T09:26:23.393 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-26T09:26:23.523 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.519+0000 7f5877d3a700 1 Processor -- start 2023-08-26T09:26:23.524 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.519+0000 7f5877d3a700 1 -- start start 2023-08-26T09:26:23.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.520+0000 7f5877d3a700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f58700af390 0x7f5870070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:23.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.520+0000 7f5877d3a700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5870071260 0x7f587006a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:23.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.520+0000 7f5877d3a700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58700aee50 con 0x7f587015d220 2023-08-26T09:26:23.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.520+0000 7f5877d3a700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58700af130 con 0x7f58700af390 2023-08-26T09:26:23.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.520+0000 7f5877d3a700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58700c4cb0 con 0x7f5870071260 2023-08-26T09:26:23.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.520+0000 7f5875ad6700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f587015d220 0x7f587006db70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:58994/0 (socket says 172.21.15.92:58994) 2023-08-26T09:26:23.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.520+0000 7f5875ad6700 1 -- 172.21.15.92:0/3396107029 learned_addr learned my addr 172.21.15.92:0/3396107029 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:26:23.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.520+0000 7f58762d7700 1 --2- 172.21.15.92:0/3396107029 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5870071260 0x7f587006a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:23.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.520+0000 7f58752d5700 1 --2- 172.21.15.92:0/3396107029 >> v2:172.21.15.188:3300/0 conn(0x7f58700af390 0x7f5870070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:23.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.520+0000 7f5874ad4700 1 -- 172.21.15.92:0/3396107029 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 419339537 0 0) 0x7f58700aee50 con 0x7f587015d220 2023-08-26T09:26:23.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.520+0000 7f5874ad4700 1 -- 172.21.15.92:0/3396107029 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f585c0035b0 con 0x7f587015d220 2023-08-26T09:26:23.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.520+0000 7f5874ad4700 1 -- 172.21.15.92:0/3396107029 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 604403881 0 0) 0x7f585c0035b0 con 0x7f587015d220 2023-08-26T09:26:23.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.520+0000 7f5874ad4700 1 -- 172.21.15.92:0/3396107029 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5870071260 msgr2=0x7f587006a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:23.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.520+0000 7f5874ad4700 1 --2- 172.21.15.92:0/3396107029 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5870071260 0x7f587006a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:23.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.520+0000 7f5874ad4700 1 -- 172.21.15.92:0/3396107029 >> v2:172.21.15.188:3300/0 conn(0x7f58700af390 msgr2=0x7f5870070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:23.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.520+0000 7f5874ad4700 1 --2- 172.21.15.92:0/3396107029 >> v2:172.21.15.188:3300/0 conn(0x7f58700af390 0x7f5870070d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:23.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.520+0000 7f5874ad4700 1 -- 172.21.15.92:0/3396107029 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58700c4f90 con 0x7f587015d220 2023-08-26T09:26:23.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.520+0000 7f5874ad4700 1 -- 172.21.15.92:0/3396107029 <== mon.0 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1019361464 0 0) 0x7f586c001670 con 0x7f587015d220 2023-08-26T09:26:23.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.520+0000 7f5874ad4700 1 -- 172.21.15.92:0/3396107029 >> v1:172.21.15.92:6789/0 conn(0x7f587015d220 legacy=0x7f587006db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:23.534 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.521+0000 7f5874ad4700 1 --2- 172.21.15.92:0/3396107029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f585c003a00 0x7f585c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:23.534 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.521+0000 7f5874ad4700 1 --2- 172.21.15.92:0/3396107029 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f585c004850 0x7f585c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:23.534 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.521+0000 7f5874ad4700 1 --2- 172.21.15.92:0/3396107029 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5870071260 0x7f585c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:23.534 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.521+0000 7f5874ad4700 1 -- 172.21.15.92:0/3396107029 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58700af130 con 0x7f585c003a00 2023-08-26T09:26:23.534 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.521+0000 7f5874ad4700 1 -- 172.21.15.92:0/3396107029 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58700c4cb0 con 0x7f585c004850 2023-08-26T09:26:23.535 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.521+0000 7f5874ad4700 1 -- 172.21.15.92:0/3396107029 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f585c00ba10 con 0x7f5870071260 2023-08-26T09:26:23.535 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.521+0000 7f5875ad6700 1 --2- 172.21.15.92:0/3396107029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f585c003a00 0x7f585c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:23.535 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.521+0000 7f58752d5700 1 --2- 172.21.15.92:0/3396107029 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f585c004850 0x7f585c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:23.535 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.521+0000 7f58762d7700 1 --2- 172.21.15.92:0/3396107029 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5870071260 0x7f585c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:23.535 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.521+0000 7f5875ad6700 1 -- 172.21.15.92:0/3396107029 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5870071260 msgr2=0x7f585c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:23.536 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.521+0000 7f5875ad6700 1 --2- 172.21.15.92:0/3396107029 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5870071260 0x7f585c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:23.536 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.521+0000 7f5875ad6700 1 -- 172.21.15.92:0/3396107029 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f585c004850 msgr2=0x7f585c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:23.536 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.521+0000 7f5875ad6700 1 --2- 172.21.15.92:0/3396107029 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f585c004850 0x7f585c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:23.536 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.521+0000 7f5875ad6700 1 -- 172.21.15.92:0/3396107029 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f585c0035b0 con 0x7f585c003a00 2023-08-26T09:26:23.536 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.521+0000 7f58752d5700 1 --2- 172.21.15.92:0/3396107029 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f585c004850 0x7f585c004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:26:23.537 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.521+0000 7f58762d7700 1 --2- 172.21.15.92:0/3396107029 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5870071260 0x7f585c005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:26:23.537 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.521+0000 7f5875ad6700 1 --2- 172.21.15.92:0/3396107029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f585c003a00 0x7f585c003e20 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f586c00c370 tx=0x7f585c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83d8ecd29de67f22 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:23.537 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.521+0000 7f5874ad4700 1 -- 172.21.15.92:0/3396107029 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586c007c60 con 0x7f585c003a00 2023-08-26T09:26:23.537 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.521+0000 7f5874ad4700 1 -- 172.21.15.92:0/3396107029 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586c005960 con 0x7f585c003a00 2023-08-26T09:26:23.537 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.521+0000 7f5874ad4700 1 -- 172.21.15.92:0/3396107029 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586c005d10 con 0x7f585c003a00 2023-08-26T09:26:23.538 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.522+0000 7f5877d3a700 1 -- 172.21.15.92:0/3396107029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f585c003a00 msgr2=0x7f585c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:23.538 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.522+0000 7f5877d3a700 1 --2- 172.21.15.92:0/3396107029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f585c003a00 0x7f585c003e20 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f586c00c370 tx=0x7f585c005880 comp rx=0 tx=0).stop 2023-08-26T09:26:23.538 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.522+0000 7f58762d7700 1 -- 172.21.15.92:0/3396107029 reap_dead start 2023-08-26T09:26:23.538 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.522+0000 7f5877d3a700 1 -- 172.21.15.92:0/3396107029 shutdown_connections 2023-08-26T09:26:23.538 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.522+0000 7f5877d3a700 1 -- 172.21.15.92:0/3396107029 >> 172.21.15.92:0/3396107029 conn(0x7f587006b430 msgr2=0x7f587006b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:23.539 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.522+0000 7f5877d3a700 1 -- 172.21.15.92:0/3396107029 shutdown_connections 2023-08-26T09:26:23.539 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.522+0000 7f5877d3a700 1 -- 172.21.15.92:0/3396107029 wait complete. 2023-08-26T09:26:23.539 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.523+0000 7f5877d3a700 1 Processor -- start 2023-08-26T09:26:23.539 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.523+0000 7f5877d3a700 1 -- start start 2023-08-26T09:26:23.540 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.524+0000 7f5877d3a700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f585c003a00 0x7f5870148870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:23.540 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.524+0000 7f5877d3a700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5870159cd0 0x7f587015be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:23.540 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.524+0000 7f5877d3a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58701574c0 0x7f5870157940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:23.540 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.524+0000 7f5877d3a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5870157e80 con 0x7f58701574c0 2023-08-26T09:26:23.540 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.524+0000 7f5877d3a700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5870148db0 con 0x7f585c003a00 2023-08-26T09:26:23.541 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.524+0000 7f5877d3a700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f587015a290 con 0x7f5870159cd0 2023-08-26T09:26:23.541 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.524+0000 7f58762d7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58701574c0 0x7f5870157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:23.541 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.524+0000 7f58762d7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58701574c0 0x7f5870157940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46996/0 (socket says 172.21.15.92:46996) 2023-08-26T09:26:23.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.524+0000 7f58762d7700 1 -- 172.21.15.92:0/693057659 learned_addr learned my addr 172.21.15.92:0/693057659 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:23.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.524+0000 7f5875ad6700 1 --2- 172.21.15.92:0/693057659 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f585c003a00 0x7f5870148870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:23.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.524+0000 7f58752d5700 1 --2- 172.21.15.92:0/693057659 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5870159cd0 0x7f587015be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:23.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.524+0000 7f58762d7700 1 -- 172.21.15.92:0/693057659 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5870159cd0 msgr2=0x7f587015be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:23.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.524+0000 7f58762d7700 1 --2- 172.21.15.92:0/693057659 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5870159cd0 0x7f587015be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:23.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.524+0000 7f58762d7700 1 -- 172.21.15.92:0/693057659 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f585c003a00 msgr2=0x7f5870148870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:23.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.524+0000 7f58762d7700 1 --2- 172.21.15.92:0/693057659 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f585c003a00 0x7f5870148870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:23.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.524+0000 7f58762d7700 1 -- 172.21.15.92:0/693057659 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f587015a570 con 0x7f58701574c0 2023-08-26T09:26:23.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.524+0000 7f58752d5700 1 --2- 172.21.15.92:0/693057659 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5870159cd0 0x7f587015be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:26:23.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.524+0000 7f5875ad6700 1 --2- 172.21.15.92:0/693057659 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f585c003a00 0x7f5870148870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:26:23.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.524+0000 7f58762d7700 1 --2- 172.21.15.92:0/693057659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58701574c0 0x7f5870157940 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f5870067d20 tx=0x7f58680104a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:23.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.524+0000 7f58667fc700 1 -- 172.21.15.92:0/693057659 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586801b070 con 0x7f58701574c0 2023-08-26T09:26:23.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.524+0000 7f58667fc700 1 -- 172.21.15.92:0/693057659 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586800f040 con 0x7f58701574c0 2023-08-26T09:26:23.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.524+0000 7f5877d3a700 1 -- 172.21.15.92:0/693057659 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f587015a850 con 0x7f58701574c0 2023-08-26T09:26:23.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.525+0000 7f58667fc700 1 -- 172.21.15.92:0/693057659 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586800e050 con 0x7f58701574c0 2023-08-26T09:26:23.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.525+0000 7f5877d3a700 1 -- 172.21.15.92:0/693057659 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f587015ae10 con 0x7f58701574c0 2023-08-26T09:26:23.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.525+0000 7f5877d3a700 1 -- 172.21.15.92:0/693057659 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f587004eeb0 con 0x7f58701574c0 2023-08-26T09:26:23.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.526+0000 7f58667fc700 1 -- 172.21.15.92:0/693057659 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5868003a20 con 0x7f58701574c0 2023-08-26T09:26:23.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.526+0000 7f58667fc700 1 --2- 172.21.15.92:0/693057659 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f585406a0e0 0x7f585406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:23.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.526+0000 7f5875ad6700 1 --2- 172.21.15.92:0/693057659 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f585406a0e0 0x7f585406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:23.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.526+0000 7f58667fc700 1 -- 172.21.15.92:0/693057659 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5868088930 con 0x7f58701574c0 2023-08-26T09:26:23.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.527+0000 7f5875ad6700 1 --2- 172.21.15.92:0/693057659 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f585406a0e0 0x7f585406c5a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f586c015040 tx=0x7f586c00a000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:23.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.531+0000 7f58667fc700 1 -- 172.21.15.92:0/693057659 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5868054020 con 0x7f58701574c0 2023-08-26T09:26:23.770 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:23.765+0000 7f5877d3a700 1 -- 172.21.15.92:0/693057659 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f58700ce120 con 0x7f58701574c0 2023-08-26T09:26:24.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.371+0000 7f58667fc700 1 -- 172.21.15.92:0/693057659 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5868057640 con 0x7f58701574c0 2023-08-26T09:26:24.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.374+0000 7f5877d3a700 1 -- 172.21.15.92:0/693057659 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f585406a0e0 msgr2=0x7f585406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:24.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.374+0000 7f5877d3a700 1 --2- 172.21.15.92:0/693057659 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f585406a0e0 0x7f585406c5a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f586c015040 tx=0x7f586c00a000 comp rx=0 tx=0).stop 2023-08-26T09:26:24.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.374+0000 7f5877d3a700 1 -- 172.21.15.92:0/693057659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58701574c0 msgr2=0x7f5870157940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:24.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.374+0000 7f5877d3a700 1 --2- 172.21.15.92:0/693057659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58701574c0 0x7f5870157940 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f5870067d20 tx=0x7f58680104a0 comp rx=0 tx=0).stop 2023-08-26T09:26:24.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.374+0000 7f5877d3a700 1 -- 172.21.15.92:0/693057659 shutdown_connections 2023-08-26T09:26:24.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.374+0000 7f5877d3a700 1 --2- 172.21.15.92:0/693057659 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f585406a0e0 0x7f585406c5a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:24.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.374+0000 7f5877d3a700 1 --2- 172.21.15.92:0/693057659 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f585c003a00 0x7f5870148870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:24.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.374+0000 7f5877d3a700 1 --2- 172.21.15.92:0/693057659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58701574c0 0x7f5870157940 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:24.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.374+0000 7f5877d3a700 1 --2- 172.21.15.92:0/693057659 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5870159cd0 0x7f587015be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:24.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.374+0000 7f5877d3a700 1 -- 172.21.15.92:0/693057659 >> 172.21.15.92:0/693057659 conn(0x7f587006b430 msgr2=0x7f587006db70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:24.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.374+0000 7f5877d3a700 1 -- 172.21.15.92:0/693057659 shutdown_connections 2023-08-26T09:26:24.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.374+0000 7f5877d3a700 1 -- 172.21.15.92:0/693057659 wait complete. 2023-08-26T09:26:24.393 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-26T09:26:24.394 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-26T09:26:24.520 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.516+0000 7f2b8348b700 1 Processor -- start 2023-08-26T09:26:24.521 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.516+0000 7f2b8348b700 1 -- start start 2023-08-26T09:26:24.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.517+0000 7f2b8348b700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2b7c0ca620 0x7f2b7c0caa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:24.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.517+0000 7f2b8348b700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f2b7c06cd60 0x7f2b7c06d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:24.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.517+0000 7f2b8348b700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b7c0cf4d0 con 0x7f2b7c15d6c0 2023-08-26T09:26:24.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.517+0000 7f2b8348b700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b7c0cb4a0 con 0x7f2b7c06cd60 2023-08-26T09:26:24.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.517+0000 7f2b8348b700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c0caf40 con 0x7f2b7c0ca620 2023-08-26T09:26:24.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.517+0000 7f2b80a26700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f2b7c15d6c0 0x7f2b7c0cea30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:59014/0 (socket says 172.21.15.92:59014) 2023-08-26T09:26:24.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.517+0000 7f2b80a26700 1 -- 172.21.15.92:0/3516253257 learned_addr learned my addr 172.21.15.92:0/3516253257 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:26:24.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.517+0000 7f2b73fff700 1 -- 172.21.15.92:0/3516253257 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3837756436 0 0) 0x7f2b7c0cf4d0 con 0x7f2b7c15d6c0 2023-08-26T09:26:24.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.517+0000 7f2b73fff700 1 -- 172.21.15.92:0/3516253257 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b680035b0 con 0x7f2b7c15d6c0 2023-08-26T09:26:24.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.517+0000 7f2b81227700 1 --2- 172.21.15.92:0/3516253257 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2b7c0ca620 0x7f2b7c0caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:24.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.517+0000 7f2b81a28700 1 --2- 172.21.15.92:0/3516253257 >> v2:172.21.15.188:3300/0 conn(0x7f2b7c06cd60 0x7f2b7c06d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:24.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.517+0000 7f2b73fff700 1 -- 172.21.15.92:0/3516253257 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1063067860 0 0) 0x7f2b680035b0 con 0x7f2b7c15d6c0 2023-08-26T09:26:24.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.517+0000 7f2b73fff700 1 -- 172.21.15.92:0/3516253257 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2b7c0ca620 msgr2=0x7f2b7c0caa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:24.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.517+0000 7f2b73fff700 1 --2- 172.21.15.92:0/3516253257 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2b7c0ca620 0x7f2b7c0caa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:24.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.517+0000 7f2b73fff700 1 -- 172.21.15.92:0/3516253257 >> v2:172.21.15.188:3300/0 conn(0x7f2b7c06cd60 msgr2=0x7f2b7c06d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:24.528 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.517+0000 7f2b73fff700 1 --2- 172.21.15.92:0/3516253257 >> v2:172.21.15.188:3300/0 conn(0x7f2b7c06cd60 0x7f2b7c06d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:24.528 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.517+0000 7f2b73fff700 1 -- 172.21.15.92:0/3516253257 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b7c0ce3b0 con 0x7f2b7c15d6c0 2023-08-26T09:26:24.528 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.517+0000 7f2b73fff700 1 -- 172.21.15.92:0/3516253257 <== mon.0 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1019361464 0 0) 0x7f2b78001670 con 0x7f2b7c15d6c0 2023-08-26T09:26:24.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.517+0000 7f2b81227700 1 --2- 172.21.15.92:0/3516253257 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2b7c0ca620 0x7f2b7c0caa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:26:24.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.518+0000 7f2b73fff700 1 -- 172.21.15.92:0/3516253257 >> v1:172.21.15.92:6789/0 conn(0x7f2b7c15d6c0 legacy=0x7f2b7c0cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:24.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.518+0000 7f2b73fff700 1 --2- 172.21.15.92:0/3516253257 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2b7c0ca620 0x7f2b68003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:24.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.518+0000 7f2b73fff700 1 --2- 172.21.15.92:0/3516253257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b68003ff0 0x7f2b68004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:24.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.518+0000 7f2b73fff700 1 --2- 172.21.15.92:0/3516253257 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2b68004d90 0x7f2b68005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:24.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.518+0000 7f2b73fff700 1 -- 172.21.15.92:0/3516253257 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c0cb4a0 con 0x7f2b68003ff0 2023-08-26T09:26:24.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.518+0000 7f2b73fff700 1 -- 172.21.15.92:0/3516253257 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c0caf40 con 0x7f2b68004d90 2023-08-26T09:26:24.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.518+0000 7f2b73fff700 1 -- 172.21.15.92:0/3516253257 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6800bb80 con 0x7f2b7c0ca620 2023-08-26T09:26:24.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.518+0000 7f2b80a26700 1 --2- 172.21.15.92:0/3516253257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b68003ff0 0x7f2b68004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:24.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.518+0000 7f2b81227700 1 --2- 172.21.15.92:0/3516253257 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2b7c0ca620 0x7f2b68003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:24.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.518+0000 7f2b81a28700 1 --2- 172.21.15.92:0/3516253257 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2b68004d90 0x7f2b68005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:24.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.518+0000 7f2b80a26700 1 -- 172.21.15.92:0/3516253257 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2b7c0ca620 msgr2=0x7f2b68003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:24.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.518+0000 7f2b80a26700 1 --2- 172.21.15.92:0/3516253257 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2b7c0ca620 0x7f2b68003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:24.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.518+0000 7f2b80a26700 1 -- 172.21.15.92:0/3516253257 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2b68004d90 msgr2=0x7f2b68005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:24.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.518+0000 7f2b80a26700 1 --2- 172.21.15.92:0/3516253257 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2b68004d90 0x7f2b68005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:24.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.518+0000 7f2b80a26700 1 -- 172.21.15.92:0/3516253257 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b680035b0 con 0x7f2b68003ff0 2023-08-26T09:26:24.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.518+0000 7f2b81a28700 1 --2- 172.21.15.92:0/3516253257 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2b68004d90 0x7f2b68005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:26:24.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.518+0000 7f2b80a26700 1 --2- 172.21.15.92:0/3516253257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b68003ff0 0x7f2b68004850 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f2b7800c320 tx=0x7f2b68005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0621a8c8ff54a69 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:24.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.518+0000 7f2b73fff700 1 -- 172.21.15.92:0/3516253257 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7800ce60 con 0x7f2b68003ff0 2023-08-26T09:26:24.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.518+0000 7f2b73fff700 1 -- 172.21.15.92:0/3516253257 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b78005960 con 0x7f2b68003ff0 2023-08-26T09:26:24.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.518+0000 7f2b73fff700 1 -- 172.21.15.92:0/3516253257 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b78005cf0 con 0x7f2b68003ff0 2023-08-26T09:26:24.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.519+0000 7f2b8348b700 1 -- 172.21.15.92:0/3516253257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b68003ff0 msgr2=0x7f2b68004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:24.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.519+0000 7f2b8348b700 1 --2- 172.21.15.92:0/3516253257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b68003ff0 0x7f2b68004850 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f2b7800c320 tx=0x7f2b68005880 comp rx=0 tx=0).stop 2023-08-26T09:26:24.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.519+0000 7f2b81a28700 1 -- 172.21.15.92:0/3516253257 reap_dead start 2023-08-26T09:26:24.534 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.519+0000 7f2b8348b700 1 -- 172.21.15.92:0/3516253257 shutdown_connections 2023-08-26T09:26:24.534 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.519+0000 7f2b8348b700 1 -- 172.21.15.92:0/3516253257 >> 172.21.15.92:0/3516253257 conn(0x7f2b7c0cc7b0 msgr2=0x7f2b7c0ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:24.534 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.519+0000 7f2b8348b700 1 -- 172.21.15.92:0/3516253257 shutdown_connections 2023-08-26T09:26:24.534 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.519+0000 7f2b8348b700 1 -- 172.21.15.92:0/3516253257 wait complete. 2023-08-26T09:26:24.534 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.520+0000 7f2b8348b700 1 Processor -- start 2023-08-26T09:26:24.535 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.520+0000 7f2b8348b700 1 -- start start 2023-08-26T09:26:24.537 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.521+0000 7f2b8348b700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2b68003ff0 0x7f2b7c0ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:24.538 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.521+0000 7f2b8348b700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2b7c14b5a0 0x7f2b7c14ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:24.538 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.521+0000 7f2b8348b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b7c0ae240 0x7f2b7c0c9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:24.538 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.521+0000 7f2b8348b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c0ad1a0 con 0x7f2b7c0ae240 2023-08-26T09:26:24.538 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.521+0000 7f2b8348b700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c0ad480 con 0x7f2b7c14b5a0 2023-08-26T09:26:24.538 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.521+0000 7f2b8348b700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c0ad760 con 0x7f2b68003ff0 2023-08-26T09:26:24.539 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.521+0000 7f2b81a28700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b7c0ae240 0x7f2b7c0c9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:24.539 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.521+0000 7f2b81a28700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b7c0ae240 0x7f2b7c0c9210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47016/0 (socket says 172.21.15.92:47016) 2023-08-26T09:26:24.539 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.521+0000 7f2b81a28700 1 -- 172.21.15.92:0/675793674 learned_addr learned my addr 172.21.15.92:0/675793674 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:24.539 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.521+0000 7f2b80a26700 1 --2- 172.21.15.92:0/675793674 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2b7c14b5a0 0x7f2b7c14ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:24.539 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.521+0000 7f2b81227700 1 --2- 172.21.15.92:0/675793674 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2b68003ff0 0x7f2b7c0ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:24.540 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.521+0000 7f2b81a28700 1 -- 172.21.15.92:0/675793674 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2b68003ff0 msgr2=0x7f2b7c0ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:24.540 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.521+0000 7f2b81a28700 1 --2- 172.21.15.92:0/675793674 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2b68003ff0 0x7f2b7c0ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:24.540 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.521+0000 7f2b81a28700 1 -- 172.21.15.92:0/675793674 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2b7c14b5a0 msgr2=0x7f2b7c14ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:24.540 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.521+0000 7f2b81a28700 1 --2- 172.21.15.92:0/675793674 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2b7c14b5a0 0x7f2b7c14ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:24.540 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.521+0000 7f2b81a28700 1 -- 172.21.15.92:0/675793674 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b7c0ada40 con 0x7f2b7c0ae240 2023-08-26T09:26:24.541 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.521+0000 7f2b81a28700 1 --2- 172.21.15.92:0/675793674 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b7c0ae240 0x7f2b7c0c9210 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c072240 tx=0x7f2b74004970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:24.541 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.521+0000 7f2b71ffb700 1 -- 172.21.15.92:0/675793674 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b74007b00 con 0x7f2b7c0ae240 2023-08-26T09:26:24.541 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.521+0000 7f2b71ffb700 1 -- 172.21.15.92:0/675793674 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b7400f050 con 0x7f2b7c0ae240 2023-08-26T09:26:24.541 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.521+0000 7f2b8348b700 1 -- 172.21.15.92:0/675793674 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b7c0add20 con 0x7f2b7c0ae240 2023-08-26T09:26:24.541 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.521+0000 7f2b71ffb700 1 -- 172.21.15.92:0/675793674 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b74014410 con 0x7f2b7c0ae240 2023-08-26T09:26:24.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.522+0000 7f2b8348b700 1 -- 172.21.15.92:0/675793674 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b7c14b0d0 con 0x7f2b7c0ae240 2023-08-26T09:26:24.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.523+0000 7f2b8348b700 1 -- 172.21.15.92:0/675793674 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b7c0adf10 con 0x7f2b7c0ae240 2023-08-26T09:26:24.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.523+0000 7f2b71ffb700 1 -- 172.21.15.92:0/675793674 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2b74014570 con 0x7f2b7c0ae240 2023-08-26T09:26:24.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.523+0000 7f2b71ffb700 1 --2- 172.21.15.92:0/675793674 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f2b6006a0e0 0x7f2b6006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:24.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.523+0000 7f2b71ffb700 1 -- 172.21.15.92:0/675793674 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2b74088930 con 0x7f2b7c0ae240 2023-08-26T09:26:24.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.523+0000 7f2b81227700 1 --2- 172.21.15.92:0/675793674 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f2b6006a0e0 0x7f2b6006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:24.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.524+0000 7f2b81227700 1 --2- 172.21.15.92:0/675793674 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f2b6006a0e0 0x7f2b6006c5a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c004410 tx=0x7f2b6c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:24.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.528+0000 7f2b71ffb700 1 -- 172.21.15.92:0/675793674 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2b74057b60 con 0x7f2b7c0ae240 2023-08-26T09:26:24.764 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.759+0000 7f2b8348b700 1 -- 172.21.15.92:0/675793674 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b7c04e660 con 0x7f2b7c0ae240 2023-08-26T09:26:24.764 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.760+0000 7f2b71ffb700 1 -- 172.21.15.92:0/675793674 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4875 (secure 0 0 0) 0x7f2b740576f0 con 0x7f2b7c0ae240 2023-08-26T09:26:24.765 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:26:24.765 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6834/815827100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":815827100},{"type":"v1","addr":"172.21.15.188:6834","nonce":815827100}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5074,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3118806406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6833","nonce":3118806406},{"type":"v1","addr":"172.21.15.188:6835","nonce":3118806406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5358,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6836/2182649382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6835","nonce":2182649382},{"type":"v1","addr":"172.21.15.92:6836","nonce":2182649382}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-26T09:26:20.742146+0000","modified":"2023-08-26T09:26:24.370168+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5361},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5361":{"gid":5361,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6837/123272842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":123272842},{"type":"v1","addr":"172.21.15.92:6837","nonce":123272842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-26T09:26:24.766 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.762+0000 7f2b8348b700 1 -- 172.21.15.92:0/675793674 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f2b6006a0e0 msgr2=0x7f2b6006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:24.767 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.762+0000 7f2b8348b700 1 --2- 172.21.15.92:0/675793674 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f2b6006a0e0 0x7f2b6006c5a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c004410 tx=0x7f2b6c008040 comp rx=0 tx=0).stop 2023-08-26T09:26:24.767 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.762+0000 7f2b8348b700 1 -- 172.21.15.92:0/675793674 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b7c0ae240 msgr2=0x7f2b7c0c9210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:24.767 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.762+0000 7f2b8348b700 1 --2- 172.21.15.92:0/675793674 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b7c0ae240 0x7f2b7c0c9210 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c072240 tx=0x7f2b74004970 comp rx=0 tx=0).stop 2023-08-26T09:26:24.767 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.762+0000 7f2b8348b700 1 -- 172.21.15.92:0/675793674 shutdown_connections 2023-08-26T09:26:24.767 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.762+0000 7f2b8348b700 1 --2- 172.21.15.92:0/675793674 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b7c0ae240 0x7f2b7c0c9210 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:24.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.762+0000 7f2b8348b700 1 --2- 172.21.15.92:0/675793674 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2b68003ff0 0x7f2b7c0ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:24.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.762+0000 7f2b8348b700 1 --2- 172.21.15.92:0/675793674 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f2b6006a0e0 0x7f2b6006c5a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:24.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.762+0000 7f2b8348b700 1 --2- 172.21.15.92:0/675793674 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2b7c14b5a0 0x7f2b7c14ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:24.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.762+0000 7f2b8348b700 1 -- 172.21.15.92:0/675793674 >> 172.21.15.92:0/675793674 conn(0x7f2b7c0cc7b0 msgr2=0x7f2b7c0ccce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:24.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.762+0000 7f2b8348b700 1 -- 172.21.15.92:0/675793674 shutdown_connections 2023-08-26T09:26:24.769 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.762+0000 7f2b8348b700 1 -- 172.21.15.92:0/675793674 wait complete. 2023-08-26T09:26:24.769 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 16 2023-08-26T09:26:24.779 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-26T09:26:24.903 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.899+0000 7f4ecf464700 1 Processor -- start 2023-08-26T09:26:24.904 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.899+0000 7f4ecf464700 1 -- start start 2023-08-26T09:26:24.906 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.900+0000 7f4ecf464700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4ec815b030 0x7f4ec80cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:24.906 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.900+0000 7f4ecf464700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4ec806aa30 0x7f4ec815b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:24.907 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.900+0000 7f4ecf464700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ec815eba0 con 0x7f4ec80ca2f0 2023-08-26T09:26:24.907 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.900+0000 7f4ecf464700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ec80ca880 con 0x7f4ec815b030 2023-08-26T09:26:24.907 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.900+0000 7f4ecf464700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec815ee80 con 0x7f4ec806aa30 2023-08-26T09:26:24.907 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.900+0000 7f4ecd200700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4ec815b030 0x7f4ec80cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:24.908 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.900+0000 7f4ecc9ff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f4ec80ca2f0 0x7f4ec806a320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:59034/0 (socket says 172.21.15.92:59034) 2023-08-26T09:26:24.908 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.900+0000 7f4ecc9ff700 1 -- 172.21.15.92:0/4220643303 learned_addr learned my addr 172.21.15.92:0/4220643303 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:26:24.908 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.900+0000 7f4ecda01700 1 --2- 172.21.15.92:0/4220643303 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4ec806aa30 0x7f4ec815b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:24.908 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.900+0000 7f4ecd200700 1 -- 172.21.15.92:0/4220643303 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4ec806aa30 msgr2=0x7f4ec815b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:24.908 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.900+0000 7f4ecd200700 1 --2- 172.21.15.92:0/4220643303 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4ec806aa30 0x7f4ec815b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:24.909 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.900+0000 7f4ecd200700 1 -- 172.21.15.92:0/4220643303 >> v1:172.21.15.92:6789/0 conn(0x7f4ec80ca2f0 legacy=0x7f4ec806a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:24.909 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.900+0000 7f4ecd200700 1 -- 172.21.15.92:0/4220643303 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec815f160 con 0x7f4ec815b030 2023-08-26T09:26:24.909 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.900+0000 7f4ebffff700 1 -- 172.21.15.92:0/4220643303 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3813556011 0 0) 0x7f4ec815eba0 con 0x7f4ec80ca2f0 2023-08-26T09:26:24.909 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.900+0000 7f4ecda01700 1 --2- 172.21.15.92:0/4220643303 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4ec806aa30 0x7f4ec815b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:26:24.909 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.900+0000 7f4ecd200700 1 --2- 172.21.15.92:0/4220643303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ec815b030 0x7f4ec80cbc50 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f4ec4009840 tx=0x7f4ec4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7af3f99de343c809 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:24.910 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.900+0000 7f4ebffff700 1 -- 172.21.15.92:0/4220643303 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec4011830 con 0x7f4ec815b030 2023-08-26T09:26:24.910 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.901+0000 7f4ebffff700 1 -- 172.21.15.92:0/4220643303 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec4011990 con 0x7f4ec815b030 2023-08-26T09:26:24.910 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.901+0000 7f4ebffff700 1 -- 172.21.15.92:0/4220643303 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec4011d20 con 0x7f4ec815b030 2023-08-26T09:26:24.910 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.901+0000 7f4ecf464700 1 -- 172.21.15.92:0/4220643303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ec815b030 msgr2=0x7f4ec80cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:24.910 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.901+0000 7f4ecf464700 1 --2- 172.21.15.92:0/4220643303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ec815b030 0x7f4ec80cbc50 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f4ec4009840 tx=0x7f4ec4009b50 comp rx=0 tx=0).stop 2023-08-26T09:26:24.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.901+0000 7f4ecf464700 1 -- 172.21.15.92:0/4220643303 shutdown_connections 2023-08-26T09:26:24.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.901+0000 7f4ecf464700 1 --2- 172.21.15.92:0/4220643303 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4ec806aa30 0x7f4ec815b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:24.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.901+0000 7f4ecf464700 1 --2- 172.21.15.92:0/4220643303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ec815b030 0x7f4ec80cbc50 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:24.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.901+0000 7f4ecf464700 1 -- 172.21.15.92:0/4220643303 >> 172.21.15.92:0/4220643303 conn(0x7f4ec80cfca0 msgr2=0x7f4ec80d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:24.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.901+0000 7f4ecf464700 1 -- 172.21.15.92:0/4220643303 shutdown_connections 2023-08-26T09:26:24.912 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.901+0000 7f4ecf464700 1 -- 172.21.15.92:0/4220643303 wait complete. 2023-08-26T09:26:24.914 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.902+0000 7f4ecf464700 1 Processor -- start 2023-08-26T09:26:24.915 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.902+0000 7f4ecf464700 1 -- start start 2023-08-26T09:26:24.961 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.903+0000 7f4ecf464700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ec806aa30 0x7f4ec80af0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:24.962 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.903+0000 7f4ecf464700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4ec80ca2f0 0x7f4ec80ae700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:24.962 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.903+0000 7f4ecf464700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4ec815b030 0x7f4ec806c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:24.962 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.903+0000 7f4ecf464700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec80ad660 con 0x7f4ec806aa30 2023-08-26T09:26:24.962 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.903+0000 7f4ecf464700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec80ad940 con 0x7f4ec80ca2f0 2023-08-26T09:26:24.962 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.903+0000 7f4ecf464700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec80adc20 con 0x7f4ec815b030 2023-08-26T09:26:24.963 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.903+0000 7f4ecd200700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ec806aa30 0x7f4ec80af0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:24.963 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.903+0000 7f4ecd200700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ec806aa30 0x7f4ec80af0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47026/0 (socket says 172.21.15.92:47026) 2023-08-26T09:26:24.963 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.903+0000 7f4ecd200700 1 -- 172.21.15.92:0/3889528751 learned_addr learned my addr 172.21.15.92:0/3889528751 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:24.963 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.904+0000 7f4ecda01700 1 --2- 172.21.15.92:0/3889528751 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4ec815b030 0x7f4ec806c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:24.963 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.904+0000 7f4ecc9ff700 1 --2- 172.21.15.92:0/3889528751 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4ec80ca2f0 0x7f4ec80ae700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:24.964 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.904+0000 7f4ecd200700 1 -- 172.21.15.92:0/3889528751 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4ec815b030 msgr2=0x7f4ec806c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:24.964 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.904+0000 7f4ecd200700 1 --2- 172.21.15.92:0/3889528751 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4ec815b030 0x7f4ec806c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:24.964 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.904+0000 7f4ecd200700 1 -- 172.21.15.92:0/3889528751 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4ec80ca2f0 msgr2=0x7f4ec80ae700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:24.964 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.904+0000 7f4ecd200700 1 --2- 172.21.15.92:0/3889528751 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4ec80ca2f0 0x7f4ec80ae700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:24.964 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.904+0000 7f4ecd200700 1 -- 172.21.15.92:0/3889528751 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec40094a0 con 0x7f4ec806aa30 2023-08-26T09:26:24.965 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.904+0000 7f4ecd200700 1 --2- 172.21.15.92:0/3889528751 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ec806aa30 0x7f4ec80af0e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f4ec4014040 tx=0x7f4ec4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:24.965 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.904+0000 7f4ebdffb700 1 -- 172.21.15.92:0/3889528751 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec40038a0 con 0x7f4ec806aa30 2023-08-26T09:26:24.965 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.904+0000 7f4ebdffb700 1 -- 172.21.15.92:0/3889528751 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec401e070 con 0x7f4ec806aa30 2023-08-26T09:26:24.965 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.904+0000 7f4ecf464700 1 -- 172.21.15.92:0/3889528751 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ec80adf00 con 0x7f4ec806aa30 2023-08-26T09:26:24.965 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.904+0000 7f4ebdffb700 1 -- 172.21.15.92:0/3889528751 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec4003c20 con 0x7f4ec806aa30 2023-08-26T09:26:24.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.904+0000 7f4ecf464700 1 -- 172.21.15.92:0/3889528751 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ec815eae0 con 0x7f4ec806aa30 2023-08-26T09:26:24.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.905+0000 7f4ecf464700 1 -- 172.21.15.92:0/3889528751 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ec804e660 con 0x7f4ec806aa30 2023-08-26T09:26:24.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.906+0000 7f4ebdffb700 1 -- 172.21.15.92:0/3889528751 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4ec402d450 con 0x7f4ec806aa30 2023-08-26T09:26:24.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.906+0000 7f4ebdffb700 1 --2- 172.21.15.92:0/3889528751 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f4eac06a0e0 0x7f4eac06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:24.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.906+0000 7f4ebdffb700 1 -- 172.21.15.92:0/3889528751 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4ec40895f0 con 0x7f4ec806aa30 2023-08-26T09:26:24.967 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.906+0000 7f4ecc9ff700 1 --2- 172.21.15.92:0/3889528751 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f4eac06a0e0 0x7f4eac06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:24.967 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.906+0000 7f4ecc9ff700 1 --2- 172.21.15.92:0/3889528751 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f4eac06a0e0 0x7f4eac06c5a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4ec80c9d50 tx=0x7f4eb8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:24.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:24.910+0000 7f4ebdffb700 1 -- 172.21.15.92:0/3889528751 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4ec4054d70 con 0x7f4ec806aa30 2023-08-26T09:26:25.106 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.101+0000 7f4ecf464700 1 -- 172.21.15.92:0/3889528751 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ec8071f40 con 0x7f4ec806aa30 2023-08-26T09:26:25.107 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.102+0000 7f4ebdffb700 1 -- 172.21.15.92:0/3889528751 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+18281 (secure 0 0 0) 0x7f4ec4058390 con 0x7f4ec806aa30 2023-08-26T09:26:25.107 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:26:25.107 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":33,"fsid":"254a2d31-bd41-4507-8326-1b205ac24377","created":"2023-08-26T09:24:55.352131+0000","modified":"2023-08-26T09:26:22.341844+0000","last_up_change":"2023-08-26T09:25:06.124496+0000","last_in_change":"2023-08-26T09:24:57.840725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-26T09:25:06.650431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-26T09:25:06.973382+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-26T09:26:19.003923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-26T09:26:19.696549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e9e7638-4459-4d8d-8e40-130bcf48df66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6819","nonce":382827192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6824","nonce":382827192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6831","nonce":382827192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6827","nonce":382827192},{"type":"v1","addr":"172.21.15.92:6829","nonce":382827192}]},"public_addr":"172.21.15.92:6819/382827192","cluster_addr":"172.21.15.92:6824/382827192","heartbeat_back_addr":"172.21.15.92:6831/382827192","heartbeat_front_addr":"172.21.15.92:6829/382827192","state":["exists","up"]},{"osd":1,"uuid":"164e68c9-aedd-4df5-9b70-f4b1ec3bda13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6809","nonce":618773438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6811","nonce":618773438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6815","nonce":618773438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":618773438},{"type":"v1","addr":"172.21.15.92:6813","nonce":618773438}]},"public_addr":"172.21.15.92:6809/618773438","cluster_addr":"172.21.15.92:6811/618773438","heartbeat_back_addr":"172.21.15.92:6815/618773438","heartbeat_front_addr":"172.21.15.92:6813/618773438","state":["exists","up"]},{"osd":2,"uuid":"8701dfee-629a-4d30-82e4-b8fac340303f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6818","nonce":3697397687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6821","nonce":3697397687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6828","nonce":3697397687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6823","nonce":3697397687},{"type":"v1","addr":"172.21.15.92:6825","nonce":3697397687}]},"public_addr":"172.21.15.92:6818/3697397687","cluster_addr":"172.21.15.92:6821/3697397687","heartbeat_back_addr":"172.21.15.92:6828/3697397687","heartbeat_front_addr":"172.21.15.92:6825/3697397687","state":["exists","up"]},{"osd":3,"uuid":"93bdc94d-dc07-495f-995a-a6ad072f0247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6801","nonce":3579846453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6803","nonce":3579846453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6807","nonce":3579846453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":3579846453},{"type":"v1","addr":"172.21.15.92:6805","nonce":3579846453}]},"public_addr":"172.21.15.92:6801/3579846453","cluster_addr":"172.21.15.92:6803/3579846453","heartbeat_back_addr":"172.21.15.92:6807/3579846453","heartbeat_front_addr":"172.21.15.92:6805/3579846453","state":["exists","up"]},{"osd":4,"uuid":"d9d0ea80-8481-46a7-9677-c338d32cf1d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6809","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6811","nonce":3228383424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6813","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6815","nonce":3228383424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6821","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6823","nonce":3228383424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6817","nonce":3228383424},{"type":"v1","addr":"172.21.15.188:6819","nonce":3228383424}]},"public_addr":"172.21.15.188:6811/3228383424","cluster_addr":"172.21.15.188:6815/3228383424","heartbeat_back_addr":"172.21.15.188:6823/3228383424","heartbeat_front_addr":"172.21.15.188:6819/3228383424","state":["exists","up"]},{"osd":5,"uuid":"38d03253-467a-456f-bd5e-5a46532a0b18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6801","nonce":1655821054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6803","nonce":1655821054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6807","nonce":1655821054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":1655821054},{"type":"v1","addr":"172.21.15.188:6805","nonce":1655821054}]},"public_addr":"172.21.15.188:6801/1655821054","cluster_addr":"172.21.15.188:6803/1655821054","heartbeat_back_addr":"172.21.15.188:6807/1655821054","heartbeat_front_addr":"172.21.15.188:6805/1655821054","state":["exists","up"]},{"osd":6,"uuid":"d61564b5-136f-42e5-a843-626c2017cc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6810","nonce":2069976891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6814","nonce":2069976891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6822","nonce":2069976891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":2069976891},{"type":"v1","addr":"172.21.15.188:6818","nonce":2069976891}]},"public_addr":"172.21.15.188:6810/2069976891","cluster_addr":"172.21.15.188:6814/2069976891","heartbeat_back_addr":"172.21.15.188:6822/2069976891","heartbeat_front_addr":"172.21.15.188:6818/2069976891","state":["exists","up"]},{"osd":7,"uuid":"fae2949e-0d62-42cd-ba72-08f516084b20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6825","nonce":1882888860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6827","nonce":1882888860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6831","nonce":1882888860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1882888860},{"type":"v1","addr":"172.21.15.188:6829","nonce":1882888860}]},"public_addr":"172.21.15.188:6825/1882888860","cluster_addr":"172.21.15.188:6827/1882888860","heartbeat_back_addr":"172.21.15.188:6831/1882888860","heartbeat_front_addr":"172.21.15.188:6829/1882888860","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.038523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.063160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.000857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.975572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.023848+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:02.765194+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:03.081365+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-26T09:25:05.110745+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-26T09:26:25.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.104+0000 7f4ecf464700 1 -- 172.21.15.92:0/3889528751 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f4eac06a0e0 msgr2=0x7f4eac06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:25.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.104+0000 7f4ecf464700 1 --2- 172.21.15.92:0/3889528751 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f4eac06a0e0 0x7f4eac06c5a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4ec80c9d50 tx=0x7f4eb8009040 comp rx=0 tx=0).stop 2023-08-26T09:26:25.110 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.104+0000 7f4ecf464700 1 -- 172.21.15.92:0/3889528751 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ec806aa30 msgr2=0x7f4ec80af0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:25.110 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.104+0000 7f4ecf464700 1 --2- 172.21.15.92:0/3889528751 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ec806aa30 0x7f4ec80af0e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f4ec4014040 tx=0x7f4ec4004750 comp rx=0 tx=0).stop 2023-08-26T09:26:25.110 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.105+0000 7f4ecf464700 1 -- 172.21.15.92:0/3889528751 shutdown_connections 2023-08-26T09:26:25.110 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.105+0000 7f4ecf464700 1 --2- 172.21.15.92:0/3889528751 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4ec815b030 0x7f4ec806c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:25.111 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.105+0000 7f4ecf464700 1 --2- 172.21.15.92:0/3889528751 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ec806aa30 0x7f4ec80af0e0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:25.111 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.105+0000 7f4ecf464700 1 --2- 172.21.15.92:0/3889528751 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f4eac06a0e0 0x7f4eac06c5a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:25.111 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.105+0000 7f4ecf464700 1 --2- 172.21.15.92:0/3889528751 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4ec80ca2f0 0x7f4ec80ae700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:25.111 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.105+0000 7f4ecf464700 1 -- 172.21.15.92:0/3889528751 >> 172.21.15.92:0/3889528751 conn(0x7f4ec80cfca0 msgr2=0x7f4ec80af720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:25.111 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.105+0000 7f4ecf464700 1 -- 172.21.15.92:0/3889528751 shutdown_connections 2023-08-26T09:26:25.112 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.105+0000 7f4ecf464700 1 -- 172.21.15.92:0/3889528751 wait complete. 2023-08-26T09:26:25.122 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-26T09:26:25.122 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-26T09:26:25.243 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.238+0000 7fa5afc68700 1 Processor -- start 2023-08-26T09:26:25.243 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.238+0000 7fa5afc68700 1 -- start start 2023-08-26T09:26:25.245 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.239+0000 7fa5afc68700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa5a80ca620 0x7fa5a80caa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:25.245 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.239+0000 7fa5afc68700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa5a815d6c0 0x7fa5a80cea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:25.246 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.239+0000 7fa5afc68700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5a80cf4d0 con 0x7fa5a80cef70 2023-08-26T09:26:25.246 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.239+0000 7fa5afc68700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5a80cb4a0 con 0x7fa5a815d6c0 2023-08-26T09:26:25.246 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.239+0000 7fa5afc68700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a80caf40 con 0x7fa5a80ca620 2023-08-26T09:26:25.246 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.239+0000 7fa5ad203700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa5a815d6c0 0x7fa5a80cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:25.247 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.239+0000 7fa5ad203700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa5a815d6c0 0x7fa5a80cea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47034/0 (socket says 172.21.15.92:47034) 2023-08-26T09:26:25.247 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.239+0000 7fa5ad203700 1 -- 172.21.15.92:0/2631163520 learned_addr learned my addr 172.21.15.92:0/2631163520 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:25.247 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.239+0000 7fa5ada04700 1 --2- 172.21.15.92:0/2631163520 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa5a80ca620 0x7fa5a80caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:25.247 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.240+0000 7fa5ad203700 1 -- 172.21.15.92:0/2631163520 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa5a80ca620 msgr2=0x7fa5a80caa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:25.247 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.240+0000 7fa5ad203700 1 --2- 172.21.15.92:0/2631163520 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa5a80ca620 0x7fa5a80caa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:25.248 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.240+0000 7fa5ad203700 1 -- 172.21.15.92:0/2631163520 >> v1:172.21.15.188:6789/0 conn(0x7fa5a80cef70 legacy=0x7fa5a806a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:25.248 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.240+0000 7fa5ad203700 1 -- 172.21.15.92:0/2631163520 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a80ce3b0 con 0x7fa5a815d6c0 2023-08-26T09:26:25.248 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.240+0000 7fa5ad203700 1 --2- 172.21.15.92:0/2631163520 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5a815d6c0 0x7fa5a80cea30 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa5a40098f0 tx=0x7fa5a4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46e91e03c9bfc6d8 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:25.248 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.240+0000 7fa5aca02700 1 -- 172.21.15.92:0/2631163520 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a4011830 con 0x7fa5a815d6c0 2023-08-26T09:26:25.248 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.240+0000 7fa5aca02700 1 -- 172.21.15.92:0/2631163520 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a4011990 con 0x7fa5a815d6c0 2023-08-26T09:26:25.249 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.240+0000 7fa5aca02700 1 -- 172.21.15.92:0/2631163520 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a4011d20 con 0x7fa5a815d6c0 2023-08-26T09:26:25.249 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.241+0000 7fa5afc68700 1 -- 172.21.15.92:0/2631163520 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5a815d6c0 msgr2=0x7fa5a80cea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:25.249 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.241+0000 7fa5afc68700 1 --2- 172.21.15.92:0/2631163520 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5a815d6c0 0x7fa5a80cea30 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa5a40098f0 tx=0x7fa5a4009c00 comp rx=0 tx=0).stop 2023-08-26T09:26:25.249 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.241+0000 7fa5afc68700 1 -- 172.21.15.92:0/2631163520 shutdown_connections 2023-08-26T09:26:25.249 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.241+0000 7fa5afc68700 1 --2- 172.21.15.92:0/2631163520 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa5a80ca620 0x7fa5a80caa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:25.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.241+0000 7fa5afc68700 1 --2- 172.21.15.92:0/2631163520 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5a815d6c0 0x7fa5a80cea30 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:25.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.241+0000 7fa5afc68700 1 -- 172.21.15.92:0/2631163520 >> 172.21.15.92:0/2631163520 conn(0x7fa5a80cc7b0 msgr2=0x7fa5a80ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:25.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.241+0000 7fa5afc68700 1 -- 172.21.15.92:0/2631163520 shutdown_connections 2023-08-26T09:26:25.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.241+0000 7fa5afc68700 1 -- 172.21.15.92:0/2631163520 wait complete. 2023-08-26T09:26:25.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.242+0000 7fa5afc68700 1 Processor -- start 2023-08-26T09:26:25.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.242+0000 7fa5afc68700 1 -- start start 2023-08-26T09:26:25.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.243+0000 7fa5afc68700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa5a80ca620 0x7fa5a80c9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:25.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.243+0000 7fa5afc68700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa5a80cef70 0x7fa5a814c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:25.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.243+0000 7fa5afc68700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5a815d6c0 0x7fa5a80af100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:25.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.243+0000 7fa5afc68700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a80aece0 con 0x7fa5a815d6c0 2023-08-26T09:26:25.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.243+0000 7fa5afc68700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a815b780 con 0x7fa5a80cef70 2023-08-26T09:26:25.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.243+0000 7fa5afc68700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a814c6d0 con 0x7fa5a80ca620 2023-08-26T09:26:25.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.243+0000 7fa5ae205700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5a815d6c0 0x7fa5a80af100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:25.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.243+0000 7fa5ae205700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5a815d6c0 0x7fa5a80af100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47042/0 (socket says 172.21.15.92:47042) 2023-08-26T09:26:25.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.243+0000 7fa5ae205700 1 -- 172.21.15.92:0/2122101461 learned_addr learned my addr 172.21.15.92:0/2122101461 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:25.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.243+0000 7fa5ada04700 1 --2- 172.21.15.92:0/2122101461 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa5a80ca620 0x7fa5a80c9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:25.256 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.243+0000 7fa5ad203700 1 --2- 172.21.15.92:0/2122101461 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa5a80cef70 0x7fa5a814c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:25.256 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.243+0000 7fa5ae205700 1 -- 172.21.15.92:0/2122101461 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa5a80ca620 msgr2=0x7fa5a80c9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:25.256 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.243+0000 7fa5ae205700 1 --2- 172.21.15.92:0/2122101461 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa5a80ca620 0x7fa5a80c9410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:25.256 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.243+0000 7fa5ae205700 1 -- 172.21.15.92:0/2122101461 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa5a80cef70 msgr2=0x7fa5a814c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:25.256 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.243+0000 7fa5ae205700 1 --2- 172.21.15.92:0/2122101461 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa5a80cef70 0x7fa5a814c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:25.257 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.243+0000 7fa5ae205700 1 -- 172.21.15.92:0/2122101461 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a4009550 con 0x7fa5a815d6c0 2023-08-26T09:26:25.257 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.243+0000 7fa5ae205700 1 --2- 172.21.15.92:0/2122101461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5a815d6c0 0x7fa5a80af100 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa5a000cc80 tx=0x7fa5a000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:25.257 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.243+0000 7fa59e7fc700 1 -- 172.21.15.92:0/2122101461 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a000ad40 con 0x7fa5a815d6c0 2023-08-26T09:26:25.257 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.243+0000 7fa59e7fc700 1 -- 172.21.15.92:0/2122101461 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a000ce80 con 0x7fa5a815d6c0 2023-08-26T09:26:25.257 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.244+0000 7fa5afc68700 1 -- 172.21.15.92:0/2122101461 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5a80af640 con 0x7fa5a815d6c0 2023-08-26T09:26:25.258 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.244+0000 7fa59e7fc700 1 -- 172.21.15.92:0/2122101461 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a000aea0 con 0x7fa5a815d6c0 2023-08-26T09:26:25.258 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.244+0000 7fa5afc68700 1 -- 172.21.15.92:0/2122101461 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5a80ae340 con 0x7fa5a815d6c0 2023-08-26T09:26:25.258 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.244+0000 7fa5afc68700 1 -- 172.21.15.92:0/2122101461 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5a80aee20 con 0x7fa5a815d6c0 2023-08-26T09:26:25.258 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.245+0000 7fa59e7fc700 1 -- 172.21.15.92:0/2122101461 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa5a0003c40 con 0x7fa5a815d6c0 2023-08-26T09:26:25.258 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.245+0000 7fa59e7fc700 1 --2- 172.21.15.92:0/2122101461 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa58c06a0e0 0x7fa58c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:25.259 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.245+0000 7fa59e7fc700 1 -- 172.21.15.92:0/2122101461 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa5a00886e0 con 0x7fa5a815d6c0 2023-08-26T09:26:25.259 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.245+0000 7fa5ada04700 1 --2- 172.21.15.92:0/2122101461 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa58c06a0e0 0x7fa58c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:25.259 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.246+0000 7fa5ada04700 1 --2- 172.21.15.92:0/2122101461 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa58c06a0e0 0x7fa58c06c5a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa598009a10 tx=0x7fa598008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:25.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.250+0000 7fa59e7fc700 1 -- 172.21.15.92:0/2122101461 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa5a80aee20 con 0x7fa5a815d6c0 2023-08-26T09:26:25.327 INFO:tasks.ceph.mds.a.smithi092.stderr:2023-08-26T09:26:25.322+0000 7fb20eecd700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-26T09:26:25.444 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.439+0000 7fa5afc68700 1 -- 172.21.15.92:0/2122101461 --> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa5a80cf720 con 0x7fa58c06a0e0 2023-08-26T09:26:25.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.448+0000 7fa59e7fc700 1 -- 172.21.15.92:0/2122101461 <== mgr.4107 v2:172.21.15.92:6832/1988454907 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311831 (secure 0 0 0) 0x7fa598009660 con 0x7fa58c06a0e0 2023-08-26T09:26:25.456 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:26:25.459 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.451+0000 7fa5afc68700 1 -- 172.21.15.92:0/2122101461 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa58c06a0e0 msgr2=0x7fa58c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:25.459 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.451+0000 7fa5afc68700 1 --2- 172.21.15.92:0/2122101461 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa58c06a0e0 0x7fa58c06c5a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa598009a10 tx=0x7fa598008040 comp rx=0 tx=0).stop 2023-08-26T09:26:25.460 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.451+0000 7fa5afc68700 1 -- 172.21.15.92:0/2122101461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5a815d6c0 msgr2=0x7fa5a80af100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:25.460 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.451+0000 7fa5afc68700 1 --2- 172.21.15.92:0/2122101461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5a815d6c0 0x7fa5a80af100 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa5a000cc80 tx=0x7fa5a000a340 comp rx=0 tx=0).stop 2023-08-26T09:26:25.460 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.451+0000 7fa5afc68700 1 -- 172.21.15.92:0/2122101461 shutdown_connections 2023-08-26T09:26:25.460 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.451+0000 7fa5afc68700 1 --2- 172.21.15.92:0/2122101461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5a815d6c0 0x7fa5a80af100 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:25.461 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.451+0000 7fa5afc68700 1 --2- 172.21.15.92:0/2122101461 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa5a80ca620 0x7fa5a80c9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:25.461 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.451+0000 7fa5afc68700 1 --2- 172.21.15.92:0/2122101461 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fa58c06a0e0 0x7fa58c06c5a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:25.461 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.451+0000 7fa5afc68700 1 --2- 172.21.15.92:0/2122101461 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa5a80cef70 0x7fa5a814c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:25.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.451+0000 7fa5afc68700 1 -- 172.21.15.92:0/2122101461 >> 172.21.15.92:0/2122101461 conn(0x7fa5a80cc7b0 msgr2=0x7fa5a815a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:25.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.451+0000 7fa5afc68700 1 -- 172.21.15.92:0/2122101461 shutdown_connections 2023-08-26T09:26:25.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.451+0000 7fa5afc68700 1 -- 172.21.15.92:0/2122101461 wait complete. 2023-08-26T09:26:25.462 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2023-08-26T09:26:25.468 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2023-08-26T09:26:24.952760+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":104,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220172,"kb_used_data":3964,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754754548,"statfs":{"total":773094113280,"available":772868657152,"internally_reserved":0,"allocated":4059136,"data_stored":2336180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.615993"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.363335+0000","last_change":"2023-08-26T09:26:21.356499+0000","last_active":"2023-08-26T09:26:21.363335+0000","last_peered":"2023-08-26T09:26:21.363335+0000","last_clean":"2023-08-26T09:26:21.363335+0000","last_became_active":"2023-08-26T09:26:21.356265+0000","last_became_peered":"2023-08-26T09:26:21.356265+0000","last_unstale":"2023-08-26T09:26:21.363335+0000","last_undegraded":"2023-08-26T09:26:21.363335+0000","last_fullsized":"2023-08-26T09:26:21.363335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:49:23.701040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.363279+0000","last_change":"2023-08-26T09:26:21.355899+0000","last_active":"2023-08-26T09:26:21.363279+0000","last_peered":"2023-08-26T09:26:21.363279+0000","last_clean":"2023-08-26T09:26:21.363279+0000","last_became_active":"2023-08-26T09:26:21.355641+0000","last_became_peered":"2023-08-26T09:26:21.355641+0000","last_unstale":"2023-08-26T09:26:21.363279+0000","last_undegraded":"2023-08-26T09:26:21.363279+0000","last_fullsized":"2023-08-26T09:26:21.363279+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T16:12:23.068891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.367697+0000","last_change":"2023-08-26T09:26:21.362725+0000","last_active":"2023-08-26T09:26:21.367697+0000","last_peered":"2023-08-26T09:26:21.367697+0000","last_clean":"2023-08-26T09:26:21.367697+0000","last_became_active":"2023-08-26T09:26:21.362464+0000","last_became_peered":"2023-08-26T09:26:21.362464+0000","last_unstale":"2023-08-26T09:26:21.367697+0000","last_undegraded":"2023-08-26T09:26:21.367697+0000","last_fullsized":"2023-08-26T09:26:21.367697+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T21:00:41.330996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.362468+0000","last_change":"2023-08-26T09:26:21.356021+0000","last_active":"2023-08-26T09:26:21.362468+0000","last_peered":"2023-08-26T09:26:21.362468+0000","last_clean":"2023-08-26T09:26:21.362468+0000","last_became_active":"2023-08-26T09:26:21.355762+0000","last_became_peered":"2023-08-26T09:26:21.355762+0000","last_unstale":"2023-08-26T09:26:21.362468+0000","last_undegraded":"2023-08-26T09:26:21.362468+0000","last_fullsized":"2023-08-26T09:26:21.362468+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T14:41:42.547140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.361911+0000","last_change":"2023-08-26T09:26:21.356680+0000","last_active":"2023-08-26T09:26:21.361911+0000","last_peered":"2023-08-26T09:26:21.361911+0000","last_clean":"2023-08-26T09:26:21.361911+0000","last_became_active":"2023-08-26T09:26:21.356366+0000","last_became_peered":"2023-08-26T09:26:21.356366+0000","last_unstale":"2023-08-26T09:26:21.361911+0000","last_undegraded":"2023-08-26T09:26:21.361911+0000","last_fullsized":"2023-08-26T09:26:21.361911+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T09:42:48.477801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.358181+0000","last_change":"2023-08-26T09:26:21.356179+0000","last_active":"2023-08-26T09:26:21.358181+0000","last_peered":"2023-08-26T09:26:21.358181+0000","last_clean":"2023-08-26T09:26:21.358181+0000","last_became_active":"2023-08-26T09:26:21.355899+0000","last_became_peered":"2023-08-26T09:26:21.355899+0000","last_unstale":"2023-08-26T09:26:21.358181+0000","last_undegraded":"2023-08-26T09:26:21.358181+0000","last_fullsized":"2023-08-26T09:26:21.358181+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T09:35:53.935954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.363650+0000","last_change":"2023-08-26T09:26:21.356982+0000","last_active":"2023-08-26T09:26:21.363650+0000","last_peered":"2023-08-26T09:26:21.363650+0000","last_clean":"2023-08-26T09:26:21.363650+0000","last_became_active":"2023-08-26T09:26:21.356644+0000","last_became_peered":"2023-08-26T09:26:21.356644+0000","last_unstale":"2023-08-26T09:26:21.363650+0000","last_undegraded":"2023-08-26T09:26:21.363650+0000","last_fullsized":"2023-08-26T09:26:21.363650+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T19:27:54.335742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.363230+0000","last_change":"2023-08-26T09:26:21.356126+0000","last_active":"2023-08-26T09:26:21.363230+0000","last_peered":"2023-08-26T09:26:21.363230+0000","last_clean":"2023-08-26T09:26:21.363230+0000","last_became_active":"2023-08-26T09:26:21.355422+0000","last_became_peered":"2023-08-26T09:26:21.355422+0000","last_unstale":"2023-08-26T09:26:21.363230+0000","last_undegraded":"2023-08-26T09:26:21.363230+0000","last_fullsized":"2023-08-26T09:26:21.363230+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T16:56:26.919045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.368544+0000","last_change":"2023-08-26T09:26:21.364303+0000","last_active":"2023-08-26T09:26:21.368544+0000","last_peered":"2023-08-26T09:26:21.368544+0000","last_clean":"2023-08-26T09:26:21.368544+0000","last_became_active":"2023-08-26T09:26:21.363525+0000","last_became_peered":"2023-08-26T09:26:21.363525+0000","last_unstale":"2023-08-26T09:26:21.368544+0000","last_undegraded":"2023-08-26T09:26:21.368544+0000","last_fullsized":"2023-08-26T09:26:21.368544+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T12:59:46.616480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.375349+0000","last_change":"2023-08-26T09:26:21.371591+0000","last_active":"2023-08-26T09:26:21.375349+0000","last_peered":"2023-08-26T09:26:21.375349+0000","last_clean":"2023-08-26T09:26:21.375349+0000","last_became_active":"2023-08-26T09:26:21.371340+0000","last_became_peered":"2023-08-26T09:26:21.371340+0000","last_unstale":"2023-08-26T09:26:21.375349+0000","last_undegraded":"2023-08-26T09:26:21.375349+0000","last_fullsized":"2023-08-26T09:26:21.375349+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:19:17.113274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.363628+0000","last_change":"2023-08-26T09:26:21.354267+0000","last_active":"2023-08-26T09:26:21.363628+0000","last_peered":"2023-08-26T09:26:21.363628+0000","last_clean":"2023-08-26T09:26:21.363628+0000","last_became_active":"2023-08-26T09:26:21.353985+0000","last_became_peered":"2023-08-26T09:26:21.353985+0000","last_unstale":"2023-08-26T09:26:21.363628+0000","last_undegraded":"2023-08-26T09:26:21.363628+0000","last_fullsized":"2023-08-26T09:26:21.363628+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T16:28:51.080189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.363765+0000","last_change":"2023-08-26T09:26:21.355176+0000","last_active":"2023-08-26T09:26:21.363765+0000","last_peered":"2023-08-26T09:26:21.363765+0000","last_clean":"2023-08-26T09:26:21.363765+0000","last_became_active":"2023-08-26T09:26:21.354917+0000","last_became_peered":"2023-08-26T09:26:21.354917+0000","last_unstale":"2023-08-26T09:26:21.363765+0000","last_undegraded":"2023-08-26T09:26:21.363765+0000","last_fullsized":"2023-08-26T09:26:21.363765+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T17:05:05.754634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.375302+0000","last_change":"2023-08-26T09:26:21.370767+0000","last_active":"2023-08-26T09:26:21.375302+0000","last_peered":"2023-08-26T09:26:21.375302+0000","last_clean":"2023-08-26T09:26:21.375302+0000","last_became_active":"2023-08-26T09:26:21.370440+0000","last_became_peered":"2023-08-26T09:26:21.370440+0000","last_unstale":"2023-08-26T09:26:21.375302+0000","last_undegraded":"2023-08-26T09:26:21.375302+0000","last_fullsized":"2023-08-26T09:26:21.375302+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T12:59:46.616480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.363870+0000","last_change":"2023-08-26T09:26:21.358868+0000","last_active":"2023-08-26T09:26:21.363870+0000","last_peered":"2023-08-26T09:26:21.363870+0000","last_clean":"2023-08-26T09:26:21.363870+0000","last_became_active":"2023-08-26T09:26:21.358606+0000","last_became_peered":"2023-08-26T09:26:21.358606+0000","last_unstale":"2023-08-26T09:26:21.363870+0000","last_undegraded":"2023-08-26T09:26:21.363870+0000","last_fullsized":"2023-08-26T09:26:21.363870+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:17:03.084649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.365763+0000","last_change":"2023-08-26T09:26:21.358650+0000","last_active":"2023-08-26T09:26:21.365763+0000","last_peered":"2023-08-26T09:26:21.365763+0000","last_clean":"2023-08-26T09:26:21.365763+0000","last_became_active":"2023-08-26T09:26:21.358335+0000","last_became_peered":"2023-08-26T09:26:21.358335+0000","last_unstale":"2023-08-26T09:26:21.365763+0000","last_undegraded":"2023-08-26T09:26:21.365763+0000","last_fullsized":"2023-08-26T09:26:21.365763+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T17:38:18.635900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.369637+0000","last_change":"2023-08-26T09:26:21.367005+0000","last_active":"2023-08-26T09:26:21.369637+0000","last_peered":"2023-08-26T09:26:21.369637+0000","last_clean":"2023-08-26T09:26:21.369637+0000","last_became_active":"2023-08-26T09:26:21.366691+0000","last_became_peered":"2023-08-26T09:26:21.366691+0000","last_unstale":"2023-08-26T09:26:21.369637+0000","last_undegraded":"2023-08-26T09:26:21.369637+0000","last_fullsized":"2023-08-26T09:26:21.369637+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T17:46:14.311433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.374757+0000","last_change":"2023-08-26T09:26:21.369025+0000","last_active":"2023-08-26T09:26:21.374757+0000","last_peered":"2023-08-26T09:26:21.374757+0000","last_clean":"2023-08-26T09:26:21.374757+0000","last_became_active":"2023-08-26T09:26:21.368308+0000","last_became_peered":"2023-08-26T09:26:21.368308+0000","last_unstale":"2023-08-26T09:26:21.374757+0000","last_undegraded":"2023-08-26T09:26:21.374757+0000","last_fullsized":"2023-08-26T09:26:21.374757+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T20:45:15.829357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.362412+0000","last_change":"2023-08-26T09:26:21.356538+0000","last_active":"2023-08-26T09:26:21.362412+0000","last_peered":"2023-08-26T09:26:21.362412+0000","last_clean":"2023-08-26T09:26:21.362412+0000","last_became_active":"2023-08-26T09:26:21.356276+0000","last_became_peered":"2023-08-26T09:26:21.356276+0000","last_unstale":"2023-08-26T09:26:21.362412+0000","last_undegraded":"2023-08-26T09:26:21.362412+0000","last_fullsized":"2023-08-26T09:26:21.362412+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T19:21:37.773350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.363292+0000","last_change":"2023-08-26T09:26:21.359734+0000","last_active":"2023-08-26T09:26:21.363292+0000","last_peered":"2023-08-26T09:26:21.363292+0000","last_clean":"2023-08-26T09:26:21.363292+0000","last_became_active":"2023-08-26T09:26:21.359405+0000","last_became_peered":"2023-08-26T09:26:21.359405+0000","last_unstale":"2023-08-26T09:26:21.363292+0000","last_undegraded":"2023-08-26T09:26:21.363292+0000","last_fullsized":"2023-08-26T09:26:21.363292+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:31:54.954077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.363082+0000","last_change":"2023-08-26T09:26:21.354556+0000","last_active":"2023-08-26T09:26:21.363082+0000","last_peered":"2023-08-26T09:26:21.363082+0000","last_clean":"2023-08-26T09:26:21.363082+0000","last_became_active":"2023-08-26T09:26:21.354263+0000","last_became_peered":"2023-08-26T09:26:21.354263+0000","last_unstale":"2023-08-26T09:26:21.363082+0000","last_undegraded":"2023-08-26T09:26:21.363082+0000","last_fullsized":"2023-08-26T09:26:21.363082+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:23:46.039851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.365683+0000","last_change":"2023-08-26T09:26:21.359718+0000","last_active":"2023-08-26T09:26:21.365683+0000","last_peered":"2023-08-26T09:26:21.365683+0000","last_clean":"2023-08-26T09:26:21.365683+0000","last_became_active":"2023-08-26T09:26:21.359437+0000","last_became_peered":"2023-08-26T09:26:21.359437+0000","last_unstale":"2023-08-26T09:26:21.365683+0000","last_undegraded":"2023-08-26T09:26:21.365683+0000","last_fullsized":"2023-08-26T09:26:21.365683+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:50:24.085600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.362362+0000","last_change":"2023-08-26T09:26:21.354186+0000","last_active":"2023-08-26T09:26:21.362362+0000","last_peered":"2023-08-26T09:26:21.362362+0000","last_clean":"2023-08-26T09:26:21.362362+0000","last_became_active":"2023-08-26T09:26:21.353893+0000","last_became_peered":"2023-08-26T09:26:21.353893+0000","last_unstale":"2023-08-26T09:26:21.362362+0000","last_undegraded":"2023-08-26T09:26:21.362362+0000","last_fullsized":"2023-08-26T09:26:21.362362+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T12:53:33.511765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.375076+0000","last_change":"2023-08-26T09:26:21.371929+0000","last_active":"2023-08-26T09:26:21.375076+0000","last_peered":"2023-08-26T09:26:21.375076+0000","last_clean":"2023-08-26T09:26:21.375076+0000","last_became_active":"2023-08-26T09:26:21.371662+0000","last_became_peered":"2023-08-26T09:26:21.371662+0000","last_unstale":"2023-08-26T09:26:21.375076+0000","last_undegraded":"2023-08-26T09:26:21.375076+0000","last_fullsized":"2023-08-26T09:26:21.375076+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T09:39:14.603202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.371327+0000","last_change":"2023-08-26T09:26:21.369504+0000","last_active":"2023-08-26T09:26:21.371327+0000","last_peered":"2023-08-26T09:26:21.371327+0000","last_clean":"2023-08-26T09:26:21.371327+0000","last_became_active":"2023-08-26T09:26:21.369252+0000","last_became_peered":"2023-08-26T09:26:21.369252+0000","last_unstale":"2023-08-26T09:26:21.371327+0000","last_undegraded":"2023-08-26T09:26:21.371327+0000","last_fullsized":"2023-08-26T09:26:21.371327+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T21:06:26.731477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.362313+0000","last_change":"2023-08-26T09:26:21.353694+0000","last_active":"2023-08-26T09:26:21.362313+0000","last_peered":"2023-08-26T09:26:21.362313+0000","last_clean":"2023-08-26T09:26:21.362313+0000","last_became_active":"2023-08-26T09:26:21.353386+0000","last_became_peered":"2023-08-26T09:26:21.353386+0000","last_unstale":"2023-08-26T09:26:21.362313+0000","last_undegraded":"2023-08-26T09:26:21.362313+0000","last_fullsized":"2023-08-26T09:26:21.362313+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:12:34.503991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.365537+0000","last_change":"2023-08-26T09:26:21.361793+0000","last_active":"2023-08-26T09:26:21.365537+0000","last_peered":"2023-08-26T09:26:21.365537+0000","last_clean":"2023-08-26T09:26:21.365537+0000","last_became_active":"2023-08-26T09:26:21.361509+0000","last_became_peered":"2023-08-26T09:26:21.361509+0000","last_unstale":"2023-08-26T09:26:21.365537+0000","last_undegraded":"2023-08-26T09:26:21.365537+0000","last_fullsized":"2023-08-26T09:26:21.365537+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T20:27:31.943677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.362551+0000","last_change":"2023-08-26T09:26:21.355964+0000","last_active":"2023-08-26T09:26:21.362551+0000","last_peered":"2023-08-26T09:26:21.362551+0000","last_clean":"2023-08-26T09:26:21.362551+0000","last_became_active":"2023-08-26T09:26:21.355702+0000","last_became_peered":"2023-08-26T09:26:21.355702+0000","last_unstale":"2023-08-26T09:26:21.362551+0000","last_undegraded":"2023-08-26T09:26:21.362551+0000","last_fullsized":"2023-08-26T09:26:21.362551+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:27:56.140692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.369071+0000","last_change":"2023-08-26T09:26:21.366654+0000","last_active":"2023-08-26T09:26:21.369071+0000","last_peered":"2023-08-26T09:26:21.369071+0000","last_clean":"2023-08-26T09:26:21.369071+0000","last_became_active":"2023-08-26T09:26:21.366366+0000","last_became_peered":"2023-08-26T09:26:21.366366+0000","last_unstale":"2023-08-26T09:26:21.369071+0000","last_undegraded":"2023-08-26T09:26:21.369071+0000","last_fullsized":"2023-08-26T09:26:21.369071+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T21:10:48.552949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.366438+0000","last_change":"2023-08-26T09:26:21.359015+0000","last_active":"2023-08-26T09:26:21.366438+0000","last_peered":"2023-08-26T09:26:21.366438+0000","last_clean":"2023-08-26T09:26:21.366438+0000","last_became_active":"2023-08-26T09:26:21.358738+0000","last_became_peered":"2023-08-26T09:26:21.358738+0000","last_unstale":"2023-08-26T09:26:21.366438+0000","last_undegraded":"2023-08-26T09:26:21.366438+0000","last_fullsized":"2023-08-26T09:26:21.366438+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:31:56.169058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.353327+0000","last_change":"2023-08-26T09:26:21.348747+0000","last_active":"2023-08-26T09:26:21.353327+0000","last_peered":"2023-08-26T09:26:21.353327+0000","last_clean":"2023-08-26T09:26:21.353327+0000","last_became_active":"2023-08-26T09:26:21.347803+0000","last_became_peered":"2023-08-26T09:26:21.347803+0000","last_unstale":"2023-08-26T09:26:21.353327+0000","last_undegraded":"2023-08-26T09:26:21.353327+0000","last_fullsized":"2023-08-26T09:26:21.353327+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T10:54:24.685983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.372932+0000","last_change":"2023-08-26T09:26:21.367904+0000","last_active":"2023-08-26T09:26:21.372932+0000","last_peered":"2023-08-26T09:26:21.372932+0000","last_clean":"2023-08-26T09:26:21.372932+0000","last_became_active":"2023-08-26T09:26:21.367444+0000","last_became_peered":"2023-08-26T09:26:21.367444+0000","last_unstale":"2023-08-26T09:26:21.372932+0000","last_undegraded":"2023-08-26T09:26:21.372932+0000","last_fullsized":"2023-08-26T09:26:21.372932+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:43:40.019964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.358977+0000","last_change":"2023-08-26T09:26:21.358270+0000","last_active":"2023-08-26T09:26:21.358977+0000","last_peered":"2023-08-26T09:26:21.358977+0000","last_clean":"2023-08-26T09:26:21.358977+0000","last_became_active":"2023-08-26T09:26:21.358018+0000","last_became_peered":"2023-08-26T09:26:21.358018+0000","last_unstale":"2023-08-26T09:26:21.358977+0000","last_undegraded":"2023-08-26T09:26:21.358977+0000","last_fullsized":"2023-08-26T09:26:21.358977+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T13:34:31.295297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.373006+0000","last_change":"2023-08-26T09:26:21.368577+0000","last_active":"2023-08-26T09:26:21.373006+0000","last_peered":"2023-08-26T09:26:21.373006+0000","last_clean":"2023-08-26T09:26:21.373006+0000","last_became_active":"2023-08-26T09:26:21.368287+0000","last_became_peered":"2023-08-26T09:26:21.368287+0000","last_unstale":"2023-08-26T09:26:21.373006+0000","last_undegraded":"2023-08-26T09:26:21.373006+0000","last_fullsized":"2023-08-26T09:26:21.373006+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T09:53:29.035361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"32'4","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.372984+0000","last_change":"2023-08-26T09:26:20.350584+0000","last_active":"2023-08-26T09:26:21.372984+0000","last_peered":"2023-08-26T09:26:21.372984+0000","last_clean":"2023-08-26T09:26:21.372984+0000","last_became_active":"2023-08-26T09:26:20.350299+0000","last_became_peered":"2023-08-26T09:26:20.350299+0000","last_unstale":"2023-08-26T09:26:21.372984+0000","last_undegraded":"2023-08-26T09:26:21.372984+0000","last_fullsized":"2023-08-26T09:26:21.372984+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T20:24:54.795148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.365371+0000","last_change":"2023-08-26T09:26:21.361333+0000","last_active":"2023-08-26T09:26:21.365371+0000","last_peered":"2023-08-26T09:26:21.365371+0000","last_clean":"2023-08-26T09:26:21.365371+0000","last_became_active":"2023-08-26T09:26:21.360691+0000","last_became_peered":"2023-08-26T09:26:21.360691+0000","last_unstale":"2023-08-26T09:26:21.365371+0000","last_undegraded":"2023-08-26T09:26:21.365371+0000","last_fullsized":"2023-08-26T09:26:21.365371+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T10:10:24.181454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"32'1","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.374556+0000","last_change":"2023-08-26T09:26:20.350002+0000","last_active":"2023-08-26T09:26:21.374556+0000","last_peered":"2023-08-26T09:26:21.374556+0000","last_clean":"2023-08-26T09:26:21.374556+0000","last_became_active":"2023-08-26T09:26:20.349240+0000","last_became_peered":"2023-08-26T09:26:20.349240+0000","last_unstale":"2023-08-26T09:26:21.374556+0000","last_undegraded":"2023-08-26T09:26:21.374556+0000","last_fullsized":"2023-08-26T09:26:21.374556+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T13:34:30.291103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.363930+0000","last_change":"2023-08-26T09:26:21.355814+0000","last_active":"2023-08-26T09:26:21.363930+0000","last_peered":"2023-08-26T09:26:21.363930+0000","last_clean":"2023-08-26T09:26:21.363930+0000","last_became_active":"2023-08-26T09:26:21.355585+0000","last_became_peered":"2023-08-26T09:26:21.355585+0000","last_unstale":"2023-08-26T09:26:21.363930+0000","last_undegraded":"2023-08-26T09:26:21.363930+0000","last_fullsized":"2023-08-26T09:26:21.363930+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T20:59:35.867501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"32'2","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.370738+0000","last_change":"2023-08-26T09:26:20.351222+0000","last_active":"2023-08-26T09:26:21.370738+0000","last_peered":"2023-08-26T09:26:21.370738+0000","last_clean":"2023-08-26T09:26:21.370738+0000","last_became_active":"2023-08-26T09:26:20.350970+0000","last_became_peered":"2023-08-26T09:26:20.350970+0000","last_unstale":"2023-08-26T09:26:21.370738+0000","last_undegraded":"2023-08-26T09:26:21.370738+0000","last_fullsized":"2023-08-26T09:26:21.370738+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T12:59:45.612287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.356576+0000","last_change":"2023-08-26T09:26:21.351789+0000","last_active":"2023-08-26T09:26:21.356576+0000","last_peered":"2023-08-26T09:26:21.356576+0000","last_clean":"2023-08-26T09:26:21.356576+0000","last_became_active":"2023-08-26T09:26:21.351486+0000","last_became_peered":"2023-08-26T09:26:21.351486+0000","last_unstale":"2023-08-26T09:26:21.356576+0000","last_undegraded":"2023-08-26T09:26:21.356576+0000","last_fullsized":"2023-08-26T09:26:21.356576+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:58:20.061297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"32'2","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.373550+0000","last_change":"2023-08-26T09:26:20.351872+0000","last_active":"2023-08-26T09:26:21.373550+0000","last_peered":"2023-08-26T09:26:21.373550+0000","last_clean":"2023-08-26T09:26:21.373550+0000","last_became_active":"2023-08-26T09:26:20.351642+0000","last_became_peered":"2023-08-26T09:26:20.351642+0000","last_unstale":"2023-08-26T09:26:21.373550+0000","last_undegraded":"2023-08-26T09:26:21.373550+0000","last_fullsized":"2023-08-26T09:26:21.373550+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T12:40:47.779170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.367618+0000","last_change":"2023-08-26T09:26:21.360948+0000","last_active":"2023-08-26T09:26:21.367618+0000","last_peered":"2023-08-26T09:26:21.367618+0000","last_clean":"2023-08-26T09:26:21.367618+0000","last_became_active":"2023-08-26T09:26:21.360646+0000","last_became_peered":"2023-08-26T09:26:21.360646+0000","last_unstale":"2023-08-26T09:26:21.367618+0000","last_undegraded":"2023-08-26T09:26:21.367618+0000","last_fullsized":"2023-08-26T09:26:21.367618+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:19:17.113274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"32'1","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.376361+0000","last_change":"2023-08-26T09:26:20.353859+0000","last_active":"2023-08-26T09:26:21.376361+0000","last_peered":"2023-08-26T09:26:21.376361+0000","last_clean":"2023-08-26T09:26:21.376361+0000","last_became_active":"2023-08-26T09:26:20.353568+0000","last_became_peered":"2023-08-26T09:26:20.353568+0000","last_unstale":"2023-08-26T09:26:21.376361+0000","last_undegraded":"2023-08-26T09:26:21.376361+0000","last_fullsized":"2023-08-26T09:26:21.376361+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T17:04:09.814528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.365782+0000","last_change":"2023-08-26T09:26:21.360302+0000","last_active":"2023-08-26T09:26:21.365782+0000","last_peered":"2023-08-26T09:26:21.365782+0000","last_clean":"2023-08-26T09:26:21.365782+0000","last_became_active":"2023-08-26T09:26:21.359997+0000","last_became_peered":"2023-08-26T09:26:21.359997+0000","last_unstale":"2023-08-26T09:26:21.365782+0000","last_undegraded":"2023-08-26T09:26:21.365782+0000","last_fullsized":"2023-08-26T09:26:21.365782+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T16:04:31.057490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"32'1","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.374885+0000","last_change":"2023-08-26T09:26:20.357653+0000","last_active":"2023-08-26T09:26:21.374885+0000","last_peered":"2023-08-26T09:26:21.374885+0000","last_clean":"2023-08-26T09:26:21.374885+0000","last_became_active":"2023-08-26T09:26:20.357386+0000","last_became_peered":"2023-08-26T09:26:20.357386+0000","last_unstale":"2023-08-26T09:26:21.374885+0000","last_undegraded":"2023-08-26T09:26:21.374885+0000","last_fullsized":"2023-08-26T09:26:21.374885+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:05:05.841587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.367067+0000","last_change":"2023-08-26T09:26:21.361840+0000","last_active":"2023-08-26T09:26:21.367067+0000","last_peered":"2023-08-26T09:26:21.367067+0000","last_clean":"2023-08-26T09:26:21.367067+0000","last_became_active":"2023-08-26T09:26:21.361378+0000","last_became_peered":"2023-08-26T09:26:21.361378+0000","last_unstale":"2023-08-26T09:26:21.367067+0000","last_undegraded":"2023-08-26T09:26:21.367067+0000","last_fullsized":"2023-08-26T09:26:21.367067+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T21:16:40.655425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.352022+0000","last_change":"2023-08-26T09:26:20.351727+0000","last_active":"2023-08-26T09:26:21.352022+0000","last_peered":"2023-08-26T09:26:21.352022+0000","last_clean":"2023-08-26T09:26:21.352022+0000","last_became_active":"2023-08-26T09:26:20.351444+0000","last_became_peered":"2023-08-26T09:26:20.351444+0000","last_unstale":"2023-08-26T09:26:21.352022+0000","last_undegraded":"2023-08-26T09:26:21.352022+0000","last_fullsized":"2023-08-26T09:26:21.352022+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T19:27:53.331548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.373504+0000","last_change":"2023-08-26T09:26:21.368542+0000","last_active":"2023-08-26T09:26:21.373504+0000","last_peered":"2023-08-26T09:26:21.373504+0000","last_clean":"2023-08-26T09:26:21.373504+0000","last_became_active":"2023-08-26T09:26:21.368008+0000","last_became_peered":"2023-08-26T09:26:21.368008+0000","last_unstale":"2023-08-26T09:26:21.373504+0000","last_undegraded":"2023-08-26T09:26:21.373504+0000","last_fullsized":"2023-08-26T09:26:21.373504+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:16:24.780513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.351714+0000","last_change":"2023-08-26T09:26:20.348770+0000","last_active":"2023-08-26T09:26:21.351714+0000","last_peered":"2023-08-26T09:26:21.351714+0000","last_clean":"2023-08-26T09:26:21.351714+0000","last_became_active":"2023-08-26T09:26:20.348468+0000","last_became_peered":"2023-08-26T09:26:20.348468+0000","last_unstale":"2023-08-26T09:26:21.351714+0000","last_undegraded":"2023-08-26T09:26:21.351714+0000","last_fullsized":"2023-08-26T09:26:21.351714+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T12:44:57.019963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.362489+0000","last_change":"2023-08-26T09:26:21.356115+0000","last_active":"2023-08-26T09:26:21.362489+0000","last_peered":"2023-08-26T09:26:21.362489+0000","last_clean":"2023-08-26T09:26:21.362489+0000","last_became_active":"2023-08-26T09:26:21.355868+0000","last_became_peered":"2023-08-26T09:26:21.355868+0000","last_unstale":"2023-08-26T09:26:21.362489+0000","last_undegraded":"2023-08-26T09:26:21.362489+0000","last_fullsized":"2023-08-26T09:26:21.362489+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T16:02:41.310006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.344226+0000","last_change":"2023-08-26T09:26:20.354098+0000","last_active":"2023-08-26T09:26:21.344226+0000","last_peered":"2023-08-26T09:26:21.344226+0000","last_clean":"2023-08-26T09:26:21.344226+0000","last_became_active":"2023-08-26T09:26:20.353824+0000","last_became_peered":"2023-08-26T09:26:20.353824+0000","last_unstale":"2023-08-26T09:26:21.344226+0000","last_undegraded":"2023-08-26T09:26:21.344226+0000","last_fullsized":"2023-08-26T09:26:21.344226+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:55:48.308194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.373832+0000","last_change":"2023-08-26T09:26:21.368593+0000","last_active":"2023-08-26T09:26:21.373832+0000","last_peered":"2023-08-26T09:26:21.373832+0000","last_clean":"2023-08-26T09:26:21.373832+0000","last_became_active":"2023-08-26T09:26:21.368158+0000","last_became_peered":"2023-08-26T09:26:21.368158+0000","last_unstale":"2023-08-26T09:26:21.373832+0000","last_undegraded":"2023-08-26T09:26:21.373832+0000","last_fullsized":"2023-08-26T09:26:21.373832+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T14:50:51.667115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.348672+0000","last_change":"2023-08-26T09:26:20.351252+0000","last_active":"2023-08-26T09:26:21.348672+0000","last_peered":"2023-08-26T09:26:21.348672+0000","last_clean":"2023-08-26T09:26:21.348672+0000","last_became_active":"2023-08-26T09:26:20.350970+0000","last_became_peered":"2023-08-26T09:26:20.350970+0000","last_unstale":"2023-08-26T09:26:21.348672+0000","last_undegraded":"2023-08-26T09:26:21.348672+0000","last_fullsized":"2023-08-26T09:26:21.348672+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T20:11:22.337434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.371352+0000","last_change":"2023-08-26T09:26:21.367648+0000","last_active":"2023-08-26T09:26:21.371352+0000","last_peered":"2023-08-26T09:26:21.371352+0000","last_clean":"2023-08-26T09:26:21.371352+0000","last_became_active":"2023-08-26T09:26:21.367293+0000","last_became_peered":"2023-08-26T09:26:21.367293+0000","last_unstale":"2023-08-26T09:26:21.371352+0000","last_undegraded":"2023-08-26T09:26:21.371352+0000","last_fullsized":"2023-08-26T09:26:21.371352+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T19:27:54.335742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"32'3","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.379368+0000","last_change":"2023-08-26T09:26:20.354326+0000","last_active":"2023-08-26T09:26:21.379368+0000","last_peered":"2023-08-26T09:26:21.379368+0000","last_clean":"2023-08-26T09:26:21.379368+0000","last_became_active":"2023-08-26T09:26:20.353998+0000","last_became_peered":"2023-08-26T09:26:20.353998+0000","last_unstale":"2023-08-26T09:26:21.379368+0000","last_undegraded":"2023-08-26T09:26:21.379368+0000","last_fullsized":"2023-08-26T09:26:21.379368+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T17:46:13.307239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.356063+0000","last_change":"2023-08-26T09:26:21.354465+0000","last_active":"2023-08-26T09:26:21.356063+0000","last_peered":"2023-08-26T09:26:21.356063+0000","last_clean":"2023-08-26T09:26:21.356063+0000","last_became_active":"2023-08-26T09:26:21.354133+0000","last_became_peered":"2023-08-26T09:26:21.354133+0000","last_unstale":"2023-08-26T09:26:21.356063+0000","last_undegraded":"2023-08-26T09:26:21.356063+0000","last_fullsized":"2023-08-26T09:26:21.356063+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T20:49:31.951364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"32'6","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.379178+0000","last_change":"2023-08-26T09:26:20.355696+0000","last_active":"2023-08-26T09:26:21.379178+0000","last_peered":"2023-08-26T09:26:21.379178+0000","last_clean":"2023-08-26T09:26:21.379178+0000","last_became_active":"2023-08-26T09:26:20.355443+0000","last_became_peered":"2023-08-26T09:26:20.355443+0000","last_unstale":"2023-08-26T09:26:21.379178+0000","last_undegraded":"2023-08-26T09:26:21.379178+0000","last_fullsized":"2023-08-26T09:26:21.379178+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T16:02:48.460043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.367764+0000","last_change":"2023-08-26T09:26:21.363907+0000","last_active":"2023-08-26T09:26:21.367764+0000","last_peered":"2023-08-26T09:26:21.367764+0000","last_clean":"2023-08-26T09:26:21.367764+0000","last_became_active":"2023-08-26T09:26:21.363638+0000","last_became_peered":"2023-08-26T09:26:21.363638+0000","last_unstale":"2023-08-26T09:26:21.367764+0000","last_undegraded":"2023-08-26T09:26:21.367764+0000","last_fullsized":"2023-08-26T09:26:21.367764+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T20:27:31.943677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"32'2","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.373751+0000","last_change":"2023-08-26T09:26:20.350930+0000","last_active":"2023-08-26T09:26:21.373751+0000","last_peered":"2023-08-26T09:26:21.373751+0000","last_clean":"2023-08-26T09:26:21.373751+0000","last_became_active":"2023-08-26T09:26:20.350640+0000","last_became_peered":"2023-08-26T09:26:20.350640+0000","last_unstale":"2023-08-26T09:26:21.373751+0000","last_undegraded":"2023-08-26T09:26:21.373751+0000","last_fullsized":"2023-08-26T09:26:21.373751+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T12:54:36.695837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.363504+0000","last_change":"2023-08-26T09:26:21.353668+0000","last_active":"2023-08-26T09:26:21.363504+0000","last_peered":"2023-08-26T09:26:21.363504+0000","last_clean":"2023-08-26T09:26:21.363504+0000","last_became_active":"2023-08-26T09:26:21.353319+0000","last_became_peered":"2023-08-26T09:26:21.353319+0000","last_unstale":"2023-08-26T09:26:21.363504+0000","last_undegraded":"2023-08-26T09:26:21.363504+0000","last_fullsized":"2023-08-26T09:26:21.363504+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T16:52:21.026233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.348570+0000","last_change":"2023-08-26T09:26:20.349855+0000","last_active":"2023-08-26T09:26:21.348570+0000","last_peered":"2023-08-26T09:26:21.348570+0000","last_clean":"2023-08-26T09:26:21.348570+0000","last_became_active":"2023-08-26T09:26:20.349573+0000","last_became_peered":"2023-08-26T09:26:20.349573+0000","last_unstale":"2023-08-26T09:26:21.348570+0000","last_undegraded":"2023-08-26T09:26:21.348570+0000","last_fullsized":"2023-08-26T09:26:21.348570+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T21:00:40.326803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.369173+0000","last_change":"2023-08-26T09:26:21.367527+0000","last_active":"2023-08-26T09:26:21.369173+0000","last_peered":"2023-08-26T09:26:21.369173+0000","last_clean":"2023-08-26T09:26:21.369173+0000","last_became_active":"2023-08-26T09:26:21.367222+0000","last_became_peered":"2023-08-26T09:26:21.367222+0000","last_unstale":"2023-08-26T09:26:21.369173+0000","last_undegraded":"2023-08-26T09:26:21.369173+0000","last_fullsized":"2023-08-26T09:26:21.369173+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:49:56.486514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.344657+0000","last_change":"2023-08-26T09:26:20.347578+0000","last_active":"2023-08-26T09:26:21.344657+0000","last_peered":"2023-08-26T09:26:21.344657+0000","last_clean":"2023-08-26T09:26:21.344657+0000","last_became_active":"2023-08-26T09:26:20.347299+0000","last_became_peered":"2023-08-26T09:26:20.347299+0000","last_unstale":"2023-08-26T09:26:21.344657+0000","last_undegraded":"2023-08-26T09:26:21.344657+0000","last_fullsized":"2023-08-26T09:26:21.344657+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T16:20:02.831278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.365768+0000","last_change":"2023-08-26T09:26:21.356126+0000","last_active":"2023-08-26T09:26:21.365768+0000","last_peered":"2023-08-26T09:26:21.365768+0000","last_clean":"2023-08-26T09:26:21.365768+0000","last_became_active":"2023-08-26T09:26:21.355548+0000","last_became_peered":"2023-08-26T09:26:21.355548+0000","last_unstale":"2023-08-26T09:26:21.365768+0000","last_undegraded":"2023-08-26T09:26:21.365768+0000","last_fullsized":"2023-08-26T09:26:21.365768+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:49:56.486514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"32'8","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.375981+0000","last_change":"2023-08-26T09:26:20.356861+0000","last_active":"2023-08-26T09:26:21.375981+0000","last_peered":"2023-08-26T09:26:21.375981+0000","last_clean":"2023-08-26T09:26:21.375981+0000","last_became_active":"2023-08-26T09:26:20.356342+0000","last_became_peered":"2023-08-26T09:26:20.356342+0000","last_unstale":"2023-08-26T09:26:21.375981+0000","last_undegraded":"2023-08-26T09:26:21.375981+0000","last_fullsized":"2023-08-26T09:26:21.375981+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T16:02:48.460043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.355157+0000","last_change":"2023-08-26T09:26:21.351708+0000","last_active":"2023-08-26T09:26:21.355157+0000","last_peered":"2023-08-26T09:26:21.355157+0000","last_clean":"2023-08-26T09:26:21.355157+0000","last_became_active":"2023-08-26T09:26:21.351410+0000","last_became_peered":"2023-08-26T09:26:21.351410+0000","last_unstale":"2023-08-26T09:26:21.355157+0000","last_undegraded":"2023-08-26T09:26:21.355157+0000","last_fullsized":"2023-08-26T09:26:21.355157+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T09:39:14.603202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'1","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.375548+0000","last_change":"2023-08-26T09:26:20.352672+0000","last_active":"2023-08-26T09:26:21.375548+0000","last_peered":"2023-08-26T09:26:21.375548+0000","last_clean":"2023-08-26T09:26:21.375548+0000","last_became_active":"2023-08-26T09:26:20.352407+0000","last_became_peered":"2023-08-26T09:26:20.352407+0000","last_unstale":"2023-08-26T09:26:21.375548+0000","last_undegraded":"2023-08-26T09:26:21.375548+0000","last_fullsized":"2023-08-26T09:26:21.375548+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T17:32:34.407999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.365773+0000","last_change":"2023-08-26T09:26:21.360725+0000","last_active":"2023-08-26T09:26:21.365773+0000","last_peered":"2023-08-26T09:26:21.365773+0000","last_clean":"2023-08-26T09:26:21.365773+0000","last_became_active":"2023-08-26T09:26:21.358796+0000","last_became_peered":"2023-08-26T09:26:21.358796+0000","last_unstale":"2023-08-26T09:26:21.365773+0000","last_undegraded":"2023-08-26T09:26:21.365773+0000","last_fullsized":"2023-08-26T09:26:21.365773+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T13:34:31.295297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"32'2","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.370261+0000","last_change":"2023-08-26T09:26:20.347859+0000","last_active":"2023-08-26T09:26:21.370261+0000","last_peered":"2023-08-26T09:26:21.370261+0000","last_clean":"2023-08-26T09:26:21.370261+0000","last_became_active":"2023-08-26T09:26:20.347583+0000","last_became_peered":"2023-08-26T09:26:20.347583+0000","last_unstale":"2023-08-26T09:26:21.370261+0000","last_undegraded":"2023-08-26T09:26:21.370261+0000","last_fullsized":"2023-08-26T09:26:21.370261+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:15:44.188624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.363953+0000","last_change":"2023-08-26T09:26:21.360738+0000","last_active":"2023-08-26T09:26:21.363953+0000","last_peered":"2023-08-26T09:26:21.363953+0000","last_clean":"2023-08-26T09:26:21.363953+0000","last_became_active":"2023-08-26T09:26:21.360471+0000","last_became_peered":"2023-08-26T09:26:21.360471+0000","last_unstale":"2023-08-26T09:26:21.363953+0000","last_undegraded":"2023-08-26T09:26:21.363953+0000","last_fullsized":"2023-08-26T09:26:21.363953+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T12:40:39.239843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"32'1","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.374392+0000","last_change":"2023-08-26T09:26:20.349851+0000","last_active":"2023-08-26T09:26:21.374392+0000","last_peered":"2023-08-26T09:26:21.374392+0000","last_clean":"2023-08-26T09:26:21.374392+0000","last_became_active":"2023-08-26T09:26:20.349353+0000","last_became_peered":"2023-08-26T09:26:20.349353+0000","last_unstale":"2023-08-26T09:26:21.374392+0000","last_undegraded":"2023-08-26T09:26:21.374392+0000","last_fullsized":"2023-08-26T09:26:21.374392+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T13:46:58.125530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.371192+0000","last_change":"2023-08-26T09:26:21.366802+0000","last_active":"2023-08-26T09:26:21.371192+0000","last_peered":"2023-08-26T09:26:21.371192+0000","last_clean":"2023-08-26T09:26:21.371192+0000","last_became_active":"2023-08-26T09:26:21.366565+0000","last_became_peered":"2023-08-26T09:26:21.366565+0000","last_unstale":"2023-08-26T09:26:21.371192+0000","last_undegraded":"2023-08-26T09:26:21.371192+0000","last_fullsized":"2023-08-26T09:26:21.371192+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T14:33:10.361546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.351279+0000","last_change":"2023-08-26T09:26:20.347910+0000","last_active":"2023-08-26T09:26:21.351279+0000","last_peered":"2023-08-26T09:26:21.351279+0000","last_clean":"2023-08-26T09:26:21.351279+0000","last_became_active":"2023-08-26T09:26:20.347628+0000","last_became_peered":"2023-08-26T09:26:20.347628+0000","last_unstale":"2023-08-26T09:26:21.351279+0000","last_undegraded":"2023-08-26T09:26:21.351279+0000","last_fullsized":"2023-08-26T09:26:21.351279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:19:16.109080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.374780+0000","last_change":"2023-08-26T09:26:21.369551+0000","last_active":"2023-08-26T09:26:21.374780+0000","last_peered":"2023-08-26T09:26:21.374780+0000","last_clean":"2023-08-26T09:26:21.374780+0000","last_became_active":"2023-08-26T09:26:21.369237+0000","last_became_peered":"2023-08-26T09:26:21.369237+0000","last_unstale":"2023-08-26T09:26:21.374780+0000","last_undegraded":"2023-08-26T09:26:21.374780+0000","last_fullsized":"2023-08-26T09:26:21.374780+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:12:32.154597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"32'2","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.371499+0000","last_change":"2023-08-26T09:26:20.352151+0000","last_active":"2023-08-26T09:26:21.371499+0000","last_peered":"2023-08-26T09:26:21.371499+0000","last_clean":"2023-08-26T09:26:21.371499+0000","last_became_active":"2023-08-26T09:26:20.351861+0000","last_became_peered":"2023-08-26T09:26:20.351861+0000","last_unstale":"2023-08-26T09:26:21.371499+0000","last_undegraded":"2023-08-26T09:26:21.371499+0000","last_fullsized":"2023-08-26T09:26:21.371499+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:38:43.296391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.371235+0000","last_change":"2023-08-26T09:26:21.367617+0000","last_active":"2023-08-26T09:26:21.371235+0000","last_peered":"2023-08-26T09:26:21.371235+0000","last_clean":"2023-08-26T09:26:21.371235+0000","last_became_active":"2023-08-26T09:26:21.367231+0000","last_became_peered":"2023-08-26T09:26:21.367231+0000","last_unstale":"2023-08-26T09:26:21.371235+0000","last_undegraded":"2023-08-26T09:26:21.371235+0000","last_fullsized":"2023-08-26T09:26:21.371235+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:50:24.085600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.348363+0000","last_change":"2023-08-26T09:26:20.350706+0000","last_active":"2023-08-26T09:26:21.348363+0000","last_peered":"2023-08-26T09:26:21.348363+0000","last_clean":"2023-08-26T09:26:21.348363+0000","last_became_active":"2023-08-26T09:26:20.350402+0000","last_became_peered":"2023-08-26T09:26:20.350402+0000","last_unstale":"2023-08-26T09:26:21.348363+0000","last_undegraded":"2023-08-26T09:26:21.348363+0000","last_fullsized":"2023-08-26T09:26:21.348363+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T20:25:08.205838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.363506+0000","last_change":"2023-08-26T09:26:21.354176+0000","last_active":"2023-08-26T09:26:21.363506+0000","last_peered":"2023-08-26T09:26:21.363506+0000","last_clean":"2023-08-26T09:26:21.363506+0000","last_became_active":"2023-08-26T09:26:21.353770+0000","last_became_peered":"2023-08-26T09:26:21.353770+0000","last_unstale":"2023-08-26T09:26:21.363506+0000","last_undegraded":"2023-08-26T09:26:21.363506+0000","last_fullsized":"2023-08-26T09:26:21.363506+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T17:05:05.754634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.359231+0000","last_change":"2023-08-26T09:26:20.356431+0000","last_active":"2023-08-26T09:26:21.359231+0000","last_peered":"2023-08-26T09:26:21.359231+0000","last_clean":"2023-08-26T09:26:21.359231+0000","last_became_active":"2023-08-26T09:26:20.356153+0000","last_became_peered":"2023-08-26T09:26:20.356153+0000","last_unstale":"2023-08-26T09:26:21.359231+0000","last_undegraded":"2023-08-26T09:26:21.359231+0000","last_fullsized":"2023-08-26T09:26:21.359231+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T16:51:20.014278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.373523+0000","last_change":"2023-08-26T09:26:21.368681+0000","last_active":"2023-08-26T09:26:21.373523+0000","last_peered":"2023-08-26T09:26:21.373523+0000","last_clean":"2023-08-26T09:26:21.373523+0000","last_became_active":"2023-08-26T09:26:21.368384+0000","last_became_peered":"2023-08-26T09:26:21.368384+0000","last_unstale":"2023-08-26T09:26:21.373523+0000","last_undegraded":"2023-08-26T09:26:21.373523+0000","last_fullsized":"2023-08-26T09:26:21.373523+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T09:53:29.035361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.349011+0000","last_change":"2023-08-26T09:26:20.355086+0000","last_active":"2023-08-26T09:26:21.349011+0000","last_peered":"2023-08-26T09:26:21.349011+0000","last_clean":"2023-08-26T09:26:21.349011+0000","last_became_active":"2023-08-26T09:26:20.354741+0000","last_became_peered":"2023-08-26T09:26:20.354741+0000","last_unstale":"2023-08-26T09:26:21.349011+0000","last_undegraded":"2023-08-26T09:26:21.349011+0000","last_fullsized":"2023-08-26T09:26:21.349011+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:02:35.450409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.367037+0000","last_change":"2023-08-26T09:26:21.361660+0000","last_active":"2023-08-26T09:26:21.367037+0000","last_peered":"2023-08-26T09:26:21.367037+0000","last_clean":"2023-08-26T09:26:21.367037+0000","last_became_active":"2023-08-26T09:26:21.361017+0000","last_became_peered":"2023-08-26T09:26:21.361017+0000","last_unstale":"2023-08-26T09:26:21.367037+0000","last_undegraded":"2023-08-26T09:26:21.367037+0000","last_fullsized":"2023-08-26T09:26:21.367037+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T14:23:06.734564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.351864+0000","last_change":"2023-08-26T09:26:20.352705+0000","last_active":"2023-08-26T09:26:21.351864+0000","last_peered":"2023-08-26T09:26:21.351864+0000","last_clean":"2023-08-26T09:26:21.351864+0000","last_became_active":"2023-08-26T09:26:20.352456+0000","last_became_peered":"2023-08-26T09:26:20.352456+0000","last_unstale":"2023-08-26T09:26:21.351864+0000","last_undegraded":"2023-08-26T09:26:21.351864+0000","last_fullsized":"2023-08-26T09:26:21.351864+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:14:26.001051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.351719+0000","last_change":"2023-08-26T09:25:08.404814+0000","last_active":"2023-08-26T09:26:21.351719+0000","last_peered":"2023-08-26T09:26:21.351719+0000","last_clean":"2023-08-26T09:26:21.351719+0000","last_became_active":"2023-08-26T09:25:08.404465+0000","last_became_peered":"2023-08-26T09:25:08.404465+0000","last_unstale":"2023-08-26T09:26:21.351719+0000","last_undegraded":"2023-08-26T09:26:21.351719+0000","last_fullsized":"2023-08-26T09:26:21.351719+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:44:25.659120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.373912+0000","last_change":"2023-08-26T09:26:21.368766+0000","last_active":"2023-08-26T09:26:21.373912+0000","last_peered":"2023-08-26T09:26:21.373912+0000","last_clean":"2023-08-26T09:26:21.373912+0000","last_became_active":"2023-08-26T09:26:21.368364+0000","last_became_peered":"2023-08-26T09:26:21.368364+0000","last_unstale":"2023-08-26T09:26:21.373912+0000","last_undegraded":"2023-08-26T09:26:21.373912+0000","last_fullsized":"2023-08-26T09:26:21.373912+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T21:07:49.596648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.343581+0000","last_change":"2023-08-26T09:26:20.348158+0000","last_active":"2023-08-26T09:26:21.343581+0000","last_peered":"2023-08-26T09:26:21.343581+0000","last_clean":"2023-08-26T09:26:21.343581+0000","last_became_active":"2023-08-26T09:26:20.347845+0000","last_became_peered":"2023-08-26T09:26:20.347845+0000","last_unstale":"2023-08-26T09:26:21.343581+0000","last_undegraded":"2023-08-26T09:26:21.343581+0000","last_fullsized":"2023-08-26T09:26:21.343581+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T14:50:50.662922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.344142+0000","last_change":"2023-08-26T09:25:08.405372+0000","last_active":"2023-08-26T09:26:21.344142+0000","last_peered":"2023-08-26T09:26:21.344142+0000","last_clean":"2023-08-26T09:26:21.344142+0000","last_became_active":"2023-08-26T09:25:08.404984+0000","last_became_peered":"2023-08-26T09:25:08.404984+0000","last_unstale":"2023-08-26T09:26:21.344142+0000","last_undegraded":"2023-08-26T09:26:21.344142+0000","last_fullsized":"2023-08-26T09:26:21.344142+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T21:12:22.656946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.363837+0000","last_change":"2023-08-26T09:26:21.360275+0000","last_active":"2023-08-26T09:26:21.363837+0000","last_peered":"2023-08-26T09:26:21.363837+0000","last_clean":"2023-08-26T09:26:21.363837+0000","last_became_active":"2023-08-26T09:26:21.360027+0000","last_became_peered":"2023-08-26T09:26:21.360027+0000","last_unstale":"2023-08-26T09:26:21.363837+0000","last_undegraded":"2023-08-26T09:26:21.363837+0000","last_fullsized":"2023-08-26T09:26:21.363837+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T17:05:05.754634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"32'2","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.379232+0000","last_change":"2023-08-26T09:26:20.354621+0000","last_active":"2023-08-26T09:26:21.379232+0000","last_peered":"2023-08-26T09:26:21.379232+0000","last_clean":"2023-08-26T09:26:21.379232+0000","last_became_active":"2023-08-26T09:26:20.354097+0000","last_became_peered":"2023-08-26T09:26:20.354097+0000","last_unstale":"2023-08-26T09:26:21.379232+0000","last_undegraded":"2023-08-26T09:26:21.379232+0000","last_fullsized":"2023-08-26T09:26:21.379232+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:43:39.015771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.351152+0000","last_change":"2023-08-26T09:25:08.410050+0000","last_active":"2023-08-26T09:26:21.351152+0000","last_peered":"2023-08-26T09:26:21.351152+0000","last_clean":"2023-08-26T09:26:21.351152+0000","last_became_active":"2023-08-26T09:25:08.409798+0000","last_became_peered":"2023-08-26T09:25:08.409798+0000","last_unstale":"2023-08-26T09:26:21.351152+0000","last_undegraded":"2023-08-26T09:26:21.351152+0000","last_fullsized":"2023-08-26T09:26:21.351152+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T16:27:38.134216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":187,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.360590+0000","last_change":"2023-08-26T09:25:08.409089+0000","last_active":"2023-08-26T09:26:21.360590+0000","last_peered":"2023-08-26T09:26:21.360590+0000","last_clean":"2023-08-26T09:26:21.360590+0000","last_became_active":"2023-08-26T09:25:08.408185+0000","last_became_peered":"2023-08-26T09:25:08.408185+0000","last_unstale":"2023-08-26T09:26:21.360590+0000","last_undegraded":"2023-08-26T09:26:21.360590+0000","last_fullsized":"2023-08-26T09:26:21.360590+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T16:11:10.122918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.373854+0000","last_change":"2023-08-26T09:26:21.368812+0000","last_active":"2023-08-26T09:26:21.373854+0000","last_peered":"2023-08-26T09:26:21.373854+0000","last_clean":"2023-08-26T09:26:21.373854+0000","last_became_active":"2023-08-26T09:26:21.368270+0000","last_became_peered":"2023-08-26T09:26:21.368270+0000","last_unstale":"2023-08-26T09:26:21.373854+0000","last_undegraded":"2023-08-26T09:26:21.373854+0000","last_fullsized":"2023-08-26T09:26:21.373854+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T21:13:35.602918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.349518+0000","last_change":"2023-08-26T09:26:20.352820+0000","last_active":"2023-08-26T09:26:21.349518+0000","last_peered":"2023-08-26T09:26:21.349518+0000","last_clean":"2023-08-26T09:26:21.349518+0000","last_became_active":"2023-08-26T09:26:20.352446+0000","last_became_peered":"2023-08-26T09:26:20.352446+0000","last_unstale":"2023-08-26T09:26:21.349518+0000","last_undegraded":"2023-08-26T09:26:21.349518+0000","last_fullsized":"2023-08-26T09:26:21.349518+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:11:51.640854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.357425+0000","last_change":"2023-08-26T09:25:08.448979+0000","last_active":"2023-08-26T09:26:21.357425+0000","last_peered":"2023-08-26T09:26:21.357425+0000","last_clean":"2023-08-26T09:26:21.357425+0000","last_became_active":"2023-08-26T09:25:08.448706+0000","last_became_peered":"2023-08-26T09:25:08.448706+0000","last_unstale":"2023-08-26T09:26:21.357425+0000","last_undegraded":"2023-08-26T09:26:21.357425+0000","last_fullsized":"2023-08-26T09:26:21.357425+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T17:31:22.466221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.367639+0000","last_change":"2023-08-26T09:26:21.364508+0000","last_active":"2023-08-26T09:26:21.367639+0000","last_peered":"2023-08-26T09:26:21.367639+0000","last_clean":"2023-08-26T09:26:21.367639+0000","last_became_active":"2023-08-26T09:26:21.364233+0000","last_became_peered":"2023-08-26T09:26:21.364233+0000","last_unstale":"2023-08-26T09:26:21.367639+0000","last_undegraded":"2023-08-26T09:26:21.367639+0000","last_fullsized":"2023-08-26T09:26:21.367639+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T21:12:47.681513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.357466+0000","last_change":"2023-08-26T09:26:20.356639+0000","last_active":"2023-08-26T09:26:21.357466+0000","last_peered":"2023-08-26T09:26:21.357466+0000","last_clean":"2023-08-26T09:26:21.357466+0000","last_became_active":"2023-08-26T09:26:20.356351+0000","last_became_peered":"2023-08-26T09:26:20.356351+0000","last_unstale":"2023-08-26T09:26:21.357466+0000","last_undegraded":"2023-08-26T09:26:21.357466+0000","last_fullsized":"2023-08-26T09:26:21.357466+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T20:11:22.337434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.360401+0000","last_change":"2023-08-26T09:25:08.448601+0000","last_active":"2023-08-26T09:26:21.360401+0000","last_peered":"2023-08-26T09:26:21.360401+0000","last_clean":"2023-08-26T09:26:21.360401+0000","last_became_active":"2023-08-26T09:25:08.448275+0000","last_became_peered":"2023-08-26T09:25:08.448275+0000","last_unstale":"2023-08-26T09:26:21.360401+0000","last_undegraded":"2023-08-26T09:26:21.360401+0000","last_fullsized":"2023-08-26T09:26:21.360401+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T12:53:24.754058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.363300+0000","last_change":"2023-08-26T09:26:21.356327+0000","last_active":"2023-08-26T09:26:21.363300+0000","last_peered":"2023-08-26T09:26:21.363300+0000","last_clean":"2023-08-26T09:26:21.363300+0000","last_became_active":"2023-08-26T09:26:21.355847+0000","last_became_peered":"2023-08-26T09:26:21.355847+0000","last_unstale":"2023-08-26T09:26:21.363300+0000","last_undegraded":"2023-08-26T09:26:21.363300+0000","last_fullsized":"2023-08-26T09:26:21.363300+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T10:31:46.346458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.347110+0000","last_change":"2023-08-26T09:26:20.342796+0000","last_active":"2023-08-26T09:26:21.347110+0000","last_peered":"2023-08-26T09:26:21.347110+0000","last_clean":"2023-08-26T09:26:21.347110+0000","last_became_active":"2023-08-26T09:26:20.342537+0000","last_became_peered":"2023-08-26T09:26:20.342537+0000","last_unstale":"2023-08-26T09:26:21.347110+0000","last_undegraded":"2023-08-26T09:26:21.347110+0000","last_fullsized":"2023-08-26T09:26:21.347110+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T16:28:50.075995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.349252+0000","last_change":"2023-08-26T09:25:08.449014+0000","last_active":"2023-08-26T09:26:21.349252+0000","last_peered":"2023-08-26T09:26:21.349252+0000","last_clean":"2023-08-26T09:26:21.349252+0000","last_became_active":"2023-08-26T09:25:08.448671+0000","last_became_peered":"2023-08-26T09:25:08.448671+0000","last_unstale":"2023-08-26T09:26:21.349252+0000","last_undegraded":"2023-08-26T09:26:21.349252+0000","last_fullsized":"2023-08-26T09:26:21.349252+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:03:53.899808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.362346+0000","last_change":"2023-08-26T09:26:21.359102+0000","last_active":"2023-08-26T09:26:21.362346+0000","last_peered":"2023-08-26T09:26:21.362346+0000","last_clean":"2023-08-26T09:26:21.362346+0000","last_became_active":"2023-08-26T09:26:21.358815+0000","last_became_peered":"2023-08-26T09:26:21.358815+0000","last_unstale":"2023-08-26T09:26:21.362346+0000","last_undegraded":"2023-08-26T09:26:21.362346+0000","last_fullsized":"2023-08-26T09:26:21.362346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:50:24.085600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.344784+0000","last_change":"2023-08-26T09:26:20.350905+0000","last_active":"2023-08-26T09:26:21.344784+0000","last_peered":"2023-08-26T09:26:21.344784+0000","last_clean":"2023-08-26T09:26:21.344784+0000","last_became_active":"2023-08-26T09:26:20.350668+0000","last_became_peered":"2023-08-26T09:26:20.350668+0000","last_unstale":"2023-08-26T09:26:21.344784+0000","last_undegraded":"2023-08-26T09:26:21.344784+0000","last_fullsized":"2023-08-26T09:26:21.344784+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:06:16.069530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.345318+0000","last_change":"2023-08-26T09:25:08.449159+0000","last_active":"2023-08-26T09:26:21.345318+0000","last_peered":"2023-08-26T09:26:21.345318+0000","last_clean":"2023-08-26T09:26:21.345318+0000","last_became_active":"2023-08-26T09:25:08.448870+0000","last_became_peered":"2023-08-26T09:25:08.448870+0000","last_unstale":"2023-08-26T09:26:21.345318+0000","last_undegraded":"2023-08-26T09:26:21.345318+0000","last_fullsized":"2023-08-26T09:26:21.345318+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T10:10:46.824060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.360839+0000","last_change":"2023-08-26T09:26:21.353880+0000","last_active":"2023-08-26T09:26:21.360839+0000","last_peered":"2023-08-26T09:26:21.360839+0000","last_clean":"2023-08-26T09:26:21.360839+0000","last_became_active":"2023-08-26T09:26:21.353543+0000","last_became_peered":"2023-08-26T09:26:21.353543+0000","last_unstale":"2023-08-26T09:26:21.360839+0000","last_undegraded":"2023-08-26T09:26:21.360839+0000","last_fullsized":"2023-08-26T09:26:21.360839+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T10:10:24.181454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.348591+0000","last_change":"2023-08-26T09:26:20.350964+0000","last_active":"2023-08-26T09:26:21.348591+0000","last_peered":"2023-08-26T09:26:21.348591+0000","last_clean":"2023-08-26T09:26:21.348591+0000","last_became_active":"2023-08-26T09:26:20.350451+0000","last_became_peered":"2023-08-26T09:26:20.350451+0000","last_unstale":"2023-08-26T09:26:21.348591+0000","last_undegraded":"2023-08-26T09:26:21.348591+0000","last_fullsized":"2023-08-26T09:26:21.348591+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T21:10:47.548756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.345316+0000","last_change":"2023-08-26T09:25:08.403552+0000","last_active":"2023-08-26T09:26:21.345316+0000","last_peered":"2023-08-26T09:26:21.345316+0000","last_clean":"2023-08-26T09:26:21.345316+0000","last_became_active":"2023-08-26T09:25:08.403261+0000","last_became_peered":"2023-08-26T09:25:08.403261+0000","last_unstale":"2023-08-26T09:26:21.345316+0000","last_undegraded":"2023-08-26T09:26:21.345316+0000","last_fullsized":"2023-08-26T09:26:21.345316+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T10:37:05.182448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":970752,"data_stored":739946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.58699999999999997}]},{"osd":1,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.55300000000000005}]},{"osd":2,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.63500000000000001}]},{"osd":3,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.64800000000000002}]},{"osd":4,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.47099999999999997}]},{"osd":5,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.54000000000000004}]},{"osd":6,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.498},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.56899999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":140768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 26 09:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.318},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.42899999999999999}]},{"osd":1,"last update":"Sat Aug 26 09:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.33500000000000002}]},{"osd":2,"last update":"Sat Aug 26 09:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.442}]},{"osd":3,"last update":"Sat Aug 26 09:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.47999999999999998}]},{"osd":4,"last update":"Sat Aug 26 09:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.377},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.27200000000000002}]},{"osd":5,"last update":"Sat Aug 26 09:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.49099999999999999}]},{"osd":7,"last update":"Sat Aug 26 09:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.40999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":942080,"data_stored":731136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 26 09:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.33200000000000002}]},{"osd":2,"last update":"Sat Aug 26 09:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":2.512,"5min":2.512,"15min":2.512},"last":0.378}]},{"osd":3,"last update":"Sat Aug 26 09:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":2.5739999999999998,"5min":2.5739999999999998,"15min":2.5739999999999998},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":4.2409999999999997,"5min":4.2409999999999997,"15min":4.2409999999999997},"last":0.39000000000000001}]},{"osd":4,"last update":"Sat Aug 26 09:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":2.544,"5min":2.544,"15min":2.544},"last":0.64100000000000001}]},{"osd":5,"last update":"Sat Aug 26 09:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.55700000000000005}]},{"osd":6,"last update":"Sat Aug 26 09:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.65200000000000002}]},{"osd":7,"last update":"Sat Aug 26 09:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.4700000000000002,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.57899999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":344064,"data_stored":139407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 26 09:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"last":0.26500000000000001}]},{"osd":2,"last update":"Sat Aug 26 09:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.33600000000000002}]},{"osd":3,"last update":"Sat Aug 26 09:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.40100000000000002}]},{"osd":4,"last update":"Sat Aug 26 09:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.48299999999999998}]},{"osd":5,"last update":"Sat Aug 26 09:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.629}]},{"osd":6,"last update":"Sat Aug 26 09:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.502}]},{"osd":7,"last update":"Sat Aug 26 09:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.61799999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":360448,"data_stored":146605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.432,"5min":0.432,"15min":0.432},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"last":0.23100000000000001}]},{"osd":1,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.308}]},{"osd":3,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"last":0.35199999999999998}]},{"osd":4,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.48499999999999999}]},{"osd":5,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.59199999999999997}]},{"osd":6,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.495}]},{"osd":7,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.51400000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":376832,"data_stored":149542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":8.3260000000000005,"5min":8.3260000000000005,"15min":8.3260000000000005},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.372}]},{"osd":1,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.34599999999999997}]},{"osd":2,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":5.6859999999999999,"5min":5.6859999999999999,"15min":5.6859999999999999},"last":0.443},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":5.5289999999999999,"5min":5.5289999999999999,"15min":5.5289999999999999},"last":0.42099999999999999}]},{"osd":4,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.629},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":5.2880000000000003,"5min":5.2880000000000003,"15min":5.2880000000000003},"last":0.77600000000000002}]},{"osd":5,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.69699999999999995}]},{"osd":6,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":5.3250000000000002,"5min":5.3250000000000002,"15min":5.3250000000000002},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.61399999999999999}]},{"osd":7,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":5.3540000000000001,"5min":5.3540000000000001,"15min":5.3540000000000001},"last":0.75800000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":140768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.57499999999999996}]},{"osd":1,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.48799999999999999}]},{"osd":2,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.51400000000000001}]},{"osd":3,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.442},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.66000000000000003}]},{"osd":5,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.53900000000000003}]},{"osd":6,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.60799999999999998}]},{"osd":7,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.79200000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":368640,"data_stored":148008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 26 09:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.499}]},{"osd":1,"last update":"Sat Aug 26 09:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.48599999999999999}]},{"osd":2,"last update":"Sat Aug 26 09:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.38},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.51200000000000001}]},{"osd":3,"last update":"Sat Aug 26 09:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.52500000000000002}]},{"osd":4,"last update":"Sat Aug 26 09:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.46800000000000003}]},{"osd":6,"last update":"Sat Aug 26 09:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.44600000000000001}]},{"osd":7,"last update":"Sat Aug 26 09:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.57099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-26T09:26:25.476 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-26T09:26:25.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.624+0000 7f6ddcdd8700 1 Processor -- start 2023-08-26T09:26:25.629 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.624+0000 7f6ddcdd8700 1 -- start start 2023-08-26T09:26:25.631 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.625+0000 7f6ddcdd8700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f6dd8144760 0x7f6dd8071860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:25.631 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.625+0000 7f6ddcdd8700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f6dd80cbda0 0x7f6dd806a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:25.631 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.625+0000 7f6ddcdd8700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dd80cc560 con 0x7f6dd80b2d10 2023-08-26T09:26:25.631 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.625+0000 7f6ddcdd8700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dd8071da0 con 0x7f6dd80cbda0 2023-08-26T09:26:25.632 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.625+0000 7f6ddcdd8700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dd80cc280 con 0x7f6dd8144760 2023-08-26T09:26:25.632 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.625+0000 7f6dd5d9b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f6dd80cbda0 0x7f6dd806a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:25.632 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.625+0000 7f6dd5d9b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f6dd80cbda0 0x7f6dd806a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47046/0 (socket says 172.21.15.92:47046) 2023-08-26T09:26:25.632 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.625+0000 7f6dd5d9b700 1 -- 172.21.15.92:0/2369947255 learned_addr learned my addr 172.21.15.92:0/2369947255 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:25.632 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.625+0000 7f6dd659c700 1 --2- 172.21.15.92:0/2369947255 >> v2:172.21.15.188:3300/0 conn(0x7f6dd8144760 0x7f6dd8071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:25.633 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.625+0000 7f6dd5d9b700 1 -- 172.21.15.92:0/2369947255 >> v2:172.21.15.188:3300/0 conn(0x7f6dd8144760 msgr2=0x7f6dd8071860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:25.633 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.625+0000 7f6dd5d9b700 1 --2- 172.21.15.92:0/2369947255 >> v2:172.21.15.188:3300/0 conn(0x7f6dd8144760 0x7f6dd8071860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:25.633 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.625+0000 7f6dd5d9b700 1 -- 172.21.15.92:0/2369947255 >> v1:172.21.15.188:6789/0 conn(0x7f6dd80b2d10 legacy=0x7f6dd815eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:25.633 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.625+0000 7f6dd5d9b700 1 -- 172.21.15.92:0/2369947255 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd806e650 con 0x7f6dd80cbda0 2023-08-26T09:26:25.633 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.625+0000 7f6dd5d9b700 1 --2- 172.21.15.92:0/2369947255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6dd80cbda0 0x7f6dd806a320 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8067540 tx=0x7f6dcc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4948c6296cab893 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:25.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.625+0000 7f6dd559a700 1 -- 172.21.15.92:0/2369947255 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc004230 con 0x7f6dd80cbda0 2023-08-26T09:26:25.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.626+0000 7f6dd559a700 1 -- 172.21.15.92:0/2369947255 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dcc004390 con 0x7f6dd80cbda0 2023-08-26T09:26:25.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.626+0000 7f6dd559a700 1 -- 172.21.15.92:0/2369947255 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc0036a0 con 0x7f6dd80cbda0 2023-08-26T09:26:25.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.626+0000 7f6ddcdd8700 1 -- 172.21.15.92:0/2369947255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6dd80cbda0 msgr2=0x7f6dd806a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:25.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.626+0000 7f6ddcdd8700 1 --2- 172.21.15.92:0/2369947255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6dd80cbda0 0x7f6dd806a320 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8067540 tx=0x7f6dcc009bd0 comp rx=0 tx=0).stop 2023-08-26T09:26:25.635 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.626+0000 7f6ddcdd8700 1 -- 172.21.15.92:0/2369947255 shutdown_connections 2023-08-26T09:26:25.635 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.626+0000 7f6ddcdd8700 1 --2- 172.21.15.92:0/2369947255 >> v2:172.21.15.188:3300/0 conn(0x7f6dd8144760 0x7f6dd8071860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:25.635 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.626+0000 7f6ddcdd8700 1 --2- 172.21.15.92:0/2369947255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6dd80cbda0 0x7f6dd806a320 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:25.635 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.626+0000 7f6ddcdd8700 1 -- 172.21.15.92:0/2369947255 >> 172.21.15.92:0/2369947255 conn(0x7f6dd80cfd80 msgr2=0x7f6dd80d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:25.635 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.626+0000 7f6ddcdd8700 1 -- 172.21.15.92:0/2369947255 shutdown_connections 2023-08-26T09:26:25.636 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.626+0000 7f6ddcdd8700 1 -- 172.21.15.92:0/2369947255 wait complete. 2023-08-26T09:26:25.638 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.627+0000 7f6ddcdd8700 1 Processor -- start 2023-08-26T09:26:25.638 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.627+0000 7f6ddcdd8700 1 -- start start 2023-08-26T09:26:25.638 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.628+0000 7f6ddcdd8700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6dd80b2d10 0x7f6dd8159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:25.639 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.628+0000 7f6ddcdd8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6dd80cbda0 0x7f6dd81415c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:25.639 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.628+0000 7f6ddcdd8700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6dd8144760 0x7f6dd813e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:25.639 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.628+0000 7f6ddcdd8700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd81411a0 con 0x7f6dd80cbda0 2023-08-26T09:26:25.639 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.628+0000 7f6ddcdd8700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd81402f0 con 0x7f6dd8144760 2023-08-26T09:26:25.639 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.628+0000 7f6ddcdd8700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd815a420 con 0x7f6dd80b2d10 2023-08-26T09:26:25.640 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.628+0000 7f6dd5d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6dd80cbda0 0x7f6dd81415c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:25.640 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.628+0000 7f6dd5d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6dd80cbda0 0x7f6dd81415c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47054/0 (socket says 172.21.15.92:47054) 2023-08-26T09:26:25.640 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.628+0000 7f6dd5d9b700 1 -- 172.21.15.92:0/2002944267 learned_addr learned my addr 172.21.15.92:0/2002944267 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:25.640 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.628+0000 7f6dd659c700 1 --2- 172.21.15.92:0/2002944267 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6dd80b2d10 0x7f6dd8159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:25.640 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.628+0000 7f6dd6d9d700 1 --2- 172.21.15.92:0/2002944267 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6dd8144760 0x7f6dd813e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:25.641 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.629+0000 7f6dd5d9b700 1 -- 172.21.15.92:0/2002944267 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6dd80b2d10 msgr2=0x7f6dd8159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:25.641 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.629+0000 7f6dd5d9b700 1 --2- 172.21.15.92:0/2002944267 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6dd80b2d10 0x7f6dd8159ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:25.641 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.629+0000 7f6dd5d9b700 1 -- 172.21.15.92:0/2002944267 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6dd8144760 msgr2=0x7f6dd813e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:25.641 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.629+0000 7f6dd5d9b700 1 --2- 172.21.15.92:0/2002944267 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6dd8144760 0x7f6dd813e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:25.641 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.629+0000 7f6dd5d9b700 1 -- 172.21.15.92:0/2002944267 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dcc009550 con 0x7f6dd80cbda0 2023-08-26T09:26:25.642 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.629+0000 7f6dd5d9b700 1 --2- 172.21.15.92:0/2002944267 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6dd80cbda0 0x7f6dd81415c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc009130 tx=0x7f6dcc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:25.642 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.629+0000 7f6dc6ffd700 1 -- 172.21.15.92:0/2002944267 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc003b90 con 0x7f6dd80cbda0 2023-08-26T09:26:25.642 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.629+0000 7f6dc6ffd700 1 -- 172.21.15.92:0/2002944267 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dcc01f070 con 0x7f6dd80cbda0 2023-08-26T09:26:25.642 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.629+0000 7f6ddcdd8700 1 -- 172.21.15.92:0/2002944267 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dd8140520 con 0x7f6dd80cbda0 2023-08-26T09:26:25.642 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.629+0000 7f6dc6ffd700 1 -- 172.21.15.92:0/2002944267 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc011630 con 0x7f6dd80cbda0 2023-08-26T09:26:25.643 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.629+0000 7f6ddcdd8700 1 -- 172.21.15.92:0/2002944267 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dd81408b0 con 0x7f6dd80cbda0 2023-08-26T09:26:25.643 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.630+0000 7f6ddcdd8700 1 -- 172.21.15.92:0/2002944267 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dd81412e0 con 0x7f6dd80cbda0 2023-08-26T09:26:25.643 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.630+0000 7f6dc6ffd700 1 -- 172.21.15.92:0/2002944267 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6dcc021030 con 0x7f6dd80cbda0 2023-08-26T09:26:25.643 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.631+0000 7f6dc6ffd700 1 --2- 172.21.15.92:0/2002944267 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f6db806a0e0 0x7f6db806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:25.643 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.631+0000 7f6dd659c700 1 --2- 172.21.15.92:0/2002944267 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f6db806a0e0 0x7f6db806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:25.644 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.631+0000 7f6dc6ffd700 1 -- 172.21.15.92:0/2002944267 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6dcc089960 con 0x7f6dd80cbda0 2023-08-26T09:26:25.644 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.631+0000 7f6dd659c700 1 --2- 172.21.15.92:0/2002944267 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f6db806a0e0 0x7f6db806c5a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8006b20 tx=0x7f6dc8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:25.644 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.635+0000 7f6dc6ffd700 1 -- 172.21.15.92:0/2002944267 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f6dd81412e0 con 0x7f6dd80cbda0 2023-08-26T09:26:25.824 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.820+0000 7f6ddcdd8700 1 -- 172.21.15.92:0/2002944267 --> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6dd806ec10 con 0x7f6db806a0e0 2023-08-26T09:26:25.832 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.828+0000 7f6dc6ffd700 1 -- 172.21.15.92:0/2002944267 <== mgr.4107 v2:172.21.15.92:6832/1988454907 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311831 (secure 0 0 0) 0x7f6dc80076b0 con 0x7f6db806a0e0 2023-08-26T09:26:25.836 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:26:25.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.831+0000 7f6ddcdd8700 1 -- 172.21.15.92:0/2002944267 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f6db806a0e0 msgr2=0x7f6db806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:25.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.831+0000 7f6ddcdd8700 1 --2- 172.21.15.92:0/2002944267 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f6db806a0e0 0x7f6db806c5a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8006b20 tx=0x7f6dc8008040 comp rx=0 tx=0).stop 2023-08-26T09:26:25.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.831+0000 7f6ddcdd8700 1 -- 172.21.15.92:0/2002944267 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6dd80cbda0 msgr2=0x7f6dd81415c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:25.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.831+0000 7f6ddcdd8700 1 --2- 172.21.15.92:0/2002944267 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6dd80cbda0 0x7f6dd81415c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc009130 tx=0x7f6dcc004750 comp rx=0 tx=0).stop 2023-08-26T09:26:25.840 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.831+0000 7f6ddcdd8700 1 -- 172.21.15.92:0/2002944267 shutdown_connections 2023-08-26T09:26:25.840 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.831+0000 7f6ddcdd8700 1 --2- 172.21.15.92:0/2002944267 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f6db806a0e0 0x7f6db806c5a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:25.840 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.831+0000 7f6ddcdd8700 1 --2- 172.21.15.92:0/2002944267 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6dd8144760 0x7f6dd813e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:25.840 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.831+0000 7f6ddcdd8700 1 --2- 172.21.15.92:0/2002944267 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6dd80b2d10 0x7f6dd8159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:25.840 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.831+0000 7f6ddcdd8700 1 --2- 172.21.15.92:0/2002944267 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6dd80cbda0 0x7f6dd81415c0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:25.841 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.831+0000 7f6ddcdd8700 1 -- 172.21.15.92:0/2002944267 >> 172.21.15.92:0/2002944267 conn(0x7f6dd80cfd80 msgr2=0x7f6dd80af980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:25.841 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.831+0000 7f6ddcdd8700 1 -- 172.21.15.92:0/2002944267 shutdown_connections 2023-08-26T09:26:25.841 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:25.831+0000 7f6ddcdd8700 1 -- 172.21.15.92:0/2002944267 wait complete. 2023-08-26T09:26:25.841 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2023-08-26T09:26:25.848 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2023-08-26T09:26:24.952760+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":104,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220172,"kb_used_data":3964,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754754548,"statfs":{"total":773094113280,"available":772868657152,"internally_reserved":0,"allocated":4059136,"data_stored":2336180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.615993"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.363335+0000","last_change":"2023-08-26T09:26:21.356499+0000","last_active":"2023-08-26T09:26:21.363335+0000","last_peered":"2023-08-26T09:26:21.363335+0000","last_clean":"2023-08-26T09:26:21.363335+0000","last_became_active":"2023-08-26T09:26:21.356265+0000","last_became_peered":"2023-08-26T09:26:21.356265+0000","last_unstale":"2023-08-26T09:26:21.363335+0000","last_undegraded":"2023-08-26T09:26:21.363335+0000","last_fullsized":"2023-08-26T09:26:21.363335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:49:23.701040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.363279+0000","last_change":"2023-08-26T09:26:21.355899+0000","last_active":"2023-08-26T09:26:21.363279+0000","last_peered":"2023-08-26T09:26:21.363279+0000","last_clean":"2023-08-26T09:26:21.363279+0000","last_became_active":"2023-08-26T09:26:21.355641+0000","last_became_peered":"2023-08-26T09:26:21.355641+0000","last_unstale":"2023-08-26T09:26:21.363279+0000","last_undegraded":"2023-08-26T09:26:21.363279+0000","last_fullsized":"2023-08-26T09:26:21.363279+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T16:12:23.068891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.367697+0000","last_change":"2023-08-26T09:26:21.362725+0000","last_active":"2023-08-26T09:26:21.367697+0000","last_peered":"2023-08-26T09:26:21.367697+0000","last_clean":"2023-08-26T09:26:21.367697+0000","last_became_active":"2023-08-26T09:26:21.362464+0000","last_became_peered":"2023-08-26T09:26:21.362464+0000","last_unstale":"2023-08-26T09:26:21.367697+0000","last_undegraded":"2023-08-26T09:26:21.367697+0000","last_fullsized":"2023-08-26T09:26:21.367697+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T21:00:41.330996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.362468+0000","last_change":"2023-08-26T09:26:21.356021+0000","last_active":"2023-08-26T09:26:21.362468+0000","last_peered":"2023-08-26T09:26:21.362468+0000","last_clean":"2023-08-26T09:26:21.362468+0000","last_became_active":"2023-08-26T09:26:21.355762+0000","last_became_peered":"2023-08-26T09:26:21.355762+0000","last_unstale":"2023-08-26T09:26:21.362468+0000","last_undegraded":"2023-08-26T09:26:21.362468+0000","last_fullsized":"2023-08-26T09:26:21.362468+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T14:41:42.547140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.361911+0000","last_change":"2023-08-26T09:26:21.356680+0000","last_active":"2023-08-26T09:26:21.361911+0000","last_peered":"2023-08-26T09:26:21.361911+0000","last_clean":"2023-08-26T09:26:21.361911+0000","last_became_active":"2023-08-26T09:26:21.356366+0000","last_became_peered":"2023-08-26T09:26:21.356366+0000","last_unstale":"2023-08-26T09:26:21.361911+0000","last_undegraded":"2023-08-26T09:26:21.361911+0000","last_fullsized":"2023-08-26T09:26:21.361911+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T09:42:48.477801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.358181+0000","last_change":"2023-08-26T09:26:21.356179+0000","last_active":"2023-08-26T09:26:21.358181+0000","last_peered":"2023-08-26T09:26:21.358181+0000","last_clean":"2023-08-26T09:26:21.358181+0000","last_became_active":"2023-08-26T09:26:21.355899+0000","last_became_peered":"2023-08-26T09:26:21.355899+0000","last_unstale":"2023-08-26T09:26:21.358181+0000","last_undegraded":"2023-08-26T09:26:21.358181+0000","last_fullsized":"2023-08-26T09:26:21.358181+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T09:35:53.935954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.363650+0000","last_change":"2023-08-26T09:26:21.356982+0000","last_active":"2023-08-26T09:26:21.363650+0000","last_peered":"2023-08-26T09:26:21.363650+0000","last_clean":"2023-08-26T09:26:21.363650+0000","last_became_active":"2023-08-26T09:26:21.356644+0000","last_became_peered":"2023-08-26T09:26:21.356644+0000","last_unstale":"2023-08-26T09:26:21.363650+0000","last_undegraded":"2023-08-26T09:26:21.363650+0000","last_fullsized":"2023-08-26T09:26:21.363650+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T19:27:54.335742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.363230+0000","last_change":"2023-08-26T09:26:21.356126+0000","last_active":"2023-08-26T09:26:21.363230+0000","last_peered":"2023-08-26T09:26:21.363230+0000","last_clean":"2023-08-26T09:26:21.363230+0000","last_became_active":"2023-08-26T09:26:21.355422+0000","last_became_peered":"2023-08-26T09:26:21.355422+0000","last_unstale":"2023-08-26T09:26:21.363230+0000","last_undegraded":"2023-08-26T09:26:21.363230+0000","last_fullsized":"2023-08-26T09:26:21.363230+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T16:56:26.919045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.368544+0000","last_change":"2023-08-26T09:26:21.364303+0000","last_active":"2023-08-26T09:26:21.368544+0000","last_peered":"2023-08-26T09:26:21.368544+0000","last_clean":"2023-08-26T09:26:21.368544+0000","last_became_active":"2023-08-26T09:26:21.363525+0000","last_became_peered":"2023-08-26T09:26:21.363525+0000","last_unstale":"2023-08-26T09:26:21.368544+0000","last_undegraded":"2023-08-26T09:26:21.368544+0000","last_fullsized":"2023-08-26T09:26:21.368544+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T12:59:46.616480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.375349+0000","last_change":"2023-08-26T09:26:21.371591+0000","last_active":"2023-08-26T09:26:21.375349+0000","last_peered":"2023-08-26T09:26:21.375349+0000","last_clean":"2023-08-26T09:26:21.375349+0000","last_became_active":"2023-08-26T09:26:21.371340+0000","last_became_peered":"2023-08-26T09:26:21.371340+0000","last_unstale":"2023-08-26T09:26:21.375349+0000","last_undegraded":"2023-08-26T09:26:21.375349+0000","last_fullsized":"2023-08-26T09:26:21.375349+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:19:17.113274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.363628+0000","last_change":"2023-08-26T09:26:21.354267+0000","last_active":"2023-08-26T09:26:21.363628+0000","last_peered":"2023-08-26T09:26:21.363628+0000","last_clean":"2023-08-26T09:26:21.363628+0000","last_became_active":"2023-08-26T09:26:21.353985+0000","last_became_peered":"2023-08-26T09:26:21.353985+0000","last_unstale":"2023-08-26T09:26:21.363628+0000","last_undegraded":"2023-08-26T09:26:21.363628+0000","last_fullsized":"2023-08-26T09:26:21.363628+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T16:28:51.080189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.363765+0000","last_change":"2023-08-26T09:26:21.355176+0000","last_active":"2023-08-26T09:26:21.363765+0000","last_peered":"2023-08-26T09:26:21.363765+0000","last_clean":"2023-08-26T09:26:21.363765+0000","last_became_active":"2023-08-26T09:26:21.354917+0000","last_became_peered":"2023-08-26T09:26:21.354917+0000","last_unstale":"2023-08-26T09:26:21.363765+0000","last_undegraded":"2023-08-26T09:26:21.363765+0000","last_fullsized":"2023-08-26T09:26:21.363765+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T17:05:05.754634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.375302+0000","last_change":"2023-08-26T09:26:21.370767+0000","last_active":"2023-08-26T09:26:21.375302+0000","last_peered":"2023-08-26T09:26:21.375302+0000","last_clean":"2023-08-26T09:26:21.375302+0000","last_became_active":"2023-08-26T09:26:21.370440+0000","last_became_peered":"2023-08-26T09:26:21.370440+0000","last_unstale":"2023-08-26T09:26:21.375302+0000","last_undegraded":"2023-08-26T09:26:21.375302+0000","last_fullsized":"2023-08-26T09:26:21.375302+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T12:59:46.616480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.363870+0000","last_change":"2023-08-26T09:26:21.358868+0000","last_active":"2023-08-26T09:26:21.363870+0000","last_peered":"2023-08-26T09:26:21.363870+0000","last_clean":"2023-08-26T09:26:21.363870+0000","last_became_active":"2023-08-26T09:26:21.358606+0000","last_became_peered":"2023-08-26T09:26:21.358606+0000","last_unstale":"2023-08-26T09:26:21.363870+0000","last_undegraded":"2023-08-26T09:26:21.363870+0000","last_fullsized":"2023-08-26T09:26:21.363870+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:17:03.084649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.365763+0000","last_change":"2023-08-26T09:26:21.358650+0000","last_active":"2023-08-26T09:26:21.365763+0000","last_peered":"2023-08-26T09:26:21.365763+0000","last_clean":"2023-08-26T09:26:21.365763+0000","last_became_active":"2023-08-26T09:26:21.358335+0000","last_became_peered":"2023-08-26T09:26:21.358335+0000","last_unstale":"2023-08-26T09:26:21.365763+0000","last_undegraded":"2023-08-26T09:26:21.365763+0000","last_fullsized":"2023-08-26T09:26:21.365763+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T17:38:18.635900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.369637+0000","last_change":"2023-08-26T09:26:21.367005+0000","last_active":"2023-08-26T09:26:21.369637+0000","last_peered":"2023-08-26T09:26:21.369637+0000","last_clean":"2023-08-26T09:26:21.369637+0000","last_became_active":"2023-08-26T09:26:21.366691+0000","last_became_peered":"2023-08-26T09:26:21.366691+0000","last_unstale":"2023-08-26T09:26:21.369637+0000","last_undegraded":"2023-08-26T09:26:21.369637+0000","last_fullsized":"2023-08-26T09:26:21.369637+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T17:46:14.311433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.374757+0000","last_change":"2023-08-26T09:26:21.369025+0000","last_active":"2023-08-26T09:26:21.374757+0000","last_peered":"2023-08-26T09:26:21.374757+0000","last_clean":"2023-08-26T09:26:21.374757+0000","last_became_active":"2023-08-26T09:26:21.368308+0000","last_became_peered":"2023-08-26T09:26:21.368308+0000","last_unstale":"2023-08-26T09:26:21.374757+0000","last_undegraded":"2023-08-26T09:26:21.374757+0000","last_fullsized":"2023-08-26T09:26:21.374757+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T20:45:15.829357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.362412+0000","last_change":"2023-08-26T09:26:21.356538+0000","last_active":"2023-08-26T09:26:21.362412+0000","last_peered":"2023-08-26T09:26:21.362412+0000","last_clean":"2023-08-26T09:26:21.362412+0000","last_became_active":"2023-08-26T09:26:21.356276+0000","last_became_peered":"2023-08-26T09:26:21.356276+0000","last_unstale":"2023-08-26T09:26:21.362412+0000","last_undegraded":"2023-08-26T09:26:21.362412+0000","last_fullsized":"2023-08-26T09:26:21.362412+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T19:21:37.773350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.363292+0000","last_change":"2023-08-26T09:26:21.359734+0000","last_active":"2023-08-26T09:26:21.363292+0000","last_peered":"2023-08-26T09:26:21.363292+0000","last_clean":"2023-08-26T09:26:21.363292+0000","last_became_active":"2023-08-26T09:26:21.359405+0000","last_became_peered":"2023-08-26T09:26:21.359405+0000","last_unstale":"2023-08-26T09:26:21.363292+0000","last_undegraded":"2023-08-26T09:26:21.363292+0000","last_fullsized":"2023-08-26T09:26:21.363292+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:31:54.954077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.363082+0000","last_change":"2023-08-26T09:26:21.354556+0000","last_active":"2023-08-26T09:26:21.363082+0000","last_peered":"2023-08-26T09:26:21.363082+0000","last_clean":"2023-08-26T09:26:21.363082+0000","last_became_active":"2023-08-26T09:26:21.354263+0000","last_became_peered":"2023-08-26T09:26:21.354263+0000","last_unstale":"2023-08-26T09:26:21.363082+0000","last_undegraded":"2023-08-26T09:26:21.363082+0000","last_fullsized":"2023-08-26T09:26:21.363082+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:23:46.039851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.365683+0000","last_change":"2023-08-26T09:26:21.359718+0000","last_active":"2023-08-26T09:26:21.365683+0000","last_peered":"2023-08-26T09:26:21.365683+0000","last_clean":"2023-08-26T09:26:21.365683+0000","last_became_active":"2023-08-26T09:26:21.359437+0000","last_became_peered":"2023-08-26T09:26:21.359437+0000","last_unstale":"2023-08-26T09:26:21.365683+0000","last_undegraded":"2023-08-26T09:26:21.365683+0000","last_fullsized":"2023-08-26T09:26:21.365683+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:50:24.085600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.362362+0000","last_change":"2023-08-26T09:26:21.354186+0000","last_active":"2023-08-26T09:26:21.362362+0000","last_peered":"2023-08-26T09:26:21.362362+0000","last_clean":"2023-08-26T09:26:21.362362+0000","last_became_active":"2023-08-26T09:26:21.353893+0000","last_became_peered":"2023-08-26T09:26:21.353893+0000","last_unstale":"2023-08-26T09:26:21.362362+0000","last_undegraded":"2023-08-26T09:26:21.362362+0000","last_fullsized":"2023-08-26T09:26:21.362362+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T12:53:33.511765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.375076+0000","last_change":"2023-08-26T09:26:21.371929+0000","last_active":"2023-08-26T09:26:21.375076+0000","last_peered":"2023-08-26T09:26:21.375076+0000","last_clean":"2023-08-26T09:26:21.375076+0000","last_became_active":"2023-08-26T09:26:21.371662+0000","last_became_peered":"2023-08-26T09:26:21.371662+0000","last_unstale":"2023-08-26T09:26:21.375076+0000","last_undegraded":"2023-08-26T09:26:21.375076+0000","last_fullsized":"2023-08-26T09:26:21.375076+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T09:39:14.603202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.371327+0000","last_change":"2023-08-26T09:26:21.369504+0000","last_active":"2023-08-26T09:26:21.371327+0000","last_peered":"2023-08-26T09:26:21.371327+0000","last_clean":"2023-08-26T09:26:21.371327+0000","last_became_active":"2023-08-26T09:26:21.369252+0000","last_became_peered":"2023-08-26T09:26:21.369252+0000","last_unstale":"2023-08-26T09:26:21.371327+0000","last_undegraded":"2023-08-26T09:26:21.371327+0000","last_fullsized":"2023-08-26T09:26:21.371327+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T21:06:26.731477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.362313+0000","last_change":"2023-08-26T09:26:21.353694+0000","last_active":"2023-08-26T09:26:21.362313+0000","last_peered":"2023-08-26T09:26:21.362313+0000","last_clean":"2023-08-26T09:26:21.362313+0000","last_became_active":"2023-08-26T09:26:21.353386+0000","last_became_peered":"2023-08-26T09:26:21.353386+0000","last_unstale":"2023-08-26T09:26:21.362313+0000","last_undegraded":"2023-08-26T09:26:21.362313+0000","last_fullsized":"2023-08-26T09:26:21.362313+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:12:34.503991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.365537+0000","last_change":"2023-08-26T09:26:21.361793+0000","last_active":"2023-08-26T09:26:21.365537+0000","last_peered":"2023-08-26T09:26:21.365537+0000","last_clean":"2023-08-26T09:26:21.365537+0000","last_became_active":"2023-08-26T09:26:21.361509+0000","last_became_peered":"2023-08-26T09:26:21.361509+0000","last_unstale":"2023-08-26T09:26:21.365537+0000","last_undegraded":"2023-08-26T09:26:21.365537+0000","last_fullsized":"2023-08-26T09:26:21.365537+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T20:27:31.943677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.362551+0000","last_change":"2023-08-26T09:26:21.355964+0000","last_active":"2023-08-26T09:26:21.362551+0000","last_peered":"2023-08-26T09:26:21.362551+0000","last_clean":"2023-08-26T09:26:21.362551+0000","last_became_active":"2023-08-26T09:26:21.355702+0000","last_became_peered":"2023-08-26T09:26:21.355702+0000","last_unstale":"2023-08-26T09:26:21.362551+0000","last_undegraded":"2023-08-26T09:26:21.362551+0000","last_fullsized":"2023-08-26T09:26:21.362551+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:27:56.140692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.369071+0000","last_change":"2023-08-26T09:26:21.366654+0000","last_active":"2023-08-26T09:26:21.369071+0000","last_peered":"2023-08-26T09:26:21.369071+0000","last_clean":"2023-08-26T09:26:21.369071+0000","last_became_active":"2023-08-26T09:26:21.366366+0000","last_became_peered":"2023-08-26T09:26:21.366366+0000","last_unstale":"2023-08-26T09:26:21.369071+0000","last_undegraded":"2023-08-26T09:26:21.369071+0000","last_fullsized":"2023-08-26T09:26:21.369071+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T21:10:48.552949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.366438+0000","last_change":"2023-08-26T09:26:21.359015+0000","last_active":"2023-08-26T09:26:21.366438+0000","last_peered":"2023-08-26T09:26:21.366438+0000","last_clean":"2023-08-26T09:26:21.366438+0000","last_became_active":"2023-08-26T09:26:21.358738+0000","last_became_peered":"2023-08-26T09:26:21.358738+0000","last_unstale":"2023-08-26T09:26:21.366438+0000","last_undegraded":"2023-08-26T09:26:21.366438+0000","last_fullsized":"2023-08-26T09:26:21.366438+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:31:56.169058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.353327+0000","last_change":"2023-08-26T09:26:21.348747+0000","last_active":"2023-08-26T09:26:21.353327+0000","last_peered":"2023-08-26T09:26:21.353327+0000","last_clean":"2023-08-26T09:26:21.353327+0000","last_became_active":"2023-08-26T09:26:21.347803+0000","last_became_peered":"2023-08-26T09:26:21.347803+0000","last_unstale":"2023-08-26T09:26:21.353327+0000","last_undegraded":"2023-08-26T09:26:21.353327+0000","last_fullsized":"2023-08-26T09:26:21.353327+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T10:54:24.685983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.372932+0000","last_change":"2023-08-26T09:26:21.367904+0000","last_active":"2023-08-26T09:26:21.372932+0000","last_peered":"2023-08-26T09:26:21.372932+0000","last_clean":"2023-08-26T09:26:21.372932+0000","last_became_active":"2023-08-26T09:26:21.367444+0000","last_became_peered":"2023-08-26T09:26:21.367444+0000","last_unstale":"2023-08-26T09:26:21.372932+0000","last_undegraded":"2023-08-26T09:26:21.372932+0000","last_fullsized":"2023-08-26T09:26:21.372932+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:43:40.019964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.358977+0000","last_change":"2023-08-26T09:26:21.358270+0000","last_active":"2023-08-26T09:26:21.358977+0000","last_peered":"2023-08-26T09:26:21.358977+0000","last_clean":"2023-08-26T09:26:21.358977+0000","last_became_active":"2023-08-26T09:26:21.358018+0000","last_became_peered":"2023-08-26T09:26:21.358018+0000","last_unstale":"2023-08-26T09:26:21.358977+0000","last_undegraded":"2023-08-26T09:26:21.358977+0000","last_fullsized":"2023-08-26T09:26:21.358977+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T13:34:31.295297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.373006+0000","last_change":"2023-08-26T09:26:21.368577+0000","last_active":"2023-08-26T09:26:21.373006+0000","last_peered":"2023-08-26T09:26:21.373006+0000","last_clean":"2023-08-26T09:26:21.373006+0000","last_became_active":"2023-08-26T09:26:21.368287+0000","last_became_peered":"2023-08-26T09:26:21.368287+0000","last_unstale":"2023-08-26T09:26:21.373006+0000","last_undegraded":"2023-08-26T09:26:21.373006+0000","last_fullsized":"2023-08-26T09:26:21.373006+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T09:53:29.035361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"32'4","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.372984+0000","last_change":"2023-08-26T09:26:20.350584+0000","last_active":"2023-08-26T09:26:21.372984+0000","last_peered":"2023-08-26T09:26:21.372984+0000","last_clean":"2023-08-26T09:26:21.372984+0000","last_became_active":"2023-08-26T09:26:20.350299+0000","last_became_peered":"2023-08-26T09:26:20.350299+0000","last_unstale":"2023-08-26T09:26:21.372984+0000","last_undegraded":"2023-08-26T09:26:21.372984+0000","last_fullsized":"2023-08-26T09:26:21.372984+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T20:24:54.795148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.365371+0000","last_change":"2023-08-26T09:26:21.361333+0000","last_active":"2023-08-26T09:26:21.365371+0000","last_peered":"2023-08-26T09:26:21.365371+0000","last_clean":"2023-08-26T09:26:21.365371+0000","last_became_active":"2023-08-26T09:26:21.360691+0000","last_became_peered":"2023-08-26T09:26:21.360691+0000","last_unstale":"2023-08-26T09:26:21.365371+0000","last_undegraded":"2023-08-26T09:26:21.365371+0000","last_fullsized":"2023-08-26T09:26:21.365371+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T10:10:24.181454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"32'1","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.374556+0000","last_change":"2023-08-26T09:26:20.350002+0000","last_active":"2023-08-26T09:26:21.374556+0000","last_peered":"2023-08-26T09:26:21.374556+0000","last_clean":"2023-08-26T09:26:21.374556+0000","last_became_active":"2023-08-26T09:26:20.349240+0000","last_became_peered":"2023-08-26T09:26:20.349240+0000","last_unstale":"2023-08-26T09:26:21.374556+0000","last_undegraded":"2023-08-26T09:26:21.374556+0000","last_fullsized":"2023-08-26T09:26:21.374556+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T13:34:30.291103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.363930+0000","last_change":"2023-08-26T09:26:21.355814+0000","last_active":"2023-08-26T09:26:21.363930+0000","last_peered":"2023-08-26T09:26:21.363930+0000","last_clean":"2023-08-26T09:26:21.363930+0000","last_became_active":"2023-08-26T09:26:21.355585+0000","last_became_peered":"2023-08-26T09:26:21.355585+0000","last_unstale":"2023-08-26T09:26:21.363930+0000","last_undegraded":"2023-08-26T09:26:21.363930+0000","last_fullsized":"2023-08-26T09:26:21.363930+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T20:59:35.867501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"32'2","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.370738+0000","last_change":"2023-08-26T09:26:20.351222+0000","last_active":"2023-08-26T09:26:21.370738+0000","last_peered":"2023-08-26T09:26:21.370738+0000","last_clean":"2023-08-26T09:26:21.370738+0000","last_became_active":"2023-08-26T09:26:20.350970+0000","last_became_peered":"2023-08-26T09:26:20.350970+0000","last_unstale":"2023-08-26T09:26:21.370738+0000","last_undegraded":"2023-08-26T09:26:21.370738+0000","last_fullsized":"2023-08-26T09:26:21.370738+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T12:59:45.612287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.356576+0000","last_change":"2023-08-26T09:26:21.351789+0000","last_active":"2023-08-26T09:26:21.356576+0000","last_peered":"2023-08-26T09:26:21.356576+0000","last_clean":"2023-08-26T09:26:21.356576+0000","last_became_active":"2023-08-26T09:26:21.351486+0000","last_became_peered":"2023-08-26T09:26:21.351486+0000","last_unstale":"2023-08-26T09:26:21.356576+0000","last_undegraded":"2023-08-26T09:26:21.356576+0000","last_fullsized":"2023-08-26T09:26:21.356576+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:58:20.061297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"32'2","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.373550+0000","last_change":"2023-08-26T09:26:20.351872+0000","last_active":"2023-08-26T09:26:21.373550+0000","last_peered":"2023-08-26T09:26:21.373550+0000","last_clean":"2023-08-26T09:26:21.373550+0000","last_became_active":"2023-08-26T09:26:20.351642+0000","last_became_peered":"2023-08-26T09:26:20.351642+0000","last_unstale":"2023-08-26T09:26:21.373550+0000","last_undegraded":"2023-08-26T09:26:21.373550+0000","last_fullsized":"2023-08-26T09:26:21.373550+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T12:40:47.779170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.367618+0000","last_change":"2023-08-26T09:26:21.360948+0000","last_active":"2023-08-26T09:26:21.367618+0000","last_peered":"2023-08-26T09:26:21.367618+0000","last_clean":"2023-08-26T09:26:21.367618+0000","last_became_active":"2023-08-26T09:26:21.360646+0000","last_became_peered":"2023-08-26T09:26:21.360646+0000","last_unstale":"2023-08-26T09:26:21.367618+0000","last_undegraded":"2023-08-26T09:26:21.367618+0000","last_fullsized":"2023-08-26T09:26:21.367618+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:19:17.113274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"32'1","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.376361+0000","last_change":"2023-08-26T09:26:20.353859+0000","last_active":"2023-08-26T09:26:21.376361+0000","last_peered":"2023-08-26T09:26:21.376361+0000","last_clean":"2023-08-26T09:26:21.376361+0000","last_became_active":"2023-08-26T09:26:20.353568+0000","last_became_peered":"2023-08-26T09:26:20.353568+0000","last_unstale":"2023-08-26T09:26:21.376361+0000","last_undegraded":"2023-08-26T09:26:21.376361+0000","last_fullsized":"2023-08-26T09:26:21.376361+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T17:04:09.814528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.365782+0000","last_change":"2023-08-26T09:26:21.360302+0000","last_active":"2023-08-26T09:26:21.365782+0000","last_peered":"2023-08-26T09:26:21.365782+0000","last_clean":"2023-08-26T09:26:21.365782+0000","last_became_active":"2023-08-26T09:26:21.359997+0000","last_became_peered":"2023-08-26T09:26:21.359997+0000","last_unstale":"2023-08-26T09:26:21.365782+0000","last_undegraded":"2023-08-26T09:26:21.365782+0000","last_fullsized":"2023-08-26T09:26:21.365782+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T16:04:31.057490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"32'1","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.374885+0000","last_change":"2023-08-26T09:26:20.357653+0000","last_active":"2023-08-26T09:26:21.374885+0000","last_peered":"2023-08-26T09:26:21.374885+0000","last_clean":"2023-08-26T09:26:21.374885+0000","last_became_active":"2023-08-26T09:26:20.357386+0000","last_became_peered":"2023-08-26T09:26:20.357386+0000","last_unstale":"2023-08-26T09:26:21.374885+0000","last_undegraded":"2023-08-26T09:26:21.374885+0000","last_fullsized":"2023-08-26T09:26:21.374885+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:05:05.841587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.367067+0000","last_change":"2023-08-26T09:26:21.361840+0000","last_active":"2023-08-26T09:26:21.367067+0000","last_peered":"2023-08-26T09:26:21.367067+0000","last_clean":"2023-08-26T09:26:21.367067+0000","last_became_active":"2023-08-26T09:26:21.361378+0000","last_became_peered":"2023-08-26T09:26:21.361378+0000","last_unstale":"2023-08-26T09:26:21.367067+0000","last_undegraded":"2023-08-26T09:26:21.367067+0000","last_fullsized":"2023-08-26T09:26:21.367067+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T21:16:40.655425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.352022+0000","last_change":"2023-08-26T09:26:20.351727+0000","last_active":"2023-08-26T09:26:21.352022+0000","last_peered":"2023-08-26T09:26:21.352022+0000","last_clean":"2023-08-26T09:26:21.352022+0000","last_became_active":"2023-08-26T09:26:20.351444+0000","last_became_peered":"2023-08-26T09:26:20.351444+0000","last_unstale":"2023-08-26T09:26:21.352022+0000","last_undegraded":"2023-08-26T09:26:21.352022+0000","last_fullsized":"2023-08-26T09:26:21.352022+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T19:27:53.331548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.373504+0000","last_change":"2023-08-26T09:26:21.368542+0000","last_active":"2023-08-26T09:26:21.373504+0000","last_peered":"2023-08-26T09:26:21.373504+0000","last_clean":"2023-08-26T09:26:21.373504+0000","last_became_active":"2023-08-26T09:26:21.368008+0000","last_became_peered":"2023-08-26T09:26:21.368008+0000","last_unstale":"2023-08-26T09:26:21.373504+0000","last_undegraded":"2023-08-26T09:26:21.373504+0000","last_fullsized":"2023-08-26T09:26:21.373504+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:16:24.780513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.351714+0000","last_change":"2023-08-26T09:26:20.348770+0000","last_active":"2023-08-26T09:26:21.351714+0000","last_peered":"2023-08-26T09:26:21.351714+0000","last_clean":"2023-08-26T09:26:21.351714+0000","last_became_active":"2023-08-26T09:26:20.348468+0000","last_became_peered":"2023-08-26T09:26:20.348468+0000","last_unstale":"2023-08-26T09:26:21.351714+0000","last_undegraded":"2023-08-26T09:26:21.351714+0000","last_fullsized":"2023-08-26T09:26:21.351714+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T12:44:57.019963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.362489+0000","last_change":"2023-08-26T09:26:21.356115+0000","last_active":"2023-08-26T09:26:21.362489+0000","last_peered":"2023-08-26T09:26:21.362489+0000","last_clean":"2023-08-26T09:26:21.362489+0000","last_became_active":"2023-08-26T09:26:21.355868+0000","last_became_peered":"2023-08-26T09:26:21.355868+0000","last_unstale":"2023-08-26T09:26:21.362489+0000","last_undegraded":"2023-08-26T09:26:21.362489+0000","last_fullsized":"2023-08-26T09:26:21.362489+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T16:02:41.310006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.344226+0000","last_change":"2023-08-26T09:26:20.354098+0000","last_active":"2023-08-26T09:26:21.344226+0000","last_peered":"2023-08-26T09:26:21.344226+0000","last_clean":"2023-08-26T09:26:21.344226+0000","last_became_active":"2023-08-26T09:26:20.353824+0000","last_became_peered":"2023-08-26T09:26:20.353824+0000","last_unstale":"2023-08-26T09:26:21.344226+0000","last_undegraded":"2023-08-26T09:26:21.344226+0000","last_fullsized":"2023-08-26T09:26:21.344226+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:55:48.308194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.373832+0000","last_change":"2023-08-26T09:26:21.368593+0000","last_active":"2023-08-26T09:26:21.373832+0000","last_peered":"2023-08-26T09:26:21.373832+0000","last_clean":"2023-08-26T09:26:21.373832+0000","last_became_active":"2023-08-26T09:26:21.368158+0000","last_became_peered":"2023-08-26T09:26:21.368158+0000","last_unstale":"2023-08-26T09:26:21.373832+0000","last_undegraded":"2023-08-26T09:26:21.373832+0000","last_fullsized":"2023-08-26T09:26:21.373832+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T14:50:51.667115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.348672+0000","last_change":"2023-08-26T09:26:20.351252+0000","last_active":"2023-08-26T09:26:21.348672+0000","last_peered":"2023-08-26T09:26:21.348672+0000","last_clean":"2023-08-26T09:26:21.348672+0000","last_became_active":"2023-08-26T09:26:20.350970+0000","last_became_peered":"2023-08-26T09:26:20.350970+0000","last_unstale":"2023-08-26T09:26:21.348672+0000","last_undegraded":"2023-08-26T09:26:21.348672+0000","last_fullsized":"2023-08-26T09:26:21.348672+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T20:11:22.337434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.371352+0000","last_change":"2023-08-26T09:26:21.367648+0000","last_active":"2023-08-26T09:26:21.371352+0000","last_peered":"2023-08-26T09:26:21.371352+0000","last_clean":"2023-08-26T09:26:21.371352+0000","last_became_active":"2023-08-26T09:26:21.367293+0000","last_became_peered":"2023-08-26T09:26:21.367293+0000","last_unstale":"2023-08-26T09:26:21.371352+0000","last_undegraded":"2023-08-26T09:26:21.371352+0000","last_fullsized":"2023-08-26T09:26:21.371352+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T19:27:54.335742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"32'3","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.379368+0000","last_change":"2023-08-26T09:26:20.354326+0000","last_active":"2023-08-26T09:26:21.379368+0000","last_peered":"2023-08-26T09:26:21.379368+0000","last_clean":"2023-08-26T09:26:21.379368+0000","last_became_active":"2023-08-26T09:26:20.353998+0000","last_became_peered":"2023-08-26T09:26:20.353998+0000","last_unstale":"2023-08-26T09:26:21.379368+0000","last_undegraded":"2023-08-26T09:26:21.379368+0000","last_fullsized":"2023-08-26T09:26:21.379368+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T17:46:13.307239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.356063+0000","last_change":"2023-08-26T09:26:21.354465+0000","last_active":"2023-08-26T09:26:21.356063+0000","last_peered":"2023-08-26T09:26:21.356063+0000","last_clean":"2023-08-26T09:26:21.356063+0000","last_became_active":"2023-08-26T09:26:21.354133+0000","last_became_peered":"2023-08-26T09:26:21.354133+0000","last_unstale":"2023-08-26T09:26:21.356063+0000","last_undegraded":"2023-08-26T09:26:21.356063+0000","last_fullsized":"2023-08-26T09:26:21.356063+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T20:49:31.951364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"32'6","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.379178+0000","last_change":"2023-08-26T09:26:20.355696+0000","last_active":"2023-08-26T09:26:21.379178+0000","last_peered":"2023-08-26T09:26:21.379178+0000","last_clean":"2023-08-26T09:26:21.379178+0000","last_became_active":"2023-08-26T09:26:20.355443+0000","last_became_peered":"2023-08-26T09:26:20.355443+0000","last_unstale":"2023-08-26T09:26:21.379178+0000","last_undegraded":"2023-08-26T09:26:21.379178+0000","last_fullsized":"2023-08-26T09:26:21.379178+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T16:02:48.460043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.367764+0000","last_change":"2023-08-26T09:26:21.363907+0000","last_active":"2023-08-26T09:26:21.367764+0000","last_peered":"2023-08-26T09:26:21.367764+0000","last_clean":"2023-08-26T09:26:21.367764+0000","last_became_active":"2023-08-26T09:26:21.363638+0000","last_became_peered":"2023-08-26T09:26:21.363638+0000","last_unstale":"2023-08-26T09:26:21.367764+0000","last_undegraded":"2023-08-26T09:26:21.367764+0000","last_fullsized":"2023-08-26T09:26:21.367764+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T20:27:31.943677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"32'2","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.373751+0000","last_change":"2023-08-26T09:26:20.350930+0000","last_active":"2023-08-26T09:26:21.373751+0000","last_peered":"2023-08-26T09:26:21.373751+0000","last_clean":"2023-08-26T09:26:21.373751+0000","last_became_active":"2023-08-26T09:26:20.350640+0000","last_became_peered":"2023-08-26T09:26:20.350640+0000","last_unstale":"2023-08-26T09:26:21.373751+0000","last_undegraded":"2023-08-26T09:26:21.373751+0000","last_fullsized":"2023-08-26T09:26:21.373751+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T12:54:36.695837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.363504+0000","last_change":"2023-08-26T09:26:21.353668+0000","last_active":"2023-08-26T09:26:21.363504+0000","last_peered":"2023-08-26T09:26:21.363504+0000","last_clean":"2023-08-26T09:26:21.363504+0000","last_became_active":"2023-08-26T09:26:21.353319+0000","last_became_peered":"2023-08-26T09:26:21.353319+0000","last_unstale":"2023-08-26T09:26:21.363504+0000","last_undegraded":"2023-08-26T09:26:21.363504+0000","last_fullsized":"2023-08-26T09:26:21.363504+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T16:52:21.026233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.348570+0000","last_change":"2023-08-26T09:26:20.349855+0000","last_active":"2023-08-26T09:26:21.348570+0000","last_peered":"2023-08-26T09:26:21.348570+0000","last_clean":"2023-08-26T09:26:21.348570+0000","last_became_active":"2023-08-26T09:26:20.349573+0000","last_became_peered":"2023-08-26T09:26:20.349573+0000","last_unstale":"2023-08-26T09:26:21.348570+0000","last_undegraded":"2023-08-26T09:26:21.348570+0000","last_fullsized":"2023-08-26T09:26:21.348570+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T21:00:40.326803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.369173+0000","last_change":"2023-08-26T09:26:21.367527+0000","last_active":"2023-08-26T09:26:21.369173+0000","last_peered":"2023-08-26T09:26:21.369173+0000","last_clean":"2023-08-26T09:26:21.369173+0000","last_became_active":"2023-08-26T09:26:21.367222+0000","last_became_peered":"2023-08-26T09:26:21.367222+0000","last_unstale":"2023-08-26T09:26:21.369173+0000","last_undegraded":"2023-08-26T09:26:21.369173+0000","last_fullsized":"2023-08-26T09:26:21.369173+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:49:56.486514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.344657+0000","last_change":"2023-08-26T09:26:20.347578+0000","last_active":"2023-08-26T09:26:21.344657+0000","last_peered":"2023-08-26T09:26:21.344657+0000","last_clean":"2023-08-26T09:26:21.344657+0000","last_became_active":"2023-08-26T09:26:20.347299+0000","last_became_peered":"2023-08-26T09:26:20.347299+0000","last_unstale":"2023-08-26T09:26:21.344657+0000","last_undegraded":"2023-08-26T09:26:21.344657+0000","last_fullsized":"2023-08-26T09:26:21.344657+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T16:20:02.831278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.365768+0000","last_change":"2023-08-26T09:26:21.356126+0000","last_active":"2023-08-26T09:26:21.365768+0000","last_peered":"2023-08-26T09:26:21.365768+0000","last_clean":"2023-08-26T09:26:21.365768+0000","last_became_active":"2023-08-26T09:26:21.355548+0000","last_became_peered":"2023-08-26T09:26:21.355548+0000","last_unstale":"2023-08-26T09:26:21.365768+0000","last_undegraded":"2023-08-26T09:26:21.365768+0000","last_fullsized":"2023-08-26T09:26:21.365768+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:49:56.486514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"32'8","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.375981+0000","last_change":"2023-08-26T09:26:20.356861+0000","last_active":"2023-08-26T09:26:21.375981+0000","last_peered":"2023-08-26T09:26:21.375981+0000","last_clean":"2023-08-26T09:26:21.375981+0000","last_became_active":"2023-08-26T09:26:20.356342+0000","last_became_peered":"2023-08-26T09:26:20.356342+0000","last_unstale":"2023-08-26T09:26:21.375981+0000","last_undegraded":"2023-08-26T09:26:21.375981+0000","last_fullsized":"2023-08-26T09:26:21.375981+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T16:02:48.460043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.355157+0000","last_change":"2023-08-26T09:26:21.351708+0000","last_active":"2023-08-26T09:26:21.355157+0000","last_peered":"2023-08-26T09:26:21.355157+0000","last_clean":"2023-08-26T09:26:21.355157+0000","last_became_active":"2023-08-26T09:26:21.351410+0000","last_became_peered":"2023-08-26T09:26:21.351410+0000","last_unstale":"2023-08-26T09:26:21.355157+0000","last_undegraded":"2023-08-26T09:26:21.355157+0000","last_fullsized":"2023-08-26T09:26:21.355157+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T09:39:14.603202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'1","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.375548+0000","last_change":"2023-08-26T09:26:20.352672+0000","last_active":"2023-08-26T09:26:21.375548+0000","last_peered":"2023-08-26T09:26:21.375548+0000","last_clean":"2023-08-26T09:26:21.375548+0000","last_became_active":"2023-08-26T09:26:20.352407+0000","last_became_peered":"2023-08-26T09:26:20.352407+0000","last_unstale":"2023-08-26T09:26:21.375548+0000","last_undegraded":"2023-08-26T09:26:21.375548+0000","last_fullsized":"2023-08-26T09:26:21.375548+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T17:32:34.407999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.365773+0000","last_change":"2023-08-26T09:26:21.360725+0000","last_active":"2023-08-26T09:26:21.365773+0000","last_peered":"2023-08-26T09:26:21.365773+0000","last_clean":"2023-08-26T09:26:21.365773+0000","last_became_active":"2023-08-26T09:26:21.358796+0000","last_became_peered":"2023-08-26T09:26:21.358796+0000","last_unstale":"2023-08-26T09:26:21.365773+0000","last_undegraded":"2023-08-26T09:26:21.365773+0000","last_fullsized":"2023-08-26T09:26:21.365773+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T13:34:31.295297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"32'2","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.370261+0000","last_change":"2023-08-26T09:26:20.347859+0000","last_active":"2023-08-26T09:26:21.370261+0000","last_peered":"2023-08-26T09:26:21.370261+0000","last_clean":"2023-08-26T09:26:21.370261+0000","last_became_active":"2023-08-26T09:26:20.347583+0000","last_became_peered":"2023-08-26T09:26:20.347583+0000","last_unstale":"2023-08-26T09:26:21.370261+0000","last_undegraded":"2023-08-26T09:26:21.370261+0000","last_fullsized":"2023-08-26T09:26:21.370261+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:15:44.188624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.363953+0000","last_change":"2023-08-26T09:26:21.360738+0000","last_active":"2023-08-26T09:26:21.363953+0000","last_peered":"2023-08-26T09:26:21.363953+0000","last_clean":"2023-08-26T09:26:21.363953+0000","last_became_active":"2023-08-26T09:26:21.360471+0000","last_became_peered":"2023-08-26T09:26:21.360471+0000","last_unstale":"2023-08-26T09:26:21.363953+0000","last_undegraded":"2023-08-26T09:26:21.363953+0000","last_fullsized":"2023-08-26T09:26:21.363953+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T12:40:39.239843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"32'1","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.374392+0000","last_change":"2023-08-26T09:26:20.349851+0000","last_active":"2023-08-26T09:26:21.374392+0000","last_peered":"2023-08-26T09:26:21.374392+0000","last_clean":"2023-08-26T09:26:21.374392+0000","last_became_active":"2023-08-26T09:26:20.349353+0000","last_became_peered":"2023-08-26T09:26:20.349353+0000","last_unstale":"2023-08-26T09:26:21.374392+0000","last_undegraded":"2023-08-26T09:26:21.374392+0000","last_fullsized":"2023-08-26T09:26:21.374392+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T13:46:58.125530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.371192+0000","last_change":"2023-08-26T09:26:21.366802+0000","last_active":"2023-08-26T09:26:21.371192+0000","last_peered":"2023-08-26T09:26:21.371192+0000","last_clean":"2023-08-26T09:26:21.371192+0000","last_became_active":"2023-08-26T09:26:21.366565+0000","last_became_peered":"2023-08-26T09:26:21.366565+0000","last_unstale":"2023-08-26T09:26:21.371192+0000","last_undegraded":"2023-08-26T09:26:21.371192+0000","last_fullsized":"2023-08-26T09:26:21.371192+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T14:33:10.361546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.351279+0000","last_change":"2023-08-26T09:26:20.347910+0000","last_active":"2023-08-26T09:26:21.351279+0000","last_peered":"2023-08-26T09:26:21.351279+0000","last_clean":"2023-08-26T09:26:21.351279+0000","last_became_active":"2023-08-26T09:26:20.347628+0000","last_became_peered":"2023-08-26T09:26:20.347628+0000","last_unstale":"2023-08-26T09:26:21.351279+0000","last_undegraded":"2023-08-26T09:26:21.351279+0000","last_fullsized":"2023-08-26T09:26:21.351279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:19:16.109080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.374780+0000","last_change":"2023-08-26T09:26:21.369551+0000","last_active":"2023-08-26T09:26:21.374780+0000","last_peered":"2023-08-26T09:26:21.374780+0000","last_clean":"2023-08-26T09:26:21.374780+0000","last_became_active":"2023-08-26T09:26:21.369237+0000","last_became_peered":"2023-08-26T09:26:21.369237+0000","last_unstale":"2023-08-26T09:26:21.374780+0000","last_undegraded":"2023-08-26T09:26:21.374780+0000","last_fullsized":"2023-08-26T09:26:21.374780+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:12:32.154597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"32'2","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.371499+0000","last_change":"2023-08-26T09:26:20.352151+0000","last_active":"2023-08-26T09:26:21.371499+0000","last_peered":"2023-08-26T09:26:21.371499+0000","last_clean":"2023-08-26T09:26:21.371499+0000","last_became_active":"2023-08-26T09:26:20.351861+0000","last_became_peered":"2023-08-26T09:26:20.351861+0000","last_unstale":"2023-08-26T09:26:21.371499+0000","last_undegraded":"2023-08-26T09:26:21.371499+0000","last_fullsized":"2023-08-26T09:26:21.371499+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T18:38:43.296391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.371235+0000","last_change":"2023-08-26T09:26:21.367617+0000","last_active":"2023-08-26T09:26:21.371235+0000","last_peered":"2023-08-26T09:26:21.371235+0000","last_clean":"2023-08-26T09:26:21.371235+0000","last_became_active":"2023-08-26T09:26:21.367231+0000","last_became_peered":"2023-08-26T09:26:21.367231+0000","last_unstale":"2023-08-26T09:26:21.371235+0000","last_undegraded":"2023-08-26T09:26:21.371235+0000","last_fullsized":"2023-08-26T09:26:21.371235+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:50:24.085600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.348363+0000","last_change":"2023-08-26T09:26:20.350706+0000","last_active":"2023-08-26T09:26:21.348363+0000","last_peered":"2023-08-26T09:26:21.348363+0000","last_clean":"2023-08-26T09:26:21.348363+0000","last_became_active":"2023-08-26T09:26:20.350402+0000","last_became_peered":"2023-08-26T09:26:20.350402+0000","last_unstale":"2023-08-26T09:26:21.348363+0000","last_undegraded":"2023-08-26T09:26:21.348363+0000","last_fullsized":"2023-08-26T09:26:21.348363+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T20:25:08.205838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.363506+0000","last_change":"2023-08-26T09:26:21.354176+0000","last_active":"2023-08-26T09:26:21.363506+0000","last_peered":"2023-08-26T09:26:21.363506+0000","last_clean":"2023-08-26T09:26:21.363506+0000","last_became_active":"2023-08-26T09:26:21.353770+0000","last_became_peered":"2023-08-26T09:26:21.353770+0000","last_unstale":"2023-08-26T09:26:21.363506+0000","last_undegraded":"2023-08-26T09:26:21.363506+0000","last_fullsized":"2023-08-26T09:26:21.363506+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T17:05:05.754634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.359231+0000","last_change":"2023-08-26T09:26:20.356431+0000","last_active":"2023-08-26T09:26:21.359231+0000","last_peered":"2023-08-26T09:26:21.359231+0000","last_clean":"2023-08-26T09:26:21.359231+0000","last_became_active":"2023-08-26T09:26:20.356153+0000","last_became_peered":"2023-08-26T09:26:20.356153+0000","last_unstale":"2023-08-26T09:26:21.359231+0000","last_undegraded":"2023-08-26T09:26:21.359231+0000","last_fullsized":"2023-08-26T09:26:21.359231+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T16:51:20.014278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.373523+0000","last_change":"2023-08-26T09:26:21.368681+0000","last_active":"2023-08-26T09:26:21.373523+0000","last_peered":"2023-08-26T09:26:21.373523+0000","last_clean":"2023-08-26T09:26:21.373523+0000","last_became_active":"2023-08-26T09:26:21.368384+0000","last_became_peered":"2023-08-26T09:26:21.368384+0000","last_unstale":"2023-08-26T09:26:21.373523+0000","last_undegraded":"2023-08-26T09:26:21.373523+0000","last_fullsized":"2023-08-26T09:26:21.373523+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T09:53:29.035361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.349011+0000","last_change":"2023-08-26T09:26:20.355086+0000","last_active":"2023-08-26T09:26:21.349011+0000","last_peered":"2023-08-26T09:26:21.349011+0000","last_clean":"2023-08-26T09:26:21.349011+0000","last_became_active":"2023-08-26T09:26:20.354741+0000","last_became_peered":"2023-08-26T09:26:20.354741+0000","last_unstale":"2023-08-26T09:26:21.349011+0000","last_undegraded":"2023-08-26T09:26:21.349011+0000","last_fullsized":"2023-08-26T09:26:21.349011+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:02:35.450409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.367037+0000","last_change":"2023-08-26T09:26:21.361660+0000","last_active":"2023-08-26T09:26:21.367037+0000","last_peered":"2023-08-26T09:26:21.367037+0000","last_clean":"2023-08-26T09:26:21.367037+0000","last_became_active":"2023-08-26T09:26:21.361017+0000","last_became_peered":"2023-08-26T09:26:21.361017+0000","last_unstale":"2023-08-26T09:26:21.367037+0000","last_undegraded":"2023-08-26T09:26:21.367037+0000","last_fullsized":"2023-08-26T09:26:21.367037+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T14:23:06.734564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.351864+0000","last_change":"2023-08-26T09:26:20.352705+0000","last_active":"2023-08-26T09:26:21.351864+0000","last_peered":"2023-08-26T09:26:21.351864+0000","last_clean":"2023-08-26T09:26:21.351864+0000","last_became_active":"2023-08-26T09:26:20.352456+0000","last_became_peered":"2023-08-26T09:26:20.352456+0000","last_unstale":"2023-08-26T09:26:21.351864+0000","last_undegraded":"2023-08-26T09:26:21.351864+0000","last_fullsized":"2023-08-26T09:26:21.351864+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:14:26.001051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.351719+0000","last_change":"2023-08-26T09:25:08.404814+0000","last_active":"2023-08-26T09:26:21.351719+0000","last_peered":"2023-08-26T09:26:21.351719+0000","last_clean":"2023-08-26T09:26:21.351719+0000","last_became_active":"2023-08-26T09:25:08.404465+0000","last_became_peered":"2023-08-26T09:25:08.404465+0000","last_unstale":"2023-08-26T09:26:21.351719+0000","last_undegraded":"2023-08-26T09:26:21.351719+0000","last_fullsized":"2023-08-26T09:26:21.351719+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:44:25.659120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.373912+0000","last_change":"2023-08-26T09:26:21.368766+0000","last_active":"2023-08-26T09:26:21.373912+0000","last_peered":"2023-08-26T09:26:21.373912+0000","last_clean":"2023-08-26T09:26:21.373912+0000","last_became_active":"2023-08-26T09:26:21.368364+0000","last_became_peered":"2023-08-26T09:26:21.368364+0000","last_unstale":"2023-08-26T09:26:21.373912+0000","last_undegraded":"2023-08-26T09:26:21.373912+0000","last_fullsized":"2023-08-26T09:26:21.373912+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T21:07:49.596648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.343581+0000","last_change":"2023-08-26T09:26:20.348158+0000","last_active":"2023-08-26T09:26:21.343581+0000","last_peered":"2023-08-26T09:26:21.343581+0000","last_clean":"2023-08-26T09:26:21.343581+0000","last_became_active":"2023-08-26T09:26:20.347845+0000","last_became_peered":"2023-08-26T09:26:20.347845+0000","last_unstale":"2023-08-26T09:26:21.343581+0000","last_undegraded":"2023-08-26T09:26:21.343581+0000","last_fullsized":"2023-08-26T09:26:21.343581+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T14:50:50.662922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.344142+0000","last_change":"2023-08-26T09:25:08.405372+0000","last_active":"2023-08-26T09:26:21.344142+0000","last_peered":"2023-08-26T09:26:21.344142+0000","last_clean":"2023-08-26T09:26:21.344142+0000","last_became_active":"2023-08-26T09:25:08.404984+0000","last_became_peered":"2023-08-26T09:25:08.404984+0000","last_unstale":"2023-08-26T09:26:21.344142+0000","last_undegraded":"2023-08-26T09:26:21.344142+0000","last_fullsized":"2023-08-26T09:26:21.344142+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T21:12:22.656946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.363837+0000","last_change":"2023-08-26T09:26:21.360275+0000","last_active":"2023-08-26T09:26:21.363837+0000","last_peered":"2023-08-26T09:26:21.363837+0000","last_clean":"2023-08-26T09:26:21.363837+0000","last_became_active":"2023-08-26T09:26:21.360027+0000","last_became_peered":"2023-08-26T09:26:21.360027+0000","last_unstale":"2023-08-26T09:26:21.363837+0000","last_undegraded":"2023-08-26T09:26:21.363837+0000","last_fullsized":"2023-08-26T09:26:21.363837+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T17:05:05.754634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"32'2","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.379232+0000","last_change":"2023-08-26T09:26:20.354621+0000","last_active":"2023-08-26T09:26:21.379232+0000","last_peered":"2023-08-26T09:26:21.379232+0000","last_clean":"2023-08-26T09:26:21.379232+0000","last_became_active":"2023-08-26T09:26:20.354097+0000","last_became_peered":"2023-08-26T09:26:20.354097+0000","last_unstale":"2023-08-26T09:26:21.379232+0000","last_undegraded":"2023-08-26T09:26:21.379232+0000","last_fullsized":"2023-08-26T09:26:21.379232+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T11:43:39.015771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.351152+0000","last_change":"2023-08-26T09:25:08.410050+0000","last_active":"2023-08-26T09:26:21.351152+0000","last_peered":"2023-08-26T09:26:21.351152+0000","last_clean":"2023-08-26T09:26:21.351152+0000","last_became_active":"2023-08-26T09:25:08.409798+0000","last_became_peered":"2023-08-26T09:25:08.409798+0000","last_unstale":"2023-08-26T09:26:21.351152+0000","last_undegraded":"2023-08-26T09:26:21.351152+0000","last_fullsized":"2023-08-26T09:26:21.351152+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T16:27:38.134216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":187,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.360590+0000","last_change":"2023-08-26T09:25:08.409089+0000","last_active":"2023-08-26T09:26:21.360590+0000","last_peered":"2023-08-26T09:26:21.360590+0000","last_clean":"2023-08-26T09:26:21.360590+0000","last_became_active":"2023-08-26T09:25:08.408185+0000","last_became_peered":"2023-08-26T09:25:08.408185+0000","last_unstale":"2023-08-26T09:26:21.360590+0000","last_undegraded":"2023-08-26T09:26:21.360590+0000","last_fullsized":"2023-08-26T09:26:21.360590+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T16:11:10.122918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.373854+0000","last_change":"2023-08-26T09:26:21.368812+0000","last_active":"2023-08-26T09:26:21.373854+0000","last_peered":"2023-08-26T09:26:21.373854+0000","last_clean":"2023-08-26T09:26:21.373854+0000","last_became_active":"2023-08-26T09:26:21.368270+0000","last_became_peered":"2023-08-26T09:26:21.368270+0000","last_unstale":"2023-08-26T09:26:21.373854+0000","last_undegraded":"2023-08-26T09:26:21.373854+0000","last_fullsized":"2023-08-26T09:26:21.373854+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T21:13:35.602918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.349518+0000","last_change":"2023-08-26T09:26:20.352820+0000","last_active":"2023-08-26T09:26:21.349518+0000","last_peered":"2023-08-26T09:26:21.349518+0000","last_clean":"2023-08-26T09:26:21.349518+0000","last_became_active":"2023-08-26T09:26:20.352446+0000","last_became_peered":"2023-08-26T09:26:20.352446+0000","last_unstale":"2023-08-26T09:26:21.349518+0000","last_undegraded":"2023-08-26T09:26:21.349518+0000","last_fullsized":"2023-08-26T09:26:21.349518+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:11:51.640854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.357425+0000","last_change":"2023-08-26T09:25:08.448979+0000","last_active":"2023-08-26T09:26:21.357425+0000","last_peered":"2023-08-26T09:26:21.357425+0000","last_clean":"2023-08-26T09:26:21.357425+0000","last_became_active":"2023-08-26T09:25:08.448706+0000","last_became_peered":"2023-08-26T09:25:08.448706+0000","last_unstale":"2023-08-26T09:26:21.357425+0000","last_undegraded":"2023-08-26T09:26:21.357425+0000","last_fullsized":"2023-08-26T09:26:21.357425+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T17:31:22.466221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.367639+0000","last_change":"2023-08-26T09:26:21.364508+0000","last_active":"2023-08-26T09:26:21.367639+0000","last_peered":"2023-08-26T09:26:21.367639+0000","last_clean":"2023-08-26T09:26:21.367639+0000","last_became_active":"2023-08-26T09:26:21.364233+0000","last_became_peered":"2023-08-26T09:26:21.364233+0000","last_unstale":"2023-08-26T09:26:21.367639+0000","last_undegraded":"2023-08-26T09:26:21.367639+0000","last_fullsized":"2023-08-26T09:26:21.367639+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T21:12:47.681513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.357466+0000","last_change":"2023-08-26T09:26:20.356639+0000","last_active":"2023-08-26T09:26:21.357466+0000","last_peered":"2023-08-26T09:26:21.357466+0000","last_clean":"2023-08-26T09:26:21.357466+0000","last_became_active":"2023-08-26T09:26:20.356351+0000","last_became_peered":"2023-08-26T09:26:20.356351+0000","last_unstale":"2023-08-26T09:26:21.357466+0000","last_undegraded":"2023-08-26T09:26:21.357466+0000","last_fullsized":"2023-08-26T09:26:21.357466+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T20:11:22.337434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.360401+0000","last_change":"2023-08-26T09:25:08.448601+0000","last_active":"2023-08-26T09:26:21.360401+0000","last_peered":"2023-08-26T09:26:21.360401+0000","last_clean":"2023-08-26T09:26:21.360401+0000","last_became_active":"2023-08-26T09:25:08.448275+0000","last_became_peered":"2023-08-26T09:25:08.448275+0000","last_unstale":"2023-08-26T09:26:21.360401+0000","last_undegraded":"2023-08-26T09:26:21.360401+0000","last_fullsized":"2023-08-26T09:26:21.360401+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T12:53:24.754058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.363300+0000","last_change":"2023-08-26T09:26:21.356327+0000","last_active":"2023-08-26T09:26:21.363300+0000","last_peered":"2023-08-26T09:26:21.363300+0000","last_clean":"2023-08-26T09:26:21.363300+0000","last_became_active":"2023-08-26T09:26:21.355847+0000","last_became_peered":"2023-08-26T09:26:21.355847+0000","last_unstale":"2023-08-26T09:26:21.363300+0000","last_undegraded":"2023-08-26T09:26:21.363300+0000","last_fullsized":"2023-08-26T09:26:21.363300+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T10:31:46.346458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.347110+0000","last_change":"2023-08-26T09:26:20.342796+0000","last_active":"2023-08-26T09:26:21.347110+0000","last_peered":"2023-08-26T09:26:21.347110+0000","last_clean":"2023-08-26T09:26:21.347110+0000","last_became_active":"2023-08-26T09:26:20.342537+0000","last_became_peered":"2023-08-26T09:26:20.342537+0000","last_unstale":"2023-08-26T09:26:21.347110+0000","last_undegraded":"2023-08-26T09:26:21.347110+0000","last_fullsized":"2023-08-26T09:26:21.347110+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T16:28:50.075995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.349252+0000","last_change":"2023-08-26T09:25:08.449014+0000","last_active":"2023-08-26T09:26:21.349252+0000","last_peered":"2023-08-26T09:26:21.349252+0000","last_clean":"2023-08-26T09:26:21.349252+0000","last_became_active":"2023-08-26T09:25:08.448671+0000","last_became_peered":"2023-08-26T09:25:08.448671+0000","last_unstale":"2023-08-26T09:26:21.349252+0000","last_undegraded":"2023-08-26T09:26:21.349252+0000","last_fullsized":"2023-08-26T09:26:21.349252+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:03:53.899808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.362346+0000","last_change":"2023-08-26T09:26:21.359102+0000","last_active":"2023-08-26T09:26:21.362346+0000","last_peered":"2023-08-26T09:26:21.362346+0000","last_clean":"2023-08-26T09:26:21.362346+0000","last_became_active":"2023-08-26T09:26:21.358815+0000","last_became_peered":"2023-08-26T09:26:21.358815+0000","last_unstale":"2023-08-26T09:26:21.362346+0000","last_undegraded":"2023-08-26T09:26:21.362346+0000","last_fullsized":"2023-08-26T09:26:21.362346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:50:24.085600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.344784+0000","last_change":"2023-08-26T09:26:20.350905+0000","last_active":"2023-08-26T09:26:21.344784+0000","last_peered":"2023-08-26T09:26:21.344784+0000","last_clean":"2023-08-26T09:26:21.344784+0000","last_became_active":"2023-08-26T09:26:20.350668+0000","last_became_peered":"2023-08-26T09:26:20.350668+0000","last_unstale":"2023-08-26T09:26:21.344784+0000","last_undegraded":"2023-08-26T09:26:21.344784+0000","last_fullsized":"2023-08-26T09:26:21.344784+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T15:06:16.069530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.345318+0000","last_change":"2023-08-26T09:25:08.449159+0000","last_active":"2023-08-26T09:26:21.345318+0000","last_peered":"2023-08-26T09:26:21.345318+0000","last_clean":"2023-08-26T09:26:21.345318+0000","last_became_active":"2023-08-26T09:25:08.448870+0000","last_became_peered":"2023-08-26T09:25:08.448870+0000","last_unstale":"2023-08-26T09:26:21.345318+0000","last_undegraded":"2023-08-26T09:26:21.345318+0000","last_fullsized":"2023-08-26T09:26:21.345318+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T10:10:46.824060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.360839+0000","last_change":"2023-08-26T09:26:21.353880+0000","last_active":"2023-08-26T09:26:21.360839+0000","last_peered":"2023-08-26T09:26:21.360839+0000","last_clean":"2023-08-26T09:26:21.360839+0000","last_became_active":"2023-08-26T09:26:21.353543+0000","last_became_peered":"2023-08-26T09:26:21.353543+0000","last_unstale":"2023-08-26T09:26:21.360839+0000","last_undegraded":"2023-08-26T09:26:21.360839+0000","last_fullsized":"2023-08-26T09:26:21.360839+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:20.331300+0000","last_clean_scrub_stamp":"2023-08-26T09:26:20.331300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T10:10:24.181454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.348591+0000","last_change":"2023-08-26T09:26:20.350964+0000","last_active":"2023-08-26T09:26:21.348591+0000","last_peered":"2023-08-26T09:26:21.348591+0000","last_clean":"2023-08-26T09:26:21.348591+0000","last_became_active":"2023-08-26T09:26:20.350451+0000","last_became_peered":"2023-08-26T09:26:20.350451+0000","last_unstale":"2023-08-26T09:26:21.348591+0000","last_undegraded":"2023-08-26T09:26:21.348591+0000","last_fullsized":"2023-08-26T09:26:21.348591+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:26:19.327106+0000","last_clean_scrub_stamp":"2023-08-26T09:26:19.327106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T21:10:47.548756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-26T09:26:21.345316+0000","last_change":"2023-08-26T09:25:08.403552+0000","last_active":"2023-08-26T09:26:21.345316+0000","last_peered":"2023-08-26T09:26:21.345316+0000","last_clean":"2023-08-26T09:26:21.345316+0000","last_became_active":"2023-08-26T09:25:08.403261+0000","last_became_peered":"2023-08-26T09:25:08.403261+0000","last_unstale":"2023-08-26T09:26:21.345316+0000","last_undegraded":"2023-08-26T09:26:21.345316+0000","last_fullsized":"2023-08-26T09:26:21.345316+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-26T09:25:07.385327+0000","last_clean_scrub_stamp":"2023-08-26T09:25:07.385327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-27T10:37:05.182448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":970752,"data_stored":739946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.58699999999999997}]},{"osd":1,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.55300000000000005}]},{"osd":2,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.63500000000000001}]},{"osd":3,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.64800000000000002}]},{"osd":4,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.47099999999999997}]},{"osd":5,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.54000000000000004}]},{"osd":6,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.498},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.56899999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":140768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 26 09:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.318},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.42899999999999999}]},{"osd":1,"last update":"Sat Aug 26 09:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.33500000000000002}]},{"osd":2,"last update":"Sat Aug 26 09:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.442}]},{"osd":3,"last update":"Sat Aug 26 09:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.47999999999999998}]},{"osd":4,"last update":"Sat Aug 26 09:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.377},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.27200000000000002}]},{"osd":5,"last update":"Sat Aug 26 09:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.49099999999999999}]},{"osd":7,"last update":"Sat Aug 26 09:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.40999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":942080,"data_stored":731136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 26 09:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.33200000000000002}]},{"osd":2,"last update":"Sat Aug 26 09:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":2.512,"5min":2.512,"15min":2.512},"last":0.378}]},{"osd":3,"last update":"Sat Aug 26 09:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":2.5739999999999998,"5min":2.5739999999999998,"15min":2.5739999999999998},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":4.2409999999999997,"5min":4.2409999999999997,"15min":4.2409999999999997},"last":0.39000000000000001}]},{"osd":4,"last update":"Sat Aug 26 09:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":2.544,"5min":2.544,"15min":2.544},"last":0.64100000000000001}]},{"osd":5,"last update":"Sat Aug 26 09:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.55700000000000005}]},{"osd":6,"last update":"Sat Aug 26 09:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.65200000000000002}]},{"osd":7,"last update":"Sat Aug 26 09:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.4700000000000002,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.57899999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":344064,"data_stored":139407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 26 09:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"last":0.26500000000000001}]},{"osd":2,"last update":"Sat Aug 26 09:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.33600000000000002}]},{"osd":3,"last update":"Sat Aug 26 09:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.40100000000000002}]},{"osd":4,"last update":"Sat Aug 26 09:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.48299999999999998}]},{"osd":5,"last update":"Sat Aug 26 09:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.629}]},{"osd":6,"last update":"Sat Aug 26 09:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.502}]},{"osd":7,"last update":"Sat Aug 26 09:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.61799999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":360448,"data_stored":146605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.432,"5min":0.432,"15min":0.432},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"last":0.23100000000000001}]},{"osd":1,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.308}]},{"osd":3,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"last":0.35199999999999998}]},{"osd":4,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.48499999999999999}]},{"osd":5,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.59199999999999997}]},{"osd":6,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.495}]},{"osd":7,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.51400000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":376832,"data_stored":149542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":8.3260000000000005,"5min":8.3260000000000005,"15min":8.3260000000000005},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.372}]},{"osd":1,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.34599999999999997}]},{"osd":2,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":5.6859999999999999,"5min":5.6859999999999999,"15min":5.6859999999999999},"last":0.443},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":5.5289999999999999,"5min":5.5289999999999999,"15min":5.5289999999999999},"last":0.42099999999999999}]},{"osd":4,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.629},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":5.2880000000000003,"5min":5.2880000000000003,"15min":5.2880000000000003},"last":0.77600000000000002}]},{"osd":5,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.69699999999999995}]},{"osd":6,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":5.3250000000000002,"5min":5.3250000000000002,"15min":5.3250000000000002},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.61399999999999999}]},{"osd":7,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":5.3540000000000001,"5min":5.3540000000000001,"15min":5.3540000000000001},"last":0.75800000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":140768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.57499999999999996}]},{"osd":1,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.48799999999999999}]},{"osd":2,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.51400000000000001}]},{"osd":3,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.442},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.66000000000000003}]},{"osd":5,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.53900000000000003}]},{"osd":6,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.60799999999999998}]},{"osd":7,"last update":"Sat Aug 26 09:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.79200000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":368640,"data_stored":148008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 26 09:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.499}]},{"osd":1,"last update":"Sat Aug 26 09:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.48599999999999999}]},{"osd":2,"last update":"Sat Aug 26 09:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.38},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.51200000000000001}]},{"osd":3,"last update":"Sat Aug 26 09:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.52500000000000002}]},{"osd":4,"last update":"Sat Aug 26 09:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.46800000000000003}]},{"osd":6,"last update":"Sat Aug 26 09:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.44600000000000001}]},{"osd":7,"last update":"Sat Aug 26 09:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.57099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-26T09:26:25.854 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-26T09:26:25.855 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-26T09:26:26.016 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.011+0000 7f5eb2a76700 1 Processor -- start 2023-08-26T09:26:26.016 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.011+0000 7f5eb2a76700 1 -- start start 2023-08-26T09:26:26.018 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.012+0000 7f5eb2a76700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5eac15d220 0x7f5eac0af390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:26.019 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.012+0000 7f5eb2a76700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5eac071430 0x7f5eac06a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:26.019 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.012+0000 7f5eb2a76700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eac0718c0 con 0x7f5eac06db70 2023-08-26T09:26:26.019 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.012+0000 7f5eb2a76700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5eac0aee50 con 0x7f5eac15d220 2023-08-26T09:26:26.019 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.012+0000 7f5eb2a76700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eac0af130 con 0x7f5eac071430 2023-08-26T09:26:26.020 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.012+0000 7f5eb0812700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5eac15d220 0x7f5eac0af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:26.020 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.012+0000 7f5eabfff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f5eac06db70 0x7f5eac070d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:59076/0 (socket says 172.21.15.92:59076) 2023-08-26T09:26:26.020 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.012+0000 7f5eabfff700 1 -- 172.21.15.92:0/1195691804 learned_addr learned my addr 172.21.15.92:0/1195691804 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:26:26.021 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.012+0000 7f5eb1013700 1 --2- 172.21.15.92:0/1195691804 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5eac071430 0x7f5eac06a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:26.021 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.012+0000 7f5eb0812700 1 -- 172.21.15.92:0/1195691804 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5eac071430 msgr2=0x7f5eac06a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:26.021 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.012+0000 7f5eb0812700 1 --2- 172.21.15.92:0/1195691804 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5eac071430 0x7f5eac06a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:26.022 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.013+0000 7f5eb0812700 1 -- 172.21.15.92:0/1195691804 >> v1:172.21.15.92:6789/0 conn(0x7f5eac06db70 legacy=0x7f5eac070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:26.022 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.013+0000 7f5eb0812700 1 -- 172.21.15.92:0/1195691804 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eac0c4cb0 con 0x7f5eac15d220 2023-08-26T09:26:26.022 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.013+0000 7f5eab7fe700 1 -- 172.21.15.92:0/1195691804 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2984950792 0 0) 0x7f5eac0718c0 con 0x7f5eac06db70 2023-08-26T09:26:26.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.013+0000 7f5eb0812700 1 --2- 172.21.15.92:0/1195691804 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5eac15d220 0x7f5eac0af390 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0009840 tx=0x7f5ea0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57ea3492429b8aa0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:26.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.013+0000 7f5eab7fe700 1 -- 172.21.15.92:0/1195691804 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea0011830 con 0x7f5eac15d220 2023-08-26T09:26:26.024 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.013+0000 7f5eab7fe700 1 -- 172.21.15.92:0/1195691804 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea0011990 con 0x7f5eac15d220 2023-08-26T09:26:26.024 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.013+0000 7f5eab7fe700 1 -- 172.21.15.92:0/1195691804 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea0011d20 con 0x7f5eac15d220 2023-08-26T09:26:26.024 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.013+0000 7f5eb2a76700 1 -- 172.21.15.92:0/1195691804 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5eac15d220 msgr2=0x7f5eac0af390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:26.025 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.013+0000 7f5eb2a76700 1 --2- 172.21.15.92:0/1195691804 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5eac15d220 0x7f5eac0af390 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0009840 tx=0x7f5ea0009b50 comp rx=0 tx=0).stop 2023-08-26T09:26:26.025 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.013+0000 7f5eb2a76700 1 -- 172.21.15.92:0/1195691804 shutdown_connections 2023-08-26T09:26:26.025 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.013+0000 7f5eb2a76700 1 --2- 172.21.15.92:0/1195691804 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5eac071430 0x7f5eac06a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:26.025 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.013+0000 7f5eb2a76700 1 --2- 172.21.15.92:0/1195691804 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5eac15d220 0x7f5eac0af390 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:26.025 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.013+0000 7f5eb2a76700 1 -- 172.21.15.92:0/1195691804 >> 172.21.15.92:0/1195691804 conn(0x7f5eac06b430 msgr2=0x7f5eac06b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:26.026 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.013+0000 7f5eb2a76700 1 -- 172.21.15.92:0/1195691804 shutdown_connections 2023-08-26T09:26:26.026 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.013+0000 7f5eb2a76700 1 -- 172.21.15.92:0/1195691804 wait complete. 2023-08-26T09:26:26.029 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.015+0000 7f5eb2a76700 1 Processor -- start 2023-08-26T09:26:26.029 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.015+0000 7f5eb2a76700 1 -- start start 2023-08-26T09:26:26.029 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.015+0000 7f5eb2a76700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5eac06db70 0x7f5eac1f2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:26.029 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.015+0000 7f5eb2a76700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5eac071430 0x7f5eac14e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:26.029 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.015+0000 7f5eb2a76700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5eac15d220 0x7f5eac0ade80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:26.030 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.015+0000 7f5eb2a76700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eac151dc0 con 0x7f5eac06db70 2023-08-26T09:26:26.030 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.015+0000 7f5eb2a76700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eac151fd0 con 0x7f5eac071430 2023-08-26T09:26:26.030 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.015+0000 7f5eb2a76700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eac1522b0 con 0x7f5eac15d220 2023-08-26T09:26:26.030 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.016+0000 7f5eb0812700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5eac06db70 0x7f5eac1f2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:26.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.016+0000 7f5eb0812700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5eac06db70 0x7f5eac1f2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47066/0 (socket says 172.21.15.92:47066) 2023-08-26T09:26:26.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.016+0000 7f5eb0812700 1 -- 172.21.15.92:0/587870621 learned_addr learned my addr 172.21.15.92:0/587870621 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:26.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.016+0000 7f5eb1013700 1 --2- 172.21.15.92:0/587870621 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5eac15d220 0x7f5eac0ade80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:26.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.016+0000 7f5eabfff700 1 --2- 172.21.15.92:0/587870621 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5eac071430 0x7f5eac14e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:26.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.016+0000 7f5eb0812700 1 -- 172.21.15.92:0/587870621 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5eac15d220 msgr2=0x7f5eac0ade80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:26.032 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.016+0000 7f5eb0812700 1 --2- 172.21.15.92:0/587870621 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5eac15d220 0x7f5eac0ade80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:26.032 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.016+0000 7f5eb0812700 1 -- 172.21.15.92:0/587870621 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5eac071430 msgr2=0x7f5eac14e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:26.032 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.016+0000 7f5eb0812700 1 --2- 172.21.15.92:0/587870621 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5eac071430 0x7f5eac14e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:26.032 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.016+0000 7f5eb0812700 1 -- 172.21.15.92:0/587870621 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea00094a0 con 0x7f5eac06db70 2023-08-26T09:26:26.032 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.016+0000 7f5eb0812700 1 --2- 172.21.15.92:0/587870621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5eac06db70 0x7f5eac1f2450 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0000c00 tx=0x7f5ea0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:26.033 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.016+0000 7f5ea97fa700 1 -- 172.21.15.92:0/587870621 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea00036a0 con 0x7f5eac06db70 2023-08-26T09:26:26.033 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.016+0000 7f5ea97fa700 1 -- 172.21.15.92:0/587870621 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea001e070 con 0x7f5eac06db70 2023-08-26T09:26:26.033 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.016+0000 7f5eb2a76700 1 -- 172.21.15.92:0/587870621 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eac152590 con 0x7f5eac06db70 2023-08-26T09:26:26.033 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.016+0000 7f5ea97fa700 1 -- 172.21.15.92:0/587870621 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea0003a60 con 0x7f5eac06db70 2023-08-26T09:26:26.033 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.016+0000 7f5eb2a76700 1 -- 172.21.15.92:0/587870621 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eac152b50 con 0x7f5eac06db70 2023-08-26T09:26:26.034 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.017+0000 7f5eb2a76700 1 -- 172.21.15.92:0/587870621 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eac04eeb0 con 0x7f5eac06db70 2023-08-26T09:26:26.034 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.017+0000 7f5ea97fa700 1 -- 172.21.15.92:0/587870621 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5ea0003bc0 con 0x7f5eac06db70 2023-08-26T09:26:26.034 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.018+0000 7f5ea97fa700 1 --2- 172.21.15.92:0/587870621 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f5e9006a0e0 0x7f5e9006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:26.034 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.018+0000 7f5ea97fa700 1 -- 172.21.15.92:0/587870621 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5ea0089560 con 0x7f5eac06db70 2023-08-26T09:26:26.034 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.018+0000 7f5eabfff700 1 --2- 172.21.15.92:0/587870621 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f5e9006a0e0 0x7f5e9006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:26.035 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.018+0000 7f5eabfff700 1 --2- 172.21.15.92:0/587870621 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f5e9006a0e0 0x7f5e9006c5a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5eac157980 tx=0x7f5e98007be0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:26.035 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.022+0000 7f5ea97fa700 1 -- 172.21.15.92:0/587870621 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5ea0054ce0 con 0x7f5eac06db70 2023-08-26T09:26:26.292 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.288+0000 7f5eb2a76700 1 -- 172.21.15.92:0/587870621 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f5eac158070 con 0x7f5eac06db70 2023-08-26T09:26:26.296 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.291+0000 7f5ea97fa700 1 -- 172.21.15.92:0/587870621 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7f5ea0058300 con 0x7f5eac06db70 2023-08-26T09:26:26.296 INFO:teuthology.orchestra.run.smithi092.stdout:[client.0] 2023-08-26T09:26:26.296 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQDFxOlkZDgMLBAA162qALEz2DZ0yz7kRLRfqQ== 2023-08-26T09:26:26.297 INFO:teuthology.orchestra.run.smithi092.stdout: caps mds = "allow" 2023-08-26T09:26:26.297 INFO:teuthology.orchestra.run.smithi092.stdout: caps mon = "allow r" 2023-08-26T09:26:26.297 INFO:teuthology.orchestra.run.smithi092.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-08-26T09:26:26.298 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.293+0000 7f5eb2a76700 1 -- 172.21.15.92:0/587870621 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f5e9006a0e0 msgr2=0x7f5e9006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:26.298 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.293+0000 7f5eb2a76700 1 --2- 172.21.15.92:0/587870621 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f5e9006a0e0 0x7f5e9006c5a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5eac157980 tx=0x7f5e98007be0 comp rx=0 tx=0).stop 2023-08-26T09:26:26.299 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.293+0000 7f5eb2a76700 1 -- 172.21.15.92:0/587870621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5eac06db70 msgr2=0x7f5eac1f2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:26.299 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.293+0000 7f5eb2a76700 1 --2- 172.21.15.92:0/587870621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5eac06db70 0x7f5eac1f2450 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0000c00 tx=0x7f5ea0004750 comp rx=0 tx=0).stop 2023-08-26T09:26:26.299 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.294+0000 7f5eb2a76700 1 -- 172.21.15.92:0/587870621 shutdown_connections 2023-08-26T09:26:26.299 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.294+0000 7f5eb2a76700 1 --2- 172.21.15.92:0/587870621 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5eac15d220 0x7f5eac0ade80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:26.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.294+0000 7f5eb2a76700 1 --2- 172.21.15.92:0/587870621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5eac06db70 0x7f5eac1f2450 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:26.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.294+0000 7f5eb2a76700 1 --2- 172.21.15.92:0/587870621 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f5e9006a0e0 0x7f5e9006c5a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:26.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.294+0000 7f5eb2a76700 1 --2- 172.21.15.92:0/587870621 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5eac071430 0x7f5eac14e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:26.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.294+0000 7f5eb2a76700 1 -- 172.21.15.92:0/587870621 >> 172.21.15.92:0/587870621 conn(0x7f5eac06b430 msgr2=0x7f5eac0cf3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:26.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.294+0000 7f5eb2a76700 1 -- 172.21.15.92:0/587870621 shutdown_connections 2023-08-26T09:26:26.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.294+0000 7f5eb2a76700 1 -- 172.21.15.92:0/587870621 wait complete. 2023-08-26T09:26:26.301 INFO:teuthology.orchestra.run.smithi092.stderr:updated caps for client.0 2023-08-26T09:26:26.310 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-26T09:26:26.432 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.428+0000 7fb41cd7e700 1 Processor -- start 2023-08-26T09:26:26.433 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.428+0000 7fb41cd7e700 1 -- start start 2023-08-26T09:26:26.436 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.429+0000 7fb41cd7e700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fb41815e770 0x7fb41806ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:26.437 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.429+0000 7fb41cd7e700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb41806b240 con 0x7fb41806ce50 2023-08-26T09:26:26.437 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.429+0000 7fb41cd7e700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb41815fb20 con 0x7fb4180cbf10 2023-08-26T09:26:26.437 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.429+0000 7fb41cd7e700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb41815eb50 con 0x7fb41815e770 2023-08-26T09:26:26.437 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.429+0000 7fb415d9b700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fb41806ce50 0x7fb41815ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:59090/0 (socket says 172.21.15.92:59090) 2023-08-26T09:26:26.437 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.429+0000 7fb415d9b700 1 -- 172.21.15.92:0/3664771286 learned_addr learned my addr 172.21.15.92:0/3664771286 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:26:26.438 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.429+0000 7fb41559a700 1 -- 172.21.15.92:0/3664771286 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2413380050 0 0) 0x7fb41806b240 con 0x7fb41806ce50 2023-08-26T09:26:26.438 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.429+0000 7fb41659c700 1 --2- 172.21.15.92:0/3664771286 >> v2:172.21.15.188:3300/0 conn(0x7fb41815e770 0x7fb41806ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:26.438 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.429+0000 7fb41559a700 1 -- 172.21.15.92:0/3664771286 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4000035b0 con 0x7fb41806ce50 2023-08-26T09:26:26.438 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.429+0000 7fb41559a700 1 -- 172.21.15.92:0/3664771286 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2082854927 0 0) 0x7fb4000035b0 con 0x7fb41806ce50 2023-08-26T09:26:26.438 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.429+0000 7fb41559a700 1 -- 172.21.15.92:0/3664771286 >> v2:172.21.15.188:3300/0 conn(0x7fb41815e770 msgr2=0x7fb41806ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:26.439 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.429+0000 7fb41559a700 1 --2- 172.21.15.92:0/3664771286 >> v2:172.21.15.188:3300/0 conn(0x7fb41815e770 0x7fb41806ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:26.439 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.429+0000 7fb41559a700 1 -- 172.21.15.92:0/3664771286 >> v1:172.21.15.188:6789/0 conn(0x7fb4180cbf10 legacy=0x7fb41815f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:26.439 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.429+0000 7fb41559a700 1 -- 172.21.15.92:0/3664771286 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb41806f470 con 0x7fb41806ce50 2023-08-26T09:26:26.439 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.429+0000 7fb41559a700 1 -- 172.21.15.92:0/3664771286 <== mon.0 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1019361464 0 0) 0x7fb40c001670 con 0x7fb41806ce50 2023-08-26T09:26:26.440 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.429+0000 7fb41559a700 1 -- 172.21.15.92:0/3664771286 >> v1:172.21.15.92:6789/0 conn(0x7fb41806ce50 legacy=0x7fb41815ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:26.440 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.430+0000 7fb41559a700 1 --2- 172.21.15.92:0/3664771286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb400003a00 0x7fb400003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:26.440 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.430+0000 7fb41559a700 1 --2- 172.21.15.92:0/3664771286 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb400004850 0x7fb400004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:26.441 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.430+0000 7fb41559a700 1 --2- 172.21.15.92:0/3664771286 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb400005210 0x7fb40000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:26.441 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.430+0000 7fb41559a700 1 -- 172.21.15.92:0/3664771286 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb41815eb50 con 0x7fb400003a00 2023-08-26T09:26:26.441 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.430+0000 7fb41559a700 1 -- 172.21.15.92:0/3664771286 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb40000c0b0 con 0x7fb400004850 2023-08-26T09:26:26.441 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.430+0000 7fb41559a700 1 -- 172.21.15.92:0/3664771286 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb40000c270 con 0x7fb400005210 2023-08-26T09:26:26.441 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.430+0000 7fb41659c700 1 --2- 172.21.15.92:0/3664771286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb400003a00 0x7fb400003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:26.442 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.430+0000 7fb415d9b700 1 --2- 172.21.15.92:0/3664771286 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb400004850 0x7fb400004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:26.442 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.430+0000 7fb416d9d700 1 --2- 172.21.15.92:0/3664771286 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb400005210 0x7fb40000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:26.442 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.430+0000 7fb41659c700 1 -- 172.21.15.92:0/3664771286 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb400005210 msgr2=0x7fb40000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:26.442 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.430+0000 7fb41659c700 1 --2- 172.21.15.92:0/3664771286 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb400005210 0x7fb40000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:26.442 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.430+0000 7fb41659c700 1 -- 172.21.15.92:0/3664771286 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb400004850 msgr2=0x7fb400004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:26.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.430+0000 7fb41659c700 1 --2- 172.21.15.92:0/3664771286 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb400004850 0x7fb400004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:26.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.430+0000 7fb41659c700 1 -- 172.21.15.92:0/3664771286 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4000035b0 con 0x7fb400003a00 2023-08-26T09:26:26.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.430+0000 7fb416d9d700 1 -- 172.21.15.92:0/3664771286 reap_dead start 2023-08-26T09:26:26.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.430+0000 7fb415d9b700 1 --2- 172.21.15.92:0/3664771286 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb400004850 0x7fb400004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:26:26.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.430+0000 7fb41659c700 1 --2- 172.21.15.92:0/3664771286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb400003a00 0x7fb400003e20 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fb408009b60 tx=0x7fb400005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a25737318e88ae5 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:26.444 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.430+0000 7fb41559a700 1 -- 172.21.15.92:0/3664771286 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40800e6c0 con 0x7fb400003a00 2023-08-26T09:26:26.444 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.430+0000 7fb41559a700 1 -- 172.21.15.92:0/3664771286 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb40800e820 con 0x7fb400003a00 2023-08-26T09:26:26.444 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.430+0000 7fb41559a700 1 -- 172.21.15.92:0/3664771286 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40800ebb0 con 0x7fb400003a00 2023-08-26T09:26:26.444 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.431+0000 7fb41cd7e700 1 -- 172.21.15.92:0/3664771286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb400003a00 msgr2=0x7fb400003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:26.444 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.431+0000 7fb41cd7e700 1 --2- 172.21.15.92:0/3664771286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb400003a00 0x7fb400003e20 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fb408009b60 tx=0x7fb400005880 comp rx=0 tx=0).stop 2023-08-26T09:26:26.445 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.431+0000 7fb41cd7e700 1 -- 172.21.15.92:0/3664771286 shutdown_connections 2023-08-26T09:26:26.445 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.431+0000 7fb41cd7e700 1 --2- 172.21.15.92:0/3664771286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb400003a00 0x7fb400003e20 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:26.445 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.431+0000 7fb41cd7e700 1 -- 172.21.15.92:0/3664771286 >> 172.21.15.92:0/3664771286 conn(0x7fb4180cc7b0 msgr2=0x7fb4180ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:26.445 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.431+0000 7fb41cd7e700 1 -- 172.21.15.92:0/3664771286 shutdown_connections 2023-08-26T09:26:26.445 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.431+0000 7fb41cd7e700 1 -- 172.21.15.92:0/3664771286 wait complete. 2023-08-26T09:26:26.445 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.432+0000 7fb41cd7e700 1 Processor -- start 2023-08-26T09:26:26.446 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.432+0000 7fb41cd7e700 1 -- start start 2023-08-26T09:26:26.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.433+0000 7fb41cd7e700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb400003a00 0x7fb41814de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:26.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.433+0000 7fb41cd7e700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb4180cf390 0x7fb4180b29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:26.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.433+0000 7fb41cd7e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4180b4df0 0x7fb4180b52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:26.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.433+0000 7fb41cd7e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4180b57e0 con 0x7fb4180b4df0 2023-08-26T09:26:26.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.433+0000 7fb41cd7e700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb41814c9b0 con 0x7fb400003a00 2023-08-26T09:26:26.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.433+0000 7fb41cd7e700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4180b3360 con 0x7fb4180cf390 2023-08-26T09:26:26.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.433+0000 7fb416d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4180b4df0 0x7fb4180b52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:26.450 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.433+0000 7fb416d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4180b4df0 0x7fb4180b52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47088/0 (socket says 172.21.15.92:47088) 2023-08-26T09:26:26.450 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.433+0000 7fb416d9d700 1 -- 172.21.15.92:0/2558428264 learned_addr learned my addr 172.21.15.92:0/2558428264 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:26.450 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.433+0000 7fb416d9d700 1 -- 172.21.15.92:0/2558428264 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb4180cf390 msgr2=0x7fb4180b29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:26.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.433+0000 7fb416d9d700 1 --2- 172.21.15.92:0/2558428264 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb4180cf390 0x7fb4180b29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:26.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.433+0000 7fb416d9d700 1 -- 172.21.15.92:0/2558428264 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb400003a00 msgr2=0x7fb41814de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:26.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.433+0000 7fb416d9d700 1 --2- 172.21.15.92:0/2558428264 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb400003a00 0x7fb41814de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:26.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.433+0000 7fb416d9d700 1 -- 172.21.15.92:0/2558428264 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4180b3640 con 0x7fb4180b4df0 2023-08-26T09:26:26.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.433+0000 7fb416d9d700 1 --2- 172.21.15.92:0/2558428264 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4180b4df0 0x7fb4180b52a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fb41806e210 tx=0x7fb41000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:26.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.434+0000 7fb406ffd700 1 -- 172.21.15.92:0/2558428264 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb410003c10 con 0x7fb4180b4df0 2023-08-26T09:26:26.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.434+0000 7fb406ffd700 1 -- 172.21.15.92:0/2558428264 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb410003d90 con 0x7fb4180b4df0 2023-08-26T09:26:26.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.434+0000 7fb41cd7e700 1 -- 172.21.15.92:0/2558428264 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4180b3920 con 0x7fb4180b4df0 2023-08-26T09:26:26.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.434+0000 7fb406ffd700 1 -- 172.21.15.92:0/2558428264 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb410005310 con 0x7fb4180b4df0 2023-08-26T09:26:26.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.434+0000 7fb41cd7e700 1 -- 172.21.15.92:0/2558428264 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4180b3ee0 con 0x7fb4180b4df0 2023-08-26T09:26:26.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.434+0000 7fb41cd7e700 1 -- 172.21.15.92:0/2558428264 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb41804e660 con 0x7fb4180b4df0 2023-08-26T09:26:26.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.435+0000 7fb406ffd700 1 -- 172.21.15.92:0/2558428264 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb410005470 con 0x7fb4180b4df0 2023-08-26T09:26:26.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.435+0000 7fb406ffd700 1 --2- 172.21.15.92:0/2558428264 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb3f806a0e0 0x7fb3f806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:26.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.435+0000 7fb406ffd700 1 -- 172.21.15.92:0/2558428264 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb4100884d0 con 0x7fb4180b4df0 2023-08-26T09:26:26.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.435+0000 7fb41659c700 1 --2- 172.21.15.92:0/2558428264 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb3f806a0e0 0x7fb3f806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:26.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.436+0000 7fb41659c700 1 --2- 172.21.15.92:0/2558428264 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb3f806a0e0 0x7fb3f806c5a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb4080090b0 tx=0x7fb408013000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:26.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.440+0000 7fb406ffd700 1 -- 172.21.15.92:0/2558428264 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb410053bc0 con 0x7fb4180b4df0 2023-08-26T09:26:26.679 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.674+0000 7fb41cd7e700 1 -- 172.21.15.92:0/2558428264 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb4180cd1c0 con 0x7fb4180b4df0 2023-08-26T09:26:26.680 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.675+0000 7fb406ffd700 1 -- 172.21.15.92:0/2558428264 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4875 (secure 0 0 0) 0x7fb4100571e0 con 0x7fb4180b4df0 2023-08-26T09:26:26.680 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:26:26.680 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6834/815827100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":815827100},{"type":"v1","addr":"172.21.15.188:6834","nonce":815827100}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5074,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3118806406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6833","nonce":3118806406},{"type":"v1","addr":"172.21.15.188:6835","nonce":3118806406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5358,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6836/2182649382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6835","nonce":2182649382},{"type":"v1","addr":"172.21.15.92:6836","nonce":2182649382}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-26T09:26:20.742146+0000","modified":"2023-08-26T09:26:24.370168+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5361},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5361":{"gid":5361,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6837/123272842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":123272842},{"type":"v1","addr":"172.21.15.92:6837","nonce":123272842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-26T09:26:26.682 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.677+0000 7fb41cd7e700 1 -- 172.21.15.92:0/2558428264 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb3f806a0e0 msgr2=0x7fb3f806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:26.682 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.677+0000 7fb41cd7e700 1 --2- 172.21.15.92:0/2558428264 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb3f806a0e0 0x7fb3f806c5a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb4080090b0 tx=0x7fb408013000 comp rx=0 tx=0).stop 2023-08-26T09:26:26.682 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.677+0000 7fb41cd7e700 1 -- 172.21.15.92:0/2558428264 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4180b4df0 msgr2=0x7fb4180b52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:26.683 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.677+0000 7fb41cd7e700 1 --2- 172.21.15.92:0/2558428264 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4180b4df0 0x7fb4180b52a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fb41806e210 tx=0x7fb41000ee80 comp rx=0 tx=0).stop 2023-08-26T09:26:26.683 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.677+0000 7fb41cd7e700 1 -- 172.21.15.92:0/2558428264 shutdown_connections 2023-08-26T09:26:26.683 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.677+0000 7fb41cd7e700 1 --2- 172.21.15.92:0/2558428264 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fb3f806a0e0 0x7fb3f806c5a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:26.684 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.677+0000 7fb41cd7e700 1 --2- 172.21.15.92:0/2558428264 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb400003a00 0x7fb41814de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:26.684 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.677+0000 7fb41cd7e700 1 --2- 172.21.15.92:0/2558428264 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4180b4df0 0x7fb4180b52a0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:26.684 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.677+0000 7fb41cd7e700 1 --2- 172.21.15.92:0/2558428264 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb4180cf390 0x7fb4180b29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:26.684 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.677+0000 7fb41cd7e700 1 -- 172.21.15.92:0/2558428264 >> 172.21.15.92:0/2558428264 conn(0x7fb4180cc7b0 msgr2=0x7fb4180c5370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:26.684 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.677+0000 7fb41cd7e700 1 -- 172.21.15.92:0/2558428264 shutdown_connections 2023-08-26T09:26:26.685 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:26.677+0000 7fb41cd7e700 1 -- 172.21.15.92:0/2558428264 wait complete. 2023-08-26T09:26:26.685 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 16 2023-08-26T09:26:27.096 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-26T09:26:20.742146+0000', 'modified': '2023-08-26T09:26:24.370168+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5361}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5361': {'gid': 5361, 'name': 'a', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.92:6837/123272842', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6834', 'nonce': 123272842}, {'type': 'v1', 'addr': '172.21.15.92:6837', 'nonce': 123272842}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-26T09:26:27.097 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-26T09:26:27.097 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-08-26T09:26:27.225 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.220+0000 7fc4d497f700 1 Processor -- start 2023-08-26T09:26:27.225 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.220+0000 7fc4d497f700 1 -- start start 2023-08-26T09:26:27.229 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.221+0000 7fc4d497f700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4d006d8a0 0x7fc4d00cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:27.229 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.221+0000 7fc4d497f700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4d006cf70 con 0x7fc4d0160b90 2023-08-26T09:26:27.229 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.221+0000 7fc4d497f700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4d0161670 con 0x7fc4d006a320 2023-08-26T09:26:27.229 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.221+0000 7fc4d497f700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d0160f70 con 0x7fc4d006d8a0 2023-08-26T09:26:27.230 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.221+0000 7fc4ce59c700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fc4d0160b90 0x7fc4d0161b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:59108/0 (socket says 172.21.15.92:59108) 2023-08-26T09:26:27.230 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.221+0000 7fc4ce59c700 1 -- 172.21.15.92:0/4092946461 learned_addr learned my addr 172.21.15.92:0/4092946461 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-08-26T09:26:27.230 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.222+0000 7fc4cdd9b700 1 --2- 172.21.15.92:0/4092946461 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4d006d8a0 0x7fc4d00cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:27.230 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.222+0000 7fc4cd59a700 1 -- 172.21.15.92:0/4092946461 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2310135510 0 0) 0x7fc4d006cf70 con 0x7fc4d0160b90 2023-08-26T09:26:27.230 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.222+0000 7fc4cd59a700 1 -- 172.21.15.92:0/4092946461 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4b80035b0 con 0x7fc4d0160b90 2023-08-26T09:26:27.231 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.222+0000 7fc4cd59a700 1 -- 172.21.15.92:0/4092946461 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2698749726 0 0) 0x7fc4b80035b0 con 0x7fc4d0160b90 2023-08-26T09:26:27.231 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.222+0000 7fc4cd59a700 1 -- 172.21.15.92:0/4092946461 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4d006d8a0 msgr2=0x7fc4d00cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:27.231 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.222+0000 7fc4cd59a700 1 --2- 172.21.15.92:0/4092946461 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4d006d8a0 0x7fc4d00cf780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:27.231 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.222+0000 7fc4cd59a700 1 -- 172.21.15.92:0/4092946461 >> v1:172.21.15.188:6789/0 conn(0x7fc4d006a320 legacy=0x7fc4d0070ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:27.231 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.222+0000 7fc4cd59a700 1 -- 172.21.15.92:0/4092946461 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d006d1c0 con 0x7fc4d0160b90 2023-08-26T09:26:27.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.222+0000 7fc4cd59a700 1 -- 172.21.15.92:0/4092946461 <== mon.0 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1019361464 0 0) 0x7fc4c80019f0 con 0x7fc4d0160b90 2023-08-26T09:26:27.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.222+0000 7fc4cd59a700 1 -- 172.21.15.92:0/4092946461 >> v1:172.21.15.92:6789/0 conn(0x7fc4d0160b90 legacy=0x7fc4d0161b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:27.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.222+0000 7fc4cd59a700 1 --2- 172.21.15.92:0/4092946461 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4d006d8a0 0x7fc4b8003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:27.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.222+0000 7fc4cd59a700 1 --2- 172.21.15.92:0/4092946461 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4b8003fb0 0x7fc4b8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:27.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.222+0000 7fc4cd59a700 1 --2- 172.21.15.92:0/4092946461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc4b8004d90 0x7fc4b8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:27.233 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.222+0000 7fc4cd59a700 1 -- 172.21.15.92:0/4092946461 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d0160f70 con 0x7fc4b8004d90 2023-08-26T09:26:27.233 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.222+0000 7fc4cd59a700 1 -- 172.21.15.92:0/4092946461 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b800baf0 con 0x7fc4b8003fb0 2023-08-26T09:26:27.233 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.222+0000 7fc4cd59a700 1 -- 172.21.15.92:0/4092946461 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b800bcb0 con 0x7fc4d006d8a0 2023-08-26T09:26:27.233 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.222+0000 7fc4ced9d700 1 --2- 172.21.15.92:0/4092946461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc4b8004d90 0x7fc4b8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:27.233 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.222+0000 7fc4ce59c700 1 --2- 172.21.15.92:0/4092946461 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4d006d8a0 0x7fc4b8003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:27.234 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.222+0000 7fc4cdd9b700 1 --2- 172.21.15.92:0/4092946461 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4b8003fb0 0x7fc4b8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:27.234 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.222+0000 7fc4ced9d700 1 -- 172.21.15.92:0/4092946461 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4d006d8a0 msgr2=0x7fc4b8003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:27.234 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.222+0000 7fc4ced9d700 1 --2- 172.21.15.92:0/4092946461 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4d006d8a0 0x7fc4b8003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:27.234 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.223+0000 7fc4ced9d700 1 -- 172.21.15.92:0/4092946461 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4b8003fb0 msgr2=0x7fc4b8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:27.234 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.223+0000 7fc4ced9d700 1 --2- 172.21.15.92:0/4092946461 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4b8003fb0 0x7fc4b8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:27.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.223+0000 7fc4ced9d700 1 -- 172.21.15.92:0/4092946461 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b80035b0 con 0x7fc4b8004d90 2023-08-26T09:26:27.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.223+0000 7fc4ced9d700 1 --2- 172.21.15.92:0/4092946461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc4b8004d90 0x7fc4b8005210 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fc4c00017c0 tx=0x7fc4b8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c845f338afb195c0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:27.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.223+0000 7fc4cd59a700 1 -- 172.21.15.92:0/4092946461 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c00052d0 con 0x7fc4b8004d90 2023-08-26T09:26:27.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.223+0000 7fc4cd59a700 1 -- 172.21.15.92:0/4092946461 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c0005430 con 0x7fc4b8004d90 2023-08-26T09:26:27.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.223+0000 7fc4cd59a700 1 -- 172.21.15.92:0/4092946461 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c00038c0 con 0x7fc4b8004d90 2023-08-26T09:26:27.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.223+0000 7fc4d497f700 1 -- 172.21.15.92:0/4092946461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc4b8004d90 msgr2=0x7fc4b8005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:27.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.223+0000 7fc4d497f700 1 --2- 172.21.15.92:0/4092946461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc4b8004d90 0x7fc4b8005210 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fc4c00017c0 tx=0x7fc4b8005880 comp rx=0 tx=0).stop 2023-08-26T09:26:27.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.223+0000 7fc4ced9d700 1 -- 172.21.15.92:0/4092946461 reap_dead start 2023-08-26T09:26:27.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.223+0000 7fc4d497f700 1 -- 172.21.15.92:0/4092946461 shutdown_connections 2023-08-26T09:26:27.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.223+0000 7fc4d497f700 1 -- 172.21.15.92:0/4092946461 >> 172.21.15.92:0/4092946461 conn(0x7fc4d00cc790 msgr2=0x7fc4d00ccb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:27.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.223+0000 7fc4d497f700 1 -- 172.21.15.92:0/4092946461 shutdown_connections 2023-08-26T09:26:27.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.223+0000 7fc4d497f700 1 -- 172.21.15.92:0/4092946461 wait complete. 2023-08-26T09:26:27.245 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.225+0000 7fc4d497f700 1 Processor -- start 2023-08-26T09:26:27.245 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.225+0000 7fc4d497f700 1 -- start start 2023-08-26T09:26:27.245 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.225+0000 7fc4d497f700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4b8004d90 0x7fc4d0151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:27.246 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.225+0000 7fc4d497f700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4d00c3840 0x7fc4d00c6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:27.246 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.225+0000 7fc4d497f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc4d00b1e50 0x7fc4d00c7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:27.246 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.225+0000 7fc4d497f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d00b4270 con 0x7fc4d00b1e50 2023-08-26T09:26:27.246 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.225+0000 7fc4d497f700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d00c9c10 con 0x7fc4b8004d90 2023-08-26T09:26:27.247 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.225+0000 7fc4d497f700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d00b15e0 con 0x7fc4d00c3840 2023-08-26T09:26:27.247 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.226+0000 7fc4ced9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc4d00b1e50 0x7fc4d00c7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:27.247 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.226+0000 7fc4ced9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc4d00b1e50 0x7fc4d00c7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47108/0 (socket says 172.21.15.92:47108) 2023-08-26T09:26:27.247 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.226+0000 7fc4ced9d700 1 -- 172.21.15.92:0/2269559873 learned_addr learned my addr 172.21.15.92:0/2269559873 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:27.247 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.226+0000 7fc4cdd9b700 1 --2- 172.21.15.92:0/2269559873 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4d00c3840 0x7fc4d00c6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:27.248 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.226+0000 7fc4ce59c700 1 --2- 172.21.15.92:0/2269559873 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4b8004d90 0x7fc4d0151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:27.248 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.226+0000 7fc4ced9d700 1 -- 172.21.15.92:0/2269559873 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4d00c3840 msgr2=0x7fc4d00c6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:27.248 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.226+0000 7fc4ced9d700 1 --2- 172.21.15.92:0/2269559873 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4d00c3840 0x7fc4d00c6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:27.248 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.226+0000 7fc4ced9d700 1 -- 172.21.15.92:0/2269559873 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4b8004d90 msgr2=0x7fc4d0151fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:27.248 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.226+0000 7fc4ced9d700 1 --2- 172.21.15.92:0/2269559873 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4b8004d90 0x7fc4d0151fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:27.248 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.226+0000 7fc4ced9d700 1 -- 172.21.15.92:0/2269559873 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d00b3940 con 0x7fc4d00b1e50 2023-08-26T09:26:27.249 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.226+0000 7fc4ced9d700 1 --2- 172.21.15.92:0/2269559873 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc4d00b1e50 0x7fc4d00c7320 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fc4c0004000 tx=0x7fc4c0001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:27.249 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.226+0000 7fc4beffd700 1 -- 172.21.15.92:0/2269559873 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c0001290 con 0x7fc4d00b1e50 2023-08-26T09:26:27.249 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.226+0000 7fc4beffd700 1 -- 172.21.15.92:0/2269559873 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c0003c70 con 0x7fc4d00b1e50 2023-08-26T09:26:27.249 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.226+0000 7fc4beffd700 1 -- 172.21.15.92:0/2269559873 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c0012420 con 0x7fc4d00b1e50 2023-08-26T09:26:27.249 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.226+0000 7fc4d497f700 1 -- 172.21.15.92:0/2269559873 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4d00b3c20 con 0x7fc4d00b1e50 2023-08-26T09:26:27.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.226+0000 7fc4d497f700 1 -- 172.21.15.92:0/2269559873 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4d00b4700 con 0x7fc4d00b1e50 2023-08-26T09:26:27.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.228+0000 7fc4beffd700 1 -- 172.21.15.92:0/2269559873 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc4c0019070 con 0x7fc4d00b1e50 2023-08-26T09:26:27.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.228+0000 7fc4beffd700 1 --2- 172.21.15.92:0/2269559873 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fc4b006a0e0 0x7fc4b006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:27.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.228+0000 7fc4beffd700 1 -- 172.21.15.92:0/2269559873 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc4c0088a00 con 0x7fc4d00b1e50 2023-08-26T09:26:27.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.228+0000 7fc4ce59c700 1 --2- 172.21.15.92:0/2269559873 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fc4b006a0e0 0x7fc4b006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:27.251 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.228+0000 7fc4ce59c700 1 --2- 172.21.15.92:0/2269559873 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fc4b006a0e0 0x7fc4b006c5a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc4d00b5880 tx=0x7fc4c8006040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:27.251 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.230+0000 7fc4e0b23b80 1 Processor -- start 2023-08-26T09:26:27.251 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.230+0000 7fc4e0b23b80 1 -- start start 2023-08-26T09:26:27.251 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.231+0000 7fc4e0b23b80 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55858d0b6a60 0x55858d0e6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:27.251 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.231+0000 7fc4e0b23b80 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55858d0b6e40 0x55858d0e6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:27.252 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.231+0000 7fc4e0b23b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55858d0b9f60 0x55858d0d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:27.252 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.231+0000 7fc4e0b23b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55858d023760 con 0x55858d0b9f60 2023-08-26T09:26:27.252 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.231+0000 7fc4e0b23b80 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55858d014730 con 0x55858d0b6a60 2023-08-26T09:26:27.252 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.231+0000 7fc4e0b23b80 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x55858d012050 con 0x55858d0b6e40 2023-08-26T09:26:27.252 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.231+0000 7fc4ced9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55858d0b9f60 0x55858d0d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:27.252 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.231+0000 7fc4ced9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55858d0b9f60 0x55858d0d14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47116/0 (socket says 172.21.15.92:47116) 2023-08-26T09:26:27.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.231+0000 7fc4ced9d700 1 -- 172.21.15.92:0/472389948 learned_addr learned my addr 172.21.15.92:0/472389948 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:27.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.231+0000 7fc4cdd9b700 1 --2- 172.21.15.92:0/472389948 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55858d0b6e40 0x55858d0e6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:27.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.231+0000 7fc4ce59c700 1 --2- 172.21.15.92:0/472389948 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55858d0b6a60 0x55858d0e6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:27.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.231+0000 7fc4ced9d700 1 -- 172.21.15.92:0/472389948 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55858d0b6e40 msgr2=0x55858d0e6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:27.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.231+0000 7fc4ced9d700 1 --2- 172.21.15.92:0/472389948 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55858d0b6e40 0x55858d0e6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:27.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.231+0000 7fc4ced9d700 1 -- 172.21.15.92:0/472389948 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55858d0b6a60 msgr2=0x55858d0e6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:27.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.231+0000 7fc4ced9d700 1 --2- 172.21.15.92:0/472389948 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55858d0b6a60 0x55858d0e6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:27.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.231+0000 7fc4ced9d700 1 -- 172.21.15.92:0/472389948 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55858ce8d5e0 con 0x55858d0b9f60 2023-08-26T09:26:27.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.231+0000 7fc4ced9d700 1 --2- 172.21.15.92:0/472389948 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55858d0b9f60 0x55858d0d14d0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fc4c00050a0 tx=0x7fc4c0057a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d662f1be9a51c8f6 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:27.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.231+0000 7fc4affff700 1 -- 172.21.15.92:0/472389948 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c005bc00 con 0x55858d0b9f60 2023-08-26T09:26:27.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.232+0000 7fc4affff700 1 -- 172.21.15.92:0/472389948 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c005fb50 con 0x55858d0b9f60 2023-08-26T09:26:27.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.232+0000 7fc4affff700 1 -- 172.21.15.92:0/472389948 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c0001410 con 0x55858d0b9f60 2023-08-26T09:26:27.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.232+0000 7fc4e0b23b80 1 -- 172.21.15.92:0/472389948 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55858d0b9f60 msgr2=0x55858d0d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:27.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.232+0000 7fc4e0b23b80 1 --2- 172.21.15.92:0/472389948 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55858d0b9f60 0x55858d0d14d0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fc4c00050a0 tx=0x7fc4c0057a80 comp rx=0 tx=0).stop 2023-08-26T09:26:27.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.232+0000 7fc4e0b23b80 1 -- 172.21.15.92:0/472389948 shutdown_connections 2023-08-26T09:26:27.256 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.232+0000 7fc4e0b23b80 1 --2- 172.21.15.92:0/472389948 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55858d0b6a60 0x55858d0e6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:27.256 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.232+0000 7fc4e0b23b80 1 --2- 172.21.15.92:0/472389948 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55858d0b9f60 0x55858d0d14d0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:27.256 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.232+0000 7fc4e0b23b80 1 --2- 172.21.15.92:0/472389948 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55858d0b6e40 0x55858d0e6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:27.256 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.232+0000 7fc4e0b23b80 1 -- 172.21.15.92:0/472389948 >> 172.21.15.92:0/472389948 conn(0x55858d030090 msgr2=0x55858d0bc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:27.256 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.232+0000 7fc4e0b23b80 1 -- 172.21.15.92:0/472389948 shutdown_connections 2023-08-26T09:26:27.257 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.232+0000 7fc4e0b23b80 1 -- 172.21.15.92:0/472389948 wait complete. 2023-08-26T09:26:27.257 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.233+0000 7fc4e0b23b80 1 -- start start 2023-08-26T09:26:27.257 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.233+0000 7fc4e0b23b80 1 Processor -- start 2023-08-26T09:26:27.257 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.234+0000 7fc4e0b23b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55858d0b6a60 0x55858d0fa6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:27.257 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.234+0000 7fc4e0b23b80 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55858d0b6e40 0x55858d1138b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:27.257 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.234+0000 7fc4e0b23b80 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55858d0b9f60 0x55858d105050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:27.258 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.234+0000 7fc4e0b23b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55858d00d940 con 0x55858d0b6a60 2023-08-26T09:26:27.258 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.234+0000 7fc4e0b23b80 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55858cfabb60 con 0x55858d0b9f60 2023-08-26T09:26:27.258 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.234+0000 7fc4e0b23b80 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x55858cfab860 con 0x55858d0b6e40 2023-08-26T09:26:27.258 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.234+0000 7fc4e0b23b80 10 client.0 _ll_register_callbacks cb 0x55858cef5a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-26T09:26:27.258 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.234+0000 7fc4ce59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55858d0b6a60 0x55858d0fa6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:27.259 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.234+0000 7fc4ce59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55858d0b6a60 0x55858d0fa6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47118/0 (socket says 172.21.15.92:47118) 2023-08-26T09:26:27.259 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.234+0000 7fc4ce59c700 1 -- 172.21.15.92:0/128391808 learned_addr learned my addr 172.21.15.92:0/128391808 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:27.259 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.234+0000 7fc4cdd9b700 1 --2- 172.21.15.92:0/128391808 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55858d0b6e40 0x55858d1138b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:27.259 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.234+0000 7fc4ced9d700 1 --2- 172.21.15.92:0/128391808 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55858d0b9f60 0x55858d105050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:27.259 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.234+0000 7fc4ce59c700 1 -- 172.21.15.92:0/128391808 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55858d0b6e40 msgr2=0x55858d1138b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:27.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.234+0000 7fc4ce59c700 1 --2- 172.21.15.92:0/128391808 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55858d0b6e40 0x55858d1138b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:27.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.234+0000 7fc4ce59c700 1 -- 172.21.15.92:0/128391808 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55858d0b9f60 msgr2=0x55858d105050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:27.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.234+0000 7fc4ce59c700 1 --2- 172.21.15.92:0/128391808 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55858d0b9f60 0x55858d105050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:27.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.234+0000 7fc4ce59c700 1 -- 172.21.15.92:0/128391808 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4d00b4700 con 0x55858d0b6a60 2023-08-26T09:26:27.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.235+0000 7fc4ce59c700 1 --2- 172.21.15.92:0/128391808 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55858d0b6a60 0x55858d0fa6b0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8015e20 tx=0x7fc4c8001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8519f886c3b0fe73 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:27.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.235+0000 7fc4ad7fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-08-26T09:26:27.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.235+0000 7fc4ad7fa700 1 -- 172.21.15.92:0/128391808 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c8015e50 con 0x55858d0b6a60 2023-08-26T09:26:27.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.235+0000 7fc4e0b23b80 1 -- 172.21.15.92:0/128391808 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55858d0aeb90 con 0x55858d0b6a60 2023-08-26T09:26:27.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.235+0000 7fc4ad7fa700 1 -- 172.21.15.92:0/128391808 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc4c801a040 con 0x55858d0b6a60 2023-08-26T09:26:27.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.235+0000 7fc4ad7fa700 1 -- 172.21.15.92:0/128391808 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc4c8014a70 con 0x55858d0b6a60 2023-08-26T09:26:27.262 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.235+0000 7fc4e0b23b80 10 client.5550 fetch_fsmap learned FSMap version 16 2023-08-26T09:26:27.262 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.235+0000 7fc4e0b23b80 1 -- 172.21.15.92:0/128391808 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55858ce39d90 con 0x55858d0b6a60 2023-08-26T09:26:27.262 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.235+0000 7fc4ad7fa700 1 -- 172.21.15.92:0/128391808 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c8031020 con 0x55858d0b6a60 2023-08-26T09:26:27.262 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.235+0000 7fc4ad7fa700 1 -- 172.21.15.92:0/128391808 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc4c8014bd0 con 0x55858d0b6a60 2023-08-26T09:26:27.262 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.235+0000 7fc4e0b23b80 10 client.5550 fetch_fsmap finished waiting for FSMap version 16 2023-08-26T09:26:27.262 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.235+0000 7fc4e0b23b80 10 client.5550 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-26T09:26:27.263 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.235+0000 7fc4e0b23b80 20 client.5550 populate_metadata read hostname 'smithi092' 2023-08-26T09:26:27.263 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.235+0000 7fc4e0b23b80 1 --2- 172.21.15.92:0/128391808 >> [v2:172.21.15.92:6834/123272842,v1:172.21.15.92:6837/123272842] conn(0x55858d0e5a10 0x55858d0e4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:27.263 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.235+0000 7fc4e0b23b80 4 client.5550 mds_command: new command op to 5361 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-26T09:26:27.263 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.235+0000 7fc4e0b23b80 1 -- 172.21.15.92:0/128391808 --> [v2:172.21.15.92:6834/123272842,v1:172.21.15.92:6837/123272842] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55858cfb3b50 con 0x55858d0e5a10 2023-08-26T09:26:27.263 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.235+0000 7fc4cdd9b700 1 --2- 172.21.15.92:0/128391808 >> [v2:172.21.15.92:6834/123272842,v1:172.21.15.92:6837/123272842] conn(0x55858d0e5a10 0x55858d0e4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:27.264 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.236+0000 7fc4ad7fa700 10 client.5550 ms_handle_connect on v2:172.21.15.92:6834/123272842 2023-08-26T09:26:27.264 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.236+0000 7fc4cdd9b700 1 --2- 172.21.15.92:0/128391808 >> [v2:172.21.15.92:6834/123272842,v1:172.21.15.92:6837/123272842] conn(0x55858d0e5a10 0x55858d0e4d70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73964377cdf7a77f server_cookie=ee6c67b3e46adcbb in_seq=0 out_seq=0 2023-08-26T09:26:27.264 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.236+0000 7fc4ad7fa700 1 -- 172.21.15.92:0/128391808 <== mds.0 v2:172.21.15.92:6834/123272842 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55858cfb3b50 con 0x55858d0e5a10 2023-08-26T09:26:27.264 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.236+0000 7fc4ad7fa700 10 client.5550 handle_command_reply: tid=0 2023-08-26T09:26:27.264 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.236+0000 7fc4e0b23b80 1 client.5550 shutdown 2023-08-26T09:26:27.265 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.236+0000 7fc4e0b23b80 1 -- 172.21.15.92:0/128391808 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55858d0b6a60 msgr2=0x55858d0fa6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:27.265 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.236+0000 7fc4e0b23b80 1 --2- 172.21.15.92:0/128391808 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55858d0b6a60 0x55858d0fa6b0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8015e20 tx=0x7fc4c8001360 comp rx=0 tx=0).stop 2023-08-26T09:26:27.265 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.236+0000 7fc4e0b23b80 1 -- 172.21.15.92:0/128391808 shutdown_connections 2023-08-26T09:26:27.265 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.236+0000 7fc4e0b23b80 1 --2- 172.21.15.92:0/128391808 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55858d0b9f60 0x55858d105050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:27.265 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.236+0000 7fc4e0b23b80 1 --2- 172.21.15.92:0/128391808 >> [v2:172.21.15.92:6834/123272842,v1:172.21.15.92:6837/123272842] conn(0x55858d0e5a10 0x55858d0e4d70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:27.266 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.236+0000 7fc4e0b23b80 1 --2- 172.21.15.92:0/128391808 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55858d0b6a60 0x55858d0fa6b0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:27.266 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.236+0000 7fc4ad7fa700 0 client.5550 ms_handle_reset on v2:172.21.15.92:6834/123272842 2023-08-26T09:26:27.266 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.236+0000 7fc4e0b23b80 1 --2- 172.21.15.92:0/128391808 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55858d0b6e40 0x55858d1138b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:27.266 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.236+0000 7fc4e0b23b80 1 -- 172.21.15.92:0/128391808 >> 172.21.15.92:0/128391808 conn(0x55858d030090 msgr2=0x55858d0d2400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:27.266 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.236+0000 7fc4e0b23b80 1 -- 172.21.15.92:0/128391808 shutdown_connections 2023-08-26T09:26:27.266 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.236+0000 7fc4e0b23b80 1 -- 172.21.15.92:0/128391808 wait complete. 2023-08-26T09:26:27.267 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.237+0000 7fc4e0b23b80 20 client.5550 trim_cache size 0 max 16384 2023-08-26T09:26:27.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.254+0000 7fc4e0b23b80 1 Processor -- start 2023-08-26T09:26:27.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.254+0000 7fc4e0b23b80 1 -- start start 2023-08-26T09:26:27.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.255+0000 7fc4e0b23b80 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55858d0b6a60 0x55858d103f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:27.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.255+0000 7fc4e0b23b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55858d0b6e40 0x55858d0fb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:27.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.255+0000 7fc4e0b23b80 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55858d0b9f60 0x55858d0b7c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:27.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.255+0000 7fc4e0b23b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55858ce8f8d0 con 0x55858d0b6e40 2023-08-26T09:26:27.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.255+0000 7fc4e0b23b80 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55858d0b94e0 con 0x55858d0b6a60 2023-08-26T09:26:27.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.255+0000 7fc4e0b23b80 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x55858d0bc860 con 0x55858d0b9f60 2023-08-26T09:26:27.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.255+0000 7fc4cdd9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55858d0b6e40 0x55858d0fb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:27.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.255+0000 7fc4cdd9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55858d0b6e40 0x55858d0fb860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47126/0 (socket says 172.21.15.92:47126) 2023-08-26T09:26:27.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.255+0000 7fc4cdd9b700 1 -- 172.21.15.92:0/409476742 learned_addr learned my addr 172.21.15.92:0/409476742 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:27.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.255+0000 7fc4ce59c700 1 --2- 172.21.15.92:0/409476742 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55858d0b6a60 0x55858d103f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:27.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.255+0000 7fc4ced9d700 1 --2- 172.21.15.92:0/409476742 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55858d0b9f60 0x55858d0b7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:27.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.255+0000 7fc4cdd9b700 1 -- 172.21.15.92:0/409476742 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55858d0b9f60 msgr2=0x55858d0b7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:27.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.255+0000 7fc4cdd9b700 1 --2- 172.21.15.92:0/409476742 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55858d0b9f60 0x55858d0b7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:27.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.255+0000 7fc4cdd9b700 1 -- 172.21.15.92:0/409476742 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55858d0b6a60 msgr2=0x55858d103f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:27.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.255+0000 7fc4cdd9b700 1 --2- 172.21.15.92:0/409476742 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55858d0b6a60 0x55858d103f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:27.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.255+0000 7fc4cdd9b700 1 -- 172.21.15.92:0/409476742 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55858ce22c10 con 0x55858d0b6e40 2023-08-26T09:26:27.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.256+0000 7fc4cdd9b700 1 --2- 172.21.15.92:0/409476742 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55858d0b6e40 0x55858d0fb860 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0071c40 tx=0x7fc4c4009210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49828b3a0cfc3ec4 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:27.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.256+0000 7fc4bcff9700 1 -- 172.21.15.92:0/409476742 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c401c040 con 0x55858d0b6e40 2023-08-26T09:26:27.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.256+0000 7fc4bcff9700 1 -- 172.21.15.92:0/409476742 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c4026020 con 0x55858d0b6e40 2023-08-26T09:26:27.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.256+0000 7fc4bcff9700 1 -- 172.21.15.92:0/409476742 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c4004040 con 0x55858d0b6e40 2023-08-26T09:26:27.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.256+0000 7fc4e0b23b80 1 -- 172.21.15.92:0/409476742 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55858d0b6e40 msgr2=0x55858d0fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:27.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.256+0000 7fc4e0b23b80 1 --2- 172.21.15.92:0/409476742 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55858d0b6e40 0x55858d0fb860 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0071c40 tx=0x7fc4c4009210 comp rx=0 tx=0).stop 2023-08-26T09:26:27.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.256+0000 7fc4e0b23b80 1 -- 172.21.15.92:0/409476742 shutdown_connections 2023-08-26T09:26:27.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.256+0000 7fc4e0b23b80 1 --2- 172.21.15.92:0/409476742 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55858d0b6a60 0x55858d103f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:27.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.256+0000 7fc4e0b23b80 1 --2- 172.21.15.92:0/409476742 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55858d0b9f60 0x55858d0b7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:27.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.256+0000 7fc4e0b23b80 1 --2- 172.21.15.92:0/409476742 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55858d0b6e40 0x55858d0fb860 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:27.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.256+0000 7fc4e0b23b80 1 -- 172.21.15.92:0/409476742 >> 172.21.15.92:0/409476742 conn(0x55858d030090 msgr2=0x55858d0b28a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:27.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.256+0000 7fc4e0b23b80 1 -- 172.21.15.92:0/409476742 shutdown_connections 2023-08-26T09:26:27.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.256+0000 7fc4e0b23b80 1 -- 172.21.15.92:0/409476742 wait complete. 2023-08-26T09:26:27.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.257+0000 7fc4e0b23b80 1 -- start start 2023-08-26T09:26:27.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.257+0000 7fc4e0b23b80 1 Processor -- start 2023-08-26T09:26:27.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.258+0000 7fc4e0b23b80 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55858d0b6a60 0x55858d0f7300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:27.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.258+0000 7fc4e0b23b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55858d0b6e40 0x55858d0e9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:27.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.258+0000 7fc4e0b23b80 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55858d0b9f60 0x55858d0e4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:27.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.258+0000 7fc4e0b23b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55858d104ca0 con 0x55858d0b6e40 2023-08-26T09:26:27.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.258+0000 7fc4e0b23b80 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55858d0f7c00 con 0x55858d0b6a60 2023-08-26T09:26:27.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.258+0000 7fc4e0b23b80 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x55858d151760 con 0x55858d0b9f60 2023-08-26T09:26:27.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.258+0000 7fc4e0b23b80 10 client.0 _ll_register_callbacks cb 0x7fc4c80157d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-26T09:26:27.281 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.258+0000 7fc4cdd9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55858d0b6e40 0x55858d0e9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:27.281 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.258+0000 7fc4cdd9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55858d0b6e40 0x55858d0e9e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47134/0 (socket says 172.21.15.92:47134) 2023-08-26T09:26:27.281 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.258+0000 7fc4cdd9b700 1 -- 172.21.15.92:0/4277375076 learned_addr learned my addr 172.21.15.92:0/4277375076 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:27.281 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.258+0000 7fc4ce59c700 1 --2- 172.21.15.92:0/4277375076 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55858d0b6a60 0x55858d0f7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:27.281 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.258+0000 7fc4ced9d700 1 --2- 172.21.15.92:0/4277375076 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55858d0b9f60 0x55858d0e4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:27.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.258+0000 7fc4cdd9b700 1 -- 172.21.15.92:0/4277375076 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55858d0b9f60 msgr2=0x55858d0e4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:27.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.258+0000 7fc4cdd9b700 1 --2- 172.21.15.92:0/4277375076 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55858d0b9f60 0x55858d0e4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:27.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.258+0000 7fc4cdd9b700 1 -- 172.21.15.92:0/4277375076 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55858d0b6a60 msgr2=0x55858d0f7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:27.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.258+0000 7fc4cdd9b700 1 --2- 172.21.15.92:0/4277375076 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55858d0b6a60 0x55858d0f7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:27.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.258+0000 7fc4cdd9b700 1 -- 172.21.15.92:0/4277375076 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4c4009ac0 con 0x55858d0b6e40 2023-08-26T09:26:27.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.258+0000 7fc4ced9d700 1 --2- 172.21.15.92:0/4277375076 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55858d0b9f60 0x55858d0e4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:26:27.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.258+0000 7fc4cdd9b700 1 --2- 172.21.15.92:0/4277375076 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55858d0b6e40 0x55858d0e9e20 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4009250 tx=0x7fc4c4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cfe805bbd41a4fe server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:27.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.258+0000 7fc4ad7fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-08-26T09:26:27.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.259+0000 7fc4ad7fa700 1 -- 172.21.15.92:0/4277375076 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c401c040 con 0x55858d0b6e40 2023-08-26T09:26:27.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.259+0000 7fc4ad7fa700 1 -- 172.21.15.92:0/4277375076 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc4c4027030 con 0x55858d0b6e40 2023-08-26T09:26:27.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.259+0000 7fc4e0b23b80 1 -- 172.21.15.92:0/4277375076 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc4c005fb50 con 0x55858d0b6e40 2023-08-26T09:26:27.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.259+0000 7fc4ad7fa700 1 -- 172.21.15.92:0/4277375076 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc4c40225c0 con 0x55858d0b6e40 2023-08-26T09:26:27.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.259+0000 7fc4e0b23b80 10 client.5556 fetch_fsmap learned FSMap version 16 2023-08-26T09:26:27.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.259+0000 7fc4e0b23b80 1 -- 172.21.15.92:0/4277375076 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55858ce60200 con 0x55858d0b6e40 2023-08-26T09:26:27.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.259+0000 7fc4ad7fa700 1 -- 172.21.15.92:0/4277375076 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c005fb50 con 0x55858d0b6e40 2023-08-26T09:26:27.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.259+0000 7fc4ad7fa700 1 -- 172.21.15.92:0/4277375076 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc4c4004460 con 0x55858d0b6e40 2023-08-26T09:26:27.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.259+0000 7fc4e0b23b80 10 client.5556 fetch_fsmap finished waiting for FSMap version 16 2023-08-26T09:26:27.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.259+0000 7fc4e0b23b80 10 client.5556 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-26T09:26:27.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.259+0000 7fc4e0b23b80 20 client.5556 populate_metadata read hostname 'smithi092' 2023-08-26T09:26:27.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.259+0000 7fc4e0b23b80 1 --2- 172.21.15.92:0/4277375076 >> [v2:172.21.15.92:6834/123272842,v1:172.21.15.92:6837/123272842] conn(0x55858d0ea360 0x55858d0e4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:27.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.259+0000 7fc4e0b23b80 4 client.5556 mds_command: new command op to 5361 tid=0[{"prefix": "status"}] 2023-08-26T09:26:27.286 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.259+0000 7fc4e0b23b80 1 -- 172.21.15.92:0/4277375076 --> [v2:172.21.15.92:6834/123272842,v1:172.21.15.92:6837/123272842] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55858d006920 con 0x55858d0ea360 2023-08-26T09:26:27.286 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.259+0000 7fc4ce59c700 1 --2- 172.21.15.92:0/4277375076 >> [v2:172.21.15.92:6834/123272842,v1:172.21.15.92:6837/123272842] conn(0x55858d0ea360 0x55858d0e4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:27.286 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.259+0000 7fc4ad7fa700 10 client.5556 ms_handle_connect on v2:172.21.15.92:6834/123272842 2023-08-26T09:26:27.286 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.259+0000 7fc4ce59c700 1 --2- 172.21.15.92:0/4277375076 >> [v2:172.21.15.92:6834/123272842,v1:172.21.15.92:6837/123272842] conn(0x55858d0ea360 0x55858d0e4f50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2507edf1c3483bd server_cookie=d9567cf594f52ee3 in_seq=0 out_seq=0 2023-08-26T09:26:27.286 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.260+0000 7fc4ad7fa700 1 -- 172.21.15.92:0/4277375076 <== mds.0 v2:172.21.15.92:6834/123272842 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55858d006920 con 0x55858d0ea360 2023-08-26T09:26:27.287 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.260+0000 7fc4ad7fa700 10 client.5556 handle_command_reply: tid=0 2023-08-26T09:26:27.287 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.260+0000 7fc4e0b23b80 1 client.5556 shutdown 2023-08-26T09:26:27.287 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.260+0000 7fc4e0b23b80 1 -- 172.21.15.92:0/4277375076 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55858d0b6e40 msgr2=0x55858d0e9e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:27.287 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.260+0000 7fc4e0b23b80 1 --2- 172.21.15.92:0/4277375076 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55858d0b6e40 0x55858d0e9e20 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4009250 tx=0x7fc4c4004750 comp rx=0 tx=0).stop 2023-08-26T09:26:27.287 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.260+0000 7fc4e0b23b80 1 -- 172.21.15.92:0/4277375076 shutdown_connections 2023-08-26T09:26:27.288 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.260+0000 7fc4e0b23b80 1 --2- 172.21.15.92:0/4277375076 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55858d0b6a60 0x55858d0f7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:27.288 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.260+0000 7fc4e0b23b80 1 --2- 172.21.15.92:0/4277375076 >> [v2:172.21.15.92:6834/123272842,v1:172.21.15.92:6837/123272842] conn(0x55858d0ea360 0x55858d0e4f50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:27.288 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.260+0000 7fc4e0b23b80 1 --2- 172.21.15.92:0/4277375076 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55858d0b9f60 0x55858d0e4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:27.288 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.260+0000 7fc4e0b23b80 1 --2- 172.21.15.92:0/4277375076 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55858d0b6e40 0x55858d0e9e20 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:27.288 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.260+0000 7fc4ad7fa700 0 client.5556 ms_handle_reset on v2:172.21.15.92:6834/123272842 2023-08-26T09:26:27.289 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.260+0000 7fc4e0b23b80 1 -- 172.21.15.92:0/4277375076 >> 172.21.15.92:0/4277375076 conn(0x55858d030090 msgr2=0x55858d0facb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:27.289 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.260+0000 7fc4e0b23b80 1 -- 172.21.15.92:0/4277375076 shutdown_connections 2023-08-26T09:26:27.289 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.260+0000 7fc4e0b23b80 1 -- 172.21.15.92:0/4277375076 wait complete. 2023-08-26T09:26:27.289 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.260+0000 7fc4e0b23b80 20 client.5556 trim_cache size 0 max 16384 2023-08-26T09:26:27.290 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-08-26T09:26:27.290 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "254a2d31-bd41-4507-8326-1b205ac24377", 2023-08-26T09:26:27.290 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 0, 2023-08-26T09:26:27.290 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 5361, 2023-08-26T09:26:27.290 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2023-08-26T09:26:27.291 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2023-08-26T09:26:27.291 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2023-08-26T09:26:27.291 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 5.9044240099999996, 2023-08-26T09:26:27.291 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 16, 2023-08-26T09:26:27.291 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 33, 2023-08-26T09:26:27.292 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 33, 2023-08-26T09:26:27.292 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 13.806807722 2023-08-26T09:26:27.292 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-08-26T09:26:27.293 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.260+0000 7fc4d497f700 1 -- 172.21.15.92:0/2269559873 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fc4b006a0e0 msgr2=0x7fc4b006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:27.294 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.260+0000 7fc4d497f700 1 --2- 172.21.15.92:0/2269559873 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fc4b006a0e0 0x7fc4b006c5a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc4d00b5880 tx=0x7fc4c8006040 comp rx=0 tx=0).stop 2023-08-26T09:26:27.294 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.260+0000 7fc4d497f700 1 -- 172.21.15.92:0/2269559873 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc4d00b1e50 msgr2=0x7fc4d00c7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:27.294 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.260+0000 7fc4d497f700 1 --2- 172.21.15.92:0/2269559873 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc4d00b1e50 0x7fc4d00c7320 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fc4c0004000 tx=0x7fc4c0001120 comp rx=0 tx=0).stop 2023-08-26T09:26:27.294 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.261+0000 7fc4d497f700 1 -- 172.21.15.92:0/2269559873 shutdown_connections 2023-08-26T09:26:27.295 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.261+0000 7fc4d497f700 1 --2- 172.21.15.92:0/2269559873 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fc4b006a0e0 0x7fc4b006c5a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:27.295 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.261+0000 7fc4d497f700 1 --2- 172.21.15.92:0/2269559873 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4b8004d90 0x7fc4d0151fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:27.295 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.261+0000 7fc4d497f700 1 --2- 172.21.15.92:0/2269559873 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc4d00b1e50 0x7fc4d00c7320 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:27.295 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.261+0000 7fc4d497f700 1 --2- 172.21.15.92:0/2269559873 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4d00c3840 0x7fc4d00c6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:27.295 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.261+0000 7fc4d497f700 1 -- 172.21.15.92:0/2269559873 >> 172.21.15.92:0/2269559873 conn(0x7fc4d00cc790 msgr2=0x7fc4d00ad540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:27.296 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.261+0000 7fc4d497f700 1 -- 172.21.15.92:0/2269559873 shutdown_connections 2023-08-26T09:26:27.296 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.261+0000 7fc4d497f700 1 -- 172.21.15.92:0/2269559873 wait complete. 2023-08-26T09:26:27.296 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-26T09:26:27.419 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.414+0000 7fc6d738c700 1 Processor -- start 2023-08-26T09:26:27.419 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.414+0000 7fc6d738c700 1 -- start start 2023-08-26T09:26:27.422 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.415+0000 7fc6d738c700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6d015e770 0x7fc6d006ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:27.422 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.415+0000 7fc6d738c700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fc6d006ce50 0x7fc6d006d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:27.422 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.415+0000 7fc6d738c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc6d015ed00 0x7fc6d015f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:27.422 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.415+0000 7fc6d738c700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6d015eb50 con 0x7fc6d015ed00 2023-08-26T09:26:27.422 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.415+0000 7fc6d738c700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6d006d810 con 0x7fc6d006ce50 2023-08-26T09:26:27.423 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.415+0000 7fc6d738c700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d006b240 con 0x7fc6d015e770 2023-08-26T09:26:27.423 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.415+0000 7fc6d5929700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc6d015ed00 0x7fc6d015f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:27.423 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.415+0000 7fc6d5929700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc6d015ed00 0x7fc6d015f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47142/0 (socket says 172.21.15.92:47142) 2023-08-26T09:26:27.423 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.415+0000 7fc6d5929700 1 -- 172.21.15.92:0/1668496767 learned_addr learned my addr 172.21.15.92:0/1668496767 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:27.423 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.416+0000 7fc6d4927700 1 --2- 172.21.15.92:0/1668496767 >> v2:172.21.15.188:3300/0 conn(0x7fc6d006ce50 0x7fc6d006d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:27.424 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.416+0000 7fc6d5128700 1 --2- 172.21.15.92:0/1668496767 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6d015e770 0x7fc6d006ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:27.424 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.416+0000 7fc6d5929700 1 -- 172.21.15.92:0/1668496767 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6d015e770 msgr2=0x7fc6d006ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:27.424 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.416+0000 7fc6d5929700 1 --2- 172.21.15.92:0/1668496767 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6d015e770 0x7fc6d006ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:27.424 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.416+0000 7fc6d5929700 1 -- 172.21.15.92:0/1668496767 >> v2:172.21.15.188:3300/0 conn(0x7fc6d006ce50 msgr2=0x7fc6d006d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:27.424 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.416+0000 7fc6d5929700 1 --2- 172.21.15.92:0/1668496767 >> v2:172.21.15.188:3300/0 conn(0x7fc6d006ce50 0x7fc6d006d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:27.425 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.416+0000 7fc6d5929700 1 -- 172.21.15.92:0/1668496767 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d006f470 con 0x7fc6d015ed00 2023-08-26T09:26:27.425 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.416+0000 7fc6d5929700 1 --2- 172.21.15.92:0/1668496767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6d015ed00 0x7fc6d015f190 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0066b20 tx=0x7fc6c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30b7c2789da2959a server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:27.425 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.416+0000 7fc6c7fff700 1 -- 172.21.15.92:0/1668496767 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c800e070 con 0x7fc6d015ed00 2023-08-26T09:26:27.425 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.416+0000 7fc6c7fff700 1 -- 172.21.15.92:0/1668496767 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c800b9c0 con 0x7fc6d015ed00 2023-08-26T09:26:27.425 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.416+0000 7fc6c7fff700 1 -- 172.21.15.92:0/1668496767 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c800bd70 con 0x7fc6d015ed00 2023-08-26T09:26:27.426 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.417+0000 7fc6d738c700 1 -- 172.21.15.92:0/1668496767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6d015ed00 msgr2=0x7fc6d015f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:27.426 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.417+0000 7fc6d738c700 1 --2- 172.21.15.92:0/1668496767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6d015ed00 0x7fc6d015f190 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0066b20 tx=0x7fc6c800b330 comp rx=0 tx=0).stop 2023-08-26T09:26:27.426 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.417+0000 7fc6d738c700 1 -- 172.21.15.92:0/1668496767 shutdown_connections 2023-08-26T09:26:27.426 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.417+0000 7fc6d738c700 1 --2- 172.21.15.92:0/1668496767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6d015ed00 0x7fc6d015f190 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:27.427 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.417+0000 7fc6d738c700 1 --2- 172.21.15.92:0/1668496767 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6d015e770 0x7fc6d006ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:27.427 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.417+0000 7fc6d738c700 1 --2- 172.21.15.92:0/1668496767 >> v2:172.21.15.188:3300/0 conn(0x7fc6d006ce50 0x7fc6d006d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:27.427 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.417+0000 7fc6d738c700 1 -- 172.21.15.92:0/1668496767 >> 172.21.15.92:0/1668496767 conn(0x7fc6d00cc7b0 msgr2=0x7fc6d00ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:27.427 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.417+0000 7fc6d738c700 1 -- 172.21.15.92:0/1668496767 shutdown_connections 2023-08-26T09:26:27.427 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.417+0000 7fc6d738c700 1 -- 172.21.15.92:0/1668496767 wait complete. 2023-08-26T09:26:27.430 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.418+0000 7fc6d738c700 1 Processor -- start 2023-08-26T09:26:27.430 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.418+0000 7fc6d738c700 1 -- start start 2023-08-26T09:26:27.430 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.419+0000 7fc6d738c700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc6d006ce50 0x7fc6d014f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:27.430 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.419+0000 7fc6d738c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6d015e770 0x7fc6d00b2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:27.431 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.419+0000 7fc6d738c700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6d015ed00 0x7fc6d00b4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:27.431 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.419+0000 7fc6d738c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d00b41c0 con 0x7fc6d015e770 2023-08-26T09:26:27.431 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.419+0000 7fc6d738c700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d00b3540 con 0x7fc6d006ce50 2023-08-26T09:26:27.431 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.419+0000 7fc6d738c700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d00b3820 con 0x7fc6d015ed00 2023-08-26T09:26:27.431 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.419+0000 7fc6d4927700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6d015e770 0x7fc6d00b2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:27.432 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.419+0000 7fc6d4927700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6d015e770 0x7fc6d00b2af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47146/0 (socket says 172.21.15.92:47146) 2023-08-26T09:26:27.432 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.419+0000 7fc6d4927700 1 -- 172.21.15.92:0/3504546797 learned_addr learned my addr 172.21.15.92:0/3504546797 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:27.432 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.419+0000 7fc6d5929700 1 --2- 172.21.15.92:0/3504546797 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6d015ed00 0x7fc6d00b4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:27.432 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.419+0000 7fc6d5128700 1 --2- 172.21.15.92:0/3504546797 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc6d006ce50 0x7fc6d014f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:27.432 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.419+0000 7fc6d4927700 1 -- 172.21.15.92:0/3504546797 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6d015ed00 msgr2=0x7fc6d00b4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:27.433 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.419+0000 7fc6d4927700 1 --2- 172.21.15.92:0/3504546797 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6d015ed00 0x7fc6d00b4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:27.433 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.419+0000 7fc6d4927700 1 -- 172.21.15.92:0/3504546797 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc6d006ce50 msgr2=0x7fc6d014f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:27.433 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.419+0000 7fc6d4927700 1 --2- 172.21.15.92:0/3504546797 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc6d006ce50 0x7fc6d014f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:27.433 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.419+0000 7fc6d4927700 1 -- 172.21.15.92:0/3504546797 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c8009b30 con 0x7fc6d015e770 2023-08-26T09:26:27.433 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.419+0000 7fc6d5929700 1 --2- 172.21.15.92:0/3504546797 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6d015ed00 0x7fc6d00b4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-26T09:26:27.434 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.419+0000 7fc6d4927700 1 --2- 172.21.15.92:0/3504546797 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6d015e770 0x7fc6d00b2af0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc00e810 tx=0x7fc6cc00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:27.434 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.419+0000 7fc6c5ffb700 1 -- 172.21.15.92:0/3504546797 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc013610 con 0x7fc6d015e770 2023-08-26T09:26:27.434 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.419+0000 7fc6c5ffb700 1 -- 172.21.15.92:0/3504546797 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6cc013770 con 0x7fc6d015e770 2023-08-26T09:26:27.434 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.419+0000 7fc6d738c700 1 -- 172.21.15.92:0/3504546797 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6d00b3b00 con 0x7fc6d015e770 2023-08-26T09:26:27.434 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.419+0000 7fc6c5ffb700 1 -- 172.21.15.92:0/3504546797 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc013b00 con 0x7fc6d015e770 2023-08-26T09:26:27.434 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.420+0000 7fc6d738c700 1 -- 172.21.15.92:0/3504546797 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6d014ff00 con 0x7fc6d015e770 2023-08-26T09:26:27.435 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.421+0000 7fc6d738c700 1 -- 172.21.15.92:0/3504546797 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6d00b4300 con 0x7fc6d015e770 2023-08-26T09:26:27.435 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.421+0000 7fc6c5ffb700 1 -- 172.21.15.92:0/3504546797 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc6cc013c60 con 0x7fc6d015e770 2023-08-26T09:26:27.435 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.421+0000 7fc6c5ffb700 1 --2- 172.21.15.92:0/3504546797 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fc6b406a0e0 0x7fc6b406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:27.435 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.422+0000 7fc6d5128700 1 --2- 172.21.15.92:0/3504546797 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fc6b406a0e0 0x7fc6b406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:27.435 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.422+0000 7fc6c5ffb700 1 -- 172.21.15.92:0/3504546797 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc6cc088240 con 0x7fc6d015e770 2023-08-26T09:26:27.436 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.422+0000 7fc6d5128700 1 --2- 172.21.15.92:0/3504546797 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fc6b406a0e0 0x7fc6b406c5a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc6d01e52c0 tx=0x7fc6c0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:27.436 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.426+0000 7fc6c5ffb700 1 -- 172.21.15.92:0/3504546797 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc6cc053930 con 0x7fc6d015e770 2023-08-26T09:26:27.665 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.661+0000 7fc6d738c700 1 -- 172.21.15.92:0/3504546797 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc6d004e660 con 0x7fc6d015e770 2023-08-26T09:26:27.666 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.661+0000 7fc6c5ffb700 1 -- 172.21.15.92:0/3504546797 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc6cc056f50 con 0x7fc6d015e770 2023-08-26T09:26:27.666 INFO:teuthology.orchestra.run.smithi092.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-26T09:26:27.668 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.663+0000 7fc6d738c700 1 -- 172.21.15.92:0/3504546797 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fc6b406a0e0 msgr2=0x7fc6b406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:27.668 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.663+0000 7fc6d738c700 1 --2- 172.21.15.92:0/3504546797 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fc6b406a0e0 0x7fc6b406c5a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc6d01e52c0 tx=0x7fc6c0008040 comp rx=0 tx=0).stop 2023-08-26T09:26:27.668 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.663+0000 7fc6d738c700 1 -- 172.21.15.92:0/3504546797 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6d015e770 msgr2=0x7fc6d00b2af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:27.669 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.663+0000 7fc6d738c700 1 --2- 172.21.15.92:0/3504546797 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6d015e770 0x7fc6d00b2af0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc00e810 tx=0x7fc6cc00ebd0 comp rx=0 tx=0).stop 2023-08-26T09:26:27.669 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.663+0000 7fc6d738c700 1 -- 172.21.15.92:0/3504546797 shutdown_connections 2023-08-26T09:26:27.669 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.663+0000 7fc6d738c700 1 --2- 172.21.15.92:0/3504546797 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7fc6b406a0e0 0x7fc6b406c5a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:27.669 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.663+0000 7fc6d738c700 1 --2- 172.21.15.92:0/3504546797 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc6d006ce50 0x7fc6d014f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:27.669 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.663+0000 7fc6d738c700 1 --2- 172.21.15.92:0/3504546797 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6d015ed00 0x7fc6d00b4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:27.670 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.663+0000 7fc6d738c700 1 --2- 172.21.15.92:0/3504546797 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6d015e770 0x7fc6d00b2af0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:27.670 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.663+0000 7fc6d738c700 1 -- 172.21.15.92:0/3504546797 >> 172.21.15.92:0/3504546797 conn(0x7fc6d00cc7b0 msgr2=0x7fc6d00c3840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:27.670 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.663+0000 7fc6d738c700 1 -- 172.21.15.92:0/3504546797 shutdown_connections 2023-08-26T09:26:27.670 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:27.663+0000 7fc6d738c700 1 -- 172.21.15.92:0/3504546797 wait complete. 2023-08-26T09:26:27.679 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-26T09:26:27.680 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-26T09:26:27.680 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi092.front.sepia.ceph.com 2023-08-26T09:26:27.681 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-26T09:26:27.681 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-26T09:26:27.681 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-26T09:26:27.681 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-26T09:26:27.682 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-26T09:26:27.682 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-26T09:26:27.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:26:27.683 DEBUG:teuthology.orchestra.run.smithi092:> ip addr 2023-08-26T09:26:27.700 INFO:teuthology.orchestra.run.smithi092.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-26T09:26:27.700 INFO:teuthology.orchestra.run.smithi092.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-26T09:26:27.701 INFO:teuthology.orchestra.run.smithi092.stdout: inet 127.0.0.1/8 scope host lo 2023-08-26T09:26:27.701 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-08-26T09:26:27.701 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 ::1/128 scope host 2023-08-26T09:26:27.701 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-08-26T09:26:27.702 INFO:teuthology.orchestra.run.smithi092.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-26T09:26:27.702 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:d8:a1:b2 brd ff:ff:ff:ff:ff:ff 2023-08-26T09:26:27.702 INFO:teuthology.orchestra.run.smithi092.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-26T09:26:27.702 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:d8:a1:b3 brd ff:ff:ff:ff:ff:ff 2023-08-26T09:26:27.703 INFO:teuthology.orchestra.run.smithi092.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-26T09:26:27.703 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:8f:cd:44 brd ff:ff:ff:ff:ff:ff 2023-08-26T09:26:27.703 INFO:teuthology.orchestra.run.smithi092.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-26T09:26:27.703 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:8f:cd:45 brd ff:ff:ff:ff:ff:ff 2023-08-26T09:26:27.703 INFO:teuthology.orchestra.run.smithi092.stdout: inet 172.21.15.92/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-26T09:26:27.704 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft 42366sec preferred_lft 42366sec 2023-08-26T09:26:27.704 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::e2e8:d841:3034:9b69/64 scope link noprefixroute 2023-08-26T09:26:27.704 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-08-26T09:26:27.704 INFO:teuthology.orchestra.run.smithi092.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-26T09:26:27.705 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 3e:f2:37:41:6b:5e brd ff:ff:ff:ff:ff:ff 2023-08-26T09:26:27.705 INFO:teuthology.orchestra.run.smithi092.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-26T09:26:27.705 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-08-26T09:26:27.705 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::dc42:1cff:fe60:5c5d/64 scope link 2023-08-26T09:26:27.705 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-08-26T09:26:27.706 INFO:teuthology.orchestra.run.smithi092.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-26T09:26:27.706 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 3e:f2:37:41:6b:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-26T09:26:27.706 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::3cf2:37ff:fe41:6b5e/64 scope link 2023-08-26T09:26:27.706 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-08-26T09:26:27.706 INFO:teuthology.orchestra.run.smithi092.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-26T09:26:27.706 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether fe:dc:71:1b:82:7a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-26T09:26:27.707 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::fcdc:71ff:fe1b:827a/64 scope link 2023-08-26T09:26:27.707 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-08-26T09:26:27.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:26:27.708 DEBUG:teuthology.orchestra.run.smithi092:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-26T09:26:27.765 INFO:teuthology.orchestra.run.smithi092.stdout:1 2023-08-26T09:26:27.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:26:27.767 DEBUG:teuthology.orchestra.run.smithi092:> route 2023-08-26T09:26:27.826 INFO:teuthology.orchestra.run.smithi092.stdout:Kernel IP routing table 2023-08-26T09:26:27.826 INFO:teuthology.orchestra.run.smithi092.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-26T09:26:27.827 INFO:teuthology.orchestra.run.smithi092.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-26T09:26:27.827 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-26T09:26:27.827 INFO:teuthology.orchestra.run.smithi092.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-26T09:26:27.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:26:27.828 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2023-08-26T09:26:27.828 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2023-08-26T09:26:27.829 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-26T09:26:27.829 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-26T09:26:27.829 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-26T09:26:27.830 DEBUG:teuthology.orchestra.run.smithi092:> ') 2023-08-26T09:26:27.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:26:27.931 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list 2023-08-26T09:26:27.947 INFO:teuthology.orchestra.run.smithi092.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-26T09:26:27.948 INFO:teuthology.orchestra.run.smithi092.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-26T09:26:27.948 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-26T09:26:27.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:26:27.949 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set brx.0 up 2023-08-26T09:26:28.015 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-08-26T09:26:28.016 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-26T09:26:28.016 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-26T09:26:28.072 INFO:teuthology.orchestra.run.smithi092.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-26T09:26:28.073 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-26T09:26:28.073 DEBUG:teuthology.orchestra.run.smithi092:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-26T09:26:28.129 DEBUG:teuthology.orchestra.run.smithi092:> sudo modprobe fuse 2023-08-26T09:26:28.196 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-26T09:26:28.197 DEBUG:teuthology.orchestra.run.smithi092:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-26T09:26:28.262 INFO:teuthology.orchestra.run.smithi092.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-26T09:26:28.263 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-26T09:26:28.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:26:28.265 DEBUG:teuthology.orchestra.run.smithi092:> ls /sys/fs/fuse/connections 2023-08-26T09:26:28.321 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-08-26T09:26:28.321 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-08-26T09:26:28.364 DEBUG:teuthology.orchestra.run.smithi092:> sudo modprobe fuse 2023-08-26T09:26:28.390 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-26T09:26:28.391 DEBUG:teuthology.orchestra.run.smithi092:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-26T09:26:28.450 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi092.stderr:2023-08-26T09:26:28.445+0000 7f0c9c3e45c0 -1 init, newargv = 0x55809dee0840 newargc=15 2023-08-26T09:26:28.451 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi092.stderr:ceph-fuse[120481]: starting ceph client 2023-08-26T09:26:28.455 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi092.stderr:ceph-fuse[120481]: starting fuse 2023-08-26T09:26:28.459 INFO:teuthology.orchestra.run.smithi092.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-26T09:26:28.460 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-26T09:26:28.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:26:28.462 DEBUG:teuthology.orchestra.run.smithi092:> ls /sys/fs/fuse/connections 2023-08-26T09:26:28.519 INFO:teuthology.orchestra.run.smithi092.stdout:47 2023-08-26T09:26:28.519 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-08-26T09:26:28.520 DEBUG:teuthology.orchestra.run.smithi092:> sudo stdin-killer -- python3 -c ' 2023-08-26T09:26:28.521 DEBUG:teuthology.orchestra.run.smithi092:> import glob 2023-08-26T09:26:28.521 DEBUG:teuthology.orchestra.run.smithi092:> import re 2023-08-26T09:26:28.522 DEBUG:teuthology.orchestra.run.smithi092:> import os 2023-08-26T09:26:28.522 DEBUG:teuthology.orchestra.run.smithi092:> import subprocess 2023-08-26T09:26:28.523 DEBUG:teuthology.orchestra.run.smithi092:> 2023-08-26T09:26:28.523 DEBUG:teuthology.orchestra.run.smithi092:> def _find_admin_socket(client_name): 2023-08-26T09:26:28.524 DEBUG:teuthology.orchestra.run.smithi092:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-08-26T09:26:28.524 DEBUG:teuthology.orchestra.run.smithi092:> files = glob.glob(asok_path) 2023-08-26T09:26:28.525 DEBUG:teuthology.orchestra.run.smithi092:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-08-26T09:26:28.525 DEBUG:teuthology.orchestra.run.smithi092:> 2023-08-26T09:26:28.526 DEBUG:teuthology.orchestra.run.smithi092:> # Given a non-glob path, it better be there 2023-08-26T09:26:28.526 DEBUG:teuthology.orchestra.run.smithi092:> if "*" not in asok_path: 2023-08-26T09:26:28.526 DEBUG:teuthology.orchestra.run.smithi092:> assert(len(files) == 1) 2023-08-26T09:26:28.527 DEBUG:teuthology.orchestra.run.smithi092:> return files[0] 2023-08-26T09:26:28.527 DEBUG:teuthology.orchestra.run.smithi092:> 2023-08-26T09:26:28.528 DEBUG:teuthology.orchestra.run.smithi092:> for f in files: 2023-08-26T09:26:28.528 DEBUG:teuthology.orchestra.run.smithi092:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-08-26T09:26:28.528 DEBUG:teuthology.orchestra.run.smithi092:> if os.path.exists("/proc/{0}".format(pid)): 2023-08-26T09:26:28.529 DEBUG:teuthology.orchestra.run.smithi092:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-08-26T09:26:28.529 DEBUG:teuthology.orchestra.run.smithi092:> contents = proc_f.read() 2023-08-26T09:26:28.529 DEBUG:teuthology.orchestra.run.smithi092:> if mountpoint in contents: 2023-08-26T09:26:28.530 DEBUG:teuthology.orchestra.run.smithi092:> return f 2023-08-26T09:26:28.530 DEBUG:teuthology.orchestra.run.smithi092:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-08-26T09:26:28.531 DEBUG:teuthology.orchestra.run.smithi092:> 2023-08-26T09:26:28.531 DEBUG:teuthology.orchestra.run.smithi092:> print(_find_admin_socket("client.0")) 2023-08-26T09:26:28.532 DEBUG:teuthology.orchestra.run.smithi092:> ' 2023-08-26T09:26:28.642 INFO:teuthology.orchestra.run.smithi092.stdout:/var/run/ceph/ceph-client.0.120481.asok 2023-08-26T09:26:28.645 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-08-26T09:26:28.652 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.120481.asok 2023-08-26T09:26:28.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:26:28.652 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.120481.asok status 2023-08-26T09:26:28.807 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-08-26T09:26:28.807 INFO:teuthology.orchestra.run.smithi092.stdout: "metadata": { 2023-08-26T09:26:28.807 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_sha1": "e7eb9853fddaf661c68f207346131a7e00d8ed2f", 2023-08-26T09:26:28.808 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_version": "ceph version 18.0.0-5706-ge7eb9853 (e7eb9853fddaf661c68f207346131a7e00d8ed2f) reef (dev)", 2023-08-26T09:26:28.808 INFO:teuthology.orchestra.run.smithi092.stdout: "entity_id": "0", 2023-08-26T09:26:28.808 INFO:teuthology.orchestra.run.smithi092.stdout: "hostname": "smithi092", 2023-08-26T09:26:28.808 INFO:teuthology.orchestra.run.smithi092.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-08-26T09:26:28.808 INFO:teuthology.orchestra.run.smithi092.stdout: "pid": "120481", 2023-08-26T09:26:28.809 INFO:teuthology.orchestra.run.smithi092.stdout: "root": "/" 2023-08-26T09:26:28.809 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-08-26T09:26:28.809 INFO:teuthology.orchestra.run.smithi092.stdout: "dentry_count": 0, 2023-08-26T09:26:28.809 INFO:teuthology.orchestra.run.smithi092.stdout: "dentry_pinned_count": 0, 2023-08-26T09:26:28.809 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 5568, 2023-08-26T09:26:28.810 INFO:teuthology.orchestra.run.smithi092.stdout: "inst": { 2023-08-26T09:26:28.810 INFO:teuthology.orchestra.run.smithi092.stdout: "name": { 2023-08-26T09:26:28.810 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "client", 2023-08-26T09:26:28.810 INFO:teuthology.orchestra.run.smithi092.stdout: "num": 5568 2023-08-26T09:26:28.810 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-08-26T09:26:28.811 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": { 2023-08-26T09:26:28.811 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "v1", 2023-08-26T09:26:28.811 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": "192.168.0.1:0", 2023-08-26T09:26:28.812 INFO:teuthology.orchestra.run.smithi092.stdout: "nonce": 3624540427 2023-08-26T09:26:28.812 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-08-26T09:26:28.812 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-08-26T09:26:28.812 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": { 2023-08-26T09:26:28.812 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "v1", 2023-08-26T09:26:28.813 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": "192.168.0.1:0", 2023-08-26T09:26:28.813 INFO:teuthology.orchestra.run.smithi092.stdout: "nonce": 3624540427 2023-08-26T09:26:28.813 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-08-26T09:26:28.813 INFO:teuthology.orchestra.run.smithi092.stdout: "inst_str": "client.5568 192.168.0.1:0/3624540427", 2023-08-26T09:26:28.813 INFO:teuthology.orchestra.run.smithi092.stdout: "addr_str": "192.168.0.1:0/3624540427", 2023-08-26T09:26:28.814 INFO:teuthology.orchestra.run.smithi092.stdout: "inode_count": 1, 2023-08-26T09:26:28.814 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_epoch": 16, 2023-08-26T09:26:28.814 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_epoch": 33, 2023-08-26T09:26:28.814 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_epoch_barrier": 0, 2023-08-26T09:26:28.814 INFO:teuthology.orchestra.run.smithi092.stdout: "blocklisted": false, 2023-08-26T09:26:28.815 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs" 2023-08-26T09:26:28.815 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-08-26T09:26:28.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:26:28.817 DEBUG:teuthology.orchestra.run.smithi092:> stat --file-system '--printf=%T 2023-08-26T09:26:28.818 DEBUG:teuthology.orchestra.run.smithi092:> ' -- /home/ubuntu/cephtest/mnt.0 2023-08-26T09:26:28.835 INFO:teuthology.orchestra.run.smithi092.stdout:fuseblk 2023-08-26T09:26:28.836 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-08-26T09:26:28.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:26:28.837 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-26T09:26:28.903 DEBUG:teuthology.orchestra.run.smithi092:> mktemp -d --suffix=xfstests-dev 2023-08-26T09:26:28.960 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/tmp.LDx1v48xscxfstests-dev 2023-08-26T09:26:28.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:26:28.961 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.LDx1v48xscxfstests-dev) 2023-08-26T09:26:29.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:26:29.029 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.LDx1v48xscxfstests-dev) 2023-08-26T09:26:29.089 INFO:teuthology.orchestra.run.smithi092.stderr:Cloning into '/tmp/tmp.LDx1v48xscxfstests-dev'... 2023-08-26T09:26:29.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:26:29.804 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-08-26T09:26:29.867 DEBUG:teuthology.orchestra.run.smithi092:> mktemp -d --suffix=test 2023-08-26T09:26:29.924 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/tmp.LAQAvgNZJytest 2023-08-26T09:26:29.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:26:29.925 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-08-26T09:26:29.983 DEBUG:teuthology.orchestra.run.smithi092:> mktemp -d --suffix=scratch 2023-08-26T09:26:30.039 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/tmp.Nvn8DrEJ9vscratch 2023-08-26T09:26:30.039 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "rhel" and "8.6". 2023-08-26T09:26:30.040 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc indent libtool lvm2 make psmisc quota sed xfsdump xfsprogs libacl-devel libattr-devel libaio-devel libuuid-devel xfsprogs-devel python3 sqlite xfsprogs-qa-devel 2023-08-26T09:26:30.437 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-08-26T09:26:31.259 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:04:15 ago on Sat 26 Aug 2023 09:22:16 AM UTC. 2023-08-26T09:26:32.612 INFO:teuthology.orchestra.run.smithi092.stdout:Package acl-2.2.53-1.el8.x86_64 is already installed. 2023-08-26T09:26:32.613 INFO:teuthology.orchestra.run.smithi092.stdout:Package attr-2.4.48-3.el8.x86_64 is already installed. 2023-08-26T09:26:32.614 INFO:teuthology.orchestra.run.smithi092.stdout:Package automake-1.16.1-7.el8.noarch is already installed. 2023-08-26T09:26:32.615 INFO:teuthology.orchestra.run.smithi092.stdout:Package bc-1.07.1-5.el8.x86_64 is already installed. 2023-08-26T09:26:32.617 INFO:teuthology.orchestra.run.smithi092.stdout:Package dbench-4.0-20.el8.x86_64 is already installed. 2023-08-26T09:26:32.619 INFO:teuthology.orchestra.run.smithi092.stdout:Package e2fsprogs-1.45.6-4.el8.x86_64 is already installed. 2023-08-26T09:26:32.621 INFO:teuthology.orchestra.run.smithi092.stdout:Package gawk-4.2.1-4.el8.x86_64 is already installed. 2023-08-26T09:26:32.622 INFO:teuthology.orchestra.run.smithi092.stdout:Package gcc-8.5.0-10.1.el8_6.x86_64 is already installed. 2023-08-26T09:26:32.624 INFO:teuthology.orchestra.run.smithi092.stdout:Package libtool-2.4.6-25.el8.x86_64 is already installed. 2023-08-26T09:26:32.625 INFO:teuthology.orchestra.run.smithi092.stdout:Package lvm2-8:2.03.14-3.el8_6.2.x86_64 is already installed. 2023-08-26T09:26:32.627 INFO:teuthology.orchestra.run.smithi092.stdout:Package make-1:4.2.1-11.el8.x86_64 is already installed. 2023-08-26T09:26:32.628 INFO:teuthology.orchestra.run.smithi092.stdout:Package psmisc-23.1-5.el8.x86_64 is already installed. 2023-08-26T09:26:32.629 INFO:teuthology.orchestra.run.smithi092.stdout:Package quota-1:4.04-14.el8.x86_64 is already installed. 2023-08-26T09:26:32.630 INFO:teuthology.orchestra.run.smithi092.stdout:Package sed-4.5-5.el8.x86_64 is already installed. 2023-08-26T09:26:32.632 INFO:teuthology.orchestra.run.smithi092.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-08-26T09:26:32.633 INFO:teuthology.orchestra.run.smithi092.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-08-26T09:26:32.634 INFO:teuthology.orchestra.run.smithi092.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-08-26T09:26:32.635 INFO:teuthology.orchestra.run.smithi092.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-08-26T09:26:32.636 INFO:teuthology.orchestra.run.smithi092.stdout:Package libaio-devel-0.3.112-1.el8.x86_64 is already installed. 2023-08-26T09:26:32.637 INFO:teuthology.orchestra.run.smithi092.stdout:Package libuuid-devel-2.32.1-35.el8.x86_64 is already installed. 2023-08-26T09:26:32.639 INFO:teuthology.orchestra.run.smithi092.stdout:Package xfsprogs-devel-5.0.0-10.el8.x86_64 is already installed. 2023-08-26T09:26:32.643 INFO:teuthology.orchestra.run.smithi092.stdout:Package python36-3.6.8-38.module+el8.5.0+12207+5c5719bc.x86_64 is already installed. 2023-08-26T09:26:32.644 INFO:teuthology.orchestra.run.smithi092.stdout:Package sqlite-3.26.0-15.el8.x86_64 is already installed. 2023-08-26T09:26:32.648 INFO:teuthology.orchestra.run.smithi092.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-08-26T09:26:32.762 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2023-08-26T09:26:32.763 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2023-08-26T09:26:32.764 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2023-08-26T09:26:32.764 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2023-08-26T09:26:32.764 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2023-08-26T09:26:32.764 INFO:teuthology.orchestra.run.smithi092.stdout: dump x86_64 1:0.4-0.36.b46.el8 rhel-8-for-x86_64-baseos-rpms 164 k 2023-08-26T09:26:32.765 INFO:teuthology.orchestra.run.smithi092.stdout: fio x86_64 3.19-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-08-26T09:26:32.765 INFO:teuthology.orchestra.run.smithi092.stdout: indent x86_64 2.2.13-2.el8 epel 187 k 2023-08-26T09:26:32.765 INFO:teuthology.orchestra.run.smithi092.stdout:Upgrading: 2023-08-26T09:26:32.765 INFO:teuthology.orchestra.run.smithi092.stdout: sqlite x86_64 3.26.0-16.el8_6 rhel-8-for-x86_64-baseos-rpms 668 k 2023-08-26T09:26:32.765 INFO:teuthology.orchestra.run.smithi092.stdout: sqlite-libs x86_64 3.26.0-16.el8_6 rhel-8-for-x86_64-baseos-rpms 581 k 2023-08-26T09:26:32.765 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2023-08-26T09:26:32.766 INFO:teuthology.orchestra.run.smithi092.stdout: daxctl-libs x86_64 71.1-3.el8 rhel-8-for-x86_64-baseos-rpms 42 k 2023-08-26T09:26:32.766 INFO:teuthology.orchestra.run.smithi092.stdout: libpmemblk x86_64 1.6.1-1.el8 rhel-8-for-x86_64-appstream-rpms 92 k 2023-08-26T09:26:32.766 INFO:teuthology.orchestra.run.smithi092.stdout: ndctl-libs x86_64 71.1-3.el8 rhel-8-for-x86_64-baseos-rpms 79 k 2023-08-26T09:26:32.766 INFO:teuthology.orchestra.run.smithi092.stdout: rmt x86_64 2:1.5.3-13.el8 rhel-8-for-x86_64-baseos-rpms 51 k 2023-08-26T09:26:32.766 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:26:32.767 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2023-08-26T09:26:32.767 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2023-08-26T09:26:32.767 INFO:teuthology.orchestra.run.smithi092.stdout:Install 7 Packages 2023-08-26T09:26:32.767 INFO:teuthology.orchestra.run.smithi092.stdout:Upgrade 2 Packages 2023-08-26T09:26:32.767 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:26:32.768 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 2.3 M 2023-08-26T09:26:32.768 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2023-08-26T09:26:32.924 INFO:teuthology.orchestra.run.smithi092.stdout:(1/9): fio-3.19-3.el8.x86_64.rpm 4.1 MB/s | 538 kB 00:00 2023-08-26T09:26:32.961 INFO:teuthology.orchestra.run.smithi092.stdout:(2/9): libpmemblk-1.6.1-1.el8.x86_64.rpm 556 kB/s | 92 kB 00:00 2023-08-26T09:26:32.995 INFO:teuthology.orchestra.run.smithi092.stdout:(3/9): dump-0.4-0.36.b46.el8.x86_64.rpm 2.4 MB/s | 164 kB 00:00 2023-08-26T09:26:33.020 INFO:teuthology.orchestra.run.smithi092.stdout:(4/9): rmt-1.5.3-13.el8.x86_64.rpm 877 kB/s | 51 kB 00:00 2023-08-26T09:26:33.053 INFO:teuthology.orchestra.run.smithi092.stdout:(5/9): daxctl-libs-71.1-3.el8.x86_64.rpm 713 kB/s | 42 kB 00:00 2023-08-26T09:26:33.079 INFO:teuthology.orchestra.run.smithi092.stdout:(6/9): ndctl-libs-71.1-3.el8.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2023-08-26T09:26:33.112 INFO:teuthology.orchestra.run.smithi092.stdout:(7/9): sqlite-3.26.0-16.el8_6.x86_64.rpm 11 MB/s | 668 kB 00:00 2023-08-26T09:26:33.146 INFO:teuthology.orchestra.run.smithi092.stdout:(8/9): sqlite-libs-3.26.0-16.el8_6.x86_64.rpm 8.5 MB/s | 581 kB 00:00 2023-08-26T09:26:33.555 INFO:teuthology.orchestra.run.smithi092.stdout:(9/9): indent-2.2.13-2.el8.x86_64.rpm 246 kB/s | 187 kB 00:00 2023-08-26T09:26:33.556 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2023-08-26T09:26:33.556 INFO:teuthology.orchestra.run.smithi092.stdout:Total 3.0 MB/s | 2.3 MB 00:00 2023-08-26T09:26:33.641 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2023-08-26T09:26:33.673 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2023-08-26T09:26:33.674 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2023-08-26T09:26:33.763 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2023-08-26T09:26:33.766 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2023-08-26T09:26:34.185 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2023-08-26T09:26:34.495 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : daxctl-libs-71.1-3.el8.x86_64 1/11 2023-08-26T09:26:34.565 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: daxctl-libs-71.1-3.el8.x86_64 1/11 2023-08-26T09:26:34.762 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ndctl-libs-71.1-3.el8.x86_64 2/11 2023-08-26T09:26:34.851 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ndctl-libs-71.1-3.el8.x86_64 2/11 2023-08-26T09:26:35.020 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libpmemblk-1.6.1-1.el8.x86_64 3/11 2023-08-26T09:26:35.131 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libpmemblk-1.6.1-1.el8.x86_64 3/11 2023-08-26T09:26:35.346 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : sqlite-libs-3.26.0-16.el8_6.x86_64 4/11 2023-08-26T09:26:35.530 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rmt-2:1.5.3-13.el8.x86_64 5/11 2023-08-26T09:26:35.801 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : dump-1:0.4-0.36.b46.el8.x86_64 6/11 2023-08-26T09:26:36.122 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : sqlite-3.26.0-16.el8_6.x86_64 7/11 2023-08-26T09:26:36.450 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : fio-3.19-3.el8.x86_64 8/11 2023-08-26T09:26:36.687 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : indent-2.2.13-2.el8.x86_64 9/11 2023-08-26T09:26:36.837 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : sqlite-3.26.0-15.el8.x86_64 10/11 2023-08-26T09:26:36.993 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : sqlite-libs-3.26.0-15.el8.x86_64 11/11 2023-08-26T09:26:37.293 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: sqlite-libs-3.26.0-15.el8.x86_64 11/11 2023-08-26T09:26:37.293 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : indent-2.2.13-2.el8.x86_64 1/11 2023-08-26T09:26:37.294 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : fio-3.19-3.el8.x86_64 2/11 2023-08-26T09:26:37.294 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libpmemblk-1.6.1-1.el8.x86_64 3/11 2023-08-26T09:26:37.294 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : dump-1:0.4-0.36.b46.el8.x86_64 4/11 2023-08-26T09:26:37.294 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rmt-2:1.5.3-13.el8.x86_64 5/11 2023-08-26T09:26:37.295 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : daxctl-libs-71.1-3.el8.x86_64 6/11 2023-08-26T09:26:37.295 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ndctl-libs-71.1-3.el8.x86_64 7/11 2023-08-26T09:26:37.295 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : sqlite-3.26.0-16.el8_6.x86_64 8/11 2023-08-26T09:26:37.295 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : sqlite-3.26.0-15.el8.x86_64 9/11 2023-08-26T09:26:37.295 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : sqlite-libs-3.26.0-16.el8_6.x86_64 10/11 2023-08-26T09:26:38.511 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : sqlite-libs-3.26.0-15.el8.x86_64 11/11 2023-08-26T09:26:38.512 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:04:22 ago on Sat 26 Aug 2023 09:22:16 AM UTC. 2023-08-26T09:26:41.748 INFO:teuthology.orchestra.run.smithi092.stdout:Installed products updated. 2023-08-26T09:26:41.937 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:26:41.937 INFO:teuthology.orchestra.run.smithi092.stdout:Upgraded: 2023-08-26T09:26:41.938 INFO:teuthology.orchestra.run.smithi092.stdout: sqlite-3.26.0-16.el8_6.x86_64 sqlite-libs-3.26.0-16.el8_6.x86_64 2023-08-26T09:26:41.938 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2023-08-26T09:26:41.938 INFO:teuthology.orchestra.run.smithi092.stdout: daxctl-libs-71.1-3.el8.x86_64 dump-1:0.4-0.36.b46.el8.x86_64 2023-08-26T09:26:41.938 INFO:teuthology.orchestra.run.smithi092.stdout: fio-3.19-3.el8.x86_64 indent-2.2.13-2.el8.x86_64 2023-08-26T09:26:41.938 INFO:teuthology.orchestra.run.smithi092.stdout: libpmemblk-1.6.1-1.el8.x86_64 ndctl-libs-71.1-3.el8.x86_64 2023-08-26T09:26:41.939 INFO:teuthology.orchestra.run.smithi092.stdout: rmt-2:1.5.3-13.el8.x86_64 2023-08-26T09:26:41.939 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:26:41.939 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2023-08-26T09:26:42.082 DEBUG:teuthology.orchestra.run.smithi092:> sudo useradd -m fsgqa 2023-08-26T09:26:42.110 INFO:teuthology.orchestra.run.smithi092.stderr:useradd: user 'fsgqa' already exists 2023-08-26T09:26:42.111 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-08-26T09:26:42.111 DEBUG:teuthology.orchestra.run.smithi092:> sudo groupadd fsgqa 2023-08-26T09:26:42.178 INFO:teuthology.orchestra.run.smithi092.stderr:groupadd: group 'fsgqa' already exists 2023-08-26T09:26:42.179 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-08-26T09:26:42.180 DEBUG:teuthology.orchestra.run.smithi092:> sudo useradd fsgqa2 2023-08-26T09:26:43.189 DEBUG:teuthology.orchestra.run.smithi092:> sudo useradd 123456-fsgqa 2023-08-26T09:26:44.057 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-08-26T09:26:44.197 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.193+0000 7f34b1090700 1 Processor -- start 2023-08-26T09:26:44.197 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.193+0000 7f34b1090700 1 -- start start 2023-08-26T09:26:44.198 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.194+0000 7f34b1090700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34ac0af0f0 0x7f34ac0ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:44.199 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.194+0000 7f34b1090700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f34ac0caff0 0x7f34ac0c3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:44.199 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.194+0000 7f34b1090700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34ac0ca230 con 0x7f34ac1597c0 2023-08-26T09:26:44.199 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.194+0000 7f34b1090700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34ac0cac00 con 0x7f34ac0caff0 2023-08-26T09:26:44.199 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.194+0000 7f34b1090700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac0cd3b0 con 0x7f34ac0af0f0 2023-08-26T09:26:44.200 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.194+0000 7f34aad9d700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34ac0af0f0 0x7f34ac0ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:44.200 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.194+0000 7f34ab59e700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f34ac0caff0 0x7f34ac0c3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:44.200 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.194+0000 7f34aad9d700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34ac0af0f0 0x7f34ac0ca6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.92:45848/0 (socket says 172.21.15.92:45848) 2023-08-26T09:26:44.200 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.194+0000 7f34aad9d700 1 -- 172.21.15.92:0/2064089335 learned_addr learned my addr 172.21.15.92:0/2064089335 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:44.200 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.195+0000 7f34aad9d700 1 -- 172.21.15.92:0/2064089335 >> v2:172.21.15.188:3300/0 conn(0x7f34ac0caff0 msgr2=0x7f34ac0c3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:44.201 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.195+0000 7f34aad9d700 1 --2- 172.21.15.92:0/2064089335 >> v2:172.21.15.188:3300/0 conn(0x7f34ac0caff0 0x7f34ac0c3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:44.201 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.195+0000 7f34aad9d700 1 -- 172.21.15.92:0/2064089335 >> v1:172.21.15.188:6789/0 conn(0x7f34ac1597c0 legacy=0x7f34ac0af4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:44.201 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.195+0000 7f34aad9d700 1 -- 172.21.15.92:0/2064089335 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34ac0cd690 con 0x7f34ac0af0f0 2023-08-26T09:26:44.201 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.195+0000 7f34ab59e700 1 --2- 172.21.15.92:0/2064089335 >> v2:172.21.15.188:3300/0 conn(0x7f34ac0caff0 0x7f34ac0c3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-26T09:26:44.201 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.195+0000 7f34aad9d700 1 --2- 172.21.15.92:0/2064089335 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34ac0af0f0 0x7f34ac0ca6c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f34a00098f0 tx=0x7f34a0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=649f52789d432fca server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:44.202 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.195+0000 7f34a9d9b700 1 -- 172.21.15.92:0/2064089335 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a0011830 con 0x7f34ac0af0f0 2023-08-26T09:26:44.202 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.195+0000 7f34a9d9b700 1 -- 172.21.15.92:0/2064089335 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a0011990 con 0x7f34ac0af0f0 2023-08-26T09:26:44.202 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.195+0000 7f34a9d9b700 1 -- 172.21.15.92:0/2064089335 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a0011d20 con 0x7f34ac0af0f0 2023-08-26T09:26:44.205 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.196+0000 7f34b1090700 1 -- 172.21.15.92:0/2064089335 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34ac0af0f0 msgr2=0x7f34ac0ca6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:44.205 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.196+0000 7f34b1090700 1 --2- 172.21.15.92:0/2064089335 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34ac0af0f0 0x7f34ac0ca6c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f34a00098f0 tx=0x7f34a0009c00 comp rx=0 tx=0).stop 2023-08-26T09:26:44.206 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.196+0000 7f34b1090700 1 -- 172.21.15.92:0/2064089335 shutdown_connections 2023-08-26T09:26:44.206 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.196+0000 7f34b1090700 1 --2- 172.21.15.92:0/2064089335 >> v2:172.21.15.188:3300/0 conn(0x7f34ac0caff0 0x7f34ac0c3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:44.206 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.196+0000 7f34b1090700 1 --2- 172.21.15.92:0/2064089335 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34ac0af0f0 0x7f34ac0ca6c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:44.206 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.196+0000 7f34b1090700 1 -- 172.21.15.92:0/2064089335 >> 172.21.15.92:0/2064089335 conn(0x7f34ac0cec80 msgr2=0x7f34ac0cf090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:44.207 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.196+0000 7f34b1090700 1 -- 172.21.15.92:0/2064089335 shutdown_connections 2023-08-26T09:26:44.207 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.196+0000 7f34b1090700 1 -- 172.21.15.92:0/2064089335 wait complete. 2023-08-26T09:26:44.207 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.197+0000 7f34b1090700 1 Processor -- start 2023-08-26T09:26:44.207 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.197+0000 7f34b1090700 1 -- start start 2023-08-26T09:26:44.207 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.198+0000 7f34b1090700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34ac0af0f0 0x7f34ac148140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:44.208 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.198+0000 7f34b1090700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34ac0caff0 0x7f34ac14ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:44.208 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.198+0000 7f34b1090700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34ac1597c0 0x7f34ac153b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:44.208 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.198+0000 7f34b1090700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac154090 con 0x7f34ac1597c0 2023-08-26T09:26:44.208 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.198+0000 7f34b1090700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac0ae310 con 0x7f34ac0af0f0 2023-08-26T09:26:44.208 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.198+0000 7f34b1090700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac0add50 con 0x7f34ac0caff0 2023-08-26T09:26:44.208 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.198+0000 7f34ab59e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34ac1597c0 0x7f34ac153b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:44.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.198+0000 7f34ab59e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34ac1597c0 0x7f34ac153b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47190/0 (socket says 172.21.15.92:47190) 2023-08-26T09:26:44.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.198+0000 7f34ab59e700 1 -- 172.21.15.92:0/1534027064 learned_addr learned my addr 172.21.15.92:0/1534027064 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:44.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.198+0000 7f34aad9d700 1 --2- 172.21.15.92:0/1534027064 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34ac0af0f0 0x7f34ac148140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:44.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.198+0000 7f34aa59c700 1 --2- 172.21.15.92:0/1534027064 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34ac0caff0 0x7f34ac14ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:44.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.199+0000 7f34ab59e700 1 -- 172.21.15.92:0/1534027064 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34ac0caff0 msgr2=0x7f34ac14ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:44.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.199+0000 7f34ab59e700 1 --2- 172.21.15.92:0/1534027064 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34ac0caff0 0x7f34ac14ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:44.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.199+0000 7f34ab59e700 1 -- 172.21.15.92:0/1534027064 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34ac0af0f0 msgr2=0x7f34ac148140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:44.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.199+0000 7f34ab59e700 1 --2- 172.21.15.92:0/1534027064 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34ac0af0f0 0x7f34ac148140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:44.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.199+0000 7f34ab59e700 1 -- 172.21.15.92:0/1534027064 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a4009a70 con 0x7f34ac1597c0 2023-08-26T09:26:44.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.199+0000 7f34ab59e700 1 --2- 172.21.15.92:0/1534027064 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34ac1597c0 0x7f34ac153b50 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f34a400efc0 tx=0x7f34a400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:44.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.199+0000 7f34937fe700 1 -- 172.21.15.92:0/1534027064 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a400ca90 con 0x7f34ac1597c0 2023-08-26T09:26:44.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.199+0000 7f34937fe700 1 -- 172.21.15.92:0/1534027064 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a400f040 con 0x7f34ac1597c0 2023-08-26T09:26:44.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.199+0000 7f34b1090700 1 -- 172.21.15.92:0/1534027064 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34a0009550 con 0x7f34ac1597c0 2023-08-26T09:26:44.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.199+0000 7f34937fe700 1 -- 172.21.15.92:0/1534027064 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a400ce10 con 0x7f34ac1597c0 2023-08-26T09:26:44.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.199+0000 7f34b1090700 1 -- 172.21.15.92:0/1534027064 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34ac1490b0 con 0x7f34ac1597c0 2023-08-26T09:26:44.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.200+0000 7f34b1090700 1 -- 172.21.15.92:0/1534027064 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34ac1492d0 con 0x7f34ac1597c0 2023-08-26T09:26:44.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.200+0000 7f34937fe700 1 -- 172.21.15.92:0/1534027064 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f34a4014480 con 0x7f34ac1597c0 2023-08-26T09:26:44.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.201+0000 7f34937fe700 1 --2- 172.21.15.92:0/1534027064 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f349806a0e0 0x7f349806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:44.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.201+0000 7f34937fe700 1 -- 172.21.15.92:0/1534027064 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f34a4088b80 con 0x7f34ac1597c0 2023-08-26T09:26:44.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.201+0000 7f34aad9d700 1 --2- 172.21.15.92:0/1534027064 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f349806a0e0 0x7f349806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:44.213 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.201+0000 7f34aad9d700 1 --2- 172.21.15.92:0/1534027064 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f349806a0e0 0x7f349806c5a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f34a0009c40 tx=0x7f34a0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:44.213 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.205+0000 7f34937fe700 1 -- 172.21.15.92:0/1534027064 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f34a4057d90 con 0x7f34ac1597c0 2023-08-26T09:26:44.488 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.484+0000 7f34b1090700 1 -- 172.21.15.92:0/1534027064 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f34ac04e660 con 0x7f34ac1597c0 2023-08-26T09:26:44.488 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.485+0000 7f34937fe700 1 -- 172.21.15.92:0/1534027064 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1276 (secure 0 0 0) 0x7f34a4009d70 con 0x7f34ac1597c0 2023-08-26T09:26:44.489 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:26:44.489 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":1,"fsid":"254a2d31-bd41-4507-8326-1b205ac24377","modified":"2023-08-26T09:24:20.559113Z","created":"2023-08-26T09:24:20.559113Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:3300","nonce":0},{"type":"v1","addr":"172.21.15.92:6789","nonce":0}]},"addr":"172.21.15.92:6789/0","public_addr":"172.21.15.92:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:3300","nonce":0},{"type":"v1","addr":"172.21.15.188:6789","nonce":0}]},"addr":"172.21.15.188:6789/0","public_addr":"172.21.15.188:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:3301","nonce":0},{"type":"v1","addr":"172.21.15.188:6790","nonce":0}]},"addr":"172.21.15.188:6790/0","public_addr":"172.21.15.188:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-08-26T09:26:44.491 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.487+0000 7f34b1090700 1 -- 172.21.15.92:0/1534027064 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f349806a0e0 msgr2=0x7f349806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:44.491 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.487+0000 7f34b1090700 1 --2- 172.21.15.92:0/1534027064 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f349806a0e0 0x7f349806c5a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f34a0009c40 tx=0x7f34a0008030 comp rx=0 tx=0).stop 2023-08-26T09:26:44.491 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.487+0000 7f34b1090700 1 -- 172.21.15.92:0/1534027064 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34ac1597c0 msgr2=0x7f34ac153b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:44.491 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.487+0000 7f34b1090700 1 --2- 172.21.15.92:0/1534027064 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34ac1597c0 0x7f34ac153b50 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f34a400efc0 tx=0x7f34a400c3a0 comp rx=0 tx=0).stop 2023-08-26T09:26:44.492 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.487+0000 7f34b1090700 1 -- 172.21.15.92:0/1534027064 shutdown_connections 2023-08-26T09:26:44.492 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.487+0000 7f34b1090700 1 --2- 172.21.15.92:0/1534027064 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f349806a0e0 0x7f349806c5a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:44.492 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.487+0000 7f34b1090700 1 --2- 172.21.15.92:0/1534027064 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34ac0af0f0 0x7f34ac148140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:44.492 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.487+0000 7f34b1090700 1 --2- 172.21.15.92:0/1534027064 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34ac1597c0 0x7f34ac153b50 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:44.492 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.487+0000 7f34b1090700 1 --2- 172.21.15.92:0/1534027064 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34ac0caff0 0x7f34ac14ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:44.493 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.487+0000 7f34b1090700 1 -- 172.21.15.92:0/1534027064 >> 172.21.15.92:0/1534027064 conn(0x7f34ac0cec80 msgr2=0x7f34ac06cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:44.493 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.487+0000 7f34b1090700 1 -- 172.21.15.92:0/1534027064 shutdown_connections 2023-08-26T09:26:44.493 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.487+0000 7f34b1090700 1 -- 172.21.15.92:0/1534027064 wait complete. 2023-08-26T09:26:44.493 INFO:teuthology.orchestra.run.smithi092.stderr:dumped monmap epoch 1 2023-08-26T09:26:44.503 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.admin 2023-08-26T09:26:44.645 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.641+0000 7f518cb8d700 1 Processor -- start 2023-08-26T09:26:44.645 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.642+0000 7f518cb8d700 1 -- start start 2023-08-26T09:26:44.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.643+0000 7f518cb8d700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f5188161b40 0x7f51880d1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:44.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.643+0000 7f518cb8d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f51880ce830 0x7f51880b2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:44.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.643+0000 7f518cb8d700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51880cf130 con 0x7f5188160ef0 2023-08-26T09:26:44.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.643+0000 7f518cb8d700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51880d2180 con 0x7f51880ce830 2023-08-26T09:26:44.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.643+0000 7f518cb8d700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51880d0e80 con 0x7f5188161b40 2023-08-26T09:26:44.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.643+0000 7f5186d9d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f51880ce830 0x7f51880b2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:44.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.643+0000 7f5186d9d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f51880ce830 0x7f51880b2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47198/0 (socket says 172.21.15.92:47198) 2023-08-26T09:26:44.651 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.643+0000 7f5186d9d700 1 -- 172.21.15.92:0/1077503610 learned_addr learned my addr 172.21.15.92:0/1077503610 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:44.651 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.643+0000 7f5185d9b700 1 --2- 172.21.15.92:0/1077503610 >> v2:172.21.15.188:3300/0 conn(0x7f5188161b40 0x7f51880d1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:44.651 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.644+0000 7f5186d9d700 1 -- 172.21.15.92:0/1077503610 >> v2:172.21.15.188:3300/0 conn(0x7f5188161b40 msgr2=0x7f51880d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:44.651 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.644+0000 7f5186d9d700 1 --2- 172.21.15.92:0/1077503610 >> v2:172.21.15.188:3300/0 conn(0x7f5188161b40 0x7f51880d1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:44.652 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.644+0000 7f5186d9d700 1 -- 172.21.15.92:0/1077503610 >> v1:172.21.15.188:6789/0 conn(0x7f5188160ef0 legacy=0x7f51881612d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-26T09:26:44.652 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.644+0000 7f5186d9d700 1 -- 172.21.15.92:0/1077503610 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51880d1160 con 0x7f51880ce830 2023-08-26T09:26:44.652 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.644+0000 7f5185d9b700 1 --2- 172.21.15.92:0/1077503610 >> v2:172.21.15.188:3300/0 conn(0x7f5188161b40 0x7f51880d1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:26:44.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.644+0000 7f5186d9d700 1 --2- 172.21.15.92:0/1077503610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51880ce830 0x7f51880b2ae0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f51880b5d40 tx=0x7f518000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b5d961a2cde056b server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:44.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.644+0000 7f518559a700 1 -- 172.21.15.92:0/1077503610 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518000e070 con 0x7f51880ce830 2023-08-26T09:26:44.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.644+0000 7f518559a700 1 -- 172.21.15.92:0/1077503610 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5180003a20 con 0x7f51880ce830 2023-08-26T09:26:44.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.644+0000 7f518559a700 1 -- 172.21.15.92:0/1077503610 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5180003dd0 con 0x7f51880ce830 2023-08-26T09:26:44.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.644+0000 7f518cb8d700 1 -- 172.21.15.92:0/1077503610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51880ce830 msgr2=0x7f51880b2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:44.654 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.644+0000 7f518cb8d700 1 --2- 172.21.15.92:0/1077503610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51880ce830 0x7f51880b2ae0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f51880b5d40 tx=0x7f518000b330 comp rx=0 tx=0).stop 2023-08-26T09:26:44.654 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.644+0000 7f518cb8d700 1 -- 172.21.15.92:0/1077503610 shutdown_connections 2023-08-26T09:26:44.654 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.645+0000 7f518cb8d700 1 --2- 172.21.15.92:0/1077503610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51880ce830 0x7f51880b2ae0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:44.654 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.645+0000 7f518cb8d700 1 --2- 172.21.15.92:0/1077503610 >> v2:172.21.15.188:3300/0 conn(0x7f5188161b40 0x7f51880d1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:44.654 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.645+0000 7f518cb8d700 1 -- 172.21.15.92:0/1077503610 >> 172.21.15.92:0/1077503610 conn(0x7f51880d3180 msgr2=0x7f51880d3590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:44.655 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.645+0000 7f518cb8d700 1 -- 172.21.15.92:0/1077503610 shutdown_connections 2023-08-26T09:26:44.655 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.645+0000 7f518cb8d700 1 -- 172.21.15.92:0/1077503610 wait complete. 2023-08-26T09:26:44.661 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.646+0000 7f518cb8d700 1 Processor -- start 2023-08-26T09:26:44.661 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.646+0000 7f518cb8d700 1 -- start start 2023-08-26T09:26:44.662 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.647+0000 7f518cb8d700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f51880ce830 0x7f51880cca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:44.662 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.647+0000 7f518cb8d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5188160ef0 0x7f518806bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:44.663 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.647+0000 7f518cb8d700 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5188161b40 0x7f518806c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:44.663 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.647+0000 7f518cb8d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51880cbfe0 con 0x7f5188160ef0 2023-08-26T09:26:44.664 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.647+0000 7f518cb8d700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51881f37c0 con 0x7f51880ce830 2023-08-26T09:26:44.664 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.647+0000 7f518cb8d700 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51881f3200 con 0x7f5188161b40 2023-08-26T09:26:44.665 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.647+0000 7f5185d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5188160ef0 0x7f518806bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:44.665 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.647+0000 7f5185d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5188160ef0 0x7f518806bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47202/0 (socket says 172.21.15.92:47202) 2023-08-26T09:26:44.665 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.647+0000 7f5185d9b700 1 -- 172.21.15.92:0/4056920427 learned_addr learned my addr 172.21.15.92:0/4056920427 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-08-26T09:26:44.666 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.647+0000 7f518659c700 1 --2- 172.21.15.92:0/4056920427 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f51880ce830 0x7f51880cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:44.666 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.647+0000 7f5186d9d700 1 --2- 172.21.15.92:0/4056920427 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5188161b40 0x7f518806c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:44.667 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.647+0000 7f5185d9b700 1 -- 172.21.15.92:0/4056920427 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5188161b40 msgr2=0x7f518806c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:44.667 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.647+0000 7f5185d9b700 1 --2- 172.21.15.92:0/4056920427 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5188161b40 0x7f518806c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:44.667 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.647+0000 7f5185d9b700 1 -- 172.21.15.92:0/4056920427 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f51880ce830 msgr2=0x7f51880cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:44.668 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.647+0000 7f5185d9b700 1 --2- 172.21.15.92:0/4056920427 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f51880ce830 0x7f51880cca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:44.668 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.647+0000 7f5185d9b700 1 -- 172.21.15.92:0/4056920427 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5180009b30 con 0x7f5188160ef0 2023-08-26T09:26:44.668 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.647+0000 7f518659c700 1 --2- 172.21.15.92:0/4056920427 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f51880ce830 0x7f51880cca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:26:44.669 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.647+0000 7f5186d9d700 1 --2- 172.21.15.92:0/4056920427 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5188161b40 0x7f518806c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-26T09:26:44.669 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.647+0000 7f5185d9b700 1 --2- 172.21.15.92:0/4056920427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5188160ef0 0x7f518806bd20 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f517c00c7f0 tx=0x7f517c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:44.669 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.647+0000 7f5176ffd700 1 -- 172.21.15.92:0/4056920427 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517c011800 con 0x7f5188160ef0 2023-08-26T09:26:44.670 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.647+0000 7f5176ffd700 1 -- 172.21.15.92:0/4056920427 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f517c011960 con 0x7f5188160ef0 2023-08-26T09:26:44.670 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.647+0000 7f518cb8d700 1 -- 172.21.15.92:0/4056920427 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51881f34e0 con 0x7f5188160ef0 2023-08-26T09:26:44.670 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.648+0000 7f5176ffd700 1 -- 172.21.15.92:0/4056920427 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517c011d10 con 0x7f5188160ef0 2023-08-26T09:26:44.671 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.648+0000 7f518cb8d700 1 -- 172.21.15.92:0/4056920427 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51880cc4f0 con 0x7f5188160ef0 2023-08-26T09:26:44.671 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.649+0000 7f518cb8d700 1 -- 172.21.15.92:0/4056920427 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51880cc710 con 0x7f5188160ef0 2023-08-26T09:26:44.671 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.649+0000 7f5176ffd700 1 -- 172.21.15.92:0/4056920427 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f517c018360 con 0x7f5188160ef0 2023-08-26T09:26:44.672 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.649+0000 7f5176ffd700 1 --2- 172.21.15.92:0/4056920427 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f516806a0e0 0x7f516806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-26T09:26:44.672 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.649+0000 7f5176ffd700 1 -- 172.21.15.92:0/4056920427 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f517c088480 con 0x7f5188160ef0 2023-08-26T09:26:44.672 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.649+0000 7f518659c700 1 --2- 172.21.15.92:0/4056920427 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f516806a0e0 0x7f516806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-26T09:26:44.673 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.650+0000 7f518659c700 1 --2- 172.21.15.92:0/4056920427 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f516806a0e0 0x7f516806c5a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f518815df50 tx=0x7f5178008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-26T09:26:44.673 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.654+0000 7f5176ffd700 1 -- 172.21.15.92:0/4056920427 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f517c057690 con 0x7f5188160ef0 2023-08-26T09:26:44.930 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.927+0000 7f518cb8d700 1 -- 172.21.15.92:0/4056920427 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.admin"} v 0) v1 -- 0x7f518804e660 con 0x7f5188160ef0 2023-08-26T09:26:44.931 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.927+0000 7f5176ffd700 1 -- 172.21.15.92:0/4056920427 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.admin"}]=0 v13) v1 ==== 82+0+151 (secure 0 0 0) 0x7f517c057220 con 0x7f5188160ef0 2023-08-26T09:26:44.931 INFO:teuthology.orchestra.run.smithi092.stdout:[client.admin] 2023-08-26T09:26:44.931 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQDExOlk7O8eMRAAxQfnRB1TRuC+Si0mb263vg== 2023-08-26T09:26:44.932 INFO:teuthology.orchestra.run.smithi092.stdout: caps mds = "allow *" 2023-08-26T09:26:44.932 INFO:teuthology.orchestra.run.smithi092.stdout: caps mgr = "allow *" 2023-08-26T09:26:44.932 INFO:teuthology.orchestra.run.smithi092.stdout: caps mon = "allow *" 2023-08-26T09:26:44.932 INFO:teuthology.orchestra.run.smithi092.stdout: caps osd = "allow *" 2023-08-26T09:26:44.933 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.929+0000 7f518cb8d700 1 -- 172.21.15.92:0/4056920427 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f516806a0e0 msgr2=0x7f516806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:44.934 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.929+0000 7f518cb8d700 1 --2- 172.21.15.92:0/4056920427 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f516806a0e0 0x7f516806c5a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f518815df50 tx=0x7f5178008040 comp rx=0 tx=0).stop 2023-08-26T09:26:44.934 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.929+0000 7f518cb8d700 1 -- 172.21.15.92:0/4056920427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5188160ef0 msgr2=0x7f518806bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-26T09:26:44.934 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.929+0000 7f518cb8d700 1 --2- 172.21.15.92:0/4056920427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5188160ef0 0x7f518806bd20 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f517c00c7f0 tx=0x7f517c00cbb0 comp rx=0 tx=0).stop 2023-08-26T09:26:44.934 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.929+0000 7f518cb8d700 1 -- 172.21.15.92:0/4056920427 shutdown_connections 2023-08-26T09:26:44.935 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.929+0000 7f518cb8d700 1 --2- 172.21.15.92:0/4056920427 >> [v2:172.21.15.92:6832/1988454907,v1:172.21.15.92:6833/1988454907] conn(0x7f516806a0e0 0x7f516806c5a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:44.935 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.929+0000 7f518cb8d700 1 --2- 172.21.15.92:0/4056920427 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f51880ce830 0x7f51880cca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:44.936 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.929+0000 7f518cb8d700 1 --2- 172.21.15.92:0/4056920427 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5188161b40 0x7f518806c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:44.936 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.929+0000 7f518cb8d700 1 --2- 172.21.15.92:0/4056920427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5188160ef0 0x7f518806bd20 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-26T09:26:44.936 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.929+0000 7f518cb8d700 1 -- 172.21.15.92:0/4056920427 >> 172.21.15.92:0/4056920427 conn(0x7f51880d3180 msgr2=0x7f518815b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-26T09:26:44.936 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.929+0000 7f518cb8d700 1 -- 172.21.15.92:0/4056920427 shutdown_connections 2023-08-26T09:26:44.937 INFO:teuthology.orchestra.run.smithi092.stderr:2023-08-26T09:26:44.929+0000 7f518cb8d700 1 -- 172.21.15.92:0/4056920427 wait complete. 2023-08-26T09:26:44.948 DEBUG:teuthology.orchestra.run.smithi092:> mktemp 2023-08-26T09:26:44.965 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/tmp.YZcxtkG7Mp 2023-08-26T09:26:44.965 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-08-26T09:26:44.966 DEBUG:teuthology.orchestra.run.smithi092:> dd of=/tmp/tmp.YZcxtkG7Mp 2023-08-26T09:26:45.022 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-08-26T09:26:45.023 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/tmp/tmp.LDx1v48xscxfstests-dev/local.config 2023-08-26T09:26:45.099 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph-fuse export CEPH_FUSE_BIN_PATH=ceph-fuse export TEST_DEV=ceph-fuse # without this tests won't get started export TEST_DIR=/tmp/tmp.LAQAvgNZJytest export SCRATCH_DEV= export SCRATCH_MNT=/tmp/tmp.Nvn8DrEJ9vscratch export CEPHFS_MOUNT_OPTIONS="-m 172.21.15.92:6789 -k /tmp/tmp.YZcxtkG7Mp --client_mountpoint /test" 2023-08-26T09:26:45.100 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-08-26T09:26:45.100 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/tmp/tmp.LDx1v48xscxfstests-dev/ceph.exclude 2023-08-26T09:26:45.165 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo make) 2023-08-26T09:26:45.252 INFO:teuthology.orchestra.run.smithi092.stdout:libtoolize -cfi 2023-08-26T09:26:45.582 INFO:teuthology.orchestra.run.smithi092.stdout:libtoolize: putting auxiliary files in '.'. 2023-08-26T09:26:45.583 INFO:teuthology.orchestra.run.smithi092.stdout:libtoolize: copying file './config.guess' 2023-08-26T09:26:45.586 INFO:teuthology.orchestra.run.smithi092.stdout:libtoolize: copying file './config.sub' 2023-08-26T09:26:45.589 INFO:teuthology.orchestra.run.smithi092.stdout:libtoolize: copying file './install-sh' 2023-08-26T09:26:45.593 INFO:teuthology.orchestra.run.smithi092.stdout:libtoolize: copying file './ltmain.sh' 2023-08-26T09:26:45.613 INFO:teuthology.orchestra.run.smithi092.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-08-26T09:26:45.613 INFO:teuthology.orchestra.run.smithi092.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-08-26T09:26:45.617 INFO:teuthology.orchestra.run.smithi092.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-08-26T09:26:45.622 INFO:teuthology.orchestra.run.smithi092.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-08-26T09:26:45.626 INFO:teuthology.orchestra.run.smithi092.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-08-26T09:26:45.630 INFO:teuthology.orchestra.run.smithi092.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-08-26T09:26:45.636 INFO:teuthology.orchestra.run.smithi092.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-08-26T09:26:45.637 INFO:teuthology.orchestra.run.smithi092.stdout:cp include/install-sh . 2023-08-26T09:26:45.638 INFO:teuthology.orchestra.run.smithi092.stdout:aclocal -I m4 2023-08-26T09:26:46.795 INFO:teuthology.orchestra.run.smithi092.stdout:autoheader 2023-08-26T09:26:47.101 INFO:teuthology.orchestra.run.smithi092.stdout:autoconf 2023-08-26T09:26:47.260 INFO:teuthology.orchestra.run.smithi092.stdout:./configure \ 2023-08-26T09:26:47.260 INFO:teuthology.orchestra.run.smithi092.stdout: --libexecdir=/usr/lib \ 2023-08-26T09:26:47.260 INFO:teuthology.orchestra.run.smithi092.stdout: --exec_prefix=/var/lib 2023-08-26T09:26:47.701 INFO:teuthology.orchestra.run.smithi092.stdout:checking build system type... x86_64-pc-linux-gnu 2023-08-26T09:26:47.701 INFO:teuthology.orchestra.run.smithi092.stdout:checking host system type... x86_64-pc-linux-gnu 2023-08-26T09:26:47.702 INFO:teuthology.orchestra.run.smithi092.stdout:checking how to print strings... printf 2023-08-26T09:26:47.703 INFO:teuthology.orchestra.run.smithi092.stdout:checking for gcc... gcc 2023-08-26T09:26:47.831 INFO:teuthology.orchestra.run.smithi092.stdout:checking whether the C compiler works... yes 2023-08-26T09:26:47.832 INFO:teuthology.orchestra.run.smithi092.stdout:checking for C compiler default output file name... a.out 2023-08-26T09:26:47.858 INFO:teuthology.orchestra.run.smithi092.stdout:checking for suffix of executables... 2023-08-26T09:26:47.901 INFO:teuthology.orchestra.run.smithi092.stdout:checking whether we are cross compiling... no 2023-08-26T09:26:47.919 INFO:teuthology.orchestra.run.smithi092.stdout:checking for suffix of object files... o 2023-08-26T09:26:47.935 INFO:teuthology.orchestra.run.smithi092.stdout:checking whether we are using the GNU C compiler... yes 2023-08-26T09:26:47.951 INFO:teuthology.orchestra.run.smithi092.stdout:checking whether gcc accepts -g... yes 2023-08-26T09:26:47.977 INFO:teuthology.orchestra.run.smithi092.stdout:checking for gcc option to accept ISO C89... none needed 2023-08-26T09:26:47.980 INFO:teuthology.orchestra.run.smithi092.stdout:checking for a sed that does not truncate output... /bin/sed 2023-08-26T09:26:47.981 INFO:teuthology.orchestra.run.smithi092.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-08-26T09:26:47.983 INFO:teuthology.orchestra.run.smithi092.stdout:checking for egrep... /bin/grep -E 2023-08-26T09:26:47.984 INFO:teuthology.orchestra.run.smithi092.stdout:checking for fgrep... /bin/grep -F 2023-08-26T09:26:47.987 INFO:teuthology.orchestra.run.smithi092.stdout:checking for ld used by gcc... /bin/ld 2023-08-26T09:26:47.988 INFO:teuthology.orchestra.run.smithi092.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-08-26T09:26:48.000 INFO:teuthology.orchestra.run.smithi092.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-08-26T09:26:48.016 INFO:teuthology.orchestra.run.smithi092.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-08-26T09:26:48.016 INFO:teuthology.orchestra.run.smithi092.stdout:checking whether ln -s works... yes 2023-08-26T09:26:48.021 INFO:teuthology.orchestra.run.smithi092.stdout:checking the maximum length of command line arguments... 1572864 2023-08-26T09:26:48.024 INFO:teuthology.orchestra.run.smithi092.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-08-26T09:26:48.024 INFO:teuthology.orchestra.run.smithi092.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-08-26T09:26:48.024 INFO:teuthology.orchestra.run.smithi092.stdout:checking for /bin/ld option to reload object files... -r 2023-08-26T09:26:48.024 INFO:teuthology.orchestra.run.smithi092.stdout:checking for objdump... objdump 2023-08-26T09:26:48.025 INFO:teuthology.orchestra.run.smithi092.stdout:checking how to recognize dependent libraries... pass_all 2023-08-26T09:26:48.026 INFO:teuthology.orchestra.run.smithi092.stdout:checking for dlltool... no 2023-08-26T09:26:48.026 INFO:teuthology.orchestra.run.smithi092.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-08-26T09:26:48.026 INFO:teuthology.orchestra.run.smithi092.stdout:checking for ar... ar 2023-08-26T09:26:48.052 INFO:teuthology.orchestra.run.smithi092.stdout:checking for archiver @FILE support... @ 2023-08-26T09:26:48.053 INFO:teuthology.orchestra.run.smithi092.stdout:checking for strip... strip 2023-08-26T09:26:48.053 INFO:teuthology.orchestra.run.smithi092.stdout:checking for ranlib... ranlib 2023-08-26T09:26:48.054 INFO:teuthology.orchestra.run.smithi092.stdout:checking for gawk... gawk 2023-08-26T09:26:48.103 INFO:teuthology.orchestra.run.smithi092.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-08-26T09:26:48.104 INFO:teuthology.orchestra.run.smithi092.stdout:checking for sysroot... no 2023-08-26T09:26:48.106 INFO:teuthology.orchestra.run.smithi092.stdout:checking for a working dd... /bin/dd 2023-08-26T09:26:48.109 INFO:teuthology.orchestra.run.smithi092.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-08-26T09:26:48.121 INFO:teuthology.orchestra.run.smithi092.stdout:checking for mt... no 2023-08-26T09:26:48.123 INFO:teuthology.orchestra.run.smithi092.stdout:checking if : is a manifest tool... no 2023-08-26T09:26:48.169 INFO:teuthology.orchestra.run.smithi092.stdout:checking how to run the C preprocessor... gcc -E 2023-08-26T09:26:48.290 INFO:teuthology.orchestra.run.smithi092.stdout:checking for ANSI C header files... yes 2023-08-26T09:26:48.310 INFO:teuthology.orchestra.run.smithi092.stdout:checking for sys/types.h... yes 2023-08-26T09:26:48.333 INFO:teuthology.orchestra.run.smithi092.stdout:checking for sys/stat.h... yes 2023-08-26T09:26:48.355 INFO:teuthology.orchestra.run.smithi092.stdout:checking for stdlib.h... yes 2023-08-26T09:26:48.379 INFO:teuthology.orchestra.run.smithi092.stdout:checking for string.h... yes 2023-08-26T09:26:48.403 INFO:teuthology.orchestra.run.smithi092.stdout:checking for memory.h... yes 2023-08-26T09:26:48.426 INFO:teuthology.orchestra.run.smithi092.stdout:checking for strings.h... yes 2023-08-26T09:26:48.452 INFO:teuthology.orchestra.run.smithi092.stdout:checking for inttypes.h... yes 2023-08-26T09:26:48.476 INFO:teuthology.orchestra.run.smithi092.stdout:checking for stdint.h... yes 2023-08-26T09:26:48.504 INFO:teuthology.orchestra.run.smithi092.stdout:checking for unistd.h... yes 2023-08-26T09:26:48.529 INFO:teuthology.orchestra.run.smithi092.stdout:checking for dlfcn.h... yes 2023-08-26T09:26:48.532 INFO:teuthology.orchestra.run.smithi092.stdout:checking for objdir... .libs 2023-08-26T09:26:48.596 INFO:teuthology.orchestra.run.smithi092.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-08-26T09:26:48.596 INFO:teuthology.orchestra.run.smithi092.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-08-26T09:26:48.611 INFO:teuthology.orchestra.run.smithi092.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-08-26T09:26:48.630 INFO:teuthology.orchestra.run.smithi092.stdout:checking if gcc static flag -static works... no 2023-08-26T09:26:48.650 INFO:teuthology.orchestra.run.smithi092.stdout:checking if gcc supports -c -o file.o... yes 2023-08-26T09:26:48.650 INFO:teuthology.orchestra.run.smithi092.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-08-26T09:26:48.656 INFO:teuthology.orchestra.run.smithi092.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-08-26T09:26:48.680 INFO:teuthology.orchestra.run.smithi092.stdout:checking whether -lc should be explicitly linked in... no 2023-08-26T09:26:48.723 INFO:teuthology.orchestra.run.smithi092.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-08-26T09:26:48.723 INFO:teuthology.orchestra.run.smithi092.stdout:checking how to hardcode library paths into programs... immediate 2023-08-26T09:26:48.725 INFO:teuthology.orchestra.run.smithi092.stdout:checking whether stripping libraries is possible... yes 2023-08-26T09:26:48.725 INFO:teuthology.orchestra.run.smithi092.stdout:checking if libtool supports shared libraries... yes 2023-08-26T09:26:48.725 INFO:teuthology.orchestra.run.smithi092.stdout:checking whether to build shared libraries... yes 2023-08-26T09:26:48.726 INFO:teuthology.orchestra.run.smithi092.stdout:checking whether to build static libraries... yes 2023-08-26T09:26:48.730 INFO:teuthology.orchestra.run.smithi092.stdout:checking for gcc... (cached) gcc 2023-08-26T09:26:48.745 INFO:teuthology.orchestra.run.smithi092.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-08-26T09:26:48.745 INFO:teuthology.orchestra.run.smithi092.stdout:checking whether gcc accepts -g... (cached) yes 2023-08-26T09:26:48.746 INFO:teuthology.orchestra.run.smithi092.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-08-26T09:26:48.746 INFO:teuthology.orchestra.run.smithi092.stdout:checking for gmake... /usr/bin/gmake 2023-08-26T09:26:48.746 INFO:teuthology.orchestra.run.smithi092.stderr:./configure: line 12070: test: $(SHELL): binary operator expected 2023-08-26T09:26:48.747 INFO:teuthology.orchestra.run.smithi092.stdout:checking for tar... /bin/tar 2023-08-26T09:26:48.747 INFO:teuthology.orchestra.run.smithi092.stdout:checking for gzip... /bin/gzip 2023-08-26T09:26:48.753 INFO:teuthology.orchestra.run.smithi092.stdout:checking whether gcc -MM is supported... yes 2023-08-26T09:26:48.754 INFO:teuthology.orchestra.run.smithi092.stdout:checking for sort... /bin/sort 2023-08-26T09:26:48.755 INFO:teuthology.orchestra.run.smithi092.stdout:checking whether ln -s works... yes 2023-08-26T09:26:48.755 INFO:teuthology.orchestra.run.smithi092.stdout:checking for rpm... /bin/rpm 2023-08-26T09:26:48.758 INFO:teuthology.orchestra.run.smithi092.stdout:checking for rpmbuild... no 2023-08-26T09:26:48.782 INFO:teuthology.orchestra.run.smithi092.stdout:checking assert.h usability... yes 2023-08-26T09:26:48.789 INFO:teuthology.orchestra.run.smithi092.stdout:checking assert.h presence... yes 2023-08-26T09:26:48.789 INFO:teuthology.orchestra.run.smithi092.stdout:checking for assert.h... yes 2023-08-26T09:26:48.814 INFO:teuthology.orchestra.run.smithi092.stdout:checking bstring.h usability... no 2023-08-26T09:26:48.823 INFO:teuthology.orchestra.run.smithi092.stdout:checking bstring.h presence... no 2023-08-26T09:26:48.824 INFO:teuthology.orchestra.run.smithi092.stdout:checking for bstring.h... no 2023-08-26T09:26:48.847 INFO:teuthology.orchestra.run.smithi092.stdout:checking libgen.h usability... yes 2023-08-26T09:26:48.854 INFO:teuthology.orchestra.run.smithi092.stdout:checking libgen.h presence... yes 2023-08-26T09:26:48.854 INFO:teuthology.orchestra.run.smithi092.stdout:checking for libgen.h... yes 2023-08-26T09:26:48.880 INFO:teuthology.orchestra.run.smithi092.stdout:checking dirent.h usability... yes 2023-08-26T09:26:48.888 INFO:teuthology.orchestra.run.smithi092.stdout:checking dirent.h presence... yes 2023-08-26T09:26:48.888 INFO:teuthology.orchestra.run.smithi092.stdout:checking for dirent.h... yes 2023-08-26T09:26:48.946 INFO:teuthology.orchestra.run.smithi092.stdout:checking errno.h usability... yes 2023-08-26T09:26:48.953 INFO:teuthology.orchestra.run.smithi092.stdout:checking errno.h presence... yes 2023-08-26T09:26:48.953 INFO:teuthology.orchestra.run.smithi092.stdout:checking for errno.h... yes 2023-08-26T09:26:48.980 INFO:teuthology.orchestra.run.smithi092.stdout:checking malloc.h usability... yes 2023-08-26T09:26:48.988 INFO:teuthology.orchestra.run.smithi092.stdout:checking malloc.h presence... yes 2023-08-26T09:26:48.988 INFO:teuthology.orchestra.run.smithi092.stdout:checking for malloc.h... yes 2023-08-26T09:26:49.013 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:26:49.014 INFO:teuthology.orchestra.run.smithi092.stdout:checking uuid.h usability... no 2023-08-26T09:26:49.016 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:26:49.023 INFO:teuthology.orchestra.run.smithi092.stdout:checking uuid.h presence... no 2023-08-26T09:26:49.023 INFO:teuthology.orchestra.run.smithi092.stdout:checking for uuid.h... no 2023-08-26T09:26:49.075 INFO:teuthology.orchestra.run.smithi092.stdout:checking uuid/uuid.h usability... yes 2023-08-26T09:26:49.083 INFO:teuthology.orchestra.run.smithi092.stdout:checking uuid/uuid.h presence... yes 2023-08-26T09:26:49.083 INFO:teuthology.orchestra.run.smithi092.stdout:checking for uuid/uuid.h... yes 2023-08-26T09:26:49.109 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/uuid.h usability... no 2023-08-26T09:26:49.118 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/uuid.h presence... no 2023-08-26T09:26:49.118 INFO:teuthology.orchestra.run.smithi092.stdout:checking for sys/uuid.h... no 2023-08-26T09:26:49.148 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/file.h usability... yes 2023-08-26T09:26:49.155 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/file.h presence... yes 2023-08-26T09:26:49.155 INFO:teuthology.orchestra.run.smithi092.stdout:checking for sys/file.h... yes 2023-08-26T09:26:49.182 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/fcntl.h usability... yes 2023-08-26T09:26:49.189 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/fcntl.h presence... yes 2023-08-26T09:26:49.189 INFO:teuthology.orchestra.run.smithi092.stdout:checking for sys/fcntl.h... yes 2023-08-26T09:26:49.214 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/syssgi.h usability... no 2023-08-26T09:26:49.223 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/syssgi.h presence... no 2023-08-26T09:26:49.224 INFO:teuthology.orchestra.run.smithi092.stdout:checking for sys/syssgi.h... no 2023-08-26T09:26:49.265 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/param.h usability... yes 2023-08-26T09:26:49.274 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/param.h presence... yes 2023-08-26T09:26:49.275 INFO:teuthology.orchestra.run.smithi092.stdout:checking for sys/param.h... yes 2023-08-26T09:26:49.279 INFO:teuthology.orchestra.run.smithi092.stdout:checking for sys/stat.h... (cached) yes 2023-08-26T09:26:49.306 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/statvfs.h usability... yes 2023-08-26T09:26:49.312 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/statvfs.h presence... yes 2023-08-26T09:26:49.312 INFO:teuthology.orchestra.run.smithi092.stdout:checking for sys/statvfs.h... yes 2023-08-26T09:26:49.338 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/time.h usability... yes 2023-08-26T09:26:49.345 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/time.h presence... yes 2023-08-26T09:26:49.346 INFO:teuthology.orchestra.run.smithi092.stdout:checking for sys/time.h... yes 2023-08-26T09:26:49.375 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/ioctl.h usability... yes 2023-08-26T09:26:49.382 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/ioctl.h presence... yes 2023-08-26T09:26:49.382 INFO:teuthology.orchestra.run.smithi092.stdout:checking for sys/ioctl.h... yes 2023-08-26T09:26:49.410 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/wait.h usability... yes 2023-08-26T09:26:49.418 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/wait.h presence... yes 2023-08-26T09:26:49.418 INFO:teuthology.orchestra.run.smithi092.stdout:checking for sys/wait.h... yes 2023-08-26T09:26:49.423 INFO:teuthology.orchestra.run.smithi092.stdout:checking for sys/types.h... (cached) yes 2023-08-26T09:26:49.428 INFO:teuthology.orchestra.run.smithi092.stdout:checking for strings.h... (cached) yes 2023-08-26T09:26:49.455 INFO:teuthology.orchestra.run.smithi092.stdout:checking err.h usability... yes 2023-08-26T09:26:49.461 INFO:teuthology.orchestra.run.smithi092.stdout:checking err.h presence... yes 2023-08-26T09:26:49.461 INFO:teuthology.orchestra.run.smithi092.stdout:checking for err.h... yes 2023-08-26T09:26:49.488 INFO:teuthology.orchestra.run.smithi092.stdout:checking linux/falloc.h usability... yes 2023-08-26T09:26:49.494 INFO:teuthology.orchestra.run.smithi092.stdout:checking linux/falloc.h presence... yes 2023-08-26T09:26:49.494 INFO:teuthology.orchestra.run.smithi092.stdout:checking for linux/falloc.h... yes 2023-08-26T09:26:49.520 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-08-26T09:26:49.528 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-08-26T09:26:49.528 INFO:teuthology.orchestra.run.smithi092.stdout:checking for sys/fs/xfs_fsops.h... no 2023-08-26T09:26:49.551 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/fs/xfs_itable.h usability... no 2023-08-26T09:26:49.560 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/fs/xfs_itable.h presence... no 2023-08-26T09:26:49.561 INFO:teuthology.orchestra.run.smithi092.stdout:checking for sys/fs/xfs_itable.h... no 2023-08-26T09:26:49.583 INFO:teuthology.orchestra.run.smithi092.stdout:checking xfs/platform_defs.h usability... no 2023-08-26T09:26:49.592 INFO:teuthology.orchestra.run.smithi092.stdout:checking xfs/platform_defs.h presence... no 2023-08-26T09:26:49.592 INFO:teuthology.orchestra.run.smithi092.stdout:checking for xfs/platform_defs.h... no 2023-08-26T09:26:49.628 INFO:teuthology.orchestra.run.smithi092.stdout:checking btrfs/ioctl.h usability... no 2023-08-26T09:26:49.643 INFO:teuthology.orchestra.run.smithi092.stdout:checking btrfs/ioctl.h presence... no 2023-08-26T09:26:49.643 INFO:teuthology.orchestra.run.smithi092.stdout:checking for btrfs/ioctl.h... no 2023-08-26T09:26:49.694 INFO:teuthology.orchestra.run.smithi092.stdout:checking cifs/ioctl.h usability... no 2023-08-26T09:26:49.717 INFO:teuthology.orchestra.run.smithi092.stdout:checking cifs/ioctl.h presence... no 2023-08-26T09:26:49.717 INFO:teuthology.orchestra.run.smithi092.stdout:checking for cifs/ioctl.h... no 2023-08-26T09:26:49.741 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/mman.h usability... yes 2023-08-26T09:26:49.748 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/mman.h presence... yes 2023-08-26T09:26:49.749 INFO:teuthology.orchestra.run.smithi092.stdout:checking for sys/mman.h... yes 2023-08-26T09:26:49.765 INFO:teuthology.orchestra.run.smithi092.stdout:checking for xfs/xfs_log_format.h... no 2023-08-26T09:26:49.798 INFO:teuthology.orchestra.run.smithi092.stdout:checking for uuid_compare... no 2023-08-26T09:26:49.828 INFO:teuthology.orchestra.run.smithi092.stdout:checking for uuid_compare in -luuid... yes 2023-08-26T09:26:49.883 INFO:teuthology.orchestra.run.smithi092.stdout:checking for xfs/xfs.h... yes 2023-08-26T09:26:49.896 INFO:teuthology.orchestra.run.smithi092.stdout:checking for xfs/libxfs.h... no 2023-08-26T09:26:49.913 INFO:teuthology.orchestra.run.smithi092.stdout:checking whether xlog_assign_lsn is declared... no 2023-08-26T09:26:49.939 INFO:teuthology.orchestra.run.smithi092.stdout:checking for xfs/xqm.h... yes 2023-08-26T09:26:49.983 INFO:teuthology.orchestra.run.smithi092.stdout:checking xfsctl from xfs/xfs.h... ok 2023-08-26T09:26:50.005 INFO:teuthology.orchestra.run.smithi092.stdout:checking xfs/handle.h usability... yes 2023-08-26T09:26:50.011 INFO:teuthology.orchestra.run.smithi092.stdout:checking xfs/handle.h presence... yes 2023-08-26T09:26:50.011 INFO:teuthology.orchestra.run.smithi092.stdout:checking for xfs/handle.h... yes 2023-08-26T09:26:50.055 INFO:teuthology.orchestra.run.smithi092.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-08-26T09:26:50.088 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/acl.h usability... yes 2023-08-26T09:26:50.096 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/acl.h presence... yes 2023-08-26T09:26:50.096 INFO:teuthology.orchestra.run.smithi092.stdout:checking for sys/acl.h... yes 2023-08-26T09:26:50.138 INFO:teuthology.orchestra.run.smithi092.stdout:checking acl/libacl.h usability... yes 2023-08-26T09:26:50.146 INFO:teuthology.orchestra.run.smithi092.stdout:checking acl/libacl.h presence... yes 2023-08-26T09:26:50.147 INFO:teuthology.orchestra.run.smithi092.stdout:checking for acl/libacl.h... yes 2023-08-26T09:26:50.177 INFO:teuthology.orchestra.run.smithi092.stdout:checking for acl_init in -lacl... yes 2023-08-26T09:26:50.199 INFO:teuthology.orchestra.run.smithi092.stdout:checking gdbm-ndbm.h usability... no 2023-08-26T09:26:50.208 INFO:teuthology.orchestra.run.smithi092.stdout:checking gdbm-ndbm.h presence... no 2023-08-26T09:26:50.208 INFO:teuthology.orchestra.run.smithi092.stdout:checking for gdbm-ndbm.h... no 2023-08-26T09:26:50.229 INFO:teuthology.orchestra.run.smithi092.stdout:checking gdbm/ndbm.h usability... no 2023-08-26T09:26:50.237 INFO:teuthology.orchestra.run.smithi092.stdout:checking gdbm/ndbm.h presence... no 2023-08-26T09:26:50.238 INFO:teuthology.orchestra.run.smithi092.stdout:checking for gdbm/ndbm.h... no 2023-08-26T09:26:50.258 INFO:teuthology.orchestra.run.smithi092.stdout:checking ndbm.h usability... no 2023-08-26T09:26:50.267 INFO:teuthology.orchestra.run.smithi092.stdout:checking ndbm.h presence... no 2023-08-26T09:26:50.268 INFO:teuthology.orchestra.run.smithi092.stdout:checking for ndbm.h... no 2023-08-26T09:26:50.292 INFO:teuthology.orchestra.run.smithi092.stdout:checking libaio.h usability... yes 2023-08-26T09:26:50.302 INFO:teuthology.orchestra.run.smithi092.stdout:checking libaio.h presence... yes 2023-08-26T09:26:50.302 INFO:teuthology.orchestra.run.smithi092.stdout:checking for libaio.h... yes 2023-08-26T09:26:50.323 INFO:teuthology.orchestra.run.smithi092.stdout:checking liburing.h usability... no 2023-08-26T09:26:50.333 INFO:teuthology.orchestra.run.smithi092.stdout:checking liburing.h presence... no 2023-08-26T09:26:50.333 INFO:teuthology.orchestra.run.smithi092.stdout:checking for liburing.h... no 2023-08-26T09:26:50.354 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/capability.h usability... no 2023-08-26T09:26:50.363 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/capability.h presence... no 2023-08-26T09:26:50.363 INFO:teuthology.orchestra.run.smithi092.stdout:checking for sys/capability.h... no 2023-08-26T09:26:50.392 INFO:teuthology.orchestra.run.smithi092.stdout:checking linux/fiemap.h usability... yes 2023-08-26T09:26:50.398 INFO:teuthology.orchestra.run.smithi092.stdout:checking linux/fiemap.h presence... yes 2023-08-26T09:26:50.398 INFO:teuthology.orchestra.run.smithi092.stdout:checking for linux/fiemap.h... yes 2023-08-26T09:26:50.430 INFO:teuthology.orchestra.run.smithi092.stdout:checking for fallocate... yes 2023-08-26T09:26:50.462 INFO:teuthology.orchestra.run.smithi092.stdout:checking for open_by_handle_at... yes 2023-08-26T09:26:50.485 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/prctl.h usability... yes 2023-08-26T09:26:50.492 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/prctl.h presence... yes 2023-08-26T09:26:50.493 INFO:teuthology.orchestra.run.smithi092.stdout:checking for sys/prctl.h... yes 2023-08-26T09:26:50.515 INFO:teuthology.orchestra.run.smithi092.stdout:checking linux/fs.h usability... yes 2023-08-26T09:26:50.522 INFO:teuthology.orchestra.run.smithi092.stdout:checking linux/fs.h presence... yes 2023-08-26T09:26:50.523 INFO:teuthology.orchestra.run.smithi092.stdout:checking for linux/fs.h... yes 2023-08-26T09:26:50.543 INFO:teuthology.orchestra.run.smithi092.stdout:checking btrfsutil.h usability... no 2023-08-26T09:26:50.553 INFO:teuthology.orchestra.run.smithi092.stdout:checking btrfsutil.h presence... no 2023-08-26T09:26:50.553 INFO:teuthology.orchestra.run.smithi092.stdout:checking for btrfsutil.h... no 2023-08-26T09:26:50.586 INFO:teuthology.orchestra.run.smithi092.stdout:checking for copy_file_range... yes 2023-08-26T09:26:50.620 INFO:teuthology.orchestra.run.smithi092.stdout:checking for SEEK_DATA... yes 2023-08-26T09:26:50.663 INFO:teuthology.orchestra.run.smithi092.stdout:checking for BMV_OF_SHARED... yes 2023-08-26T09:26:50.700 INFO:teuthology.orchestra.run.smithi092.stdout:checking for nftw... yes 2023-08-26T09:26:50.733 INFO:teuthology.orchestra.run.smithi092.stdout:checking for RLIMIT_NOFILE... yes 2023-08-26T09:26:50.749 INFO:teuthology.orchestra.run.smithi092.stdout:checking for FIEXCHANGE_RANGE... no 2023-08-26T09:26:50.781 INFO:teuthology.orchestra.run.smithi092.stdout:checking for renameat2... yes 2023-08-26T09:26:50.812 INFO:teuthology.orchestra.run.smithi092.stdout:checking for reallocarray... yes 2023-08-26T09:26:50.826 INFO:teuthology.orchestra.run.smithi092.stdout:checking for struct mount_attr... no 2023-08-26T09:26:50.873 INFO:teuthology.orchestra.run.smithi092.stdout:checking for struct btrfs_qgroup_limit... yes 2023-08-26T09:26:50.906 INFO:teuthology.orchestra.run.smithi092.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-08-26T09:26:50.939 INFO:teuthology.orchestra.run.smithi092.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-08-26T09:26:50.972 INFO:teuthology.orchestra.run.smithi092.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-08-26T09:26:51.004 INFO:teuthology.orchestra.run.smithi092.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-08-26T09:26:51.038 INFO:teuthology.orchestra.run.smithi092.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-08-26T09:26:51.071 INFO:teuthology.orchestra.run.smithi092.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-08-26T09:26:51.097 INFO:teuthology.orchestra.run.smithi092.stdout:checking linux/btrfs.h usability... yes 2023-08-26T09:26:51.103 INFO:teuthology.orchestra.run.smithi092.stdout:checking linux/btrfs.h presence... yes 2023-08-26T09:26:51.104 INFO:teuthology.orchestra.run.smithi092.stdout:checking for linux/btrfs.h... yes 2023-08-26T09:26:51.132 INFO:teuthology.orchestra.run.smithi092.stdout:checking linux/btrfs_tree.h usability... yes 2023-08-26T09:26:51.139 INFO:teuthology.orchestra.run.smithi092.stdout:checking linux/btrfs_tree.h presence... yes 2023-08-26T09:26:51.139 INFO:teuthology.orchestra.run.smithi092.stdout:checking for linux/btrfs_tree.h... yes 2023-08-26T09:26:51.169 INFO:teuthology.orchestra.run.smithi092.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... no 2023-08-26T09:26:51.184 INFO:teuthology.orchestra.run.smithi092.stdout:configure: creating ./config.status 2023-08-26T09:26:51.478 INFO:teuthology.orchestra.run.smithi092.stdout:config.status: creating include/builddefs 2023-08-26T09:26:51.488 INFO:teuthology.orchestra.run.smithi092.stdout:config.status: creating include/config.h 2023-08-26T09:26:51.495 INFO:teuthology.orchestra.run.smithi092.stdout:config.status: executing libtool commands 2023-08-26T09:26:51.532 INFO:teuthology.orchestra.run.smithi092.stdout:Building include 2023-08-26T09:26:51.535 INFO:teuthology.orchestra.run.smithi092.stdout:Building lib 2023-08-26T09:26:51.538 INFO:teuthology.orchestra.run.smithi092.stdout: [LTDEP] 2023-08-26T09:26:51.637 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] dataascii.lo 2023-08-26T09:26:51.749 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] databin.lo 2023-08-26T09:26:51.884 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] datapid.lo 2023-08-26T09:26:51.981 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] file_lock.lo 2023-08-26T09:26:52.117 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] forker.lo 2023-08-26T09:26:52.240 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] pattern.lo 2023-08-26T09:26:52.354 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] open_flags.lo 2023-08-26T09:26:52.486 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] random_range.lo 2023-08-26T09:26:52.691 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] string_to_tokens.lo 2023-08-26T09:26:52.788 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] str_to_bytes.lo 2023-08-26T09:26:52.906 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] tlibio.lo 2023-08-26T09:26:53.116 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] write_log.lo 2023-08-26T09:26:53.334 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] random.lo 2023-08-26T09:26:53.446 INFO:teuthology.orchestra.run.smithi092.stdout: [LD] 2023-08-26T09:26:53.519 INFO:teuthology.orchestra.run.smithi092.stdout:Building ltp 2023-08-26T09:26:53.522 INFO:teuthology.orchestra.run.smithi092.stdout: [DEP] 2023-08-26T09:26:53.628 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] doio 2023-08-26T09:26:54.218 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] fsstress 2023-08-26T09:26:55.398 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] fsx 2023-08-26T09:26:56.174 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] growfiles 2023-08-26T09:26:56.630 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] iogen 2023-08-26T09:26:56.947 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] aio-stress 2023-08-26T09:26:57.323 INFO:teuthology.orchestra.run.smithi092.stdout:Building src 2023-08-26T09:26:57.328 INFO:teuthology.orchestra.run.smithi092.stdout: [DEP] 2023-08-26T09:26:58.622 INFO:teuthology.orchestra.run.smithi092.stdout: [DEP] 2023-08-26T09:26:58.646 INFO:teuthology.orchestra.run.smithi092.stdout: [DEP] 2023-08-26T09:26:58.654 INFO:teuthology.orchestra.run.smithi092.stdout: [DEP] 2023-08-26T09:26:58.830 INFO:teuthology.orchestra.run.smithi092.stdout: [DEP] 2023-08-26T09:26:58.851 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] dirstress 2023-08-26T09:26:59.080 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] fill 2023-08-26T09:26:59.219 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] fill2 2023-08-26T09:26:59.423 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] getpagesize 2023-08-26T09:26:59.546 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] holes 2023-08-26T09:26:59.720 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] lstat64 2023-08-26T09:26:59.886 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] nametest 2023-08-26T09:27:00.099 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] permname 2023-08-26T09:27:00.279 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] randholes 2023-08-26T09:27:00.503 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] runas 2023-08-26T09:27:00.660 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] truncfile 2023-08-26T09:27:00.821 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] usemem 2023-08-26T09:27:00.957 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] mmapcat 2023-08-26T09:27:01.094 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] append_reader 2023-08-26T09:27:01.231 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] append_writer 2023-08-26T09:27:01.369 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] dirperf 2023-08-26T09:27:01.566 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] metaperf 2023-08-26T09:27:01.793 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] devzero 2023-08-26T09:27:01.950 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] feature 2023-08-26T09:27:02.143 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] alloc 2023-08-26T09:27:02.333 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] fault 2023-08-26T09:27:02.481 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] fstest 2023-08-26T09:27:02.693 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_access_root 2023-08-26T09:27:02.833 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] godown 2023-08-26T09:27:02.985 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] resvtest 2023-08-26T09:27:03.153 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] writemod 2023-08-26T09:27:03.287 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] writev_on_pagefault 2023-08-26T09:27:03.432 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] makeextents 2023-08-26T09:27:03.593 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] itrash 2023-08-26T09:27:03.735 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] rename 2023-08-26T09:27:03.862 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] multi_open_unlink 2023-08-26T09:27:04.012 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] unwritten_sync 2023-08-26T09:27:04.174 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] genhashnames 2023-08-26T09:27:04.343 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_holes 2023-08-26T09:27:04.478 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_mmap_writev 2023-08-26T09:27:04.613 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_truncate_cmtime 2023-08-26T09:27:04.758 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] dirhash_collide 2023-08-26T09:27:04.921 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_rename_overwrite 2023-08-26T09:27:05.051 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] holetest 2023-08-26T09:27:05.247 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_truncate_self 2023-08-26T09:27:05.376 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] af_unix 2023-08-26T09:27:05.516 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_mmap_stale_pmd 2023-08-26T09:27:05.655 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_mmap_cow_race 2023-08-26T09:27:05.805 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_mmap_fallocate 2023-08-26T09:27:05.943 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] fsync-err 2023-08-26T09:27:06.111 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_mmap_write_ro 2023-08-26T09:27:06.249 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_ext4_dax_journal_corruption 2023-08-26T09:27:06.393 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_ext4_dax_inline_corruption 2023-08-26T09:27:06.535 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_ofd_locks 2023-08-26T09:27:06.716 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_mmap_collision 2023-08-26T09:27:06.894 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] mmap-write-concurrent 2023-08-26T09:27:07.048 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_get_file_time 2023-08-26T09:27:07.182 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_create_short_dirs 2023-08-26T09:27:07.333 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_create_long_dirs 2023-08-26T09:27:07.482 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_enospc 2023-08-26T09:27:07.650 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_mmap_writev_overlap 2023-08-26T09:27:07.802 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] checkpoint_journal 2023-08-26T09:27:07.943 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] mmap-rw-fault 2023-08-26T09:27:08.110 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] allocstale 2023-08-26T09:27:08.262 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_mmap_cow_memory_failure 2023-08-26T09:27:08.417 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] fake-dump-rootino 2023-08-26T09:27:08.553 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] dio-buf-fault 2023-08-26T09:27:08.693 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] xfsctl 2023-08-26T09:27:08.862 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] bstat 2023-08-26T09:27:09.045 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_mtab 2023-08-26T09:27:09.213 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] getdevicesize 2023-08-26T09:27:09.342 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] preallo_rw_pattern_reader 2023-08-26T09:27:09.488 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] preallo_rw_pattern_writer 2023-08-26T09:27:09.632 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] ftrunc 2023-08-26T09:27:09.768 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] trunc 2023-08-26T09:27:09.915 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] fs_perms 2023-08-26T09:27:10.064 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] testx 2023-08-26T09:27:10.186 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] looptest 2023-08-26T09:27:10.361 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] locktest 2023-08-26T09:27:10.635 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] unwritten_mmap 2023-08-26T09:27:10.783 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] bulkstat_unlink_test 2023-08-26T09:27:10.964 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] deduperace 2023-08-26T09:27:11.140 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] bulkstat_unlink_test_modified 2023-08-26T09:27:11.317 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_dir_offset 2023-08-26T09:27:11.452 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_futimens 2023-08-26T09:27:11.582 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_immutable 2023-08-26T09:27:12.122 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] stale_handle 2023-08-26T09:27:12.276 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] pwrite_mmap_blocked 2023-08-26T09:27:12.415 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_dir_offset2 2023-08-26T09:27:12.589 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] seek_sanity_test 2023-08-26T09:27:12.961 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] seek_copy_test 2023-08-26T09:27:13.121 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_readdir_1 2023-08-26T09:27:13.256 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_readdir_2 2023-08-26T09:27:13.394 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] fsync-tester 2023-08-26T09:27:13.618 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] nsexec 2023-08-26T09:27:13.779 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] cloner 2023-08-26T09:27:13.940 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] renameat2 2023-08-26T09:27:14.093 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_getcwd 2023-08-26T09:27:14.238 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] e4compact 2023-08-26T09:27:14.419 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] test-nextquota 2023-08-26T09:27:14.573 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] punch-alternating 2023-08-26T09:27:14.728 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] attr-list-by-handle-cursor-test 2023-08-26T09:27:14.880 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] listxattr 2023-08-26T09:27:15.015 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] dio-interleaved 2023-08-26T09:27:15.162 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_dir_type 2023-08-26T09:27:15.305 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] dio-invalidate-cache 2023-08-26T09:27:15.488 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] stat_test 2023-08-26T09:27:15.820 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_encrypted_d_revalidate 2023-08-26T09:27:16.060 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] attr_replace_test 2023-08-26T09:27:16.208 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] swapon 2023-08-26T09:27:16.359 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] mkswap 2023-08-26T09:27:16.499 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_attr_corruption 2023-08-26T09:27:16.636 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_open_tmpfiles 2023-08-26T09:27:16.797 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] fscrypt-crypt-util 2023-08-26T09:27:17.368 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] bulkstat_null_ocount 2023-08-26T09:27:17.512 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] splice-test 2023-08-26T09:27:17.676 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] chprojid_fail 2023-08-26T09:27:17.823 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] detached_mounts_propagation 2023-08-26T09:27:17.990 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] ext4_resize 2023-08-26T09:27:18.126 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_readdir_3 2023-08-26T09:27:18.303 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] splice2pipe 2023-08-26T09:27:18.451 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] uuid_ioctl 2023-08-26T09:27:18.592 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] fiemap-tester 2023-08-26T09:27:18.831 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_stripealign 2023-08-26T09:27:18.971 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] open_by_handle 2023-08-26T09:27:19.071 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:27:19.073 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:27:19.206 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_mmap_dio 2023-08-26T09:27:19.354 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] xfsfind 2023-08-26T09:27:19.528 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] fssum 2023-08-26T09:27:19.916 INFO:teuthology.orchestra.run.smithi092.stdout:Building log-writes 2023-08-26T09:27:19.920 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] replay-log 2023-08-26T09:27:20.198 INFO:teuthology.orchestra.run.smithi092.stdout:Building perf 2023-08-26T09:27:20.202 INFO:teuthology.orchestra.run.smithi092.stdout:Building aio-dio-regress 2023-08-26T09:27:20.208 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] aio-dio-append-write-fallocate-race 2023-08-26T09:27:20.366 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] aio-dio-fcntl-race 2023-08-26T09:27:20.515 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] aio-dio-subblock-eof-read 2023-08-26T09:27:20.650 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] aio-dio-append-write-read-race 2023-08-26T09:27:20.811 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] aio-dio-invalidate-readahead 2023-08-26T09:27:20.962 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] aio-dio-write-verify 2023-08-26T09:27:21.139 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-08-26T09:27:21.266 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] aio-last-ref-held-by-io 2023-08-26T09:27:21.427 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] aio-dio-cycle-write 2023-08-26T09:27:21.596 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] aio-dio-extend-stat 2023-08-26T09:27:21.749 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-08-26T09:27:21.875 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] aio-dio-hole-filling-race 2023-08-26T09:27:22.014 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] aio-dio-invalidate-failure 2023-08-26T09:27:22.163 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] aiodio_sparse2 2023-08-26T09:27:22.361 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] aiocp 2023-08-26T09:27:22.564 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] aio-dio-cow-race 2023-08-26T09:27:22.707 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] aio-dio-eof-race 2023-08-26T09:27:22.875 INFO:teuthology.orchestra.run.smithi092.stdout:Building vfs 2023-08-26T09:27:22.880 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] vfstest 2023-08-26T09:27:24.556 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] mount-idmapped 2023-08-26T09:27:24.888 INFO:teuthology.orchestra.run.smithi092.stdout:Building m4 2023-08-26T09:27:24.891 INFO:teuthology.orchestra.run.smithi092.stdout:Building common 2023-08-26T09:27:24.895 INFO:teuthology.orchestra.run.smithi092.stdout:Building tests 2023-08-26T09:27:24.900 INFO:teuthology.orchestra.run.smithi092.stdout:Building perf 2023-08-26T09:27:24.905 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.LDx1v48xscxfstests-dev/tests/perf/group.list 2023-08-26T09:27:24.915 INFO:teuthology.orchestra.run.smithi092.stdout:Building ext4 2023-08-26T09:27:24.920 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.LDx1v48xscxfstests-dev/tests/ext4/group.list 2023-08-26T09:27:24.954 INFO:teuthology.orchestra.run.smithi092.stdout:Building ocfs2 2023-08-26T09:27:24.958 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.LDx1v48xscxfstests-dev/tests/ocfs2/group.list 2023-08-26T09:27:24.970 INFO:teuthology.orchestra.run.smithi092.stdout:Building overlay 2023-08-26T09:27:24.975 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.LDx1v48xscxfstests-dev/tests/overlay/group.list 2023-08-26T09:27:25.010 INFO:teuthology.orchestra.run.smithi092.stdout:Building cifs 2023-08-26T09:27:25.014 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.LDx1v48xscxfstests-dev/tests/cifs/group.list 2023-08-26T09:27:25.025 INFO:teuthology.orchestra.run.smithi092.stdout:Building generic 2023-08-26T09:27:25.032 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.LDx1v48xscxfstests-dev/tests/generic/group.list 2023-08-26T09:27:25.119 INFO:teuthology.orchestra.run.smithi092.stdout:Building shared 2023-08-26T09:27:25.124 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.LDx1v48xscxfstests-dev/tests/shared/group.list 2023-08-26T09:27:25.139 INFO:teuthology.orchestra.run.smithi092.stdout:Building nfs 2023-08-26T09:27:25.144 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.LDx1v48xscxfstests-dev/tests/nfs/group.list 2023-08-26T09:27:25.156 INFO:teuthology.orchestra.run.smithi092.stdout:Building f2fs 2023-08-26T09:27:25.161 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.LDx1v48xscxfstests-dev/tests/f2fs/group.list 2023-08-26T09:27:25.176 INFO:teuthology.orchestra.run.smithi092.stdout:Building udf 2023-08-26T09:27:25.181 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.LDx1v48xscxfstests-dev/tests/udf/group.list 2023-08-26T09:27:25.191 INFO:teuthology.orchestra.run.smithi092.stdout:Building ceph 2023-08-26T09:27:25.196 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.LDx1v48xscxfstests-dev/tests/ceph/group.list 2023-08-26T09:27:25.209 INFO:teuthology.orchestra.run.smithi092.stdout:Building xfs 2023-08-26T09:27:25.215 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.LDx1v48xscxfstests-dev/tests/xfs/group.list 2023-08-26T09:27:25.304 INFO:teuthology.orchestra.run.smithi092.stdout:Building btrfs 2023-08-26T09:27:25.310 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.LDx1v48xscxfstests-dev/tests/btrfs/group.list 2023-08-26T09:27:25.363 INFO:teuthology.orchestra.run.smithi092.stdout:Building tmpfs 2023-08-26T09:27:25.368 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.LDx1v48xscxfstests-dev/tests/tmpfs/group.list 2023-08-26T09:27:25.380 INFO:teuthology.orchestra.run.smithi092.stdout:Building selftest 2023-08-26T09:27:25.384 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.LDx1v48xscxfstests-dev/tests/selftest/group.list 2023-08-26T09:27:25.397 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo make install) 2023-08-26T09:27:25.435 INFO:teuthology.orchestra.run.smithi092.stdout:Building include 2023-08-26T09:27:25.438 INFO:teuthology.orchestra.run.smithi092.stdout:Building lib 2023-08-26T09:27:25.442 INFO:teuthology.orchestra.run.smithi092.stdout:Building ltp 2023-08-26T09:27:25.446 INFO:teuthology.orchestra.run.smithi092.stdout:Building src 2023-08-26T09:27:25.478 INFO:teuthology.orchestra.run.smithi092.stdout:Building log-writes 2023-08-26T09:27:25.481 INFO:teuthology.orchestra.run.smithi092.stdout:Building perf 2023-08-26T09:27:25.484 INFO:teuthology.orchestra.run.smithi092.stdout:Building aio-dio-regress 2023-08-26T09:27:25.488 INFO:teuthology.orchestra.run.smithi092.stdout:Building vfs 2023-08-26T09:27:25.492 INFO:teuthology.orchestra.run.smithi092.stdout:Building m4 2023-08-26T09:27:25.495 INFO:teuthology.orchestra.run.smithi092.stdout:Building common 2023-08-26T09:27:25.498 INFO:teuthology.orchestra.run.smithi092.stdout:Building tests 2023-08-26T09:27:25.504 INFO:teuthology.orchestra.run.smithi092.stdout:Building perf 2023-08-26T09:27:25.508 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.LDx1v48xscxfstests-dev/tests/perf/group.list 2023-08-26T09:27:25.518 INFO:teuthology.orchestra.run.smithi092.stdout:Building ext4 2023-08-26T09:27:25.523 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.LDx1v48xscxfstests-dev/tests/ext4/group.list 2023-08-26T09:27:25.557 INFO:teuthology.orchestra.run.smithi092.stdout:Building ocfs2 2023-08-26T09:27:25.561 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.LDx1v48xscxfstests-dev/tests/ocfs2/group.list 2023-08-26T09:27:25.573 INFO:teuthology.orchestra.run.smithi092.stdout:Building overlay 2023-08-26T09:27:25.578 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.LDx1v48xscxfstests-dev/tests/overlay/group.list 2023-08-26T09:27:25.614 INFO:teuthology.orchestra.run.smithi092.stdout:Building cifs 2023-08-26T09:27:25.618 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.LDx1v48xscxfstests-dev/tests/cifs/group.list 2023-08-26T09:27:25.629 INFO:teuthology.orchestra.run.smithi092.stdout:Building generic 2023-08-26T09:27:25.636 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.LDx1v48xscxfstests-dev/tests/generic/group.list 2023-08-26T09:27:25.721 INFO:teuthology.orchestra.run.smithi092.stdout:Building shared 2023-08-26T09:27:25.726 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.LDx1v48xscxfstests-dev/tests/shared/group.list 2023-08-26T09:27:25.741 INFO:teuthology.orchestra.run.smithi092.stdout:Building nfs 2023-08-26T09:27:25.746 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.LDx1v48xscxfstests-dev/tests/nfs/group.list 2023-08-26T09:27:25.759 INFO:teuthology.orchestra.run.smithi092.stdout:Building f2fs 2023-08-26T09:27:25.763 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.LDx1v48xscxfstests-dev/tests/f2fs/group.list 2023-08-26T09:27:25.779 INFO:teuthology.orchestra.run.smithi092.stdout:Building udf 2023-08-26T09:27:25.784 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.LDx1v48xscxfstests-dev/tests/udf/group.list 2023-08-26T09:27:25.794 INFO:teuthology.orchestra.run.smithi092.stdout:Building ceph 2023-08-26T09:27:25.799 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.LDx1v48xscxfstests-dev/tests/ceph/group.list 2023-08-26T09:27:25.811 INFO:teuthology.orchestra.run.smithi092.stdout:Building xfs 2023-08-26T09:27:25.817 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.LDx1v48xscxfstests-dev/tests/xfs/group.list 2023-08-26T09:27:25.904 INFO:teuthology.orchestra.run.smithi092.stdout:Building btrfs 2023-08-26T09:27:25.909 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.LDx1v48xscxfstests-dev/tests/btrfs/group.list 2023-08-26T09:27:25.962 INFO:teuthology.orchestra.run.smithi092.stdout:Building tmpfs 2023-08-26T09:27:25.967 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.LDx1v48xscxfstests-dev/tests/tmpfs/group.list 2023-08-26T09:27:25.979 INFO:teuthology.orchestra.run.smithi092.stdout:Building selftest 2023-08-26T09:27:25.984 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.LDx1v48xscxfstests-dev/tests/selftest/group.list 2023-08-26T09:27:25.995 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-08-26T09:27:25.996 INFO:teuthology.orchestra.run.smithi092.stdout:gmake[1]: Nothing to be done for 'install'. 2023-08-26T09:27:25.997 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-08-26T09:27:25.998 INFO:teuthology.orchestra.run.smithi092.stdout:gmake[1]: Nothing to be done for 'install'. 2023-08-26T09:27:25.999 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-08-26T09:27:26.001 INFO:teuthology.orchestra.run.smithi092.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-08-26T09:27:26.009 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-08-26T09:27:26.087 INFO:teuthology.orchestra.run.smithi092.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-08-26T09:27:26.094 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-08-26T09:27:26.111 INFO:teuthology.orchestra.run.smithi092.stdout:Building log-writes 2023-08-26T09:27:26.114 INFO:teuthology.orchestra.run.smithi092.stdout:Building perf 2023-08-26T09:27:26.117 INFO:teuthology.orchestra.run.smithi092.stdout:Building aio-dio-regress 2023-08-26T09:27:26.121 INFO:teuthology.orchestra.run.smithi092.stdout:Building vfs 2023-08-26T09:27:26.124 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/gmake -C log-writes install 2023-08-26T09:27:26.125 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-08-26T09:27:26.134 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-08-26T09:27:26.143 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/gmake -C perf install 2023-08-26T09:27:26.144 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-08-26T09:27:26.153 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 ResultData.py fio-insert-and-compare.py FioResultDecoder.py FioCompare.py generate-schema.py fio-results.sql /var/lib/xfstests/src/perf 2023-08-26T09:27:26.175 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-08-26T09:27:26.177 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-08-26T09:27:26.185 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 aio-dio-append-write-fallocate-race aio-dio-fcntl-race aio-dio-subblock-eof-read aio-dio-append-write-read-race aio-dio-invalidate-readahead aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-last-ref-held-by-io aio-dio-cycle-write aio-dio-extend-stat aio-io-setup-with-nonwritable-context-pointer aio-dio-hole-filling-race aio-dio-invalidate-failure aiodio_sparse2 aiocp aio-dio-cow-race aio-dio-eof-race /var/lib/xfstests/src/aio-dio-regress 2023-08-26T09:27:26.238 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/gmake -C vfs install 2023-08-26T09:27:26.240 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-08-26T09:27:26.248 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-08-26T09:27:26.260 INFO:teuthology.orchestra.run.smithi092.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-08-26T09:27:26.268 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-08-26T09:27:27.447 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py /var/lib/xfstests/src 2023-08-26T09:27:27.540 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-08-26T09:27:27.570 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-08-26T09:27:27.571 INFO:teuthology.orchestra.run.smithi092.stdout:gmake[1]: Nothing to be done for 'install'. 2023-08-26T09:27:27.572 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-08-26T09:27:27.573 INFO:teuthology.orchestra.run.smithi092.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-08-26T09:27:27.581 INFO:teuthology.orchestra.run.smithi092.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-08-26T09:27:27.710 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-08-26T09:27:27.712 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.LDx1v48xscxfstests-dev/tests/btrfs/ install 2023-08-26T09:27:27.714 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-08-26T09:27:27.723 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 299 /var/lib/xfstests/tests/btrfs 2023-08-26T09:27:28.524 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-08-26T09:27:28.532 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 186.out 240.out 092.out 077.out 140.out 265.out 236.out 108.out 204.out 233.out 194.out 234.out 295.out 109.out 033.out 082.out 252.out 270.out 040.out 176.out 202.out 137.out 034.out 125.out 014.out 165.out 181.out 152.out 142.out 024.out 192.out 148.out 282.out 267.out 052.out 228.out 183.out 094.out 273.out 251.out 110.out 043.out 069.out 151.out 206.out 195.out 274.out 215.out 115.out 015.out 275.out 250.out 191.out 281.out 046.out 051.out 131.out 244.out 219.out 119.out 019.out 128.out 177.out 232.out 196.out 242.out 189.out 220.out 120.out 020.out 102.out 263.out 171.out 261.out 045.out 217.out 117.out 017.out 072.out 068.out 048.out 062.out 038.out 084.out 129.out 066.out 029.out 229.out 103.out 003.out 111.out 011.out 243.out 134.out 170.out 260.out 157.out 143.out 133.out 286.out 161.out 246.out 216.out 116.out 016.out 155.out 296.out 118.out 287.out 067.out 010.out 238.out 141.out 114.out 138.out 095.out 184.out 160.out 091.out 081.out 071.out 061.out 085.out 037.out 200.out 100.out 025.out 139.out 258.out 185.out 269.out 208.out 039.out 222.out 035.out 169.out 098.out 290.out 080.out 070.out 060.out 207.out 106.out 009.out 167.out 004.out 211.out 158.out 182.out 146.out 188.out 104.out 089.out 086.out 254.out 279.out 225.out 174.out 156.out 268.out 135.out 257.out 124.out 172.out 058.out 262.out 036.out 042.out 047.out 193.out 097.out 271.out 283.out 083.out 199.out 099.out 278.out 209.out 053.out 164.out 154.out 239.out 241.out 002.out 178.out 190.out 214.out 074.out 056.out 041.out 057.out 175.out 005.out 223.out 150.out 123.out 179.out 144.out 032.out 277.out 205.out 136.out 096.out 198.out 008.out 280.out 050.out 105.out 027.out 187.out 153.out 088.out 285.out 044.out 201.out 101.out 001.out 266.out 237.out 065.out 231.out 227.out 075.out 028.out 213.out 113.out 013.out 031.out 272.out 078.out 173.out 259.out 210.out 132.out 093.out 235.out 127.out 230.out 166.out 292.out 130.out 023.out 073.out 030.out 203.out 063.out 055.out 291.out 245.out 145.out 159.out 249.out 122.out 076.out 022.out 289.out 006.out 284.out 299.out 224.out 276.out 149.out 064.out 264.out 218.out 018.out 168.out 007.out 293.out 079.out 054.out 059.out 049.out 226.out 163.out 126.out 121.out 026.out 180.out 021.out 253.out 255.out 090.out 221.out 087.out 294.out 212.out 112.out 256.out 012.out 247.out 107.out 248.out 162.out 147.out 288.out 197.out /var/lib/xfstests/tests/btrfs 2023-08-26T09:27:29.341 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.LDx1v48xscxfstests-dev/tests/ceph/ install 2023-08-26T09:27:29.342 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-08-26T09:27:29.351 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-08-26T09:27:29.370 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-08-26T09:27:29.378 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/ceph 2023-08-26T09:27:29.398 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.LDx1v48xscxfstests-dev/tests/cifs/ install 2023-08-26T09:27:29.400 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-08-26T09:27:29.408 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-08-26T09:27:29.416 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-08-26T09:27:29.425 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-08-26T09:27:29.433 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.LDx1v48xscxfstests-dev/tests/ext4/ install 2023-08-26T09:27:29.435 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-08-26T09:27:29.444 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-08-26T09:27:29.630 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-08-26T09:27:29.639 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 001.out.nodelalloc 001.out.default 001.out.nozero 001.cfg 032.out 039.out 305.out 005.out 008.out 035.out 036.out 308.out 050.out 040.out 306.out 007.out 021.out 046.out 012.out 009.out 033.out 045.out 034.out 056.out 047.out 018.out 023.out 302.out 020.out 002.out 014.out 024.out 013.out 031.out 015.out 304.out 004.out 048.out 038.out 052.out 303.out 029.out 011.out 027.out 042.out 044.out 055.out 030.out 058.out 003.out 017.out 043.out 053.out 016.out 059.out 037.out 301.out 010.out 022.out 006.out 057.out 025.out 026.out 271.out 051.out 041.out 307.out 019.out 028.out 054.out 049.out /var/lib/xfstests/tests/ext4 2023-08-26T09:27:29.836 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.LDx1v48xscxfstests-dev/tests/f2fs/ install 2023-08-26T09:27:29.837 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-08-26T09:27:29.846 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-08-26T09:27:29.857 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-08-26T09:27:29.865 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-08-26T09:27:29.877 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.LDx1v48xscxfstests-dev/tests/generic/ install 2023-08-26T09:27:29.881 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-08-26T09:27:29.890 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 /var/lib/xfstests/tests/generic 2023-08-26T09:27:31.866 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-08-26T09:27:31.874 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 050.out.xfsquota 035.out.nfs 035.out.default 050.out.nojournal 050.out.default 050.cfg 035.cfg 208.out 433.out 670.out 040.out 104.out 575.out 537.out 683.out 497.out 337.out 702.out 460.out 149.out 088.out 366.out 202.out 137.out 034.out 110.out 389.out 403.out 593.out 571.out 243.out 592.out 282.out 472.out 468.out 628.out 528.out 607.out 428.out 659.out 407.out 228.out 128.out 171.out 028.out 620.out 273.out 474.out 492.out 609.out 707.out 693.out 595.out 506.out 268.out 632.out 532.out 591.out 281.out 471.out 619.out 519.out 013.out 419.out 319.out 177.out 523.out 119.out 019.out 727.out 372.out 686.out 312.out 718.out 143.out 716.out 161.out 516.out 518.out 538.out 655.out 216.out 116.out 016.out 155.out 338.out 238.out 500.out 138.out 189.out 263.out 277.out 181.out 160.out 483.out 274.out 722.out 061.out 239.out 457.out 333.out 258.out 362.out 379.out 691.out 039.out 173.out 498.out 665.out 098.out 711.out 290.out 480.out 706.out 060.out 406.out 306.out 106.out 642.out 447.out 217.out 120.out 191.out 411.out 357.out 481.out 211.out 158.out 014.out 182.out 370.out 188.out 030.out 099.out 585.out 724.out 721.out 624.out 524.out 174.out 156.out 324.out 224.out 313.out 355.out 124.out 382.out 672.out 278.out 063.out 058.out 384.out 296.out 042.out 193.out 271.out 465.out 473.out 335.out 247.out 509.out 568.out 441.out 440.out 475.out 548.out 356.out 341.out 094.out 241.out 600.out 089.out 714.out 614.out 514.out 414.out 314.out 416.out 214.out 381.out 056.out 041.out 057.out 340.out 358.out 572.out 586.out 521.out 240.out 549.out 095.out 633.out 434.out 140.out 708.out 533.out 508.out 408.out 308.out 087.out 199.out 458.out 233.out 639.out 443.out 540.out 397.out 053.out 279.out 276.out 448.out 164.out 376.out 589.out 587.out 339.out 294.out 352.out 484.out 489.out 139.out 317.out 399.out 220.out 552.out 695.out 017.out 677.out 097.out 175.out 315.out 295.out 580.out 075.out 186.out 452.out 679.out 292.out 252.out 077.out 167.out 688.out 206.out 348.out 394.out 651.out 184.out 466.out 697.out 495.out 725.out 109.out 482.out 625.out 283.out 525.out 488.out 496.out 325.out 551.out 225.out 322.out 636.out 125.out 715.out 192.out 544.out 515.out 650.out 152.out 658.out 563.out 393.out 578.out 015.out 392.out 682.out 684.out 550.out 052.out 652.out 534.out 351.out 583.out 451.out 450.out 463.out 251.out 267.out 176.out 069.out 644.out 065.out 487.out 615.out 395.out 676.out 415.out 344.out 215.out 115.out 444.out 027.out 250.out 391.out 674.out 464.out 705.out 536.out 577.out 439.out 244.out 336.out 144.out 505.out 405.out 342.out 205.out 136.out 598.out 363.out 036.out 198.out 723.out 008.out 390.out 680.out 605.out 305.out 105.out 005.out 367.out 291.out 719.out 323.out 685.out 562.out 570.out 388.out 527.out 237.out 151.out 227.out 163.out 332.out 661.out 582.out 232.out 478.out 584.out 462.out 597.out 412.out 132.out 179.out 037.out 293.out 499.out 638.out 353.out 020.out 660.out 561.out 141.out 076.out 668.out 044.out 648.out 387.out 594.out 438.out 265.out 289.out 574.out 006.out 690.out 284.out 567.out 299.out 456.out 461.out 477.out 307.out 647.out 493.out 107.out 007.out 380.out 526.out 479.out 426.out 150.out 326.out 082.out 226.out 413.out 126.out 025.out 121.out 026.out 021.out 485.out 694.out 347.out 275.out 090.out 361.out 564.out 302.out 432.out 002.out 558.out 162.out 147.out 288.out 197.out 033.out 396.out 051.out 350.out 547.out 047.out 024.out 360.out 543.out 261.out 045.out 692.out 255.out 726.out 729.out 378.out 346.out 048.out 062.out 626.out 529.out 231.out 343.out 662.out 425.out 329.out 165.out 334.out 103.out 003.out 129.out 423.out 371.out 234.out 183.out 671.out 645.out 673.out 190.out 486.out 223.out 123.out 262.out 669.out 023.out 459.out 616.out 032.out 266.out 146.out 398.out 728.out 696.out 427.out 590.out 280.out 470.out 455.out 187.out 091.out 046.out 374.out 631.out 328.out 260.out 654.out 359.out 531.out 649.out 301.out 101.out 635.out 623.out 385.out 331.out 556.out 713.out 613.out 513.out 622.out 131.out 213.out 634.out 031.out 565.out 630.out 675.out 272.out 530.out 510.out 627.out 573.out 576.out 430.out 310.out 569.out 454.out 259.out 210.out 449.out 327.out 330.out 067.out 093.out 604.out 287.out 127.out 699.out 166.out 130.out 219.out 073.out 603.out 503.out 303.out 203.out 354.out 157.out 386.out 349.out 055.out 245.out 709.out 522.out 422.out 222.out 159.out 539.out 249.out 122.out 689.out 022.out 681.out 424.out 321.out 066.out 490.out 435.out 375.out 134.out 154.out 566.out 618.out 501.out 418.out 318.out 542.out 218.out 118.out 018.out 377.out 172.out 168.out 079.out 469.out 054.out 059.out 049.out 442.out 657.out 621.out 180.out 270.out 253.out 421.out 712.out 612.out 667.out 512.out 494.out 221.out 212.out 112.out 256.out 012.out 029.out 195.out 554.out 148.out 185.out 596.out 720.out 248.out 196.out 520.out 242.out 420.out 285.out 320.out 629.out 230.out 602.out 502.out 402.out 102.out 717.out 617.out 517.out 429.out 417.out 365.out 092.out 117.out 664.out 072.out 068.out 229.out 038.out 084.out 369.out 611.out 511.out 311.out 368.out 637.out 111.out 011.out 257.out 194.out 170.out 606.out 133.out 286.out 043.out 437.out 545.out 559.out 710.out 610.out 687.out 410.out 701.out 601.out 401.out 201.out 010.out 001.out 096.out 114.out 113.out 074.out 581.out 145.out 641.out 491.out 081.out 071.out 083.out 653.out 700.out 064.out 400.out 300.out 200.out 100.out 646.out 541.out 445.out 269.out 546.out 656.out 698.out 553.out 178.out 298.out 446.out 080.out 070.out 608.out 507.out 409.out 309.out 209.out 108.out 009.out 643.out 004.out 557.out 453.out 666.out 236.out 078.out 364.out 555.out 383.out 085.out 704.out 588.out 504.out 404.out 304.out 204.out 535.out 345.out 246.out 467.out 086.out 254.out 207.out 142.out 235.out 436.out 703.out 135.out 264.out 431.out 678.out 373.out 316.out 169.out 640.out 579.out 297.out 153.out 560.out 663.out 599.out 476.out /var/lib/xfstests/tests/generic 2023-08-26T09:27:33.864 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.LDx1v48xscxfstests-dev/tests/nfs/ install 2023-08-26T09:27:33.865 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-08-26T09:27:33.873 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-08-26T09:27:33.882 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-08-26T09:27:33.890 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-08-26T09:27:33.899 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.LDx1v48xscxfstests-dev/tests/ocfs2/ install 2023-08-26T09:27:33.901 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-08-26T09:27:33.909 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-08-26T09:27:33.918 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-08-26T09:27:33.927 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-08-26T09:27:33.935 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.LDx1v48xscxfstests-dev/tests/overlay/ install 2023-08-26T09:27:33.937 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-08-26T09:27:33.946 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-08-26T09:27:34.214 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-08-26T09:27:34.222 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 035.out 019.out 034.out 018.out 024.out 077.out 069.out 020.out 102.out 014.out 013.out 031.out 015.out 117.out 017.out 072.out 068.out 063.out 048.out 062.out 038.out 026.out 042.out 052.out 110.out 067.out 029.out 111.out 055.out 112.out 073.out 078.out 030.out 058.out 003.out 045.out 023.out 043.out 053.out 109.out 036.out 116.out 016.out 010.out 001.out 022.out 106.out 007.out 006.out 115.out 057.out 113.out 114.out 074.out 046.out 071.out 061.out 025.out 051.out 011.out 041.out 047.out 100.out 064.out 107.out 104.out 028.out 076.out 079.out 054.out 059.out 008.out 049.out 032.out 039.out 021.out 005.out 002.out 065.out 108.out 080.out 070.out 060.out 050.out 027.out 105.out 009.out 004.out 037.out 044.out 012.out 101.out 075.out 103.out 033.out 066.out 040.out 056.out /var/lib/xfstests/tests/overlay 2023-08-26T09:27:34.492 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.LDx1v48xscxfstests-dev/tests/perf/ install 2023-08-26T09:27:34.493 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-08-26T09:27:34.502 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-08-26T09:27:34.510 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-08-26T09:27:34.519 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-08-26T09:27:34.527 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.LDx1v48xscxfstests-dev/tests/selftest/ install 2023-08-26T09:27:34.529 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-08-26T09:27:34.538 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-08-26T09:27:34.559 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-08-26T09:27:34.568 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 006.out 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/selftest 2023-08-26T09:27:34.590 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.LDx1v48xscxfstests-dev/tests/shared/ install 2023-08-26T09:27:34.591 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-08-26T09:27:34.600 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-08-26T09:27:34.614 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-08-26T09:27:34.622 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 032.out 298.out 002.out /var/lib/xfstests/tests/shared 2023-08-26T09:27:34.636 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.LDx1v48xscxfstests-dev/tests/tmpfs/ install 2023-08-26T09:27:34.638 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-08-26T09:27:34.647 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-08-26T09:27:34.655 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-08-26T09:27:34.663 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-08-26T09:27:34.672 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.LDx1v48xscxfstests-dev/tests/udf/ install 2023-08-26T09:27:34.674 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-08-26T09:27:34.682 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-08-26T09:27:34.691 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-08-26T09:27:34.699 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-08-26T09:27:34.708 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.LDx1v48xscxfstests-dev/tests/xfs/ install 2023-08-26T09:27:34.712 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-08-26T09:27:34.721 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-08-26T09:27:36.596 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-08-26T09:27:36.813 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 096.out.internal 033.out.crc 096.out.external 033.out.default 071.out.64 216.out.classic 216.out.64mblog 071.out.32 216.cfg 033.cfg 537.out 295.out 497.out 337.out 385.out 082.out 270.out 460.out 149.out 759.out 502.out 088.out 366.out 202.out 137.out 034.out 110.out 389.out 018.out 593.out 571.out 243.out 592.out 282.out 267.out 728.out 468.out 799.out 284.out 528.out 769.out 428.out 507.out 407.out 228.out 128.out 171.out 183.out 273.out 017.out 492.out 109.out 559.out 506.out 195.out 732.out 268.out 275.out 113.out 532.out 591.out 281.out 471.out 723.out 255.out 013.out 371.out 319.out 467.out 523.out 119.out 775.out 727.out 372.out 329.out 165.out 229.out 103.out 003.out 129.out 131.out 383.out 738.out 260.out 718.out 143.out 716.out 161.out 516.out 518.out 416.out 026.out 116.out 043.out 155.out 338.out 238.out 500.out 138.out 189.out 263.out 184.out 181.out 160.out 483.out 274.out 722.out 061.out 239.out 047.out 772.out 258.out 379.out 322.out 039.out 430.out 173.out 222.out 742.out 098.out 426.out 290.out 480.out 060.out 406.out 306.out 141.out 106.out 006.out 167.out 191.out 542.out 211.out 442.out 188.out 099.out 177.out 721.out 174.out 156.out 771.out 324.out 224.out 313.out 124.out 278.out 058.out 741.out 384.out 042.out 193.out 392.out 768.out 399.out 473.out 770.out 709.out 247.out 568.out 364.out 209.out 441.out 440.out 009.out 740.out 356.out 197.out 341.out 094.out 241.out 501.out 089.out 540.out 514.out 414.out 314.out 214.out 381.out 147.out 041.out 340.out 793.out 358.out 572.out 586.out 240.out 549.out 092.out 439.out 434.out 140.out 708.out 766.out 508.out 408.out 308.out 208.out 737.out 040.out 304.out 349.out 254.out 544.out 059.out 086.out 249.out 335.out 142.out 235.out 436.out 575.out 253.out 715.out 533.out 264.out 431.out 784.out 433.out 036.out 316.out 169.out 035.out 579.out 457.out 297.out 393.out 333.out 599.out 476.out 087.out 199.out 739.out 233.out 752.out 736.out 443.out 773.out 053.out 749.out 279.out 133.out 711.out 458.out 164.out 589.out 587.out 339.out 577.out 294.out 352.out 484.out 498.out 489.out 139.out 774.out 790.out 552.out 781.out 357.out 065.out 097.out 175.out 186.out 452.out 069.out 252.out 751.out 376.out 724.out 206.out 778.out 190.out 794.out 348.out 466.out 248.out 725.out 785.out 750.out 525.out 496.out 325.out 257.out 225.out 125.out 789.out 192.out 296.out 152.out 563.out 246.out 551.out 015.out 792.out 075.out 472.out 578.out 463.out 550.out 052.out 534.out 351.out 276.out 451.out 425.out 450.out 744.out 251.out 444.out 487.out 762.out 395.out 515.out 415.out 315.out 215.out 115.out 597.out 027.out 250.out 344.out 051.out 536.out 030.out 244.out 336.out 028.out 150.out 144.out 505.out 342.out 136.out 598.out 005.out 176.out 198.out 008.out 390.out 178.out 405.out 305.out 205.out 105.out 367.out 291.out 437.out 044.out 719.out 323.out 519.out 363.out 562.out 382.out 570.out 388.out 527.out 158.out 019.out 237.out 151.out 760.out 227.out 163.out 332.out 796.out 582.out 232.out 584.out 462.out 220.out 412.out 132.out 179.out 037.out 293.out 499.out 112.out 748.out 020.out 786.out 063.out 561.out 076.out 465.out 014.out 758.out 387.out 594.out 438.out 265.out 289.out 574.out 755.out 548.out 299.out 419.out 521.out 581.out 595.out 461.out 477.out 307.out 726.out 107.out 007.out 448.out 262.out 380.out 093.out 479.out 547.out 326.out 226.out 747.out 126.out 025.out 121.out 447.out 761.out 580.out 021.out 485.out 347.out 077.out 090.out 361.out 564.out 788.out 066.out 455.out 432.out 002.out 585.out 162.out 288.out 050.out 396.out 446.out 350.out 354.out 429.out 187.out 360.out 543.out 261.out 734.out 045.out 292.out 482.out 729.out 104.out 048.out 062.out 529.out 231.out 343.out 503.out 526.out 486.out 223.out 123.out 023.out 459.out 032.out 798.out 277.out 373.out 146.out 398.out 168.out 427.out 590.out 280.out 470.out 491.out 767.out 016.out 046.out 488.out 731.out 782.out 374.out 583.out 285.out 127.out 328.out 359.out 531.out 301.out 101.out 266.out 331.out 791.out 743.out 556.out 713.out 081.out 024.out 513.out 213.out 730.out 095.out 031.out 565.out 182.out 272.out 530.out 754.out 573.out 576.out 569.out 454.out 259.out 449.out 327.out 330.out 067.out 493.out 010.out 287.out 230.out 166.out 130.out 219.out 073.out 370.out 135.out 303.out 203.out 345.out 355.out 386.out 560.out 055.out 334.out 245.out 522.out 787.out 745.out 422.out 394.out 539.out 524.out 122.out 234.out 022.out 424.out 779.out 490.out 435.out 353.out 423.out 134.out 154.out 271.out 064.out 418.out 318.out 218.out 118.out 757.out 377.out 172.out 079.out 469.out 054.out 049.out 765.out 776.out 456.out 180.out 378.out 421.out 712.out 403.out 321.out 057.out 512.out 494.out 221.out 312.out 212.out 538.out 256.out 012.out 764.out 283.out 554.out 397.out 185.out 596.out 720.out 481.out 196.out 520.out 242.out 420.out 478.out 320.out 555.out 120.out 153.out 402.out 302.out 102.out 717.out 517.out 417.out 317.out 365.out 217.out 117.out 475.out 072.out 068.out 474.out 038.out 084.out 056.out 369.out 511.out 148.out 411.out 029.out 311.out 368.out 111.out 011.out 783.out 194.out 170.out 286.out 756.out 545.out 714.out 157.out 710.out 510.out 413.out 410.out 310.out 210.out 401.out 201.out 001.out 495.out 362.out 114.out 753.out 074.out 145.out 797.out 464.out 091.out 746.out 083.out 800.out 777.out 400.out 300.out 200.out 100.out 375.out 541.out 445.out 269.out 546.out 780.out 553.out 763.out 298.out 567.out 080.out 070.out 509.out 409.out 309.out 207.out 108.out 346.out 391.out 004.out 557.out 453.out 236.out 078.out 159.out 566.out 735.out 085.out 588.out 504.out 404.out 558.out 204.out 535.out 795.out 733.out /var/lib/xfstests/tests/xfs 2023-08-26T09:27:38.488 INFO:teuthology.orchestra.run.smithi092.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-08-26T09:27:38.496 INFO:teuthology.orchestra.run.smithi092.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-08-26T09:27:38.505 INFO:teuthology.orchestra.run.smithi092.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-08-26T09:27:38.514 INFO:teuthology.orchestra.run.smithi092.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-08-26T09:27:38.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-26T09:27:38.525 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec ls tests/generic) 2023-08-26T09:27:38.583 INFO:teuthology.orchestra.run.smithi092.stdout:001 2023-08-26T09:27:38.583 INFO:teuthology.orchestra.run.smithi092.stdout:001.out 2023-08-26T09:27:38.583 INFO:teuthology.orchestra.run.smithi092.stdout:002 2023-08-26T09:27:38.584 INFO:teuthology.orchestra.run.smithi092.stdout:002.out 2023-08-26T09:27:38.584 INFO:teuthology.orchestra.run.smithi092.stdout:003 2023-08-26T09:27:38.584 INFO:teuthology.orchestra.run.smithi092.stdout:003.out 2023-08-26T09:27:38.584 INFO:teuthology.orchestra.run.smithi092.stdout:004 2023-08-26T09:27:38.584 INFO:teuthology.orchestra.run.smithi092.stdout:004.out 2023-08-26T09:27:38.585 INFO:teuthology.orchestra.run.smithi092.stdout:005 2023-08-26T09:27:38.585 INFO:teuthology.orchestra.run.smithi092.stdout:005.out 2023-08-26T09:27:38.585 INFO:teuthology.orchestra.run.smithi092.stdout:006 2023-08-26T09:27:38.585 INFO:teuthology.orchestra.run.smithi092.stdout:006.out 2023-08-26T09:27:38.585 INFO:teuthology.orchestra.run.smithi092.stdout:007 2023-08-26T09:27:38.586 INFO:teuthology.orchestra.run.smithi092.stdout:007.out 2023-08-26T09:27:38.586 INFO:teuthology.orchestra.run.smithi092.stdout:008 2023-08-26T09:27:38.586 INFO:teuthology.orchestra.run.smithi092.stdout:008.out 2023-08-26T09:27:38.586 INFO:teuthology.orchestra.run.smithi092.stdout:009 2023-08-26T09:27:38.586 INFO:teuthology.orchestra.run.smithi092.stdout:009.out 2023-08-26T09:27:38.587 INFO:teuthology.orchestra.run.smithi092.stdout:010 2023-08-26T09:27:38.587 INFO:teuthology.orchestra.run.smithi092.stdout:010.out 2023-08-26T09:27:38.587 INFO:teuthology.orchestra.run.smithi092.stdout:011 2023-08-26T09:27:38.587 INFO:teuthology.orchestra.run.smithi092.stdout:011.out 2023-08-26T09:27:38.587 INFO:teuthology.orchestra.run.smithi092.stdout:012 2023-08-26T09:27:38.588 INFO:teuthology.orchestra.run.smithi092.stdout:012.out 2023-08-26T09:27:38.588 INFO:teuthology.orchestra.run.smithi092.stdout:013 2023-08-26T09:27:38.588 INFO:teuthology.orchestra.run.smithi092.stdout:013.out 2023-08-26T09:27:38.588 INFO:teuthology.orchestra.run.smithi092.stdout:014 2023-08-26T09:27:38.588 INFO:teuthology.orchestra.run.smithi092.stdout:014.out 2023-08-26T09:27:38.589 INFO:teuthology.orchestra.run.smithi092.stdout:015 2023-08-26T09:27:38.589 INFO:teuthology.orchestra.run.smithi092.stdout:015.out 2023-08-26T09:27:38.589 INFO:teuthology.orchestra.run.smithi092.stdout:016 2023-08-26T09:27:38.589 INFO:teuthology.orchestra.run.smithi092.stdout:016.out 2023-08-26T09:27:38.589 INFO:teuthology.orchestra.run.smithi092.stdout:017 2023-08-26T09:27:38.590 INFO:teuthology.orchestra.run.smithi092.stdout:017.out 2023-08-26T09:27:38.590 INFO:teuthology.orchestra.run.smithi092.stdout:018 2023-08-26T09:27:38.590 INFO:teuthology.orchestra.run.smithi092.stdout:018.out 2023-08-26T09:27:38.590 INFO:teuthology.orchestra.run.smithi092.stdout:019 2023-08-26T09:27:38.590 INFO:teuthology.orchestra.run.smithi092.stdout:019.out 2023-08-26T09:27:38.590 INFO:teuthology.orchestra.run.smithi092.stdout:020 2023-08-26T09:27:38.591 INFO:teuthology.orchestra.run.smithi092.stdout:020.out 2023-08-26T09:27:38.591 INFO:teuthology.orchestra.run.smithi092.stdout:021 2023-08-26T09:27:38.591 INFO:teuthology.orchestra.run.smithi092.stdout:021.out 2023-08-26T09:27:38.591 INFO:teuthology.orchestra.run.smithi092.stdout:022 2023-08-26T09:27:38.591 INFO:teuthology.orchestra.run.smithi092.stdout:022.out 2023-08-26T09:27:38.592 INFO:teuthology.orchestra.run.smithi092.stdout:023 2023-08-26T09:27:38.592 INFO:teuthology.orchestra.run.smithi092.stdout:023.out 2023-08-26T09:27:38.592 INFO:teuthology.orchestra.run.smithi092.stdout:024 2023-08-26T09:27:38.592 INFO:teuthology.orchestra.run.smithi092.stdout:024.out 2023-08-26T09:27:38.592 INFO:teuthology.orchestra.run.smithi092.stdout:025 2023-08-26T09:27:38.593 INFO:teuthology.orchestra.run.smithi092.stdout:025.out 2023-08-26T09:27:38.593 INFO:teuthology.orchestra.run.smithi092.stdout:026 2023-08-26T09:27:38.593 INFO:teuthology.orchestra.run.smithi092.stdout:026.out 2023-08-26T09:27:38.593 INFO:teuthology.orchestra.run.smithi092.stdout:027 2023-08-26T09:27:38.593 INFO:teuthology.orchestra.run.smithi092.stdout:027.out 2023-08-26T09:27:38.594 INFO:teuthology.orchestra.run.smithi092.stdout:028 2023-08-26T09:27:38.594 INFO:teuthology.orchestra.run.smithi092.stdout:028.out 2023-08-26T09:27:38.594 INFO:teuthology.orchestra.run.smithi092.stdout:029 2023-08-26T09:27:38.594 INFO:teuthology.orchestra.run.smithi092.stdout:029.out 2023-08-26T09:27:38.594 INFO:teuthology.orchestra.run.smithi092.stdout:030 2023-08-26T09:27:38.595 INFO:teuthology.orchestra.run.smithi092.stdout:030.out 2023-08-26T09:27:38.595 INFO:teuthology.orchestra.run.smithi092.stdout:031 2023-08-26T09:27:38.595 INFO:teuthology.orchestra.run.smithi092.stdout:031.out 2023-08-26T09:27:38.595 INFO:teuthology.orchestra.run.smithi092.stdout:032 2023-08-26T09:27:38.595 INFO:teuthology.orchestra.run.smithi092.stdout:032.out 2023-08-26T09:27:38.595 INFO:teuthology.orchestra.run.smithi092.stdout:033 2023-08-26T09:27:38.596 INFO:teuthology.orchestra.run.smithi092.stdout:033.out 2023-08-26T09:27:38.596 INFO:teuthology.orchestra.run.smithi092.stdout:034 2023-08-26T09:27:38.596 INFO:teuthology.orchestra.run.smithi092.stdout:034.out 2023-08-26T09:27:38.596 INFO:teuthology.orchestra.run.smithi092.stdout:035 2023-08-26T09:27:38.596 INFO:teuthology.orchestra.run.smithi092.stdout:035.cfg 2023-08-26T09:27:38.597 INFO:teuthology.orchestra.run.smithi092.stdout:035.out.default 2023-08-26T09:27:38.597 INFO:teuthology.orchestra.run.smithi092.stdout:035.out.nfs 2023-08-26T09:27:38.597 INFO:teuthology.orchestra.run.smithi092.stdout:036 2023-08-26T09:27:38.597 INFO:teuthology.orchestra.run.smithi092.stdout:036.out 2023-08-26T09:27:38.597 INFO:teuthology.orchestra.run.smithi092.stdout:037 2023-08-26T09:27:38.598 INFO:teuthology.orchestra.run.smithi092.stdout:037.out 2023-08-26T09:27:38.598 INFO:teuthology.orchestra.run.smithi092.stdout:038 2023-08-26T09:27:38.598 INFO:teuthology.orchestra.run.smithi092.stdout:038.out 2023-08-26T09:27:38.598 INFO:teuthology.orchestra.run.smithi092.stdout:039 2023-08-26T09:27:38.598 INFO:teuthology.orchestra.run.smithi092.stdout:039.out 2023-08-26T09:27:38.598 INFO:teuthology.orchestra.run.smithi092.stdout:040 2023-08-26T09:27:38.599 INFO:teuthology.orchestra.run.smithi092.stdout:040.out 2023-08-26T09:27:38.599 INFO:teuthology.orchestra.run.smithi092.stdout:041 2023-08-26T09:27:38.599 INFO:teuthology.orchestra.run.smithi092.stdout:041.out 2023-08-26T09:27:38.599 INFO:teuthology.orchestra.run.smithi092.stdout:042 2023-08-26T09:27:38.599 INFO:teuthology.orchestra.run.smithi092.stdout:042.out 2023-08-26T09:27:38.600 INFO:teuthology.orchestra.run.smithi092.stdout:043 2023-08-26T09:27:38.600 INFO:teuthology.orchestra.run.smithi092.stdout:043.out 2023-08-26T09:27:38.600 INFO:teuthology.orchestra.run.smithi092.stdout:044 2023-08-26T09:27:38.600 INFO:teuthology.orchestra.run.smithi092.stdout:044.out 2023-08-26T09:27:38.600 INFO:teuthology.orchestra.run.smithi092.stdout:045 2023-08-26T09:27:38.601 INFO:teuthology.orchestra.run.smithi092.stdout:045.out 2023-08-26T09:27:38.601 INFO:teuthology.orchestra.run.smithi092.stdout:046 2023-08-26T09:27:38.601 INFO:teuthology.orchestra.run.smithi092.stdout:046.out 2023-08-26T09:27:38.601 INFO:teuthology.orchestra.run.smithi092.stdout:047 2023-08-26T09:27:38.601 INFO:teuthology.orchestra.run.smithi092.stdout:047.out 2023-08-26T09:27:38.601 INFO:teuthology.orchestra.run.smithi092.stdout:048 2023-08-26T09:27:38.602 INFO:teuthology.orchestra.run.smithi092.stdout:048.out 2023-08-26T09:27:38.602 INFO:teuthology.orchestra.run.smithi092.stdout:049 2023-08-26T09:27:38.602 INFO:teuthology.orchestra.run.smithi092.stdout:049.out 2023-08-26T09:27:38.602 INFO:teuthology.orchestra.run.smithi092.stdout:050 2023-08-26T09:27:38.602 INFO:teuthology.orchestra.run.smithi092.stdout:050.cfg 2023-08-26T09:27:38.603 INFO:teuthology.orchestra.run.smithi092.stdout:050.out.default 2023-08-26T09:27:38.603 INFO:teuthology.orchestra.run.smithi092.stdout:050.out.nojournal 2023-08-26T09:27:38.603 INFO:teuthology.orchestra.run.smithi092.stdout:050.out.xfsquota 2023-08-26T09:27:38.603 INFO:teuthology.orchestra.run.smithi092.stdout:051 2023-08-26T09:27:38.603 INFO:teuthology.orchestra.run.smithi092.stdout:051.out 2023-08-26T09:27:38.604 INFO:teuthology.orchestra.run.smithi092.stdout:052 2023-08-26T09:27:38.604 INFO:teuthology.orchestra.run.smithi092.stdout:052.out 2023-08-26T09:27:38.604 INFO:teuthology.orchestra.run.smithi092.stdout:053 2023-08-26T09:27:38.604 INFO:teuthology.orchestra.run.smithi092.stdout:053.out 2023-08-26T09:27:38.604 INFO:teuthology.orchestra.run.smithi092.stdout:054 2023-08-26T09:27:38.604 INFO:teuthology.orchestra.run.smithi092.stdout:054.out 2023-08-26T09:27:38.605 INFO:teuthology.orchestra.run.smithi092.stdout:055 2023-08-26T09:27:38.605 INFO:teuthology.orchestra.run.smithi092.stdout:055.out 2023-08-26T09:27:38.605 INFO:teuthology.orchestra.run.smithi092.stdout:056 2023-08-26T09:27:38.605 INFO:teuthology.orchestra.run.smithi092.stdout:056.out 2023-08-26T09:27:38.605 INFO:teuthology.orchestra.run.smithi092.stdout:057 2023-08-26T09:27:38.606 INFO:teuthology.orchestra.run.smithi092.stdout:057.out 2023-08-26T09:27:38.606 INFO:teuthology.orchestra.run.smithi092.stdout:058 2023-08-26T09:27:38.606 INFO:teuthology.orchestra.run.smithi092.stdout:058.out 2023-08-26T09:27:38.606 INFO:teuthology.orchestra.run.smithi092.stdout:059 2023-08-26T09:27:38.606 INFO:teuthology.orchestra.run.smithi092.stdout:059.out 2023-08-26T09:27:38.606 INFO:teuthology.orchestra.run.smithi092.stdout:060 2023-08-26T09:27:38.607 INFO:teuthology.orchestra.run.smithi092.stdout:060.out 2023-08-26T09:27:38.607 INFO:teuthology.orchestra.run.smithi092.stdout:061 2023-08-26T09:27:38.607 INFO:teuthology.orchestra.run.smithi092.stdout:061.out 2023-08-26T09:27:38.607 INFO:teuthology.orchestra.run.smithi092.stdout:062 2023-08-26T09:27:38.607 INFO:teuthology.orchestra.run.smithi092.stdout:062.out 2023-08-26T09:27:38.608 INFO:teuthology.orchestra.run.smithi092.stdout:063 2023-08-26T09:27:38.608 INFO:teuthology.orchestra.run.smithi092.stdout:063.out 2023-08-26T09:27:38.608 INFO:teuthology.orchestra.run.smithi092.stdout:064 2023-08-26T09:27:38.608 INFO:teuthology.orchestra.run.smithi092.stdout:064.out 2023-08-26T09:27:38.608 INFO:teuthology.orchestra.run.smithi092.stdout:065 2023-08-26T09:27:38.608 INFO:teuthology.orchestra.run.smithi092.stdout:065.out 2023-08-26T09:27:38.609 INFO:teuthology.orchestra.run.smithi092.stdout:066 2023-08-26T09:27:38.609 INFO:teuthology.orchestra.run.smithi092.stdout:066.out 2023-08-26T09:27:38.609 INFO:teuthology.orchestra.run.smithi092.stdout:067 2023-08-26T09:27:38.609 INFO:teuthology.orchestra.run.smithi092.stdout:067.out 2023-08-26T09:27:38.609 INFO:teuthology.orchestra.run.smithi092.stdout:068 2023-08-26T09:27:38.610 INFO:teuthology.orchestra.run.smithi092.stdout:068.out 2023-08-26T09:27:38.610 INFO:teuthology.orchestra.run.smithi092.stdout:069 2023-08-26T09:27:38.610 INFO:teuthology.orchestra.run.smithi092.stdout:069.out 2023-08-26T09:27:38.610 INFO:teuthology.orchestra.run.smithi092.stdout:070 2023-08-26T09:27:38.610 INFO:teuthology.orchestra.run.smithi092.stdout:070.out 2023-08-26T09:27:38.611 INFO:teuthology.orchestra.run.smithi092.stdout:071 2023-08-26T09:27:38.611 INFO:teuthology.orchestra.run.smithi092.stdout:071.out 2023-08-26T09:27:38.611 INFO:teuthology.orchestra.run.smithi092.stdout:072 2023-08-26T09:27:38.611 INFO:teuthology.orchestra.run.smithi092.stdout:072.out 2023-08-26T09:27:38.611 INFO:teuthology.orchestra.run.smithi092.stdout:073 2023-08-26T09:27:38.612 INFO:teuthology.orchestra.run.smithi092.stdout:073.out 2023-08-26T09:27:38.612 INFO:teuthology.orchestra.run.smithi092.stdout:074 2023-08-26T09:27:38.612 INFO:teuthology.orchestra.run.smithi092.stdout:074.out 2023-08-26T09:27:38.612 INFO:teuthology.orchestra.run.smithi092.stdout:075 2023-08-26T09:27:38.612 INFO:teuthology.orchestra.run.smithi092.stdout:075.out 2023-08-26T09:27:38.612 INFO:teuthology.orchestra.run.smithi092.stdout:076 2023-08-26T09:27:38.613 INFO:teuthology.orchestra.run.smithi092.stdout:076.out 2023-08-26T09:27:38.613 INFO:teuthology.orchestra.run.smithi092.stdout:077 2023-08-26T09:27:38.613 INFO:teuthology.orchestra.run.smithi092.stdout:077.out 2023-08-26T09:27:38.613 INFO:teuthology.orchestra.run.smithi092.stdout:078 2023-08-26T09:27:38.613 INFO:teuthology.orchestra.run.smithi092.stdout:078.out 2023-08-26T09:27:38.614 INFO:teuthology.orchestra.run.smithi092.stdout:079 2023-08-26T09:27:38.614 INFO:teuthology.orchestra.run.smithi092.stdout:079.out 2023-08-26T09:27:38.614 INFO:teuthology.orchestra.run.smithi092.stdout:080 2023-08-26T09:27:38.614 INFO:teuthology.orchestra.run.smithi092.stdout:080.out 2023-08-26T09:27:38.614 INFO:teuthology.orchestra.run.smithi092.stdout:081 2023-08-26T09:27:38.615 INFO:teuthology.orchestra.run.smithi092.stdout:081.out 2023-08-26T09:27:38.615 INFO:teuthology.orchestra.run.smithi092.stdout:082 2023-08-26T09:27:38.615 INFO:teuthology.orchestra.run.smithi092.stdout:082.out 2023-08-26T09:27:38.615 INFO:teuthology.orchestra.run.smithi092.stdout:083 2023-08-26T09:27:38.615 INFO:teuthology.orchestra.run.smithi092.stdout:083.out 2023-08-26T09:27:38.615 INFO:teuthology.orchestra.run.smithi092.stdout:084 2023-08-26T09:27:38.616 INFO:teuthology.orchestra.run.smithi092.stdout:084.out 2023-08-26T09:27:38.616 INFO:teuthology.orchestra.run.smithi092.stdout:085 2023-08-26T09:27:38.616 INFO:teuthology.orchestra.run.smithi092.stdout:085.out 2023-08-26T09:27:38.616 INFO:teuthology.orchestra.run.smithi092.stdout:086 2023-08-26T09:27:38.616 INFO:teuthology.orchestra.run.smithi092.stdout:086.out 2023-08-26T09:27:38.617 INFO:teuthology.orchestra.run.smithi092.stdout:087 2023-08-26T09:27:38.617 INFO:teuthology.orchestra.run.smithi092.stdout:087.out 2023-08-26T09:27:38.617 INFO:teuthology.orchestra.run.smithi092.stdout:088 2023-08-26T09:27:38.617 INFO:teuthology.orchestra.run.smithi092.stdout:088.out 2023-08-26T09:27:38.617 INFO:teuthology.orchestra.run.smithi092.stdout:089 2023-08-26T09:27:38.618 INFO:teuthology.orchestra.run.smithi092.stdout:089.out 2023-08-26T09:27:38.618 INFO:teuthology.orchestra.run.smithi092.stdout:090 2023-08-26T09:27:38.618 INFO:teuthology.orchestra.run.smithi092.stdout:090.out 2023-08-26T09:27:38.618 INFO:teuthology.orchestra.run.smithi092.stdout:091 2023-08-26T09:27:38.618 INFO:teuthology.orchestra.run.smithi092.stdout:091.out 2023-08-26T09:27:38.618 INFO:teuthology.orchestra.run.smithi092.stdout:092 2023-08-26T09:27:38.619 INFO:teuthology.orchestra.run.smithi092.stdout:092.out 2023-08-26T09:27:38.619 INFO:teuthology.orchestra.run.smithi092.stdout:093 2023-08-26T09:27:38.619 INFO:teuthology.orchestra.run.smithi092.stdout:093.out 2023-08-26T09:27:38.619 INFO:teuthology.orchestra.run.smithi092.stdout:094 2023-08-26T09:27:38.619 INFO:teuthology.orchestra.run.smithi092.stdout:094.out 2023-08-26T09:27:38.620 INFO:teuthology.orchestra.run.smithi092.stdout:095 2023-08-26T09:27:38.620 INFO:teuthology.orchestra.run.smithi092.stdout:095.out 2023-08-26T09:27:38.620 INFO:teuthology.orchestra.run.smithi092.stdout:096 2023-08-26T09:27:38.620 INFO:teuthology.orchestra.run.smithi092.stdout:096.out 2023-08-26T09:27:38.620 INFO:teuthology.orchestra.run.smithi092.stdout:097 2023-08-26T09:27:38.620 INFO:teuthology.orchestra.run.smithi092.stdout:097.out 2023-08-26T09:27:38.621 INFO:teuthology.orchestra.run.smithi092.stdout:098 2023-08-26T09:27:38.621 INFO:teuthology.orchestra.run.smithi092.stdout:098.out 2023-08-26T09:27:38.621 INFO:teuthology.orchestra.run.smithi092.stdout:099 2023-08-26T09:27:38.621 INFO:teuthology.orchestra.run.smithi092.stdout:099.out 2023-08-26T09:27:38.621 INFO:teuthology.orchestra.run.smithi092.stdout:100 2023-08-26T09:27:38.622 INFO:teuthology.orchestra.run.smithi092.stdout:100.out 2023-08-26T09:27:38.622 INFO:teuthology.orchestra.run.smithi092.stdout:101 2023-08-26T09:27:38.622 INFO:teuthology.orchestra.run.smithi092.stdout:101.out 2023-08-26T09:27:38.622 INFO:teuthology.orchestra.run.smithi092.stdout:102 2023-08-26T09:27:38.622 INFO:teuthology.orchestra.run.smithi092.stdout:102.out 2023-08-26T09:27:38.623 INFO:teuthology.orchestra.run.smithi092.stdout:103 2023-08-26T09:27:38.623 INFO:teuthology.orchestra.run.smithi092.stdout:103.out 2023-08-26T09:27:38.623 INFO:teuthology.orchestra.run.smithi092.stdout:104 2023-08-26T09:27:38.623 INFO:teuthology.orchestra.run.smithi092.stdout:104.out 2023-08-26T09:27:38.623 INFO:teuthology.orchestra.run.smithi092.stdout:105 2023-08-26T09:27:38.624 INFO:teuthology.orchestra.run.smithi092.stdout:105.out 2023-08-26T09:27:38.624 INFO:teuthology.orchestra.run.smithi092.stdout:106 2023-08-26T09:27:38.624 INFO:teuthology.orchestra.run.smithi092.stdout:106.out 2023-08-26T09:27:38.624 INFO:teuthology.orchestra.run.smithi092.stdout:107 2023-08-26T09:27:38.624 INFO:teuthology.orchestra.run.smithi092.stdout:107.out 2023-08-26T09:27:38.624 INFO:teuthology.orchestra.run.smithi092.stdout:108 2023-08-26T09:27:38.625 INFO:teuthology.orchestra.run.smithi092.stdout:108.out 2023-08-26T09:27:38.625 INFO:teuthology.orchestra.run.smithi092.stdout:109 2023-08-26T09:27:38.625 INFO:teuthology.orchestra.run.smithi092.stdout:109.out 2023-08-26T09:27:38.625 INFO:teuthology.orchestra.run.smithi092.stdout:110 2023-08-26T09:27:38.625 INFO:teuthology.orchestra.run.smithi092.stdout:110.out 2023-08-26T09:27:38.626 INFO:teuthology.orchestra.run.smithi092.stdout:111 2023-08-26T09:27:38.626 INFO:teuthology.orchestra.run.smithi092.stdout:111.out 2023-08-26T09:27:38.626 INFO:teuthology.orchestra.run.smithi092.stdout:112 2023-08-26T09:27:38.626 INFO:teuthology.orchestra.run.smithi092.stdout:112.out 2023-08-26T09:27:38.626 INFO:teuthology.orchestra.run.smithi092.stdout:113 2023-08-26T09:27:38.626 INFO:teuthology.orchestra.run.smithi092.stdout:113.out 2023-08-26T09:27:38.627 INFO:teuthology.orchestra.run.smithi092.stdout:114 2023-08-26T09:27:38.627 INFO:teuthology.orchestra.run.smithi092.stdout:114.out 2023-08-26T09:27:38.627 INFO:teuthology.orchestra.run.smithi092.stdout:115 2023-08-26T09:27:38.627 INFO:teuthology.orchestra.run.smithi092.stdout:115.out 2023-08-26T09:27:38.627 INFO:teuthology.orchestra.run.smithi092.stdout:116 2023-08-26T09:27:38.628 INFO:teuthology.orchestra.run.smithi092.stdout:116.out 2023-08-26T09:27:38.628 INFO:teuthology.orchestra.run.smithi092.stdout:117 2023-08-26T09:27:38.628 INFO:teuthology.orchestra.run.smithi092.stdout:117.out 2023-08-26T09:27:38.628 INFO:teuthology.orchestra.run.smithi092.stdout:118 2023-08-26T09:27:38.628 INFO:teuthology.orchestra.run.smithi092.stdout:118.out 2023-08-26T09:27:38.629 INFO:teuthology.orchestra.run.smithi092.stdout:119 2023-08-26T09:27:38.629 INFO:teuthology.orchestra.run.smithi092.stdout:119.out 2023-08-26T09:27:38.629 INFO:teuthology.orchestra.run.smithi092.stdout:120 2023-08-26T09:27:38.629 INFO:teuthology.orchestra.run.smithi092.stdout:120.out 2023-08-26T09:27:38.629 INFO:teuthology.orchestra.run.smithi092.stdout:121 2023-08-26T09:27:38.629 INFO:teuthology.orchestra.run.smithi092.stdout:121.out 2023-08-26T09:27:38.630 INFO:teuthology.orchestra.run.smithi092.stdout:122 2023-08-26T09:27:38.630 INFO:teuthology.orchestra.run.smithi092.stdout:122.out 2023-08-26T09:27:38.630 INFO:teuthology.orchestra.run.smithi092.stdout:123 2023-08-26T09:27:38.630 INFO:teuthology.orchestra.run.smithi092.stdout:123.out 2023-08-26T09:27:38.630 INFO:teuthology.orchestra.run.smithi092.stdout:124 2023-08-26T09:27:38.631 INFO:teuthology.orchestra.run.smithi092.stdout:124.out 2023-08-26T09:27:38.631 INFO:teuthology.orchestra.run.smithi092.stdout:125 2023-08-26T09:27:38.631 INFO:teuthology.orchestra.run.smithi092.stdout:125.out 2023-08-26T09:27:38.631 INFO:teuthology.orchestra.run.smithi092.stdout:126 2023-08-26T09:27:38.631 INFO:teuthology.orchestra.run.smithi092.stdout:126.out 2023-08-26T09:27:38.631 INFO:teuthology.orchestra.run.smithi092.stdout:127 2023-08-26T09:27:38.632 INFO:teuthology.orchestra.run.smithi092.stdout:127.out 2023-08-26T09:27:38.632 INFO:teuthology.orchestra.run.smithi092.stdout:128 2023-08-26T09:27:38.632 INFO:teuthology.orchestra.run.smithi092.stdout:128.out 2023-08-26T09:27:38.632 INFO:teuthology.orchestra.run.smithi092.stdout:129 2023-08-26T09:27:38.632 INFO:teuthology.orchestra.run.smithi092.stdout:129.out 2023-08-26T09:27:38.633 INFO:teuthology.orchestra.run.smithi092.stdout:130 2023-08-26T09:27:38.633 INFO:teuthology.orchestra.run.smithi092.stdout:130.out 2023-08-26T09:27:38.633 INFO:teuthology.orchestra.run.smithi092.stdout:131 2023-08-26T09:27:38.633 INFO:teuthology.orchestra.run.smithi092.stdout:131.out 2023-08-26T09:27:38.633 INFO:teuthology.orchestra.run.smithi092.stdout:132 2023-08-26T09:27:38.633 INFO:teuthology.orchestra.run.smithi092.stdout:132.out 2023-08-26T09:27:38.634 INFO:teuthology.orchestra.run.smithi092.stdout:133 2023-08-26T09:27:38.634 INFO:teuthology.orchestra.run.smithi092.stdout:133.out 2023-08-26T09:27:38.634 INFO:teuthology.orchestra.run.smithi092.stdout:134 2023-08-26T09:27:38.634 INFO:teuthology.orchestra.run.smithi092.stdout:134.out 2023-08-26T09:27:38.634 INFO:teuthology.orchestra.run.smithi092.stdout:135 2023-08-26T09:27:38.635 INFO:teuthology.orchestra.run.smithi092.stdout:135.out 2023-08-26T09:27:38.635 INFO:teuthology.orchestra.run.smithi092.stdout:136 2023-08-26T09:27:38.635 INFO:teuthology.orchestra.run.smithi092.stdout:136.out 2023-08-26T09:27:38.635 INFO:teuthology.orchestra.run.smithi092.stdout:137 2023-08-26T09:27:38.635 INFO:teuthology.orchestra.run.smithi092.stdout:137.out 2023-08-26T09:27:38.636 INFO:teuthology.orchestra.run.smithi092.stdout:138 2023-08-26T09:27:38.636 INFO:teuthology.orchestra.run.smithi092.stdout:138.out 2023-08-26T09:27:38.636 INFO:teuthology.orchestra.run.smithi092.stdout:139 2023-08-26T09:27:38.636 INFO:teuthology.orchestra.run.smithi092.stdout:139.out 2023-08-26T09:27:38.636 INFO:teuthology.orchestra.run.smithi092.stdout:140 2023-08-26T09:27:38.637 INFO:teuthology.orchestra.run.smithi092.stdout:140.out 2023-08-26T09:27:38.637 INFO:teuthology.orchestra.run.smithi092.stdout:141 2023-08-26T09:27:38.637 INFO:teuthology.orchestra.run.smithi092.stdout:141.out 2023-08-26T09:27:38.637 INFO:teuthology.orchestra.run.smithi092.stdout:142 2023-08-26T09:27:38.637 INFO:teuthology.orchestra.run.smithi092.stdout:142.out 2023-08-26T09:27:38.638 INFO:teuthology.orchestra.run.smithi092.stdout:143 2023-08-26T09:27:38.638 INFO:teuthology.orchestra.run.smithi092.stdout:143.out 2023-08-26T09:27:38.638 INFO:teuthology.orchestra.run.smithi092.stdout:144 2023-08-26T09:27:38.638 INFO:teuthology.orchestra.run.smithi092.stdout:144.out 2023-08-26T09:27:38.638 INFO:teuthology.orchestra.run.smithi092.stdout:145 2023-08-26T09:27:38.638 INFO:teuthology.orchestra.run.smithi092.stdout:145.out 2023-08-26T09:27:38.639 INFO:teuthology.orchestra.run.smithi092.stdout:146 2023-08-26T09:27:38.639 INFO:teuthology.orchestra.run.smithi092.stdout:146.out 2023-08-26T09:27:38.639 INFO:teuthology.orchestra.run.smithi092.stdout:147 2023-08-26T09:27:38.639 INFO:teuthology.orchestra.run.smithi092.stdout:147.out 2023-08-26T09:27:38.639 INFO:teuthology.orchestra.run.smithi092.stdout:148 2023-08-26T09:27:38.640 INFO:teuthology.orchestra.run.smithi092.stdout:148.out 2023-08-26T09:27:38.640 INFO:teuthology.orchestra.run.smithi092.stdout:149 2023-08-26T09:27:38.640 INFO:teuthology.orchestra.run.smithi092.stdout:149.out 2023-08-26T09:27:38.640 INFO:teuthology.orchestra.run.smithi092.stdout:150 2023-08-26T09:27:38.640 INFO:teuthology.orchestra.run.smithi092.stdout:150.out 2023-08-26T09:27:38.640 INFO:teuthology.orchestra.run.smithi092.stdout:151 2023-08-26T09:27:38.641 INFO:teuthology.orchestra.run.smithi092.stdout:151.out 2023-08-26T09:27:38.641 INFO:teuthology.orchestra.run.smithi092.stdout:152 2023-08-26T09:27:38.641 INFO:teuthology.orchestra.run.smithi092.stdout:152.out 2023-08-26T09:27:38.641 INFO:teuthology.orchestra.run.smithi092.stdout:153 2023-08-26T09:27:38.641 INFO:teuthology.orchestra.run.smithi092.stdout:153.out 2023-08-26T09:27:38.642 INFO:teuthology.orchestra.run.smithi092.stdout:154 2023-08-26T09:27:38.642 INFO:teuthology.orchestra.run.smithi092.stdout:154.out 2023-08-26T09:27:38.642 INFO:teuthology.orchestra.run.smithi092.stdout:155 2023-08-26T09:27:38.642 INFO:teuthology.orchestra.run.smithi092.stdout:155.out 2023-08-26T09:27:38.642 INFO:teuthology.orchestra.run.smithi092.stdout:156 2023-08-26T09:27:38.643 INFO:teuthology.orchestra.run.smithi092.stdout:156.out 2023-08-26T09:27:38.643 INFO:teuthology.orchestra.run.smithi092.stdout:157 2023-08-26T09:27:38.643 INFO:teuthology.orchestra.run.smithi092.stdout:157.out 2023-08-26T09:27:38.643 INFO:teuthology.orchestra.run.smithi092.stdout:158 2023-08-26T09:27:38.643 INFO:teuthology.orchestra.run.smithi092.stdout:158.out 2023-08-26T09:27:38.644 INFO:teuthology.orchestra.run.smithi092.stdout:159 2023-08-26T09:27:38.644 INFO:teuthology.orchestra.run.smithi092.stdout:159.out 2023-08-26T09:27:38.644 INFO:teuthology.orchestra.run.smithi092.stdout:160 2023-08-26T09:27:38.644 INFO:teuthology.orchestra.run.smithi092.stdout:160.out 2023-08-26T09:27:38.644 INFO:teuthology.orchestra.run.smithi092.stdout:161 2023-08-26T09:27:38.644 INFO:teuthology.orchestra.run.smithi092.stdout:161.out 2023-08-26T09:27:38.645 INFO:teuthology.orchestra.run.smithi092.stdout:162 2023-08-26T09:27:38.645 INFO:teuthology.orchestra.run.smithi092.stdout:162.out 2023-08-26T09:27:38.645 INFO:teuthology.orchestra.run.smithi092.stdout:163 2023-08-26T09:27:38.645 INFO:teuthology.orchestra.run.smithi092.stdout:163.out 2023-08-26T09:27:38.645 INFO:teuthology.orchestra.run.smithi092.stdout:164 2023-08-26T09:27:38.646 INFO:teuthology.orchestra.run.smithi092.stdout:164.out 2023-08-26T09:27:38.646 INFO:teuthology.orchestra.run.smithi092.stdout:165 2023-08-26T09:27:38.646 INFO:teuthology.orchestra.run.smithi092.stdout:165.out 2023-08-26T09:27:38.646 INFO:teuthology.orchestra.run.smithi092.stdout:166 2023-08-26T09:27:38.646 INFO:teuthology.orchestra.run.smithi092.stdout:166.out 2023-08-26T09:27:38.646 INFO:teuthology.orchestra.run.smithi092.stdout:167 2023-08-26T09:27:38.647 INFO:teuthology.orchestra.run.smithi092.stdout:167.out 2023-08-26T09:27:38.647 INFO:teuthology.orchestra.run.smithi092.stdout:168 2023-08-26T09:27:38.647 INFO:teuthology.orchestra.run.smithi092.stdout:168.out 2023-08-26T09:27:38.647 INFO:teuthology.orchestra.run.smithi092.stdout:169 2023-08-26T09:27:38.647 INFO:teuthology.orchestra.run.smithi092.stdout:169.out 2023-08-26T09:27:38.648 INFO:teuthology.orchestra.run.smithi092.stdout:170 2023-08-26T09:27:38.648 INFO:teuthology.orchestra.run.smithi092.stdout:170.out 2023-08-26T09:27:38.648 INFO:teuthology.orchestra.run.smithi092.stdout:171 2023-08-26T09:27:38.648 INFO:teuthology.orchestra.run.smithi092.stdout:171.out 2023-08-26T09:27:38.648 INFO:teuthology.orchestra.run.smithi092.stdout:172 2023-08-26T09:27:38.649 INFO:teuthology.orchestra.run.smithi092.stdout:172.out 2023-08-26T09:27:38.649 INFO:teuthology.orchestra.run.smithi092.stdout:173 2023-08-26T09:27:38.649 INFO:teuthology.orchestra.run.smithi092.stdout:173.out 2023-08-26T09:27:38.649 INFO:teuthology.orchestra.run.smithi092.stdout:174 2023-08-26T09:27:38.649 INFO:teuthology.orchestra.run.smithi092.stdout:174.out 2023-08-26T09:27:38.649 INFO:teuthology.orchestra.run.smithi092.stdout:175 2023-08-26T09:27:38.650 INFO:teuthology.orchestra.run.smithi092.stdout:175.out 2023-08-26T09:27:38.650 INFO:teuthology.orchestra.run.smithi092.stdout:176 2023-08-26T09:27:38.650 INFO:teuthology.orchestra.run.smithi092.stdout:176.out 2023-08-26T09:27:38.650 INFO:teuthology.orchestra.run.smithi092.stdout:177 2023-08-26T09:27:38.651 INFO:teuthology.orchestra.run.smithi092.stdout:177.out 2023-08-26T09:27:38.651 INFO:teuthology.orchestra.run.smithi092.stdout:178 2023-08-26T09:27:38.651 INFO:teuthology.orchestra.run.smithi092.stdout:178.out 2023-08-26T09:27:38.651 INFO:teuthology.orchestra.run.smithi092.stdout:179 2023-08-26T09:27:38.651 INFO:teuthology.orchestra.run.smithi092.stdout:179.out 2023-08-26T09:27:38.652 INFO:teuthology.orchestra.run.smithi092.stdout:180 2023-08-26T09:27:38.652 INFO:teuthology.orchestra.run.smithi092.stdout:180.out 2023-08-26T09:27:38.652 INFO:teuthology.orchestra.run.smithi092.stdout:181 2023-08-26T09:27:38.652 INFO:teuthology.orchestra.run.smithi092.stdout:181.out 2023-08-26T09:27:38.652 INFO:teuthology.orchestra.run.smithi092.stdout:182 2023-08-26T09:27:38.652 INFO:teuthology.orchestra.run.smithi092.stdout:182.out 2023-08-26T09:27:38.653 INFO:teuthology.orchestra.run.smithi092.stdout:183 2023-08-26T09:27:38.653 INFO:teuthology.orchestra.run.smithi092.stdout:183.out 2023-08-26T09:27:38.653 INFO:teuthology.orchestra.run.smithi092.stdout:184 2023-08-26T09:27:38.653 INFO:teuthology.orchestra.run.smithi092.stdout:184.out 2023-08-26T09:27:38.653 INFO:teuthology.orchestra.run.smithi092.stdout:185 2023-08-26T09:27:38.654 INFO:teuthology.orchestra.run.smithi092.stdout:185.out 2023-08-26T09:27:38.654 INFO:teuthology.orchestra.run.smithi092.stdout:186 2023-08-26T09:27:38.654 INFO:teuthology.orchestra.run.smithi092.stdout:186.out 2023-08-26T09:27:38.654 INFO:teuthology.orchestra.run.smithi092.stdout:187 2023-08-26T09:27:38.654 INFO:teuthology.orchestra.run.smithi092.stdout:187.out 2023-08-26T09:27:38.654 INFO:teuthology.orchestra.run.smithi092.stdout:188 2023-08-26T09:27:38.655 INFO:teuthology.orchestra.run.smithi092.stdout:188.out 2023-08-26T09:27:38.655 INFO:teuthology.orchestra.run.smithi092.stdout:189 2023-08-26T09:27:38.655 INFO:teuthology.orchestra.run.smithi092.stdout:189.out 2023-08-26T09:27:38.655 INFO:teuthology.orchestra.run.smithi092.stdout:190 2023-08-26T09:27:38.655 INFO:teuthology.orchestra.run.smithi092.stdout:190.out 2023-08-26T09:27:38.656 INFO:teuthology.orchestra.run.smithi092.stdout:191 2023-08-26T09:27:38.656 INFO:teuthology.orchestra.run.smithi092.stdout:191.out 2023-08-26T09:27:38.656 INFO:teuthology.orchestra.run.smithi092.stdout:192 2023-08-26T09:27:38.656 INFO:teuthology.orchestra.run.smithi092.stdout:192.out 2023-08-26T09:27:38.656 INFO:teuthology.orchestra.run.smithi092.stdout:193 2023-08-26T09:27:38.656 INFO:teuthology.orchestra.run.smithi092.stdout:193.out 2023-08-26T09:27:38.657 INFO:teuthology.orchestra.run.smithi092.stdout:194 2023-08-26T09:27:38.657 INFO:teuthology.orchestra.run.smithi092.stdout:194.out 2023-08-26T09:27:38.657 INFO:teuthology.orchestra.run.smithi092.stdout:195 2023-08-26T09:27:38.657 INFO:teuthology.orchestra.run.smithi092.stdout:195.out 2023-08-26T09:27:38.657 INFO:teuthology.orchestra.run.smithi092.stdout:196 2023-08-26T09:27:38.658 INFO:teuthology.orchestra.run.smithi092.stdout:196.out 2023-08-26T09:27:38.658 INFO:teuthology.orchestra.run.smithi092.stdout:197 2023-08-26T09:27:38.658 INFO:teuthology.orchestra.run.smithi092.stdout:197.out 2023-08-26T09:27:38.658 INFO:teuthology.orchestra.run.smithi092.stdout:198 2023-08-26T09:27:38.658 INFO:teuthology.orchestra.run.smithi092.stdout:198.out 2023-08-26T09:27:38.658 INFO:teuthology.orchestra.run.smithi092.stdout:199 2023-08-26T09:27:38.659 INFO:teuthology.orchestra.run.smithi092.stdout:199.out 2023-08-26T09:27:38.659 INFO:teuthology.orchestra.run.smithi092.stdout:200 2023-08-26T09:27:38.659 INFO:teuthology.orchestra.run.smithi092.stdout:200.out 2023-08-26T09:27:38.659 INFO:teuthology.orchestra.run.smithi092.stdout:201 2023-08-26T09:27:38.659 INFO:teuthology.orchestra.run.smithi092.stdout:201.out 2023-08-26T09:27:38.660 INFO:teuthology.orchestra.run.smithi092.stdout:202 2023-08-26T09:27:38.660 INFO:teuthology.orchestra.run.smithi092.stdout:202.out 2023-08-26T09:27:38.660 INFO:teuthology.orchestra.run.smithi092.stdout:203 2023-08-26T09:27:38.660 INFO:teuthology.orchestra.run.smithi092.stdout:203.out 2023-08-26T09:27:38.660 INFO:teuthology.orchestra.run.smithi092.stdout:204 2023-08-26T09:27:38.660 INFO:teuthology.orchestra.run.smithi092.stdout:204.out 2023-08-26T09:27:38.661 INFO:teuthology.orchestra.run.smithi092.stdout:205 2023-08-26T09:27:38.661 INFO:teuthology.orchestra.run.smithi092.stdout:205.out 2023-08-26T09:27:38.661 INFO:teuthology.orchestra.run.smithi092.stdout:206 2023-08-26T09:27:38.661 INFO:teuthology.orchestra.run.smithi092.stdout:206.out 2023-08-26T09:27:38.661 INFO:teuthology.orchestra.run.smithi092.stdout:207 2023-08-26T09:27:38.662 INFO:teuthology.orchestra.run.smithi092.stdout:207.out 2023-08-26T09:27:38.662 INFO:teuthology.orchestra.run.smithi092.stdout:208 2023-08-26T09:27:38.662 INFO:teuthology.orchestra.run.smithi092.stdout:208.out 2023-08-26T09:27:38.662 INFO:teuthology.orchestra.run.smithi092.stdout:209 2023-08-26T09:27:38.662 INFO:teuthology.orchestra.run.smithi092.stdout:209.out 2023-08-26T09:27:38.662 INFO:teuthology.orchestra.run.smithi092.stdout:210 2023-08-26T09:27:38.663 INFO:teuthology.orchestra.run.smithi092.stdout:210.out 2023-08-26T09:27:38.663 INFO:teuthology.orchestra.run.smithi092.stdout:211 2023-08-26T09:27:38.663 INFO:teuthology.orchestra.run.smithi092.stdout:211.out 2023-08-26T09:27:38.663 INFO:teuthology.orchestra.run.smithi092.stdout:212 2023-08-26T09:27:38.663 INFO:teuthology.orchestra.run.smithi092.stdout:212.out 2023-08-26T09:27:38.664 INFO:teuthology.orchestra.run.smithi092.stdout:213 2023-08-26T09:27:38.664 INFO:teuthology.orchestra.run.smithi092.stdout:213.out 2023-08-26T09:27:38.664 INFO:teuthology.orchestra.run.smithi092.stdout:214 2023-08-26T09:27:38.664 INFO:teuthology.orchestra.run.smithi092.stdout:214.out 2023-08-26T09:27:38.664 INFO:teuthology.orchestra.run.smithi092.stdout:215 2023-08-26T09:27:38.665 INFO:teuthology.orchestra.run.smithi092.stdout:215.out 2023-08-26T09:27:38.665 INFO:teuthology.orchestra.run.smithi092.stdout:216 2023-08-26T09:27:38.665 INFO:teuthology.orchestra.run.smithi092.stdout:216.out 2023-08-26T09:27:38.665 INFO:teuthology.orchestra.run.smithi092.stdout:217 2023-08-26T09:27:38.665 INFO:teuthology.orchestra.run.smithi092.stdout:217.out 2023-08-26T09:27:38.665 INFO:teuthology.orchestra.run.smithi092.stdout:218 2023-08-26T09:27:38.666 INFO:teuthology.orchestra.run.smithi092.stdout:218.out 2023-08-26T09:27:38.666 INFO:teuthology.orchestra.run.smithi092.stdout:219 2023-08-26T09:27:38.666 INFO:teuthology.orchestra.run.smithi092.stdout:219.out 2023-08-26T09:27:38.666 INFO:teuthology.orchestra.run.smithi092.stdout:220 2023-08-26T09:27:38.666 INFO:teuthology.orchestra.run.smithi092.stdout:220.out 2023-08-26T09:27:38.666 INFO:teuthology.orchestra.run.smithi092.stdout:221 2023-08-26T09:27:38.667 INFO:teuthology.orchestra.run.smithi092.stdout:221.out 2023-08-26T09:27:38.667 INFO:teuthology.orchestra.run.smithi092.stdout:222 2023-08-26T09:27:38.667 INFO:teuthology.orchestra.run.smithi092.stdout:222.out 2023-08-26T09:27:38.667 INFO:teuthology.orchestra.run.smithi092.stdout:223 2023-08-26T09:27:38.667 INFO:teuthology.orchestra.run.smithi092.stdout:223.out 2023-08-26T09:27:38.668 INFO:teuthology.orchestra.run.smithi092.stdout:224 2023-08-26T09:27:38.668 INFO:teuthology.orchestra.run.smithi092.stdout:224.out 2023-08-26T09:27:38.668 INFO:teuthology.orchestra.run.smithi092.stdout:225 2023-08-26T09:27:38.668 INFO:teuthology.orchestra.run.smithi092.stdout:225.out 2023-08-26T09:27:38.668 INFO:teuthology.orchestra.run.smithi092.stdout:226 2023-08-26T09:27:38.668 INFO:teuthology.orchestra.run.smithi092.stdout:226.out 2023-08-26T09:27:38.669 INFO:teuthology.orchestra.run.smithi092.stdout:227 2023-08-26T09:27:38.669 INFO:teuthology.orchestra.run.smithi092.stdout:227.out 2023-08-26T09:27:38.669 INFO:teuthology.orchestra.run.smithi092.stdout:228 2023-08-26T09:27:38.669 INFO:teuthology.orchestra.run.smithi092.stdout:228.out 2023-08-26T09:27:38.669 INFO:teuthology.orchestra.run.smithi092.stdout:229 2023-08-26T09:27:38.670 INFO:teuthology.orchestra.run.smithi092.stdout:229.out 2023-08-26T09:27:38.670 INFO:teuthology.orchestra.run.smithi092.stdout:230 2023-08-26T09:27:38.670 INFO:teuthology.orchestra.run.smithi092.stdout:230.out 2023-08-26T09:27:38.670 INFO:teuthology.orchestra.run.smithi092.stdout:231 2023-08-26T09:27:38.670 INFO:teuthology.orchestra.run.smithi092.stdout:231.out 2023-08-26T09:27:38.670 INFO:teuthology.orchestra.run.smithi092.stdout:232 2023-08-26T09:27:38.671 INFO:teuthology.orchestra.run.smithi092.stdout:232.out 2023-08-26T09:27:38.671 INFO:teuthology.orchestra.run.smithi092.stdout:233 2023-08-26T09:27:38.671 INFO:teuthology.orchestra.run.smithi092.stdout:233.out 2023-08-26T09:27:38.671 INFO:teuthology.orchestra.run.smithi092.stdout:234 2023-08-26T09:27:38.671 INFO:teuthology.orchestra.run.smithi092.stdout:234.out 2023-08-26T09:27:38.672 INFO:teuthology.orchestra.run.smithi092.stdout:235 2023-08-26T09:27:38.672 INFO:teuthology.orchestra.run.smithi092.stdout:235.out 2023-08-26T09:27:38.672 INFO:teuthology.orchestra.run.smithi092.stdout:236 2023-08-26T09:27:38.672 INFO:teuthology.orchestra.run.smithi092.stdout:236.out 2023-08-26T09:27:38.672 INFO:teuthology.orchestra.run.smithi092.stdout:237 2023-08-26T09:27:38.672 INFO:teuthology.orchestra.run.smithi092.stdout:237.out 2023-08-26T09:27:38.673 INFO:teuthology.orchestra.run.smithi092.stdout:238 2023-08-26T09:27:38.673 INFO:teuthology.orchestra.run.smithi092.stdout:238.out 2023-08-26T09:27:38.673 INFO:teuthology.orchestra.run.smithi092.stdout:239 2023-08-26T09:27:38.673 INFO:teuthology.orchestra.run.smithi092.stdout:239.out 2023-08-26T09:27:38.673 INFO:teuthology.orchestra.run.smithi092.stdout:240 2023-08-26T09:27:38.674 INFO:teuthology.orchestra.run.smithi092.stdout:240.out 2023-08-26T09:27:38.674 INFO:teuthology.orchestra.run.smithi092.stdout:241 2023-08-26T09:27:38.674 INFO:teuthology.orchestra.run.smithi092.stdout:241.out 2023-08-26T09:27:38.674 INFO:teuthology.orchestra.run.smithi092.stdout:242 2023-08-26T09:27:38.674 INFO:teuthology.orchestra.run.smithi092.stdout:242.out 2023-08-26T09:27:38.674 INFO:teuthology.orchestra.run.smithi092.stdout:243 2023-08-26T09:27:38.675 INFO:teuthology.orchestra.run.smithi092.stdout:243.out 2023-08-26T09:27:38.675 INFO:teuthology.orchestra.run.smithi092.stdout:244 2023-08-26T09:27:38.675 INFO:teuthology.orchestra.run.smithi092.stdout:244.out 2023-08-26T09:27:38.675 INFO:teuthology.orchestra.run.smithi092.stdout:245 2023-08-26T09:27:38.675 INFO:teuthology.orchestra.run.smithi092.stdout:245.out 2023-08-26T09:27:38.676 INFO:teuthology.orchestra.run.smithi092.stdout:246 2023-08-26T09:27:38.676 INFO:teuthology.orchestra.run.smithi092.stdout:246.out 2023-08-26T09:27:38.676 INFO:teuthology.orchestra.run.smithi092.stdout:247 2023-08-26T09:27:38.676 INFO:teuthology.orchestra.run.smithi092.stdout:247.out 2023-08-26T09:27:38.676 INFO:teuthology.orchestra.run.smithi092.stdout:248 2023-08-26T09:27:38.676 INFO:teuthology.orchestra.run.smithi092.stdout:248.out 2023-08-26T09:27:38.677 INFO:teuthology.orchestra.run.smithi092.stdout:249 2023-08-26T09:27:38.677 INFO:teuthology.orchestra.run.smithi092.stdout:249.out 2023-08-26T09:27:38.677 INFO:teuthology.orchestra.run.smithi092.stdout:250 2023-08-26T09:27:38.677 INFO:teuthology.orchestra.run.smithi092.stdout:250.out 2023-08-26T09:27:38.677 INFO:teuthology.orchestra.run.smithi092.stdout:251 2023-08-26T09:27:38.678 INFO:teuthology.orchestra.run.smithi092.stdout:251.out 2023-08-26T09:27:38.678 INFO:teuthology.orchestra.run.smithi092.stdout:252 2023-08-26T09:27:38.678 INFO:teuthology.orchestra.run.smithi092.stdout:252.out 2023-08-26T09:27:38.678 INFO:teuthology.orchestra.run.smithi092.stdout:253 2023-08-26T09:27:38.678 INFO:teuthology.orchestra.run.smithi092.stdout:253.out 2023-08-26T09:27:38.678 INFO:teuthology.orchestra.run.smithi092.stdout:254 2023-08-26T09:27:38.679 INFO:teuthology.orchestra.run.smithi092.stdout:254.out 2023-08-26T09:27:38.679 INFO:teuthology.orchestra.run.smithi092.stdout:255 2023-08-26T09:27:38.679 INFO:teuthology.orchestra.run.smithi092.stdout:255.out 2023-08-26T09:27:38.679 INFO:teuthology.orchestra.run.smithi092.stdout:256 2023-08-26T09:27:38.679 INFO:teuthology.orchestra.run.smithi092.stdout:256.out 2023-08-26T09:27:38.680 INFO:teuthology.orchestra.run.smithi092.stdout:257 2023-08-26T09:27:38.680 INFO:teuthology.orchestra.run.smithi092.stdout:257.out 2023-08-26T09:27:38.680 INFO:teuthology.orchestra.run.smithi092.stdout:258 2023-08-26T09:27:38.680 INFO:teuthology.orchestra.run.smithi092.stdout:258.out 2023-08-26T09:27:38.680 INFO:teuthology.orchestra.run.smithi092.stdout:259 2023-08-26T09:27:38.680 INFO:teuthology.orchestra.run.smithi092.stdout:259.out 2023-08-26T09:27:38.681 INFO:teuthology.orchestra.run.smithi092.stdout:260 2023-08-26T09:27:38.681 INFO:teuthology.orchestra.run.smithi092.stdout:260.out 2023-08-26T09:27:38.681 INFO:teuthology.orchestra.run.smithi092.stdout:261 2023-08-26T09:27:38.681 INFO:teuthology.orchestra.run.smithi092.stdout:261.out 2023-08-26T09:27:38.681 INFO:teuthology.orchestra.run.smithi092.stdout:262 2023-08-26T09:27:38.682 INFO:teuthology.orchestra.run.smithi092.stdout:262.out 2023-08-26T09:27:38.682 INFO:teuthology.orchestra.run.smithi092.stdout:263 2023-08-26T09:27:38.682 INFO:teuthology.orchestra.run.smithi092.stdout:263.out 2023-08-26T09:27:38.682 INFO:teuthology.orchestra.run.smithi092.stdout:264 2023-08-26T09:27:38.682 INFO:teuthology.orchestra.run.smithi092.stdout:264.out 2023-08-26T09:27:38.683 INFO:teuthology.orchestra.run.smithi092.stdout:265 2023-08-26T09:27:38.683 INFO:teuthology.orchestra.run.smithi092.stdout:265.out 2023-08-26T09:27:38.683 INFO:teuthology.orchestra.run.smithi092.stdout:266 2023-08-26T09:27:38.683 INFO:teuthology.orchestra.run.smithi092.stdout:266.out 2023-08-26T09:27:38.683 INFO:teuthology.orchestra.run.smithi092.stdout:267 2023-08-26T09:27:38.683 INFO:teuthology.orchestra.run.smithi092.stdout:267.out 2023-08-26T09:27:38.684 INFO:teuthology.orchestra.run.smithi092.stdout:268 2023-08-26T09:27:38.684 INFO:teuthology.orchestra.run.smithi092.stdout:268.out 2023-08-26T09:27:38.684 INFO:teuthology.orchestra.run.smithi092.stdout:269 2023-08-26T09:27:38.684 INFO:teuthology.orchestra.run.smithi092.stdout:269.out 2023-08-26T09:27:38.684 INFO:teuthology.orchestra.run.smithi092.stdout:270 2023-08-26T09:27:38.685 INFO:teuthology.orchestra.run.smithi092.stdout:270.out 2023-08-26T09:27:38.685 INFO:teuthology.orchestra.run.smithi092.stdout:271 2023-08-26T09:27:38.685 INFO:teuthology.orchestra.run.smithi092.stdout:271.out 2023-08-26T09:27:38.685 INFO:teuthology.orchestra.run.smithi092.stdout:272 2023-08-26T09:27:38.685 INFO:teuthology.orchestra.run.smithi092.stdout:272.out 2023-08-26T09:27:38.686 INFO:teuthology.orchestra.run.smithi092.stdout:273 2023-08-26T09:27:38.686 INFO:teuthology.orchestra.run.smithi092.stdout:273.out 2023-08-26T09:27:38.686 INFO:teuthology.orchestra.run.smithi092.stdout:274 2023-08-26T09:27:38.686 INFO:teuthology.orchestra.run.smithi092.stdout:274.out 2023-08-26T09:27:38.686 INFO:teuthology.orchestra.run.smithi092.stdout:275 2023-08-26T09:27:38.686 INFO:teuthology.orchestra.run.smithi092.stdout:275.out 2023-08-26T09:27:38.687 INFO:teuthology.orchestra.run.smithi092.stdout:276 2023-08-26T09:27:38.687 INFO:teuthology.orchestra.run.smithi092.stdout:276.out 2023-08-26T09:27:38.687 INFO:teuthology.orchestra.run.smithi092.stdout:277 2023-08-26T09:27:38.687 INFO:teuthology.orchestra.run.smithi092.stdout:277.out 2023-08-26T09:27:38.687 INFO:teuthology.orchestra.run.smithi092.stdout:278 2023-08-26T09:27:38.688 INFO:teuthology.orchestra.run.smithi092.stdout:278.out 2023-08-26T09:27:38.688 INFO:teuthology.orchestra.run.smithi092.stdout:279 2023-08-26T09:27:38.688 INFO:teuthology.orchestra.run.smithi092.stdout:279.out 2023-08-26T09:27:38.688 INFO:teuthology.orchestra.run.smithi092.stdout:280 2023-08-26T09:27:38.688 INFO:teuthology.orchestra.run.smithi092.stdout:280.out 2023-08-26T09:27:38.689 INFO:teuthology.orchestra.run.smithi092.stdout:281 2023-08-26T09:27:38.689 INFO:teuthology.orchestra.run.smithi092.stdout:281.out 2023-08-26T09:27:38.689 INFO:teuthology.orchestra.run.smithi092.stdout:282 2023-08-26T09:27:38.689 INFO:teuthology.orchestra.run.smithi092.stdout:282.out 2023-08-26T09:27:38.689 INFO:teuthology.orchestra.run.smithi092.stdout:283 2023-08-26T09:27:38.689 INFO:teuthology.orchestra.run.smithi092.stdout:283.out 2023-08-26T09:27:38.690 INFO:teuthology.orchestra.run.smithi092.stdout:284 2023-08-26T09:27:38.690 INFO:teuthology.orchestra.run.smithi092.stdout:284.out 2023-08-26T09:27:38.690 INFO:teuthology.orchestra.run.smithi092.stdout:285 2023-08-26T09:27:38.690 INFO:teuthology.orchestra.run.smithi092.stdout:285.out 2023-08-26T09:27:38.690 INFO:teuthology.orchestra.run.smithi092.stdout:286 2023-08-26T09:27:38.691 INFO:teuthology.orchestra.run.smithi092.stdout:286.out 2023-08-26T09:27:38.691 INFO:teuthology.orchestra.run.smithi092.stdout:287 2023-08-26T09:27:38.691 INFO:teuthology.orchestra.run.smithi092.stdout:287.out 2023-08-26T09:27:38.691 INFO:teuthology.orchestra.run.smithi092.stdout:288 2023-08-26T09:27:38.691 INFO:teuthology.orchestra.run.smithi092.stdout:288.out 2023-08-26T09:27:38.691 INFO:teuthology.orchestra.run.smithi092.stdout:289 2023-08-26T09:27:38.692 INFO:teuthology.orchestra.run.smithi092.stdout:289.out 2023-08-26T09:27:38.692 INFO:teuthology.orchestra.run.smithi092.stdout:290 2023-08-26T09:27:38.692 INFO:teuthology.orchestra.run.smithi092.stdout:290.out 2023-08-26T09:27:38.692 INFO:teuthology.orchestra.run.smithi092.stdout:291 2023-08-26T09:27:38.692 INFO:teuthology.orchestra.run.smithi092.stdout:291.out 2023-08-26T09:27:38.693 INFO:teuthology.orchestra.run.smithi092.stdout:292 2023-08-26T09:27:38.693 INFO:teuthology.orchestra.run.smithi092.stdout:292.out 2023-08-26T09:27:38.693 INFO:teuthology.orchestra.run.smithi092.stdout:293 2023-08-26T09:27:38.693 INFO:teuthology.orchestra.run.smithi092.stdout:293.out 2023-08-26T09:27:38.693 INFO:teuthology.orchestra.run.smithi092.stdout:294 2023-08-26T09:27:38.693 INFO:teuthology.orchestra.run.smithi092.stdout:294.out 2023-08-26T09:27:38.694 INFO:teuthology.orchestra.run.smithi092.stdout:295 2023-08-26T09:27:38.694 INFO:teuthology.orchestra.run.smithi092.stdout:295.out 2023-08-26T09:27:38.694 INFO:teuthology.orchestra.run.smithi092.stdout:296 2023-08-26T09:27:38.694 INFO:teuthology.orchestra.run.smithi092.stdout:296.out 2023-08-26T09:27:38.694 INFO:teuthology.orchestra.run.smithi092.stdout:297 2023-08-26T09:27:38.694 INFO:teuthology.orchestra.run.smithi092.stdout:297.out 2023-08-26T09:27:38.695 INFO:teuthology.orchestra.run.smithi092.stdout:298 2023-08-26T09:27:38.695 INFO:teuthology.orchestra.run.smithi092.stdout:298.out 2023-08-26T09:27:38.695 INFO:teuthology.orchestra.run.smithi092.stdout:299 2023-08-26T09:27:38.695 INFO:teuthology.orchestra.run.smithi092.stdout:299.out 2023-08-26T09:27:38.695 INFO:teuthology.orchestra.run.smithi092.stdout:300 2023-08-26T09:27:38.696 INFO:teuthology.orchestra.run.smithi092.stdout:300.out 2023-08-26T09:27:38.696 INFO:teuthology.orchestra.run.smithi092.stdout:301 2023-08-26T09:27:38.696 INFO:teuthology.orchestra.run.smithi092.stdout:301.out 2023-08-26T09:27:38.696 INFO:teuthology.orchestra.run.smithi092.stdout:302 2023-08-26T09:27:38.696 INFO:teuthology.orchestra.run.smithi092.stdout:302.out 2023-08-26T09:27:38.697 INFO:teuthology.orchestra.run.smithi092.stdout:303 2023-08-26T09:27:38.697 INFO:teuthology.orchestra.run.smithi092.stdout:303.out 2023-08-26T09:27:38.697 INFO:teuthology.orchestra.run.smithi092.stdout:304 2023-08-26T09:27:38.697 INFO:teuthology.orchestra.run.smithi092.stdout:304.out 2023-08-26T09:27:38.697 INFO:teuthology.orchestra.run.smithi092.stdout:305 2023-08-26T09:27:38.697 INFO:teuthology.orchestra.run.smithi092.stdout:305.out 2023-08-26T09:27:38.698 INFO:teuthology.orchestra.run.smithi092.stdout:306 2023-08-26T09:27:38.698 INFO:teuthology.orchestra.run.smithi092.stdout:306.out 2023-08-26T09:27:38.698 INFO:teuthology.orchestra.run.smithi092.stdout:307 2023-08-26T09:27:38.698 INFO:teuthology.orchestra.run.smithi092.stdout:307.out 2023-08-26T09:27:38.698 INFO:teuthology.orchestra.run.smithi092.stdout:308 2023-08-26T09:27:38.699 INFO:teuthology.orchestra.run.smithi092.stdout:308.out 2023-08-26T09:27:38.699 INFO:teuthology.orchestra.run.smithi092.stdout:309 2023-08-26T09:27:38.699 INFO:teuthology.orchestra.run.smithi092.stdout:309.out 2023-08-26T09:27:38.699 INFO:teuthology.orchestra.run.smithi092.stdout:310 2023-08-26T09:27:38.699 INFO:teuthology.orchestra.run.smithi092.stdout:310.out 2023-08-26T09:27:38.699 INFO:teuthology.orchestra.run.smithi092.stdout:311 2023-08-26T09:27:38.700 INFO:teuthology.orchestra.run.smithi092.stdout:311.out 2023-08-26T09:27:38.700 INFO:teuthology.orchestra.run.smithi092.stdout:312 2023-08-26T09:27:38.700 INFO:teuthology.orchestra.run.smithi092.stdout:312.out 2023-08-26T09:27:38.700 INFO:teuthology.orchestra.run.smithi092.stdout:313 2023-08-26T09:27:38.700 INFO:teuthology.orchestra.run.smithi092.stdout:313.out 2023-08-26T09:27:38.700 INFO:teuthology.orchestra.run.smithi092.stdout:314 2023-08-26T09:27:38.701 INFO:teuthology.orchestra.run.smithi092.stdout:314.out 2023-08-26T09:27:38.701 INFO:teuthology.orchestra.run.smithi092.stdout:315 2023-08-26T09:27:38.701 INFO:teuthology.orchestra.run.smithi092.stdout:315.out 2023-08-26T09:27:38.701 INFO:teuthology.orchestra.run.smithi092.stdout:316 2023-08-26T09:27:38.701 INFO:teuthology.orchestra.run.smithi092.stdout:316.out 2023-08-26T09:27:38.702 INFO:teuthology.orchestra.run.smithi092.stdout:317 2023-08-26T09:27:38.702 INFO:teuthology.orchestra.run.smithi092.stdout:317.out 2023-08-26T09:27:38.702 INFO:teuthology.orchestra.run.smithi092.stdout:318 2023-08-26T09:27:38.702 INFO:teuthology.orchestra.run.smithi092.stdout:318.out 2023-08-26T09:27:38.702 INFO:teuthology.orchestra.run.smithi092.stdout:319 2023-08-26T09:27:38.702 INFO:teuthology.orchestra.run.smithi092.stdout:319.out 2023-08-26T09:27:38.703 INFO:teuthology.orchestra.run.smithi092.stdout:320 2023-08-26T09:27:38.703 INFO:teuthology.orchestra.run.smithi092.stdout:320.out 2023-08-26T09:27:38.703 INFO:teuthology.orchestra.run.smithi092.stdout:321 2023-08-26T09:27:38.703 INFO:teuthology.orchestra.run.smithi092.stdout:321.out 2023-08-26T09:27:38.703 INFO:teuthology.orchestra.run.smithi092.stdout:322 2023-08-26T09:27:38.704 INFO:teuthology.orchestra.run.smithi092.stdout:322.out 2023-08-26T09:27:38.704 INFO:teuthology.orchestra.run.smithi092.stdout:323 2023-08-26T09:27:38.704 INFO:teuthology.orchestra.run.smithi092.stdout:323.out 2023-08-26T09:27:38.704 INFO:teuthology.orchestra.run.smithi092.stdout:324 2023-08-26T09:27:38.704 INFO:teuthology.orchestra.run.smithi092.stdout:324.out 2023-08-26T09:27:38.704 INFO:teuthology.orchestra.run.smithi092.stdout:325 2023-08-26T09:27:38.705 INFO:teuthology.orchestra.run.smithi092.stdout:325.out 2023-08-26T09:27:38.705 INFO:teuthology.orchestra.run.smithi092.stdout:326 2023-08-26T09:27:38.705 INFO:teuthology.orchestra.run.smithi092.stdout:326.out 2023-08-26T09:27:38.705 INFO:teuthology.orchestra.run.smithi092.stdout:327 2023-08-26T09:27:38.705 INFO:teuthology.orchestra.run.smithi092.stdout:327.out 2023-08-26T09:27:38.706 INFO:teuthology.orchestra.run.smithi092.stdout:328 2023-08-26T09:27:38.706 INFO:teuthology.orchestra.run.smithi092.stdout:328.out 2023-08-26T09:27:38.706 INFO:teuthology.orchestra.run.smithi092.stdout:329 2023-08-26T09:27:38.706 INFO:teuthology.orchestra.run.smithi092.stdout:329.out 2023-08-26T09:27:38.706 INFO:teuthology.orchestra.run.smithi092.stdout:330 2023-08-26T09:27:38.707 INFO:teuthology.orchestra.run.smithi092.stdout:330.out 2023-08-26T09:27:38.707 INFO:teuthology.orchestra.run.smithi092.stdout:331 2023-08-26T09:27:38.707 INFO:teuthology.orchestra.run.smithi092.stdout:331.out 2023-08-26T09:27:38.707 INFO:teuthology.orchestra.run.smithi092.stdout:332 2023-08-26T09:27:38.707 INFO:teuthology.orchestra.run.smithi092.stdout:332.out 2023-08-26T09:27:38.707 INFO:teuthology.orchestra.run.smithi092.stdout:333 2023-08-26T09:27:38.708 INFO:teuthology.orchestra.run.smithi092.stdout:333.out 2023-08-26T09:27:38.708 INFO:teuthology.orchestra.run.smithi092.stdout:334 2023-08-26T09:27:38.708 INFO:teuthology.orchestra.run.smithi092.stdout:334.out 2023-08-26T09:27:38.708 INFO:teuthology.orchestra.run.smithi092.stdout:335 2023-08-26T09:27:38.708 INFO:teuthology.orchestra.run.smithi092.stdout:335.out 2023-08-26T09:27:38.709 INFO:teuthology.orchestra.run.smithi092.stdout:336 2023-08-26T09:27:38.709 INFO:teuthology.orchestra.run.smithi092.stdout:336.out 2023-08-26T09:27:38.709 INFO:teuthology.orchestra.run.smithi092.stdout:337 2023-08-26T09:27:38.709 INFO:teuthology.orchestra.run.smithi092.stdout:337.out 2023-08-26T09:27:38.709 INFO:teuthology.orchestra.run.smithi092.stdout:338 2023-08-26T09:27:38.709 INFO:teuthology.orchestra.run.smithi092.stdout:338.out 2023-08-26T09:27:38.710 INFO:teuthology.orchestra.run.smithi092.stdout:339 2023-08-26T09:27:38.710 INFO:teuthology.orchestra.run.smithi092.stdout:339.out 2023-08-26T09:27:38.710 INFO:teuthology.orchestra.run.smithi092.stdout:340 2023-08-26T09:27:38.710 INFO:teuthology.orchestra.run.smithi092.stdout:340.out 2023-08-26T09:27:38.710 INFO:teuthology.orchestra.run.smithi092.stdout:341 2023-08-26T09:27:38.711 INFO:teuthology.orchestra.run.smithi092.stdout:341.out 2023-08-26T09:27:38.711 INFO:teuthology.orchestra.run.smithi092.stdout:342 2023-08-26T09:27:38.711 INFO:teuthology.orchestra.run.smithi092.stdout:342.out 2023-08-26T09:27:38.711 INFO:teuthology.orchestra.run.smithi092.stdout:343 2023-08-26T09:27:38.711 INFO:teuthology.orchestra.run.smithi092.stdout:343.out 2023-08-26T09:27:38.711 INFO:teuthology.orchestra.run.smithi092.stdout:344 2023-08-26T09:27:38.712 INFO:teuthology.orchestra.run.smithi092.stdout:344.out 2023-08-26T09:27:38.712 INFO:teuthology.orchestra.run.smithi092.stdout:345 2023-08-26T09:27:38.712 INFO:teuthology.orchestra.run.smithi092.stdout:345.out 2023-08-26T09:27:38.712 INFO:teuthology.orchestra.run.smithi092.stdout:346 2023-08-26T09:27:38.712 INFO:teuthology.orchestra.run.smithi092.stdout:346.out 2023-08-26T09:27:38.713 INFO:teuthology.orchestra.run.smithi092.stdout:347 2023-08-26T09:27:38.713 INFO:teuthology.orchestra.run.smithi092.stdout:347.out 2023-08-26T09:27:38.713 INFO:teuthology.orchestra.run.smithi092.stdout:348 2023-08-26T09:27:38.713 INFO:teuthology.orchestra.run.smithi092.stdout:348.out 2023-08-26T09:27:38.713 INFO:teuthology.orchestra.run.smithi092.stdout:349 2023-08-26T09:27:38.713 INFO:teuthology.orchestra.run.smithi092.stdout:349.out 2023-08-26T09:27:38.714 INFO:teuthology.orchestra.run.smithi092.stdout:350 2023-08-26T09:27:38.714 INFO:teuthology.orchestra.run.smithi092.stdout:350.out 2023-08-26T09:27:38.714 INFO:teuthology.orchestra.run.smithi092.stdout:351 2023-08-26T09:27:38.714 INFO:teuthology.orchestra.run.smithi092.stdout:351.out 2023-08-26T09:27:38.714 INFO:teuthology.orchestra.run.smithi092.stdout:352 2023-08-26T09:27:38.715 INFO:teuthology.orchestra.run.smithi092.stdout:352.out 2023-08-26T09:27:38.715 INFO:teuthology.orchestra.run.smithi092.stdout:353 2023-08-26T09:27:38.715 INFO:teuthology.orchestra.run.smithi092.stdout:353.out 2023-08-26T09:27:38.715 INFO:teuthology.orchestra.run.smithi092.stdout:354 2023-08-26T09:27:38.715 INFO:teuthology.orchestra.run.smithi092.stdout:354.out 2023-08-26T09:27:38.715 INFO:teuthology.orchestra.run.smithi092.stdout:355 2023-08-26T09:27:38.716 INFO:teuthology.orchestra.run.smithi092.stdout:355.out 2023-08-26T09:27:38.716 INFO:teuthology.orchestra.run.smithi092.stdout:356 2023-08-26T09:27:38.716 INFO:teuthology.orchestra.run.smithi092.stdout:356.out 2023-08-26T09:27:38.716 INFO:teuthology.orchestra.run.smithi092.stdout:357 2023-08-26T09:27:38.716 INFO:teuthology.orchestra.run.smithi092.stdout:357.out 2023-08-26T09:27:38.717 INFO:teuthology.orchestra.run.smithi092.stdout:358 2023-08-26T09:27:38.717 INFO:teuthology.orchestra.run.smithi092.stdout:358.out 2023-08-26T09:27:38.717 INFO:teuthology.orchestra.run.smithi092.stdout:359 2023-08-26T09:27:38.717 INFO:teuthology.orchestra.run.smithi092.stdout:359.out 2023-08-26T09:27:38.717 INFO:teuthology.orchestra.run.smithi092.stdout:360 2023-08-26T09:27:38.717 INFO:teuthology.orchestra.run.smithi092.stdout:360.out 2023-08-26T09:27:38.718 INFO:teuthology.orchestra.run.smithi092.stdout:361 2023-08-26T09:27:38.718 INFO:teuthology.orchestra.run.smithi092.stdout:361.out 2023-08-26T09:27:38.718 INFO:teuthology.orchestra.run.smithi092.stdout:362 2023-08-26T09:27:38.718 INFO:teuthology.orchestra.run.smithi092.stdout:362.out 2023-08-26T09:27:38.718 INFO:teuthology.orchestra.run.smithi092.stdout:363 2023-08-26T09:27:38.719 INFO:teuthology.orchestra.run.smithi092.stdout:363.out 2023-08-26T09:27:38.719 INFO:teuthology.orchestra.run.smithi092.stdout:364 2023-08-26T09:27:38.719 INFO:teuthology.orchestra.run.smithi092.stdout:364.out 2023-08-26T09:27:38.719 INFO:teuthology.orchestra.run.smithi092.stdout:365 2023-08-26T09:27:38.719 INFO:teuthology.orchestra.run.smithi092.stdout:365.out 2023-08-26T09:27:38.719 INFO:teuthology.orchestra.run.smithi092.stdout:366 2023-08-26T09:27:38.720 INFO:teuthology.orchestra.run.smithi092.stdout:366.out 2023-08-26T09:27:38.720 INFO:teuthology.orchestra.run.smithi092.stdout:367 2023-08-26T09:27:38.720 INFO:teuthology.orchestra.run.smithi092.stdout:367.out 2023-08-26T09:27:38.720 INFO:teuthology.orchestra.run.smithi092.stdout:368 2023-08-26T09:27:38.720 INFO:teuthology.orchestra.run.smithi092.stdout:368.out 2023-08-26T09:27:38.721 INFO:teuthology.orchestra.run.smithi092.stdout:369 2023-08-26T09:27:38.721 INFO:teuthology.orchestra.run.smithi092.stdout:369.out 2023-08-26T09:27:38.721 INFO:teuthology.orchestra.run.smithi092.stdout:370 2023-08-26T09:27:38.721 INFO:teuthology.orchestra.run.smithi092.stdout:370.out 2023-08-26T09:27:38.721 INFO:teuthology.orchestra.run.smithi092.stdout:371 2023-08-26T09:27:38.721 INFO:teuthology.orchestra.run.smithi092.stdout:371.out 2023-08-26T09:27:38.722 INFO:teuthology.orchestra.run.smithi092.stdout:372 2023-08-26T09:27:38.722 INFO:teuthology.orchestra.run.smithi092.stdout:372.out 2023-08-26T09:27:38.722 INFO:teuthology.orchestra.run.smithi092.stdout:373 2023-08-26T09:27:38.722 INFO:teuthology.orchestra.run.smithi092.stdout:373.out 2023-08-26T09:27:38.722 INFO:teuthology.orchestra.run.smithi092.stdout:374 2023-08-26T09:27:38.723 INFO:teuthology.orchestra.run.smithi092.stdout:374.out 2023-08-26T09:27:38.723 INFO:teuthology.orchestra.run.smithi092.stdout:375 2023-08-26T09:27:38.723 INFO:teuthology.orchestra.run.smithi092.stdout:375.out 2023-08-26T09:27:38.723 INFO:teuthology.orchestra.run.smithi092.stdout:376 2023-08-26T09:27:38.723 INFO:teuthology.orchestra.run.smithi092.stdout:376.out 2023-08-26T09:27:38.723 INFO:teuthology.orchestra.run.smithi092.stdout:377 2023-08-26T09:27:38.724 INFO:teuthology.orchestra.run.smithi092.stdout:377.out 2023-08-26T09:27:38.724 INFO:teuthology.orchestra.run.smithi092.stdout:378 2023-08-26T09:27:38.724 INFO:teuthology.orchestra.run.smithi092.stdout:378.out 2023-08-26T09:27:38.724 INFO:teuthology.orchestra.run.smithi092.stdout:379 2023-08-26T09:27:38.724 INFO:teuthology.orchestra.run.smithi092.stdout:379.out 2023-08-26T09:27:38.725 INFO:teuthology.orchestra.run.smithi092.stdout:380 2023-08-26T09:27:38.725 INFO:teuthology.orchestra.run.smithi092.stdout:380.out 2023-08-26T09:27:38.725 INFO:teuthology.orchestra.run.smithi092.stdout:381 2023-08-26T09:27:38.725 INFO:teuthology.orchestra.run.smithi092.stdout:381.out 2023-08-26T09:27:38.725 INFO:teuthology.orchestra.run.smithi092.stdout:382 2023-08-26T09:27:38.726 INFO:teuthology.orchestra.run.smithi092.stdout:382.out 2023-08-26T09:27:38.726 INFO:teuthology.orchestra.run.smithi092.stdout:383 2023-08-26T09:27:38.726 INFO:teuthology.orchestra.run.smithi092.stdout:383.out 2023-08-26T09:27:38.726 INFO:teuthology.orchestra.run.smithi092.stdout:384 2023-08-26T09:27:38.726 INFO:teuthology.orchestra.run.smithi092.stdout:384.out 2023-08-26T09:27:38.726 INFO:teuthology.orchestra.run.smithi092.stdout:385 2023-08-26T09:27:38.727 INFO:teuthology.orchestra.run.smithi092.stdout:385.out 2023-08-26T09:27:38.727 INFO:teuthology.orchestra.run.smithi092.stdout:386 2023-08-26T09:27:38.727 INFO:teuthology.orchestra.run.smithi092.stdout:386.out 2023-08-26T09:27:38.727 INFO:teuthology.orchestra.run.smithi092.stdout:387 2023-08-26T09:27:38.727 INFO:teuthology.orchestra.run.smithi092.stdout:387.out 2023-08-26T09:27:38.728 INFO:teuthology.orchestra.run.smithi092.stdout:388 2023-08-26T09:27:38.728 INFO:teuthology.orchestra.run.smithi092.stdout:388.out 2023-08-26T09:27:38.728 INFO:teuthology.orchestra.run.smithi092.stdout:389 2023-08-26T09:27:38.728 INFO:teuthology.orchestra.run.smithi092.stdout:389.out 2023-08-26T09:27:38.728 INFO:teuthology.orchestra.run.smithi092.stdout:390 2023-08-26T09:27:38.728 INFO:teuthology.orchestra.run.smithi092.stdout:390.out 2023-08-26T09:27:38.729 INFO:teuthology.orchestra.run.smithi092.stdout:391 2023-08-26T09:27:38.729 INFO:teuthology.orchestra.run.smithi092.stdout:391.out 2023-08-26T09:27:38.729 INFO:teuthology.orchestra.run.smithi092.stdout:392 2023-08-26T09:27:38.729 INFO:teuthology.orchestra.run.smithi092.stdout:392.out 2023-08-26T09:27:38.729 INFO:teuthology.orchestra.run.smithi092.stdout:393 2023-08-26T09:27:38.730 INFO:teuthology.orchestra.run.smithi092.stdout:393.out 2023-08-26T09:27:38.730 INFO:teuthology.orchestra.run.smithi092.stdout:394 2023-08-26T09:27:38.730 INFO:teuthology.orchestra.run.smithi092.stdout:394.out 2023-08-26T09:27:38.730 INFO:teuthology.orchestra.run.smithi092.stdout:395 2023-08-26T09:27:38.730 INFO:teuthology.orchestra.run.smithi092.stdout:395.out 2023-08-26T09:27:38.731 INFO:teuthology.orchestra.run.smithi092.stdout:396 2023-08-26T09:27:38.731 INFO:teuthology.orchestra.run.smithi092.stdout:396.out 2023-08-26T09:27:38.731 INFO:teuthology.orchestra.run.smithi092.stdout:397 2023-08-26T09:27:38.731 INFO:teuthology.orchestra.run.smithi092.stdout:397.out 2023-08-26T09:27:38.731 INFO:teuthology.orchestra.run.smithi092.stdout:398 2023-08-26T09:27:38.731 INFO:teuthology.orchestra.run.smithi092.stdout:398.out 2023-08-26T09:27:38.732 INFO:teuthology.orchestra.run.smithi092.stdout:399 2023-08-26T09:27:38.732 INFO:teuthology.orchestra.run.smithi092.stdout:399.out 2023-08-26T09:27:38.732 INFO:teuthology.orchestra.run.smithi092.stdout:400 2023-08-26T09:27:38.732 INFO:teuthology.orchestra.run.smithi092.stdout:400.out 2023-08-26T09:27:38.732 INFO:teuthology.orchestra.run.smithi092.stdout:401 2023-08-26T09:27:38.733 INFO:teuthology.orchestra.run.smithi092.stdout:401.out 2023-08-26T09:27:38.733 INFO:teuthology.orchestra.run.smithi092.stdout:402 2023-08-26T09:27:38.733 INFO:teuthology.orchestra.run.smithi092.stdout:402.out 2023-08-26T09:27:38.733 INFO:teuthology.orchestra.run.smithi092.stdout:403 2023-08-26T09:27:38.733 INFO:teuthology.orchestra.run.smithi092.stdout:403.out 2023-08-26T09:27:38.733 INFO:teuthology.orchestra.run.smithi092.stdout:404 2023-08-26T09:27:38.734 INFO:teuthology.orchestra.run.smithi092.stdout:404.out 2023-08-26T09:27:38.734 INFO:teuthology.orchestra.run.smithi092.stdout:405 2023-08-26T09:27:38.734 INFO:teuthology.orchestra.run.smithi092.stdout:405.out 2023-08-26T09:27:38.734 INFO:teuthology.orchestra.run.smithi092.stdout:406 2023-08-26T09:27:38.734 INFO:teuthology.orchestra.run.smithi092.stdout:406.out 2023-08-26T09:27:38.734 INFO:teuthology.orchestra.run.smithi092.stdout:407 2023-08-26T09:27:38.735 INFO:teuthology.orchestra.run.smithi092.stdout:407.out 2023-08-26T09:27:38.735 INFO:teuthology.orchestra.run.smithi092.stdout:408 2023-08-26T09:27:38.735 INFO:teuthology.orchestra.run.smithi092.stdout:408.out 2023-08-26T09:27:38.735 INFO:teuthology.orchestra.run.smithi092.stdout:409 2023-08-26T09:27:38.735 INFO:teuthology.orchestra.run.smithi092.stdout:409.out 2023-08-26T09:27:38.736 INFO:teuthology.orchestra.run.smithi092.stdout:410 2023-08-26T09:27:38.736 INFO:teuthology.orchestra.run.smithi092.stdout:410.out 2023-08-26T09:27:38.736 INFO:teuthology.orchestra.run.smithi092.stdout:411 2023-08-26T09:27:38.736 INFO:teuthology.orchestra.run.smithi092.stdout:411.out 2023-08-26T09:27:38.736 INFO:teuthology.orchestra.run.smithi092.stdout:412 2023-08-26T09:27:38.737 INFO:teuthology.orchestra.run.smithi092.stdout:412.out 2023-08-26T09:27:38.737 INFO:teuthology.orchestra.run.smithi092.stdout:413 2023-08-26T09:27:38.737 INFO:teuthology.orchestra.run.smithi092.stdout:413.out 2023-08-26T09:27:38.737 INFO:teuthology.orchestra.run.smithi092.stdout:414 2023-08-26T09:27:38.737 INFO:teuthology.orchestra.run.smithi092.stdout:414.out 2023-08-26T09:27:38.737 INFO:teuthology.orchestra.run.smithi092.stdout:415 2023-08-26T09:27:38.738 INFO:teuthology.orchestra.run.smithi092.stdout:415.out 2023-08-26T09:27:38.738 INFO:teuthology.orchestra.run.smithi092.stdout:416 2023-08-26T09:27:38.738 INFO:teuthology.orchestra.run.smithi092.stdout:416.out 2023-08-26T09:27:38.738 INFO:teuthology.orchestra.run.smithi092.stdout:417 2023-08-26T09:27:38.738 INFO:teuthology.orchestra.run.smithi092.stdout:417.out 2023-08-26T09:27:38.738 INFO:teuthology.orchestra.run.smithi092.stdout:418 2023-08-26T09:27:38.739 INFO:teuthology.orchestra.run.smithi092.stdout:418.out 2023-08-26T09:27:38.739 INFO:teuthology.orchestra.run.smithi092.stdout:419 2023-08-26T09:27:38.739 INFO:teuthology.orchestra.run.smithi092.stdout:419.out 2023-08-26T09:27:38.739 INFO:teuthology.orchestra.run.smithi092.stdout:420 2023-08-26T09:27:38.739 INFO:teuthology.orchestra.run.smithi092.stdout:420.out 2023-08-26T09:27:38.740 INFO:teuthology.orchestra.run.smithi092.stdout:421 2023-08-26T09:27:38.740 INFO:teuthology.orchestra.run.smithi092.stdout:421.out 2023-08-26T09:27:38.740 INFO:teuthology.orchestra.run.smithi092.stdout:422 2023-08-26T09:27:38.740 INFO:teuthology.orchestra.run.smithi092.stdout:422.out 2023-08-26T09:27:38.740 INFO:teuthology.orchestra.run.smithi092.stdout:423 2023-08-26T09:27:38.740 INFO:teuthology.orchestra.run.smithi092.stdout:423.out 2023-08-26T09:27:38.741 INFO:teuthology.orchestra.run.smithi092.stdout:424 2023-08-26T09:27:38.741 INFO:teuthology.orchestra.run.smithi092.stdout:424.out 2023-08-26T09:27:38.741 INFO:teuthology.orchestra.run.smithi092.stdout:425 2023-08-26T09:27:38.741 INFO:teuthology.orchestra.run.smithi092.stdout:425.out 2023-08-26T09:27:38.741 INFO:teuthology.orchestra.run.smithi092.stdout:426 2023-08-26T09:27:38.742 INFO:teuthology.orchestra.run.smithi092.stdout:426.out 2023-08-26T09:27:38.742 INFO:teuthology.orchestra.run.smithi092.stdout:427 2023-08-26T09:27:38.742 INFO:teuthology.orchestra.run.smithi092.stdout:427.out 2023-08-26T09:27:38.742 INFO:teuthology.orchestra.run.smithi092.stdout:428 2023-08-26T09:27:38.742 INFO:teuthology.orchestra.run.smithi092.stdout:428.out 2023-08-26T09:27:38.742 INFO:teuthology.orchestra.run.smithi092.stdout:429 2023-08-26T09:27:38.743 INFO:teuthology.orchestra.run.smithi092.stdout:429.out 2023-08-26T09:27:38.743 INFO:teuthology.orchestra.run.smithi092.stdout:430 2023-08-26T09:27:38.743 INFO:teuthology.orchestra.run.smithi092.stdout:430.out 2023-08-26T09:27:38.743 INFO:teuthology.orchestra.run.smithi092.stdout:431 2023-08-26T09:27:38.743 INFO:teuthology.orchestra.run.smithi092.stdout:431.out 2023-08-26T09:27:38.744 INFO:teuthology.orchestra.run.smithi092.stdout:432 2023-08-26T09:27:38.744 INFO:teuthology.orchestra.run.smithi092.stdout:432.out 2023-08-26T09:27:38.744 INFO:teuthology.orchestra.run.smithi092.stdout:433 2023-08-26T09:27:38.744 INFO:teuthology.orchestra.run.smithi092.stdout:433.out 2023-08-26T09:27:38.744 INFO:teuthology.orchestra.run.smithi092.stdout:434 2023-08-26T09:27:38.744 INFO:teuthology.orchestra.run.smithi092.stdout:434.out 2023-08-26T09:27:38.745 INFO:teuthology.orchestra.run.smithi092.stdout:435 2023-08-26T09:27:38.745 INFO:teuthology.orchestra.run.smithi092.stdout:435.out 2023-08-26T09:27:38.745 INFO:teuthology.orchestra.run.smithi092.stdout:436 2023-08-26T09:27:38.745 INFO:teuthology.orchestra.run.smithi092.stdout:436.out 2023-08-26T09:27:38.745 INFO:teuthology.orchestra.run.smithi092.stdout:437 2023-08-26T09:27:38.746 INFO:teuthology.orchestra.run.smithi092.stdout:437.out 2023-08-26T09:27:38.746 INFO:teuthology.orchestra.run.smithi092.stdout:438 2023-08-26T09:27:38.746 INFO:teuthology.orchestra.run.smithi092.stdout:438.out 2023-08-26T09:27:38.746 INFO:teuthology.orchestra.run.smithi092.stdout:439 2023-08-26T09:27:38.746 INFO:teuthology.orchestra.run.smithi092.stdout:439.out 2023-08-26T09:27:38.746 INFO:teuthology.orchestra.run.smithi092.stdout:440 2023-08-26T09:27:38.747 INFO:teuthology.orchestra.run.smithi092.stdout:440.out 2023-08-26T09:27:38.747 INFO:teuthology.orchestra.run.smithi092.stdout:441 2023-08-26T09:27:38.747 INFO:teuthology.orchestra.run.smithi092.stdout:441.out 2023-08-26T09:27:38.747 INFO:teuthology.orchestra.run.smithi092.stdout:442 2023-08-26T09:27:38.747 INFO:teuthology.orchestra.run.smithi092.stdout:442.out 2023-08-26T09:27:38.748 INFO:teuthology.orchestra.run.smithi092.stdout:443 2023-08-26T09:27:38.748 INFO:teuthology.orchestra.run.smithi092.stdout:443.out 2023-08-26T09:27:38.748 INFO:teuthology.orchestra.run.smithi092.stdout:444 2023-08-26T09:27:38.748 INFO:teuthology.orchestra.run.smithi092.stdout:444.out 2023-08-26T09:27:38.748 INFO:teuthology.orchestra.run.smithi092.stdout:445 2023-08-26T09:27:38.748 INFO:teuthology.orchestra.run.smithi092.stdout:445.out 2023-08-26T09:27:38.749 INFO:teuthology.orchestra.run.smithi092.stdout:446 2023-08-26T09:27:38.749 INFO:teuthology.orchestra.run.smithi092.stdout:446.out 2023-08-26T09:27:38.749 INFO:teuthology.orchestra.run.smithi092.stdout:447 2023-08-26T09:27:38.749 INFO:teuthology.orchestra.run.smithi092.stdout:447.out 2023-08-26T09:27:38.749 INFO:teuthology.orchestra.run.smithi092.stdout:448 2023-08-26T09:27:38.750 INFO:teuthology.orchestra.run.smithi092.stdout:448.out 2023-08-26T09:27:38.750 INFO:teuthology.orchestra.run.smithi092.stdout:449 2023-08-26T09:27:38.750 INFO:teuthology.orchestra.run.smithi092.stdout:449.out 2023-08-26T09:27:38.750 INFO:teuthology.orchestra.run.smithi092.stdout:450 2023-08-26T09:27:38.750 INFO:teuthology.orchestra.run.smithi092.stdout:450.out 2023-08-26T09:27:38.750 INFO:teuthology.orchestra.run.smithi092.stdout:451 2023-08-26T09:27:38.751 INFO:teuthology.orchestra.run.smithi092.stdout:451.out 2023-08-26T09:27:38.751 INFO:teuthology.orchestra.run.smithi092.stdout:452 2023-08-26T09:27:38.751 INFO:teuthology.orchestra.run.smithi092.stdout:452.out 2023-08-26T09:27:38.751 INFO:teuthology.orchestra.run.smithi092.stdout:453 2023-08-26T09:27:38.751 INFO:teuthology.orchestra.run.smithi092.stdout:453.out 2023-08-26T09:27:38.752 INFO:teuthology.orchestra.run.smithi092.stdout:454 2023-08-26T09:27:38.752 INFO:teuthology.orchestra.run.smithi092.stdout:454.out 2023-08-26T09:27:38.752 INFO:teuthology.orchestra.run.smithi092.stdout:455 2023-08-26T09:27:38.752 INFO:teuthology.orchestra.run.smithi092.stdout:455.out 2023-08-26T09:27:38.752 INFO:teuthology.orchestra.run.smithi092.stdout:456 2023-08-26T09:27:38.752 INFO:teuthology.orchestra.run.smithi092.stdout:456.out 2023-08-26T09:27:38.753 INFO:teuthology.orchestra.run.smithi092.stdout:457 2023-08-26T09:27:38.753 INFO:teuthology.orchestra.run.smithi092.stdout:457.out 2023-08-26T09:27:38.753 INFO:teuthology.orchestra.run.smithi092.stdout:458 2023-08-26T09:27:38.753 INFO:teuthology.orchestra.run.smithi092.stdout:458.out 2023-08-26T09:27:38.753 INFO:teuthology.orchestra.run.smithi092.stdout:459 2023-08-26T09:27:38.754 INFO:teuthology.orchestra.run.smithi092.stdout:459.out 2023-08-26T09:27:38.754 INFO:teuthology.orchestra.run.smithi092.stdout:460 2023-08-26T09:27:38.754 INFO:teuthology.orchestra.run.smithi092.stdout:460.out 2023-08-26T09:27:38.754 INFO:teuthology.orchestra.run.smithi092.stdout:461 2023-08-26T09:27:38.754 INFO:teuthology.orchestra.run.smithi092.stdout:461.out 2023-08-26T09:27:38.754 INFO:teuthology.orchestra.run.smithi092.stdout:462 2023-08-26T09:27:38.755 INFO:teuthology.orchestra.run.smithi092.stdout:462.out 2023-08-26T09:27:38.755 INFO:teuthology.orchestra.run.smithi092.stdout:463 2023-08-26T09:27:38.755 INFO:teuthology.orchestra.run.smithi092.stdout:463.out 2023-08-26T09:27:38.755 INFO:teuthology.orchestra.run.smithi092.stdout:464 2023-08-26T09:27:38.755 INFO:teuthology.orchestra.run.smithi092.stdout:464.out 2023-08-26T09:27:38.756 INFO:teuthology.orchestra.run.smithi092.stdout:465 2023-08-26T09:27:38.756 INFO:teuthology.orchestra.run.smithi092.stdout:465.out 2023-08-26T09:27:38.756 INFO:teuthology.orchestra.run.smithi092.stdout:466 2023-08-26T09:27:38.756 INFO:teuthology.orchestra.run.smithi092.stdout:466.out 2023-08-26T09:27:38.756 INFO:teuthology.orchestra.run.smithi092.stdout:467 2023-08-26T09:27:38.756 INFO:teuthology.orchestra.run.smithi092.stdout:467.out 2023-08-26T09:27:38.757 INFO:teuthology.orchestra.run.smithi092.stdout:468 2023-08-26T09:27:38.757 INFO:teuthology.orchestra.run.smithi092.stdout:468.out 2023-08-26T09:27:38.757 INFO:teuthology.orchestra.run.smithi092.stdout:469 2023-08-26T09:27:38.757 INFO:teuthology.orchestra.run.smithi092.stdout:469.out 2023-08-26T09:27:38.757 INFO:teuthology.orchestra.run.smithi092.stdout:470 2023-08-26T09:27:38.758 INFO:teuthology.orchestra.run.smithi092.stdout:470.out 2023-08-26T09:27:38.758 INFO:teuthology.orchestra.run.smithi092.stdout:471 2023-08-26T09:27:38.758 INFO:teuthology.orchestra.run.smithi092.stdout:471.out 2023-08-26T09:27:38.758 INFO:teuthology.orchestra.run.smithi092.stdout:472 2023-08-26T09:27:38.758 INFO:teuthology.orchestra.run.smithi092.stdout:472.out 2023-08-26T09:27:38.758 INFO:teuthology.orchestra.run.smithi092.stdout:473 2023-08-26T09:27:38.759 INFO:teuthology.orchestra.run.smithi092.stdout:473.out 2023-08-26T09:27:38.759 INFO:teuthology.orchestra.run.smithi092.stdout:474 2023-08-26T09:27:38.759 INFO:teuthology.orchestra.run.smithi092.stdout:474.out 2023-08-26T09:27:38.759 INFO:teuthology.orchestra.run.smithi092.stdout:475 2023-08-26T09:27:38.759 INFO:teuthology.orchestra.run.smithi092.stdout:475.out 2023-08-26T09:27:38.760 INFO:teuthology.orchestra.run.smithi092.stdout:476 2023-08-26T09:27:38.760 INFO:teuthology.orchestra.run.smithi092.stdout:476.out 2023-08-26T09:27:38.760 INFO:teuthology.orchestra.run.smithi092.stdout:477 2023-08-26T09:27:38.760 INFO:teuthology.orchestra.run.smithi092.stdout:477.out 2023-08-26T09:27:38.760 INFO:teuthology.orchestra.run.smithi092.stdout:478 2023-08-26T09:27:38.760 INFO:teuthology.orchestra.run.smithi092.stdout:478.out 2023-08-26T09:27:38.761 INFO:teuthology.orchestra.run.smithi092.stdout:479 2023-08-26T09:27:38.761 INFO:teuthology.orchestra.run.smithi092.stdout:479.out 2023-08-26T09:27:38.761 INFO:teuthology.orchestra.run.smithi092.stdout:480 2023-08-26T09:27:38.761 INFO:teuthology.orchestra.run.smithi092.stdout:480.out 2023-08-26T09:27:38.761 INFO:teuthology.orchestra.run.smithi092.stdout:481 2023-08-26T09:27:38.762 INFO:teuthology.orchestra.run.smithi092.stdout:481.out 2023-08-26T09:27:38.762 INFO:teuthology.orchestra.run.smithi092.stdout:482 2023-08-26T09:27:38.762 INFO:teuthology.orchestra.run.smithi092.stdout:482.out 2023-08-26T09:27:38.762 INFO:teuthology.orchestra.run.smithi092.stdout:483 2023-08-26T09:27:38.762 INFO:teuthology.orchestra.run.smithi092.stdout:483.out 2023-08-26T09:27:38.762 INFO:teuthology.orchestra.run.smithi092.stdout:484 2023-08-26T09:27:38.763 INFO:teuthology.orchestra.run.smithi092.stdout:484.out 2023-08-26T09:27:38.763 INFO:teuthology.orchestra.run.smithi092.stdout:485 2023-08-26T09:27:38.763 INFO:teuthology.orchestra.run.smithi092.stdout:485.out 2023-08-26T09:27:38.763 INFO:teuthology.orchestra.run.smithi092.stdout:486 2023-08-26T09:27:38.763 INFO:teuthology.orchestra.run.smithi092.stdout:486.out 2023-08-26T09:27:38.764 INFO:teuthology.orchestra.run.smithi092.stdout:487 2023-08-26T09:27:38.764 INFO:teuthology.orchestra.run.smithi092.stdout:487.out 2023-08-26T09:27:38.764 INFO:teuthology.orchestra.run.smithi092.stdout:488 2023-08-26T09:27:38.764 INFO:teuthology.orchestra.run.smithi092.stdout:488.out 2023-08-26T09:27:38.764 INFO:teuthology.orchestra.run.smithi092.stdout:489 2023-08-26T09:27:38.764 INFO:teuthology.orchestra.run.smithi092.stdout:489.out 2023-08-26T09:27:38.765 INFO:teuthology.orchestra.run.smithi092.stdout:490 2023-08-26T09:27:38.765 INFO:teuthology.orchestra.run.smithi092.stdout:490.out 2023-08-26T09:27:38.765 INFO:teuthology.orchestra.run.smithi092.stdout:491 2023-08-26T09:27:38.765 INFO:teuthology.orchestra.run.smithi092.stdout:491.out 2023-08-26T09:27:38.765 INFO:teuthology.orchestra.run.smithi092.stdout:492 2023-08-26T09:27:38.766 INFO:teuthology.orchestra.run.smithi092.stdout:492.out 2023-08-26T09:27:38.766 INFO:teuthology.orchestra.run.smithi092.stdout:493 2023-08-26T09:27:38.766 INFO:teuthology.orchestra.run.smithi092.stdout:493.out 2023-08-26T09:27:38.766 INFO:teuthology.orchestra.run.smithi092.stdout:494 2023-08-26T09:27:38.766 INFO:teuthology.orchestra.run.smithi092.stdout:494.out 2023-08-26T09:27:38.766 INFO:teuthology.orchestra.run.smithi092.stdout:495 2023-08-26T09:27:38.767 INFO:teuthology.orchestra.run.smithi092.stdout:495.out 2023-08-26T09:27:38.767 INFO:teuthology.orchestra.run.smithi092.stdout:496 2023-08-26T09:27:38.767 INFO:teuthology.orchestra.run.smithi092.stdout:496.out 2023-08-26T09:27:38.767 INFO:teuthology.orchestra.run.smithi092.stdout:497 2023-08-26T09:27:38.767 INFO:teuthology.orchestra.run.smithi092.stdout:497.out 2023-08-26T09:27:38.768 INFO:teuthology.orchestra.run.smithi092.stdout:498 2023-08-26T09:27:38.768 INFO:teuthology.orchestra.run.smithi092.stdout:498.out 2023-08-26T09:27:38.768 INFO:teuthology.orchestra.run.smithi092.stdout:499 2023-08-26T09:27:38.768 INFO:teuthology.orchestra.run.smithi092.stdout:499.out 2023-08-26T09:27:38.768 INFO:teuthology.orchestra.run.smithi092.stdout:500 2023-08-26T09:27:38.768 INFO:teuthology.orchestra.run.smithi092.stdout:500.out 2023-08-26T09:27:38.769 INFO:teuthology.orchestra.run.smithi092.stdout:501 2023-08-26T09:27:38.769 INFO:teuthology.orchestra.run.smithi092.stdout:501.out 2023-08-26T09:27:38.769 INFO:teuthology.orchestra.run.smithi092.stdout:502 2023-08-26T09:27:38.769 INFO:teuthology.orchestra.run.smithi092.stdout:502.out 2023-08-26T09:27:38.769 INFO:teuthology.orchestra.run.smithi092.stdout:503 2023-08-26T09:27:38.769 INFO:teuthology.orchestra.run.smithi092.stdout:503.out 2023-08-26T09:27:38.770 INFO:teuthology.orchestra.run.smithi092.stdout:504 2023-08-26T09:27:38.770 INFO:teuthology.orchestra.run.smithi092.stdout:504.out 2023-08-26T09:27:38.770 INFO:teuthology.orchestra.run.smithi092.stdout:505 2023-08-26T09:27:38.770 INFO:teuthology.orchestra.run.smithi092.stdout:505.out 2023-08-26T09:27:38.770 INFO:teuthology.orchestra.run.smithi092.stdout:506 2023-08-26T09:27:38.771 INFO:teuthology.orchestra.run.smithi092.stdout:506.out 2023-08-26T09:27:38.771 INFO:teuthology.orchestra.run.smithi092.stdout:507 2023-08-26T09:27:38.771 INFO:teuthology.orchestra.run.smithi092.stdout:507.out 2023-08-26T09:27:38.771 INFO:teuthology.orchestra.run.smithi092.stdout:508 2023-08-26T09:27:38.771 INFO:teuthology.orchestra.run.smithi092.stdout:508.out 2023-08-26T09:27:38.771 INFO:teuthology.orchestra.run.smithi092.stdout:509 2023-08-26T09:27:38.772 INFO:teuthology.orchestra.run.smithi092.stdout:509.out 2023-08-26T09:27:38.772 INFO:teuthology.orchestra.run.smithi092.stdout:510 2023-08-26T09:27:38.772 INFO:teuthology.orchestra.run.smithi092.stdout:510.out 2023-08-26T09:27:38.772 INFO:teuthology.orchestra.run.smithi092.stdout:511 2023-08-26T09:27:38.772 INFO:teuthology.orchestra.run.smithi092.stdout:511.out 2023-08-26T09:27:38.773 INFO:teuthology.orchestra.run.smithi092.stdout:512 2023-08-26T09:27:38.773 INFO:teuthology.orchestra.run.smithi092.stdout:512.out 2023-08-26T09:27:38.773 INFO:teuthology.orchestra.run.smithi092.stdout:513 2023-08-26T09:27:38.773 INFO:teuthology.orchestra.run.smithi092.stdout:513.out 2023-08-26T09:27:38.773 INFO:teuthology.orchestra.run.smithi092.stdout:514 2023-08-26T09:27:38.773 INFO:teuthology.orchestra.run.smithi092.stdout:514.out 2023-08-26T09:27:38.774 INFO:teuthology.orchestra.run.smithi092.stdout:515 2023-08-26T09:27:38.774 INFO:teuthology.orchestra.run.smithi092.stdout:515.out 2023-08-26T09:27:38.774 INFO:teuthology.orchestra.run.smithi092.stdout:516 2023-08-26T09:27:38.774 INFO:teuthology.orchestra.run.smithi092.stdout:516.out 2023-08-26T09:27:38.774 INFO:teuthology.orchestra.run.smithi092.stdout:517 2023-08-26T09:27:38.775 INFO:teuthology.orchestra.run.smithi092.stdout:517.out 2023-08-26T09:27:38.775 INFO:teuthology.orchestra.run.smithi092.stdout:518 2023-08-26T09:27:38.775 INFO:teuthology.orchestra.run.smithi092.stdout:518.out 2023-08-26T09:27:38.775 INFO:teuthology.orchestra.run.smithi092.stdout:519 2023-08-26T09:27:38.775 INFO:teuthology.orchestra.run.smithi092.stdout:519.out 2023-08-26T09:27:38.775 INFO:teuthology.orchestra.run.smithi092.stdout:520 2023-08-26T09:27:38.776 INFO:teuthology.orchestra.run.smithi092.stdout:520.out 2023-08-26T09:27:38.776 INFO:teuthology.orchestra.run.smithi092.stdout:521 2023-08-26T09:27:38.776 INFO:teuthology.orchestra.run.smithi092.stdout:521.out 2023-08-26T09:27:38.776 INFO:teuthology.orchestra.run.smithi092.stdout:522 2023-08-26T09:27:38.776 INFO:teuthology.orchestra.run.smithi092.stdout:522.out 2023-08-26T09:27:38.777 INFO:teuthology.orchestra.run.smithi092.stdout:523 2023-08-26T09:27:38.777 INFO:teuthology.orchestra.run.smithi092.stdout:523.out 2023-08-26T09:27:38.777 INFO:teuthology.orchestra.run.smithi092.stdout:524 2023-08-26T09:27:38.777 INFO:teuthology.orchestra.run.smithi092.stdout:524.out 2023-08-26T09:27:38.777 INFO:teuthology.orchestra.run.smithi092.stdout:525 2023-08-26T09:27:38.777 INFO:teuthology.orchestra.run.smithi092.stdout:525.out 2023-08-26T09:27:38.778 INFO:teuthology.orchestra.run.smithi092.stdout:526 2023-08-26T09:27:38.778 INFO:teuthology.orchestra.run.smithi092.stdout:526.out 2023-08-26T09:27:38.778 INFO:teuthology.orchestra.run.smithi092.stdout:527 2023-08-26T09:27:38.778 INFO:teuthology.orchestra.run.smithi092.stdout:527.out 2023-08-26T09:27:38.778 INFO:teuthology.orchestra.run.smithi092.stdout:528 2023-08-26T09:27:38.779 INFO:teuthology.orchestra.run.smithi092.stdout:528.out 2023-08-26T09:27:38.779 INFO:teuthology.orchestra.run.smithi092.stdout:529 2023-08-26T09:27:38.779 INFO:teuthology.orchestra.run.smithi092.stdout:529.out 2023-08-26T09:27:38.779 INFO:teuthology.orchestra.run.smithi092.stdout:530 2023-08-26T09:27:38.779 INFO:teuthology.orchestra.run.smithi092.stdout:530.out 2023-08-26T09:27:38.779 INFO:teuthology.orchestra.run.smithi092.stdout:531 2023-08-26T09:27:38.780 INFO:teuthology.orchestra.run.smithi092.stdout:531.out 2023-08-26T09:27:38.780 INFO:teuthology.orchestra.run.smithi092.stdout:532 2023-08-26T09:27:38.780 INFO:teuthology.orchestra.run.smithi092.stdout:532.out 2023-08-26T09:27:38.780 INFO:teuthology.orchestra.run.smithi092.stdout:533 2023-08-26T09:27:38.780 INFO:teuthology.orchestra.run.smithi092.stdout:533.out 2023-08-26T09:27:38.781 INFO:teuthology.orchestra.run.smithi092.stdout:534 2023-08-26T09:27:38.781 INFO:teuthology.orchestra.run.smithi092.stdout:534.out 2023-08-26T09:27:38.781 INFO:teuthology.orchestra.run.smithi092.stdout:535 2023-08-26T09:27:38.781 INFO:teuthology.orchestra.run.smithi092.stdout:535.out 2023-08-26T09:27:38.781 INFO:teuthology.orchestra.run.smithi092.stdout:536 2023-08-26T09:27:38.781 INFO:teuthology.orchestra.run.smithi092.stdout:536.out 2023-08-26T09:27:38.782 INFO:teuthology.orchestra.run.smithi092.stdout:537 2023-08-26T09:27:38.782 INFO:teuthology.orchestra.run.smithi092.stdout:537.out 2023-08-26T09:27:38.782 INFO:teuthology.orchestra.run.smithi092.stdout:538 2023-08-26T09:27:38.782 INFO:teuthology.orchestra.run.smithi092.stdout:538.out 2023-08-26T09:27:38.782 INFO:teuthology.orchestra.run.smithi092.stdout:539 2023-08-26T09:27:38.783 INFO:teuthology.orchestra.run.smithi092.stdout:539.out 2023-08-26T09:27:38.783 INFO:teuthology.orchestra.run.smithi092.stdout:540 2023-08-26T09:27:38.783 INFO:teuthology.orchestra.run.smithi092.stdout:540.out 2023-08-26T09:27:38.783 INFO:teuthology.orchestra.run.smithi092.stdout:541 2023-08-26T09:27:38.783 INFO:teuthology.orchestra.run.smithi092.stdout:541.out 2023-08-26T09:27:38.783 INFO:teuthology.orchestra.run.smithi092.stdout:542 2023-08-26T09:27:38.784 INFO:teuthology.orchestra.run.smithi092.stdout:542.out 2023-08-26T09:27:38.784 INFO:teuthology.orchestra.run.smithi092.stdout:543 2023-08-26T09:27:38.784 INFO:teuthology.orchestra.run.smithi092.stdout:543.out 2023-08-26T09:27:38.784 INFO:teuthology.orchestra.run.smithi092.stdout:544 2023-08-26T09:27:38.784 INFO:teuthology.orchestra.run.smithi092.stdout:544.out 2023-08-26T09:27:38.785 INFO:teuthology.orchestra.run.smithi092.stdout:545 2023-08-26T09:27:38.785 INFO:teuthology.orchestra.run.smithi092.stdout:545.out 2023-08-26T09:27:38.785 INFO:teuthology.orchestra.run.smithi092.stdout:546 2023-08-26T09:27:38.785 INFO:teuthology.orchestra.run.smithi092.stdout:546.out 2023-08-26T09:27:38.785 INFO:teuthology.orchestra.run.smithi092.stdout:547 2023-08-26T09:27:38.785 INFO:teuthology.orchestra.run.smithi092.stdout:547.out 2023-08-26T09:27:38.786 INFO:teuthology.orchestra.run.smithi092.stdout:548 2023-08-26T09:27:38.786 INFO:teuthology.orchestra.run.smithi092.stdout:548.out 2023-08-26T09:27:38.786 INFO:teuthology.orchestra.run.smithi092.stdout:549 2023-08-26T09:27:38.786 INFO:teuthology.orchestra.run.smithi092.stdout:549.out 2023-08-26T09:27:38.786 INFO:teuthology.orchestra.run.smithi092.stdout:550 2023-08-26T09:27:38.787 INFO:teuthology.orchestra.run.smithi092.stdout:550.out 2023-08-26T09:27:38.787 INFO:teuthology.orchestra.run.smithi092.stdout:551 2023-08-26T09:27:38.787 INFO:teuthology.orchestra.run.smithi092.stdout:551.out 2023-08-26T09:27:38.787 INFO:teuthology.orchestra.run.smithi092.stdout:552 2023-08-26T09:27:38.787 INFO:teuthology.orchestra.run.smithi092.stdout:552.out 2023-08-26T09:27:38.787 INFO:teuthology.orchestra.run.smithi092.stdout:553 2023-08-26T09:27:38.788 INFO:teuthology.orchestra.run.smithi092.stdout:553.out 2023-08-26T09:27:38.788 INFO:teuthology.orchestra.run.smithi092.stdout:554 2023-08-26T09:27:38.788 INFO:teuthology.orchestra.run.smithi092.stdout:554.out 2023-08-26T09:27:38.788 INFO:teuthology.orchestra.run.smithi092.stdout:555 2023-08-26T09:27:38.788 INFO:teuthology.orchestra.run.smithi092.stdout:555.out 2023-08-26T09:27:38.789 INFO:teuthology.orchestra.run.smithi092.stdout:556 2023-08-26T09:27:38.789 INFO:teuthology.orchestra.run.smithi092.stdout:556.out 2023-08-26T09:27:38.789 INFO:teuthology.orchestra.run.smithi092.stdout:557 2023-08-26T09:27:38.789 INFO:teuthology.orchestra.run.smithi092.stdout:557.out 2023-08-26T09:27:38.789 INFO:teuthology.orchestra.run.smithi092.stdout:558 2023-08-26T09:27:38.789 INFO:teuthology.orchestra.run.smithi092.stdout:558.out 2023-08-26T09:27:38.790 INFO:teuthology.orchestra.run.smithi092.stdout:559 2023-08-26T09:27:38.790 INFO:teuthology.orchestra.run.smithi092.stdout:559.out 2023-08-26T09:27:38.790 INFO:teuthology.orchestra.run.smithi092.stdout:560 2023-08-26T09:27:38.790 INFO:teuthology.orchestra.run.smithi092.stdout:560.out 2023-08-26T09:27:38.790 INFO:teuthology.orchestra.run.smithi092.stdout:561 2023-08-26T09:27:38.790 INFO:teuthology.orchestra.run.smithi092.stdout:561.out 2023-08-26T09:27:38.791 INFO:teuthology.orchestra.run.smithi092.stdout:562 2023-08-26T09:27:38.791 INFO:teuthology.orchestra.run.smithi092.stdout:562.out 2023-08-26T09:27:38.791 INFO:teuthology.orchestra.run.smithi092.stdout:563 2023-08-26T09:27:38.791 INFO:teuthology.orchestra.run.smithi092.stdout:563.out 2023-08-26T09:27:38.791 INFO:teuthology.orchestra.run.smithi092.stdout:564 2023-08-26T09:27:38.792 INFO:teuthology.orchestra.run.smithi092.stdout:564.out 2023-08-26T09:27:38.792 INFO:teuthology.orchestra.run.smithi092.stdout:565 2023-08-26T09:27:38.792 INFO:teuthology.orchestra.run.smithi092.stdout:565.out 2023-08-26T09:27:38.792 INFO:teuthology.orchestra.run.smithi092.stdout:566 2023-08-26T09:27:38.792 INFO:teuthology.orchestra.run.smithi092.stdout:566.out 2023-08-26T09:27:38.793 INFO:teuthology.orchestra.run.smithi092.stdout:567 2023-08-26T09:27:38.793 INFO:teuthology.orchestra.run.smithi092.stdout:567.out 2023-08-26T09:27:38.793 INFO:teuthology.orchestra.run.smithi092.stdout:568 2023-08-26T09:27:38.793 INFO:teuthology.orchestra.run.smithi092.stdout:568.out 2023-08-26T09:27:38.793 INFO:teuthology.orchestra.run.smithi092.stdout:569 2023-08-26T09:27:38.793 INFO:teuthology.orchestra.run.smithi092.stdout:569.out 2023-08-26T09:27:38.794 INFO:teuthology.orchestra.run.smithi092.stdout:570 2023-08-26T09:27:38.794 INFO:teuthology.orchestra.run.smithi092.stdout:570.out 2023-08-26T09:27:38.794 INFO:teuthology.orchestra.run.smithi092.stdout:571 2023-08-26T09:27:38.794 INFO:teuthology.orchestra.run.smithi092.stdout:571.out 2023-08-26T09:27:38.794 INFO:teuthology.orchestra.run.smithi092.stdout:572 2023-08-26T09:27:38.794 INFO:teuthology.orchestra.run.smithi092.stdout:572.out 2023-08-26T09:27:38.795 INFO:teuthology.orchestra.run.smithi092.stdout:573 2023-08-26T09:27:38.795 INFO:teuthology.orchestra.run.smithi092.stdout:573.out 2023-08-26T09:27:38.795 INFO:teuthology.orchestra.run.smithi092.stdout:574 2023-08-26T09:27:38.795 INFO:teuthology.orchestra.run.smithi092.stdout:574.out 2023-08-26T09:27:38.795 INFO:teuthology.orchestra.run.smithi092.stdout:575 2023-08-26T09:27:38.796 INFO:teuthology.orchestra.run.smithi092.stdout:575.out 2023-08-26T09:27:38.796 INFO:teuthology.orchestra.run.smithi092.stdout:576 2023-08-26T09:27:38.796 INFO:teuthology.orchestra.run.smithi092.stdout:576.out 2023-08-26T09:27:38.796 INFO:teuthology.orchestra.run.smithi092.stdout:577 2023-08-26T09:27:38.796 INFO:teuthology.orchestra.run.smithi092.stdout:577.out 2023-08-26T09:27:38.796 INFO:teuthology.orchestra.run.smithi092.stdout:578 2023-08-26T09:27:38.797 INFO:teuthology.orchestra.run.smithi092.stdout:578.out 2023-08-26T09:27:38.797 INFO:teuthology.orchestra.run.smithi092.stdout:579 2023-08-26T09:27:38.797 INFO:teuthology.orchestra.run.smithi092.stdout:579.out 2023-08-26T09:27:38.797 INFO:teuthology.orchestra.run.smithi092.stdout:580 2023-08-26T09:27:38.797 INFO:teuthology.orchestra.run.smithi092.stdout:580.out 2023-08-26T09:27:38.798 INFO:teuthology.orchestra.run.smithi092.stdout:581 2023-08-26T09:27:38.798 INFO:teuthology.orchestra.run.smithi092.stdout:581.out 2023-08-26T09:27:38.798 INFO:teuthology.orchestra.run.smithi092.stdout:582 2023-08-26T09:27:38.798 INFO:teuthology.orchestra.run.smithi092.stdout:582.out 2023-08-26T09:27:38.798 INFO:teuthology.orchestra.run.smithi092.stdout:583 2023-08-26T09:27:38.798 INFO:teuthology.orchestra.run.smithi092.stdout:583.out 2023-08-26T09:27:38.799 INFO:teuthology.orchestra.run.smithi092.stdout:584 2023-08-26T09:27:38.799 INFO:teuthology.orchestra.run.smithi092.stdout:584.out 2023-08-26T09:27:38.799 INFO:teuthology.orchestra.run.smithi092.stdout:585 2023-08-26T09:27:38.799 INFO:teuthology.orchestra.run.smithi092.stdout:585.out 2023-08-26T09:27:38.799 INFO:teuthology.orchestra.run.smithi092.stdout:586 2023-08-26T09:27:38.800 INFO:teuthology.orchestra.run.smithi092.stdout:586.out 2023-08-26T09:27:38.800 INFO:teuthology.orchestra.run.smithi092.stdout:587 2023-08-26T09:27:38.800 INFO:teuthology.orchestra.run.smithi092.stdout:587.out 2023-08-26T09:27:38.800 INFO:teuthology.orchestra.run.smithi092.stdout:588 2023-08-26T09:27:38.800 INFO:teuthology.orchestra.run.smithi092.stdout:588.out 2023-08-26T09:27:38.800 INFO:teuthology.orchestra.run.smithi092.stdout:589 2023-08-26T09:27:38.801 INFO:teuthology.orchestra.run.smithi092.stdout:589.out 2023-08-26T09:27:38.801 INFO:teuthology.orchestra.run.smithi092.stdout:590 2023-08-26T09:27:38.801 INFO:teuthology.orchestra.run.smithi092.stdout:590.out 2023-08-26T09:27:38.801 INFO:teuthology.orchestra.run.smithi092.stdout:591 2023-08-26T09:27:38.801 INFO:teuthology.orchestra.run.smithi092.stdout:591.out 2023-08-26T09:27:38.802 INFO:teuthology.orchestra.run.smithi092.stdout:592 2023-08-26T09:27:38.802 INFO:teuthology.orchestra.run.smithi092.stdout:592.out 2023-08-26T09:27:38.802 INFO:teuthology.orchestra.run.smithi092.stdout:593 2023-08-26T09:27:38.802 INFO:teuthology.orchestra.run.smithi092.stdout:593.out 2023-08-26T09:27:38.802 INFO:teuthology.orchestra.run.smithi092.stdout:594 2023-08-26T09:27:38.802 INFO:teuthology.orchestra.run.smithi092.stdout:594.out 2023-08-26T09:27:38.803 INFO:teuthology.orchestra.run.smithi092.stdout:595 2023-08-26T09:27:38.803 INFO:teuthology.orchestra.run.smithi092.stdout:595.out 2023-08-26T09:27:38.803 INFO:teuthology.orchestra.run.smithi092.stdout:596 2023-08-26T09:27:38.803 INFO:teuthology.orchestra.run.smithi092.stdout:596.out 2023-08-26T09:27:38.803 INFO:teuthology.orchestra.run.smithi092.stdout:597 2023-08-26T09:27:38.804 INFO:teuthology.orchestra.run.smithi092.stdout:597.out 2023-08-26T09:27:38.804 INFO:teuthology.orchestra.run.smithi092.stdout:598 2023-08-26T09:27:38.804 INFO:teuthology.orchestra.run.smithi092.stdout:598.out 2023-08-26T09:27:38.804 INFO:teuthology.orchestra.run.smithi092.stdout:599 2023-08-26T09:27:38.804 INFO:teuthology.orchestra.run.smithi092.stdout:599.out 2023-08-26T09:27:38.804 INFO:teuthology.orchestra.run.smithi092.stdout:600 2023-08-26T09:27:38.805 INFO:teuthology.orchestra.run.smithi092.stdout:600.out 2023-08-26T09:27:38.805 INFO:teuthology.orchestra.run.smithi092.stdout:601 2023-08-26T09:27:38.805 INFO:teuthology.orchestra.run.smithi092.stdout:601.out 2023-08-26T09:27:38.805 INFO:teuthology.orchestra.run.smithi092.stdout:602 2023-08-26T09:27:38.805 INFO:teuthology.orchestra.run.smithi092.stdout:602.out 2023-08-26T09:27:38.806 INFO:teuthology.orchestra.run.smithi092.stdout:603 2023-08-26T09:27:38.806 INFO:teuthology.orchestra.run.smithi092.stdout:603.out 2023-08-26T09:27:38.806 INFO:teuthology.orchestra.run.smithi092.stdout:604 2023-08-26T09:27:38.806 INFO:teuthology.orchestra.run.smithi092.stdout:604.out 2023-08-26T09:27:38.806 INFO:teuthology.orchestra.run.smithi092.stdout:605 2023-08-26T09:27:38.806 INFO:teuthology.orchestra.run.smithi092.stdout:605.out 2023-08-26T09:27:38.807 INFO:teuthology.orchestra.run.smithi092.stdout:606 2023-08-26T09:27:38.807 INFO:teuthology.orchestra.run.smithi092.stdout:606.out 2023-08-26T09:27:38.807 INFO:teuthology.orchestra.run.smithi092.stdout:607 2023-08-26T09:27:38.807 INFO:teuthology.orchestra.run.smithi092.stdout:607.out 2023-08-26T09:27:38.807 INFO:teuthology.orchestra.run.smithi092.stdout:608 2023-08-26T09:27:38.807 INFO:teuthology.orchestra.run.smithi092.stdout:608.out 2023-08-26T09:27:38.808 INFO:teuthology.orchestra.run.smithi092.stdout:609 2023-08-26T09:27:38.808 INFO:teuthology.orchestra.run.smithi092.stdout:609.out 2023-08-26T09:27:38.808 INFO:teuthology.orchestra.run.smithi092.stdout:610 2023-08-26T09:27:38.808 INFO:teuthology.orchestra.run.smithi092.stdout:610.out 2023-08-26T09:27:38.808 INFO:teuthology.orchestra.run.smithi092.stdout:611 2023-08-26T09:27:38.809 INFO:teuthology.orchestra.run.smithi092.stdout:611.out 2023-08-26T09:27:38.809 INFO:teuthology.orchestra.run.smithi092.stdout:612 2023-08-26T09:27:38.809 INFO:teuthology.orchestra.run.smithi092.stdout:612.out 2023-08-26T09:27:38.809 INFO:teuthology.orchestra.run.smithi092.stdout:613 2023-08-26T09:27:38.809 INFO:teuthology.orchestra.run.smithi092.stdout:613.out 2023-08-26T09:27:38.809 INFO:teuthology.orchestra.run.smithi092.stdout:614 2023-08-26T09:27:38.810 INFO:teuthology.orchestra.run.smithi092.stdout:614.out 2023-08-26T09:27:38.810 INFO:teuthology.orchestra.run.smithi092.stdout:615 2023-08-26T09:27:38.810 INFO:teuthology.orchestra.run.smithi092.stdout:615.out 2023-08-26T09:27:38.810 INFO:teuthology.orchestra.run.smithi092.stdout:616 2023-08-26T09:27:38.810 INFO:teuthology.orchestra.run.smithi092.stdout:616.out 2023-08-26T09:27:38.811 INFO:teuthology.orchestra.run.smithi092.stdout:617 2023-08-26T09:27:38.811 INFO:teuthology.orchestra.run.smithi092.stdout:617.out 2023-08-26T09:27:38.811 INFO:teuthology.orchestra.run.smithi092.stdout:618 2023-08-26T09:27:38.811 INFO:teuthology.orchestra.run.smithi092.stdout:618.out 2023-08-26T09:27:38.811 INFO:teuthology.orchestra.run.smithi092.stdout:619 2023-08-26T09:27:38.811 INFO:teuthology.orchestra.run.smithi092.stdout:619.out 2023-08-26T09:27:38.812 INFO:teuthology.orchestra.run.smithi092.stdout:620 2023-08-26T09:27:38.812 INFO:teuthology.orchestra.run.smithi092.stdout:620.out 2023-08-26T09:27:38.812 INFO:teuthology.orchestra.run.smithi092.stdout:621 2023-08-26T09:27:38.812 INFO:teuthology.orchestra.run.smithi092.stdout:621.out 2023-08-26T09:27:38.812 INFO:teuthology.orchestra.run.smithi092.stdout:622 2023-08-26T09:27:38.813 INFO:teuthology.orchestra.run.smithi092.stdout:622.out 2023-08-26T09:27:38.813 INFO:teuthology.orchestra.run.smithi092.stdout:623 2023-08-26T09:27:38.813 INFO:teuthology.orchestra.run.smithi092.stdout:623.out 2023-08-26T09:27:38.813 INFO:teuthology.orchestra.run.smithi092.stdout:624 2023-08-26T09:27:38.813 INFO:teuthology.orchestra.run.smithi092.stdout:624.out 2023-08-26T09:27:38.813 INFO:teuthology.orchestra.run.smithi092.stdout:625 2023-08-26T09:27:38.814 INFO:teuthology.orchestra.run.smithi092.stdout:625.out 2023-08-26T09:27:38.814 INFO:teuthology.orchestra.run.smithi092.stdout:626 2023-08-26T09:27:38.814 INFO:teuthology.orchestra.run.smithi092.stdout:626.out 2023-08-26T09:27:38.814 INFO:teuthology.orchestra.run.smithi092.stdout:627 2023-08-26T09:27:38.814 INFO:teuthology.orchestra.run.smithi092.stdout:627.out 2023-08-26T09:27:38.815 INFO:teuthology.orchestra.run.smithi092.stdout:628 2023-08-26T09:27:38.815 INFO:teuthology.orchestra.run.smithi092.stdout:628.out 2023-08-26T09:27:38.815 INFO:teuthology.orchestra.run.smithi092.stdout:629 2023-08-26T09:27:38.815 INFO:teuthology.orchestra.run.smithi092.stdout:629.out 2023-08-26T09:27:38.815 INFO:teuthology.orchestra.run.smithi092.stdout:630 2023-08-26T09:27:38.815 INFO:teuthology.orchestra.run.smithi092.stdout:630.out 2023-08-26T09:27:38.816 INFO:teuthology.orchestra.run.smithi092.stdout:631 2023-08-26T09:27:38.816 INFO:teuthology.orchestra.run.smithi092.stdout:631.out 2023-08-26T09:27:38.816 INFO:teuthology.orchestra.run.smithi092.stdout:632 2023-08-26T09:27:38.816 INFO:teuthology.orchestra.run.smithi092.stdout:632.out 2023-08-26T09:27:38.816 INFO:teuthology.orchestra.run.smithi092.stdout:633 2023-08-26T09:27:38.817 INFO:teuthology.orchestra.run.smithi092.stdout:633.out 2023-08-26T09:27:38.817 INFO:teuthology.orchestra.run.smithi092.stdout:634 2023-08-26T09:27:38.817 INFO:teuthology.orchestra.run.smithi092.stdout:634.out 2023-08-26T09:27:38.817 INFO:teuthology.orchestra.run.smithi092.stdout:635 2023-08-26T09:27:38.817 INFO:teuthology.orchestra.run.smithi092.stdout:635.out 2023-08-26T09:27:38.817 INFO:teuthology.orchestra.run.smithi092.stdout:636 2023-08-26T09:27:38.818 INFO:teuthology.orchestra.run.smithi092.stdout:636.out 2023-08-26T09:27:38.818 INFO:teuthology.orchestra.run.smithi092.stdout:637 2023-08-26T09:27:38.818 INFO:teuthology.orchestra.run.smithi092.stdout:637.out 2023-08-26T09:27:38.818 INFO:teuthology.orchestra.run.smithi092.stdout:638 2023-08-26T09:27:38.818 INFO:teuthology.orchestra.run.smithi092.stdout:638.out 2023-08-26T09:27:38.819 INFO:teuthology.orchestra.run.smithi092.stdout:639 2023-08-26T09:27:38.819 INFO:teuthology.orchestra.run.smithi092.stdout:639.out 2023-08-26T09:27:38.819 INFO:teuthology.orchestra.run.smithi092.stdout:640 2023-08-26T09:27:38.819 INFO:teuthology.orchestra.run.smithi092.stdout:640.out 2023-08-26T09:27:38.819 INFO:teuthology.orchestra.run.smithi092.stdout:641 2023-08-26T09:27:38.820 INFO:teuthology.orchestra.run.smithi092.stdout:641.out 2023-08-26T09:27:38.820 INFO:teuthology.orchestra.run.smithi092.stdout:642 2023-08-26T09:27:38.820 INFO:teuthology.orchestra.run.smithi092.stdout:642.out 2023-08-26T09:27:38.820 INFO:teuthology.orchestra.run.smithi092.stdout:643 2023-08-26T09:27:38.820 INFO:teuthology.orchestra.run.smithi092.stdout:643.out 2023-08-26T09:27:38.820 INFO:teuthology.orchestra.run.smithi092.stdout:644 2023-08-26T09:27:38.821 INFO:teuthology.orchestra.run.smithi092.stdout:644.out 2023-08-26T09:27:38.821 INFO:teuthology.orchestra.run.smithi092.stdout:645 2023-08-26T09:27:38.821 INFO:teuthology.orchestra.run.smithi092.stdout:645.out 2023-08-26T09:27:38.821 INFO:teuthology.orchestra.run.smithi092.stdout:646 2023-08-26T09:27:38.821 INFO:teuthology.orchestra.run.smithi092.stdout:646.out 2023-08-26T09:27:38.822 INFO:teuthology.orchestra.run.smithi092.stdout:647 2023-08-26T09:27:38.822 INFO:teuthology.orchestra.run.smithi092.stdout:647.out 2023-08-26T09:27:38.822 INFO:teuthology.orchestra.run.smithi092.stdout:648 2023-08-26T09:27:38.822 INFO:teuthology.orchestra.run.smithi092.stdout:648.out 2023-08-26T09:27:38.822 INFO:teuthology.orchestra.run.smithi092.stdout:649 2023-08-26T09:27:38.823 INFO:teuthology.orchestra.run.smithi092.stdout:649.out 2023-08-26T09:27:38.823 INFO:teuthology.orchestra.run.smithi092.stdout:650 2023-08-26T09:27:38.823 INFO:teuthology.orchestra.run.smithi092.stdout:650.out 2023-08-26T09:27:38.823 INFO:teuthology.orchestra.run.smithi092.stdout:651 2023-08-26T09:27:38.823 INFO:teuthology.orchestra.run.smithi092.stdout:651.out 2023-08-26T09:27:38.824 INFO:teuthology.orchestra.run.smithi092.stdout:652 2023-08-26T09:27:38.824 INFO:teuthology.orchestra.run.smithi092.stdout:652.out 2023-08-26T09:27:38.824 INFO:teuthology.orchestra.run.smithi092.stdout:653 2023-08-26T09:27:38.824 INFO:teuthology.orchestra.run.smithi092.stdout:653.out 2023-08-26T09:27:38.824 INFO:teuthology.orchestra.run.smithi092.stdout:654 2023-08-26T09:27:38.825 INFO:teuthology.orchestra.run.smithi092.stdout:654.out 2023-08-26T09:27:38.825 INFO:teuthology.orchestra.run.smithi092.stdout:655 2023-08-26T09:27:38.825 INFO:teuthology.orchestra.run.smithi092.stdout:655.out 2023-08-26T09:27:38.825 INFO:teuthology.orchestra.run.smithi092.stdout:656 2023-08-26T09:27:38.825 INFO:teuthology.orchestra.run.smithi092.stdout:656.out 2023-08-26T09:27:38.825 INFO:teuthology.orchestra.run.smithi092.stdout:657 2023-08-26T09:27:38.826 INFO:teuthology.orchestra.run.smithi092.stdout:657.out 2023-08-26T09:27:38.826 INFO:teuthology.orchestra.run.smithi092.stdout:658 2023-08-26T09:27:38.826 INFO:teuthology.orchestra.run.smithi092.stdout:658.out 2023-08-26T09:27:38.826 INFO:teuthology.orchestra.run.smithi092.stdout:659 2023-08-26T09:27:38.826 INFO:teuthology.orchestra.run.smithi092.stdout:659.out 2023-08-26T09:27:38.827 INFO:teuthology.orchestra.run.smithi092.stdout:660 2023-08-26T09:27:38.827 INFO:teuthology.orchestra.run.smithi092.stdout:660.out 2023-08-26T09:27:38.827 INFO:teuthology.orchestra.run.smithi092.stdout:661 2023-08-26T09:27:38.827 INFO:teuthology.orchestra.run.smithi092.stdout:661.out 2023-08-26T09:27:38.827 INFO:teuthology.orchestra.run.smithi092.stdout:662 2023-08-26T09:27:38.827 INFO:teuthology.orchestra.run.smithi092.stdout:662.out 2023-08-26T09:27:38.828 INFO:teuthology.orchestra.run.smithi092.stdout:663 2023-08-26T09:27:38.828 INFO:teuthology.orchestra.run.smithi092.stdout:663.out 2023-08-26T09:27:38.828 INFO:teuthology.orchestra.run.smithi092.stdout:664 2023-08-26T09:27:38.828 INFO:teuthology.orchestra.run.smithi092.stdout:664.out 2023-08-26T09:27:38.828 INFO:teuthology.orchestra.run.smithi092.stdout:665 2023-08-26T09:27:38.829 INFO:teuthology.orchestra.run.smithi092.stdout:665.out 2023-08-26T09:27:38.829 INFO:teuthology.orchestra.run.smithi092.stdout:666 2023-08-26T09:27:38.829 INFO:teuthology.orchestra.run.smithi092.stdout:666.out 2023-08-26T09:27:38.829 INFO:teuthology.orchestra.run.smithi092.stdout:667 2023-08-26T09:27:38.829 INFO:teuthology.orchestra.run.smithi092.stdout:667.out 2023-08-26T09:27:38.830 INFO:teuthology.orchestra.run.smithi092.stdout:668 2023-08-26T09:27:38.830 INFO:teuthology.orchestra.run.smithi092.stdout:668.out 2023-08-26T09:27:38.830 INFO:teuthology.orchestra.run.smithi092.stdout:669 2023-08-26T09:27:38.830 INFO:teuthology.orchestra.run.smithi092.stdout:669.out 2023-08-26T09:27:38.830 INFO:teuthology.orchestra.run.smithi092.stdout:670 2023-08-26T09:27:38.830 INFO:teuthology.orchestra.run.smithi092.stdout:670.out 2023-08-26T09:27:38.831 INFO:teuthology.orchestra.run.smithi092.stdout:671 2023-08-26T09:27:38.831 INFO:teuthology.orchestra.run.smithi092.stdout:671.out 2023-08-26T09:27:38.831 INFO:teuthology.orchestra.run.smithi092.stdout:672 2023-08-26T09:27:38.831 INFO:teuthology.orchestra.run.smithi092.stdout:672.out 2023-08-26T09:27:38.831 INFO:teuthology.orchestra.run.smithi092.stdout:673 2023-08-26T09:27:38.832 INFO:teuthology.orchestra.run.smithi092.stdout:673.out 2023-08-26T09:27:38.832 INFO:teuthology.orchestra.run.smithi092.stdout:674 2023-08-26T09:27:38.832 INFO:teuthology.orchestra.run.smithi092.stdout:674.out 2023-08-26T09:27:38.832 INFO:teuthology.orchestra.run.smithi092.stdout:675 2023-08-26T09:27:38.832 INFO:teuthology.orchestra.run.smithi092.stdout:675.out 2023-08-26T09:27:38.833 INFO:teuthology.orchestra.run.smithi092.stdout:676 2023-08-26T09:27:38.833 INFO:teuthology.orchestra.run.smithi092.stdout:676.out 2023-08-26T09:27:38.833 INFO:teuthology.orchestra.run.smithi092.stdout:677 2023-08-26T09:27:38.833 INFO:teuthology.orchestra.run.smithi092.stdout:677.out 2023-08-26T09:27:38.833 INFO:teuthology.orchestra.run.smithi092.stdout:678 2023-08-26T09:27:38.834 INFO:teuthology.orchestra.run.smithi092.stdout:678.out 2023-08-26T09:27:38.834 INFO:teuthology.orchestra.run.smithi092.stdout:679 2023-08-26T09:27:38.834 INFO:teuthology.orchestra.run.smithi092.stdout:679.out 2023-08-26T09:27:38.834 INFO:teuthology.orchestra.run.smithi092.stdout:680 2023-08-26T09:27:38.834 INFO:teuthology.orchestra.run.smithi092.stdout:680.out 2023-08-26T09:27:38.835 INFO:teuthology.orchestra.run.smithi092.stdout:681 2023-08-26T09:27:38.835 INFO:teuthology.orchestra.run.smithi092.stdout:681.out 2023-08-26T09:27:38.835 INFO:teuthology.orchestra.run.smithi092.stdout:682 2023-08-26T09:27:38.835 INFO:teuthology.orchestra.run.smithi092.stdout:682.out 2023-08-26T09:27:38.835 INFO:teuthology.orchestra.run.smithi092.stdout:683 2023-08-26T09:27:38.836 INFO:teuthology.orchestra.run.smithi092.stdout:683.out 2023-08-26T09:27:38.836 INFO:teuthology.orchestra.run.smithi092.stdout:684 2023-08-26T09:27:38.836 INFO:teuthology.orchestra.run.smithi092.stdout:684.out 2023-08-26T09:27:38.836 INFO:teuthology.orchestra.run.smithi092.stdout:685 2023-08-26T09:27:38.836 INFO:teuthology.orchestra.run.smithi092.stdout:685.out 2023-08-26T09:27:38.837 INFO:teuthology.orchestra.run.smithi092.stdout:686 2023-08-26T09:27:38.837 INFO:teuthology.orchestra.run.smithi092.stdout:686.out 2023-08-26T09:27:38.837 INFO:teuthology.orchestra.run.smithi092.stdout:687 2023-08-26T09:27:38.837 INFO:teuthology.orchestra.run.smithi092.stdout:687.out 2023-08-26T09:27:38.837 INFO:teuthology.orchestra.run.smithi092.stdout:688 2023-08-26T09:27:38.838 INFO:teuthology.orchestra.run.smithi092.stdout:688.out 2023-08-26T09:27:38.838 INFO:teuthology.orchestra.run.smithi092.stdout:689 2023-08-26T09:27:38.838 INFO:teuthology.orchestra.run.smithi092.stdout:689.out 2023-08-26T09:27:38.838 INFO:teuthology.orchestra.run.smithi092.stdout:690 2023-08-26T09:27:38.838 INFO:teuthology.orchestra.run.smithi092.stdout:690.out 2023-08-26T09:27:38.838 INFO:teuthology.orchestra.run.smithi092.stdout:691 2023-08-26T09:27:38.839 INFO:teuthology.orchestra.run.smithi092.stdout:691.out 2023-08-26T09:27:38.839 INFO:teuthology.orchestra.run.smithi092.stdout:692 2023-08-26T09:27:38.839 INFO:teuthology.orchestra.run.smithi092.stdout:692.out 2023-08-26T09:27:38.839 INFO:teuthology.orchestra.run.smithi092.stdout:693 2023-08-26T09:27:38.839 INFO:teuthology.orchestra.run.smithi092.stdout:693.out 2023-08-26T09:27:38.840 INFO:teuthology.orchestra.run.smithi092.stdout:694 2023-08-26T09:27:38.840 INFO:teuthology.orchestra.run.smithi092.stdout:694.out 2023-08-26T09:27:38.840 INFO:teuthology.orchestra.run.smithi092.stdout:695 2023-08-26T09:27:38.840 INFO:teuthology.orchestra.run.smithi092.stdout:695.out 2023-08-26T09:27:38.840 INFO:teuthology.orchestra.run.smithi092.stdout:696 2023-08-26T09:27:38.841 INFO:teuthology.orchestra.run.smithi092.stdout:696.out 2023-08-26T09:27:38.841 INFO:teuthology.orchestra.run.smithi092.stdout:697 2023-08-26T09:27:38.841 INFO:teuthology.orchestra.run.smithi092.stdout:697.out 2023-08-26T09:27:38.841 INFO:teuthology.orchestra.run.smithi092.stdout:698 2023-08-26T09:27:38.841 INFO:teuthology.orchestra.run.smithi092.stdout:698.out 2023-08-26T09:27:38.841 INFO:teuthology.orchestra.run.smithi092.stdout:699 2023-08-26T09:27:38.842 INFO:teuthology.orchestra.run.smithi092.stdout:699.out 2023-08-26T09:27:38.842 INFO:teuthology.orchestra.run.smithi092.stdout:700 2023-08-26T09:27:38.842 INFO:teuthology.orchestra.run.smithi092.stdout:700.out 2023-08-26T09:27:38.842 INFO:teuthology.orchestra.run.smithi092.stdout:701 2023-08-26T09:27:38.842 INFO:teuthology.orchestra.run.smithi092.stdout:701.out 2023-08-26T09:27:38.843 INFO:teuthology.orchestra.run.smithi092.stdout:702 2023-08-26T09:27:38.843 INFO:teuthology.orchestra.run.smithi092.stdout:702.out 2023-08-26T09:27:38.843 INFO:teuthology.orchestra.run.smithi092.stdout:703 2023-08-26T09:27:38.843 INFO:teuthology.orchestra.run.smithi092.stdout:703.out 2023-08-26T09:27:38.843 INFO:teuthology.orchestra.run.smithi092.stdout:704 2023-08-26T09:27:38.843 INFO:teuthology.orchestra.run.smithi092.stdout:704.out 2023-08-26T09:27:38.844 INFO:teuthology.orchestra.run.smithi092.stdout:705 2023-08-26T09:27:38.844 INFO:teuthology.orchestra.run.smithi092.stdout:705.out 2023-08-26T09:27:38.844 INFO:teuthology.orchestra.run.smithi092.stdout:706 2023-08-26T09:27:38.844 INFO:teuthology.orchestra.run.smithi092.stdout:706.out 2023-08-26T09:27:38.844 INFO:teuthology.orchestra.run.smithi092.stdout:707 2023-08-26T09:27:38.845 INFO:teuthology.orchestra.run.smithi092.stdout:707.out 2023-08-26T09:27:38.845 INFO:teuthology.orchestra.run.smithi092.stdout:708 2023-08-26T09:27:38.845 INFO:teuthology.orchestra.run.smithi092.stdout:708.out 2023-08-26T09:27:38.845 INFO:teuthology.orchestra.run.smithi092.stdout:709 2023-08-26T09:27:38.845 INFO:teuthology.orchestra.run.smithi092.stdout:709.out 2023-08-26T09:27:38.845 INFO:teuthology.orchestra.run.smithi092.stdout:710 2023-08-26T09:27:38.846 INFO:teuthology.orchestra.run.smithi092.stdout:710.out 2023-08-26T09:27:38.846 INFO:teuthology.orchestra.run.smithi092.stdout:711 2023-08-26T09:27:38.846 INFO:teuthology.orchestra.run.smithi092.stdout:711.out 2023-08-26T09:27:38.846 INFO:teuthology.orchestra.run.smithi092.stdout:712 2023-08-26T09:27:38.846 INFO:teuthology.orchestra.run.smithi092.stdout:712.out 2023-08-26T09:27:38.847 INFO:teuthology.orchestra.run.smithi092.stdout:713 2023-08-26T09:27:38.847 INFO:teuthology.orchestra.run.smithi092.stdout:713.out 2023-08-26T09:27:38.847 INFO:teuthology.orchestra.run.smithi092.stdout:714 2023-08-26T09:27:38.847 INFO:teuthology.orchestra.run.smithi092.stdout:714.out 2023-08-26T09:27:38.847 INFO:teuthology.orchestra.run.smithi092.stdout:715 2023-08-26T09:27:38.847 INFO:teuthology.orchestra.run.smithi092.stdout:715.out 2023-08-26T09:27:38.848 INFO:teuthology.orchestra.run.smithi092.stdout:716 2023-08-26T09:27:38.848 INFO:teuthology.orchestra.run.smithi092.stdout:716.out 2023-08-26T09:27:38.848 INFO:teuthology.orchestra.run.smithi092.stdout:717 2023-08-26T09:27:38.848 INFO:teuthology.orchestra.run.smithi092.stdout:717.out 2023-08-26T09:27:38.848 INFO:teuthology.orchestra.run.smithi092.stdout:718 2023-08-26T09:27:38.849 INFO:teuthology.orchestra.run.smithi092.stdout:718.out 2023-08-26T09:27:38.849 INFO:teuthology.orchestra.run.smithi092.stdout:719 2023-08-26T09:27:38.849 INFO:teuthology.orchestra.run.smithi092.stdout:719.out 2023-08-26T09:27:38.849 INFO:teuthology.orchestra.run.smithi092.stdout:720 2023-08-26T09:27:38.849 INFO:teuthology.orchestra.run.smithi092.stdout:720.out 2023-08-26T09:27:38.849 INFO:teuthology.orchestra.run.smithi092.stdout:721 2023-08-26T09:27:38.850 INFO:teuthology.orchestra.run.smithi092.stdout:721.out 2023-08-26T09:27:38.850 INFO:teuthology.orchestra.run.smithi092.stdout:722 2023-08-26T09:27:38.850 INFO:teuthology.orchestra.run.smithi092.stdout:722.out 2023-08-26T09:27:38.850 INFO:teuthology.orchestra.run.smithi092.stdout:723 2023-08-26T09:27:38.850 INFO:teuthology.orchestra.run.smithi092.stdout:723.out 2023-08-26T09:27:38.851 INFO:teuthology.orchestra.run.smithi092.stdout:724 2023-08-26T09:27:38.851 INFO:teuthology.orchestra.run.smithi092.stdout:724.out 2023-08-26T09:27:38.851 INFO:teuthology.orchestra.run.smithi092.stdout:725 2023-08-26T09:27:38.851 INFO:teuthology.orchestra.run.smithi092.stdout:725.out 2023-08-26T09:27:38.851 INFO:teuthology.orchestra.run.smithi092.stdout:726 2023-08-26T09:27:38.851 INFO:teuthology.orchestra.run.smithi092.stdout:726.out 2023-08-26T09:27:38.852 INFO:teuthology.orchestra.run.smithi092.stdout:727 2023-08-26T09:27:38.852 INFO:teuthology.orchestra.run.smithi092.stdout:727.out 2023-08-26T09:27:38.852 INFO:teuthology.orchestra.run.smithi092.stdout:728 2023-08-26T09:27:38.852 INFO:teuthology.orchestra.run.smithi092.stdout:728.out 2023-08-26T09:27:38.852 INFO:teuthology.orchestra.run.smithi092.stdout:729 2023-08-26T09:27:38.853 INFO:teuthology.orchestra.run.smithi092.stdout:729.out 2023-08-26T09:27:38.853 INFO:teuthology.orchestra.run.smithi092.stdout:group.list 2023-08-26T09:27:38.853 INFO:teuthology.orchestra.run.smithi092.stdout:Makefile 2023-08-26T09:27:38.854 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-08-26T09:27:39.009 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:27:39.013 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:27:39.014 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:27:40.938 INFO:teuthology.orchestra.run.smithi092.stdout:generic/001 1s 2023-08-26T09:27:40.943 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/001 2023-08-26T09:27:40.943 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:27:40.945 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:27:40.953 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi092.stderr:ceph-fuse[120481]: fuse finished with error 0 and tester_r 0 2023-08-26T09:27:40.960 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:27:40.961 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-08-26T09:27:41.127 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:27:41.131 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:27:41.131 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:27:41.569 INFO:teuthology.orchestra.run.smithi092.stdout:generic/002 0s 2023-08-26T09:27:41.574 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/002 2023-08-26T09:27:41.574 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:27:41.576 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:27:41.595 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:27:41.596 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-08-26T09:27:41.801 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:27:41.805 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:27:41.806 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:27:41.924 INFO:teuthology.orchestra.run.smithi092.stdout:generic/003 [not run] this test requires a valid $SCRATCH_DEV 2023-08-26T09:27:41.927 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/003 2023-08-26T09:27:41.927 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/003 2023-08-26T09:27:41.928 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:27:41.929 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:27:41.954 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:27:41.955 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-08-26T09:27:42.117 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:27:42.121 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:27:42.122 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:27:42.248 INFO:teuthology.orchestra.run.smithi092.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-08-26T09:27:42.251 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/004 2023-08-26T09:27:42.251 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/004 2023-08-26T09:27:42.252 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:27:42.253 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:27:42.273 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:27:42.274 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-08-26T09:27:42.438 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:27:42.442 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:27:42.442 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:27:42.955 INFO:teuthology.orchestra.run.smithi092.stdout:generic/005 0s 2023-08-26T09:27:42.960 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/005 2023-08-26T09:27:42.961 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:27:42.962 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:27:42.982 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:27:42.982 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-08-26T09:27:43.176 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:27:43.180 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:27:43.181 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:27:49.144 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:27:49.148 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:28:18.157 INFO:teuthology.orchestra.run.smithi092.stdout:generic/006 35s 2023-08-26T09:28:18.161 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/006 2023-08-26T09:28:18.161 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:28:18.163 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:28:18.183 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:28:18.184 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-08-26T09:28:18.380 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:28:18.384 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:28:18.385 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:28:19.220 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:28:19.225 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:28:49.304 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:28:49.307 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:29:19.376 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:29:19.379 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:29:31.438 INFO:teuthology.orchestra.run.smithi092.stdout:generic/007 73s 2023-08-26T09:29:31.443 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/007 2023-08-26T09:29:31.443 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:29:31.445 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:29:31.469 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:29:31.470 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-08-26T09:29:31.670 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:29:31.674 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:29:31.674 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:29:32.628 INFO:teuthology.orchestra.run.smithi092.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-08-26T09:29:32.632 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/008 2023-08-26T09:29:32.632 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/008 2023-08-26T09:29:32.632 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:29:32.633 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:29:32.654 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:29:32.655 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-08-26T09:29:32.823 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:29:32.827 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:29:32.828 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:29:33.689 INFO:teuthology.orchestra.run.smithi092.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-08-26T09:29:33.693 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/009 2023-08-26T09:29:33.693 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/009 2023-08-26T09:29:33.693 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:29:33.695 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:29:33.715 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:29:33.715 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-08-26T09:29:33.878 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:29:33.882 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:29:33.882 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:29:34.005 INFO:teuthology.orchestra.run.smithi092.stdout:generic/010 [not run] /tmp/tmp.LDx1v48xscxfstests-dev/src/dbtest not built 2023-08-26T09:29:34.008 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/010 2023-08-26T09:29:34.008 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/010 2023-08-26T09:29:34.009 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:29:34.010 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:29:34.038 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:29:34.039 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-08-26T09:29:34.202 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:29:34.206 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:29:34.206 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:29:49.785 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:29:49.788 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:30:14.014 INFO:teuthology.orchestra.run.smithi092.stdout:generic/011 40s 2023-08-26T09:30:14.019 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/011 2023-08-26T09:30:14.019 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:30:14.021 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:30:14.039 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:30:14.039 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-08-26T09:30:14.240 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:30:14.245 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:30:14.245 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:30:15.191 INFO:teuthology.orchestra.run.smithi092.stdout:generic/012 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-08-26T09:30:15.195 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/012 2023-08-26T09:30:15.195 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/012 2023-08-26T09:30:15.195 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:30:15.197 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:30:15.222 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:30:15.223 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-08-26T09:30:15.421 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:30:15.425 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:30:15.425 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:30:19.857 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:30:19.860 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:30:50.178 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:30:50.186 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:31:20.512 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:31:20.514 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:31:50.636 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:31:50.639 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:32:02.644 INFO:teuthology.orchestra.run.smithi092.stdout:generic/013 107s 2023-08-26T09:32:02.719 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/013 2023-08-26T09:32:02.719 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:32:02.721 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:32:02.734 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:32:02.735 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-08-26T09:32:03.007 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:32:03.015 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:32:03.015 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:32:20.740 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:32:20.742 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:32:20.816 INFO:tasks.ceph.mds.a.smithi092.stderr:2023-08-26T09:32:20.814+0000 7fb212ed5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 166437) UID: 0 2023-08-26T09:32:20.817 INFO:tasks.ceph.mds.c.smithi092.stderr:2023-08-26T09:32:20.814+0000 7f7ff087b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 166437) UID: 0 2023-08-26T09:35:32.593 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:35:32.596 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:36:02.711 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:36:02.714 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:36:32.822 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:36:32.835 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:36:44.110 INFO:teuthology.orchestra.run.smithi092.stdout:generic/014 281s 2023-08-26T09:36:44.120 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/014 2023-08-26T09:36:44.121 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:36:44.123 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:36:44.145 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:36:44.146 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-08-26T09:36:44.442 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:36:44.447 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:36:44.447 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:36:44.666 INFO:teuthology.orchestra.run.smithi092.stdout:generic/015 [not run] this test requires a valid $SCRATCH_DEV 2023-08-26T09:36:44.670 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/015 2023-08-26T09:36:44.670 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/015 2023-08-26T09:36:44.670 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:36:44.672 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:36:44.692 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:36:44.692 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-08-26T09:36:44.975 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:36:44.986 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:36:44.986 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:36:46.700 INFO:teuthology.orchestra.run.smithi092.stdout:generic/016 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-08-26T09:36:46.704 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/016 2023-08-26T09:36:46.704 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/016 2023-08-26T09:36:46.704 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:36:46.706 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:36:46.732 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:36:46.733 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-08-26T09:36:47.333 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:36:47.344 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:36:47.344 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:36:47.538 INFO:teuthology.orchestra.run.smithi092.stdout:generic/017 [not run] this test requires a valid $SCRATCH_DEV 2023-08-26T09:36:47.541 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/017 2023-08-26T09:36:47.541 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/017 2023-08-26T09:36:47.541 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:36:47.543 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:36:47.568 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:36:47.569 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-08-26T09:36:47.872 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:36:47.877 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:36:47.878 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:36:48.072 INFO:teuthology.orchestra.run.smithi092.stdout:generic/018 [not run] this test requires a valid $SCRATCH_DEV 2023-08-26T09:36:48.081 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/018 2023-08-26T09:36:48.081 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/018 2023-08-26T09:36:48.081 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:36:48.083 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:36:48.105 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:36:48.106 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-08-26T09:36:48.392 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:36:48.398 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:36:48.399 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:36:48.617 INFO:teuthology.orchestra.run.smithi092.stdout:generic/019 [not run] this test requires a valid $SCRATCH_DEV 2023-08-26T09:36:48.621 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/019 2023-08-26T09:36:48.622 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/019 2023-08-26T09:36:48.622 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:36:48.624 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:36:48.646 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:36:48.647 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-08-26T09:36:48.941 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:36:48.955 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:36:48.955 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:37:00.822 INFO:teuthology.orchestra.run.smithi092.stdout:generic/020 - output mismatch (see /tmp/tmp.LDx1v48xscxfstests-dev/results//generic/020.out.bad) 2023-08-26T09:37:00.824 INFO:teuthology.orchestra.run.smithi092.stdout: --- tests/generic/020.out 2023-08-26 09:26:29.714654621 +0000 2023-08-26T09:37:00.824 INFO:teuthology.orchestra.run.smithi092.stdout: +++ /tmp/tmp.LDx1v48xscxfstests-dev/results//generic/020.out.bad 2023-08-26 09:37:00.820289059 +0000 2023-08-26T09:37:00.824 INFO:teuthology.orchestra.run.smithi092.stdout: @@ -47,9 +47,13 @@ 2023-08-26T09:37:00.825 INFO:teuthology.orchestra.run.smithi092.stdout: user.snrub="fish2\012" 2023-08-26T09:37:00.825 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:37:00.825 INFO:teuthology.orchestra.run.smithi092.stdout: *** really long value 2023-08-26T09:37:00.825 INFO:teuthology.orchestra.run.smithi092.stdout: -0000000 00 2023-08-26T09:37:00.826 INFO:teuthology.orchestra.run.smithi092.stdout: -* 2023-08-26T09:37:00.826 INFO:teuthology.orchestra.run.smithi092.stdout: -ATTRSIZE 2023-08-26T09:37:00.826 INFO:teuthology.orchestra.run.smithi092.stdout: +attr_set: No space left on device 2023-08-26T09:37:00.826 INFO:teuthology.orchestra.run.smithi092.stdout: +Could not set "long_attr" for 2023-08-26T09:37:00.827 INFO:teuthology.orchestra.run.smithi092.stdout: +attr_get: No data available 2023-08-26T09:37:00.827 INFO:teuthology.orchestra.run.smithi092.stdout: +Could not get "long_attr" for 2023-08-26T09:37:00.827 INFO:teuthology.orchestra.run.smithi092.stdout: +0000000 2023-08-26T09:37:00.827 INFO:teuthology.orchestra.run.smithi092.stdout: +attr_remove: No data available 2023-08-26T09:37:00.828 INFO:teuthology.orchestra.run.smithi092.stdout: +Could not remove "long_attr" for 2023-08-26T09:37:00.828 INFO:teuthology.orchestra.run.smithi092.stdout: *** set/get/remove really long names (expect failure) 2023-08-26T09:37:00.828 INFO:teuthology.orchestra.run.smithi092.stdout: attr_set: Invalid argument 2023-08-26T09:37:00.828 INFO:teuthology.orchestra.run.smithi092.stdout: Could not set "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2023-08-26T09:37:00.830 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/020 2023-08-26T09:37:00.830 INFO:teuthology.orchestra.run.smithi092.stdout:Failures: generic/020 2023-08-26T09:37:00.830 INFO:teuthology.orchestra.run.smithi092.stdout:Failed 1 of 1 tests 2023-08-26T09:37:00.831 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:37:00.852 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-26T09:37:00.853 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-08-26T09:37:00.853 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-08-26T09:37:00.853 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-08-26T09:37:01.467 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:37:01.475 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:37:01.475 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:37:02.938 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:37:02.941 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:37:03.280 INFO:teuthology.orchestra.run.smithi092.stdout:generic/021 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-08-26T09:37:03.285 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/021 2023-08-26T09:37:03.285 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/021 2023-08-26T09:37:03.285 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:37:03.287 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:37:03.314 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:37:03.315 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-08-26T09:37:03.902 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:37:03.916 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:37:03.917 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:37:05.697 INFO:teuthology.orchestra.run.smithi092.stdout:generic/022 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-08-26T09:37:05.701 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/022 2023-08-26T09:37:05.701 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/022 2023-08-26T09:37:05.701 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:37:05.704 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:37:05.730 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:37:05.731 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-08-26T09:37:06.304 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:37:06.312 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:37:06.312 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:37:33.049 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:37:33.052 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:38:03.131 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:38:03.135 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:38:23.727 INFO:teuthology.orchestra.run.smithi092.stdout:generic/023 77s 2023-08-26T09:38:23.732 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/023 2023-08-26T09:38:23.733 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:38:23.735 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:23.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:38:23.783 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-08-26T09:38:24.218 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:38:24.222 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:38:24.222 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:24.365 INFO:teuthology.orchestra.run.smithi092.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-08-26T09:38:24.369 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/024 2023-08-26T09:38:24.369 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/024 2023-08-26T09:38:24.370 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:38:24.371 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:24.435 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:38:24.435 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-08-26T09:38:24.853 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:38:24.859 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:38:24.859 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:25.009 INFO:teuthology.orchestra.run.smithi092.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-08-26T09:38:25.012 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/025 2023-08-26T09:38:25.013 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/025 2023-08-26T09:38:25.013 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:38:25.014 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:25.058 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:38:25.059 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-08-26T09:38:25.517 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:38:25.521 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:38:25.521 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:25.689 INFO:teuthology.orchestra.run.smithi092.stdout:generic/026 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-08-26T09:38:25.693 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/026 2023-08-26T09:38:25.693 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/026 2023-08-26T09:38:25.693 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:38:25.696 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:25.717 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:38:25.717 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-08-26T09:38:25.880 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:38:25.884 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:38:25.885 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:26.008 INFO:teuthology.orchestra.run.smithi092.stdout:generic/027 [not run] this test requires a valid $SCRATCH_DEV 2023-08-26T09:38:26.009 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/027 2023-08-26T09:38:26.009 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/027 2023-08-26T09:38:26.009 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:38:26.009 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:26.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:38:26.025 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-08-26T09:38:26.187 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:38:26.196 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:38:26.197 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:31.326 INFO:teuthology.orchestra.run.smithi092.stdout:generic/028 5s 2023-08-26T09:38:31.331 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/028 2023-08-26T09:38:31.331 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:38:31.339 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:31.353 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:38:31.353 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-08-26T09:38:31.519 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:38:31.523 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:38:31.523 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:31.648 INFO:teuthology.orchestra.run.smithi092.stdout:generic/029 [not run] this test requires a valid $SCRATCH_DEV 2023-08-26T09:38:31.652 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/029 2023-08-26T09:38:31.652 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/029 2023-08-26T09:38:31.652 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:38:31.653 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:31.679 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:38:31.680 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-08-26T09:38:31.842 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:38:31.847 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:38:31.847 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:31.963 INFO:teuthology.orchestra.run.smithi092.stdout:generic/030 [not run] this test requires a valid $SCRATCH_DEV 2023-08-26T09:38:31.966 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/030 2023-08-26T09:38:31.967 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/030 2023-08-26T09:38:31.967 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:38:31.969 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:31.986 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:38:31.987 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-08-26T09:38:32.156 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:38:32.160 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:38:32.160 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:32.282 INFO:teuthology.orchestra.run.smithi092.stdout:generic/031 [not run] this test requires a valid $SCRATCH_DEV 2023-08-26T09:38:32.286 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/031 2023-08-26T09:38:32.286 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/031 2023-08-26T09:38:32.286 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:38:32.288 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:32.312 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:38:32.313 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-08-26T09:38:32.476 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:38:32.481 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:38:32.481 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:32.597 INFO:teuthology.orchestra.run.smithi092.stdout:generic/032 [not run] this test requires a valid $SCRATCH_DEV 2023-08-26T09:38:32.601 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/032 2023-08-26T09:38:32.602 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/032 2023-08-26T09:38:32.602 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:38:32.603 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:32.626 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:38:32.626 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-08-26T09:38:32.788 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:38:32.793 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:38:32.793 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:32.910 INFO:teuthology.orchestra.run.smithi092.stdout:generic/033 [not run] this test requires a valid $SCRATCH_DEV 2023-08-26T09:38:32.913 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/033 2023-08-26T09:38:32.914 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/033 2023-08-26T09:38:32.914 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:38:32.915 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:32.934 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:38:32.935 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-08-26T09:38:33.097 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:38:33.102 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:38:33.102 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:33.196 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:38:33.200 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:38:33.234 INFO:teuthology.orchestra.run.smithi092.stdout:generic/034 [not run] this test requires a valid $SCRATCH_DEV 2023-08-26T09:38:33.237 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/034 2023-08-26T09:38:33.238 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/034 2023-08-26T09:38:33.238 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:38:33.239 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:33.260 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:38:33.261 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-08-26T09:38:33.473 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:38:33.475 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:38:33.475 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:33.661 INFO:teuthology.orchestra.run.smithi092.stdout:generic/035 0s 2023-08-26T09:38:33.666 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/035 2023-08-26T09:38:33.666 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:38:33.668 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:33.931 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:38:33.932 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-08-26T09:38:34.146 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:38:34.150 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:38:34.150 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:44.394 INFO:teuthology.orchestra.run.smithi092.stdout:generic/036 10s 2023-08-26T09:38:44.399 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/036 2023-08-26T09:38:44.399 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:38:44.401 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:44.424 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:38:44.425 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-08-26T09:38:44.882 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:38:44.886 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:38:44.886 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:45.004 INFO:teuthology.orchestra.run.smithi092.stdout:generic/037 [not run] this test requires a valid $SCRATCH_DEV 2023-08-26T09:38:45.008 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/037 2023-08-26T09:38:45.008 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/037 2023-08-26T09:38:45.009 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:38:45.010 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:45.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:38:45.025 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-08-26T09:38:45.189 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:38:45.192 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:38:45.193 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:45.311 INFO:teuthology.orchestra.run.smithi092.stdout:generic/038 [not run] this test requires a valid $SCRATCH_DEV 2023-08-26T09:38:45.314 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/038 2023-08-26T09:38:45.315 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/038 2023-08-26T09:38:45.315 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:38:45.316 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:45.337 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:38:45.338 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-08-26T09:38:45.502 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:38:45.506 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:38:45.506 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:45.640 INFO:teuthology.orchestra.run.smithi092.stdout:generic/039 [not run] this test requires a valid $SCRATCH_DEV 2023-08-26T09:38:45.644 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/039 2023-08-26T09:38:45.644 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/039 2023-08-26T09:38:45.644 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:38:45.646 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:45.662 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:38:45.663 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-08-26T09:38:45.827 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:38:45.832 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:38:45.832 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:45.970 INFO:teuthology.orchestra.run.smithi092.stdout:generic/040 [not run] this test requires a valid $SCRATCH_DEV 2023-08-26T09:38:45.973 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/040 2023-08-26T09:38:45.974 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/040 2023-08-26T09:38:45.974 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:38:45.976 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:45.992 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:38:45.992 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-08-26T09:38:46.156 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:38:46.160 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:38:46.160 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:46.295 INFO:teuthology.orchestra.run.smithi092.stdout:generic/041 [not run] this test requires a valid $SCRATCH_DEV 2023-08-26T09:38:46.299 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/041 2023-08-26T09:38:46.299 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/041 2023-08-26T09:38:46.299 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:38:46.301 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:46.323 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:38:46.323 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-08-26T09:38:46.485 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:38:46.489 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:38:46.489 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:46.616 INFO:teuthology.orchestra.run.smithi092.stdout:generic/042 [not run] this test requires a valid $SCRATCH_DEV 2023-08-26T09:38:46.619 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/042 2023-08-26T09:38:46.620 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/042 2023-08-26T09:38:46.620 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:38:46.622 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:46.652 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:38:46.652 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-08-26T09:38:46.817 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:38:46.822 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:38:46.822 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:46.942 INFO:teuthology.orchestra.run.smithi092.stdout:generic/043 [not run] this test requires a valid $SCRATCH_DEV 2023-08-26T09:38:46.945 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/043 2023-08-26T09:38:46.946 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/043 2023-08-26T09:38:46.946 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:38:46.947 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:46.970 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:38:46.970 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-08-26T09:38:47.133 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:38:47.138 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:38:47.138 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:47.257 INFO:teuthology.orchestra.run.smithi092.stdout:generic/044 [not run] this test requires a valid $SCRATCH_DEV 2023-08-26T09:38:47.261 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/044 2023-08-26T09:38:47.261 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/044 2023-08-26T09:38:47.261 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:38:47.263 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:47.287 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:38:47.287 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-08-26T09:38:47.450 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:38:47.454 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:38:47.454 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:47.577 INFO:teuthology.orchestra.run.smithi092.stdout:generic/045 [not run] this test requires a valid $SCRATCH_DEV 2023-08-26T09:38:47.579 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/045 2023-08-26T09:38:47.580 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/045 2023-08-26T09:38:47.580 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:38:47.581 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:47.603 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:38:47.604 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-08-26T09:38:47.768 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:38:47.772 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:38:47.772 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:47.888 INFO:teuthology.orchestra.run.smithi092.stdout:generic/046 [not run] this test requires a valid $SCRATCH_DEV 2023-08-26T09:38:47.892 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/046 2023-08-26T09:38:47.892 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/046 2023-08-26T09:38:47.892 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:38:47.894 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:47.920 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:38:47.921 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-08-26T09:38:48.086 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:38:48.090 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:38:48.090 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:48.207 INFO:teuthology.orchestra.run.smithi092.stdout:generic/047 [not run] this test requires a valid $SCRATCH_DEV 2023-08-26T09:38:48.210 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/047 2023-08-26T09:38:48.210 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/047 2023-08-26T09:38:48.210 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:38:48.212 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:48.235 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:38:48.236 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-08-26T09:38:48.398 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:38:48.403 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:38:48.403 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:48.519 INFO:teuthology.orchestra.run.smithi092.stdout:generic/048 [not run] this test requires a valid $SCRATCH_DEV 2023-08-26T09:38:48.523 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/048 2023-08-26T09:38:48.523 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/048 2023-08-26T09:38:48.523 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:38:48.525 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:48.548 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:38:48.548 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-08-26T09:38:48.712 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:38:48.715 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:38:48.716 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:48.835 INFO:teuthology.orchestra.run.smithi092.stdout:generic/049 [not run] this test requires a valid $SCRATCH_DEV 2023-08-26T09:38:48.837 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/049 2023-08-26T09:38:48.837 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/049 2023-08-26T09:38:48.837 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:38:48.839 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:48.870 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:38:48.871 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-08-26T09:38:49.033 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:38:49.037 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:38:49.038 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:49.170 INFO:teuthology.orchestra.run.smithi092.stdout:generic/050 [not run] this test requires a valid $SCRATCH_DEV 2023-08-26T09:38:49.174 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/050 2023-08-26T09:38:49.174 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/050 2023-08-26T09:38:49.174 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:38:49.176 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:49.203 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:38:49.204 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-08-26T09:38:49.365 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:38:49.369 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:38:49.369 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:49.499 INFO:teuthology.orchestra.run.smithi092.stdout:generic/051 [not run] this test requires a valid $SCRATCH_DEV 2023-08-26T09:38:49.499 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/051 2023-08-26T09:38:49.500 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/051 2023-08-26T09:38:49.500 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:38:49.500 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:49.514 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:38:49.514 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-08-26T09:38:49.681 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:38:49.685 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:38:49.686 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:49.806 INFO:teuthology.orchestra.run.smithi092.stdout:generic/052 [not run] this test requires a valid $SCRATCH_DEV 2023-08-26T09:38:49.811 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/052 2023-08-26T09:38:49.812 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/052 2023-08-26T09:38:49.812 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:38:49.813 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:49.833 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:38:49.834 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-08-26T09:38:49.999 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:38:50.004 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:38:50.004 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:50.126 INFO:teuthology.orchestra.run.smithi092.stdout:generic/053 [not run] this test requires a valid $SCRATCH_DEV 2023-08-26T09:38:50.130 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/053 2023-08-26T09:38:50.130 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/053 2023-08-26T09:38:50.130 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:38:50.132 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:50.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:38:50.150 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-08-26T09:38:50.312 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:38:50.317 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:38:50.317 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:50.437 INFO:teuthology.orchestra.run.smithi092.stdout:generic/054 [not run] this test requires a valid $SCRATCH_DEV 2023-08-26T09:38:50.440 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/054 2023-08-26T09:38:50.441 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/054 2023-08-26T09:38:50.441 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:38:50.442 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:50.462 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:38:50.464 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-08-26T09:38:50.628 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:38:50.632 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:38:50.632 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:50.755 INFO:teuthology.orchestra.run.smithi092.stdout:generic/055 [not run] this test requires a valid $SCRATCH_DEV 2023-08-26T09:38:50.759 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/055 2023-08-26T09:38:50.759 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/055 2023-08-26T09:38:50.759 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:38:50.761 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:50.784 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:38:50.784 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-08-26T09:38:50.949 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:38:50.953 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:38:50.953 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:51.089 INFO:teuthology.orchestra.run.smithi092.stdout:generic/056 [not run] this test requires a valid $SCRATCH_DEV 2023-08-26T09:38:51.093 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/056 2023-08-26T09:38:51.093 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/056 2023-08-26T09:38:51.093 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:38:51.095 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:51.114 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:38:51.115 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-08-26T09:38:51.279 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:38:51.283 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:38:51.283 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:51.416 INFO:teuthology.orchestra.run.smithi092.stdout:generic/057 [not run] this test requires a valid $SCRATCH_DEV 2023-08-26T09:38:51.419 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/057 2023-08-26T09:38:51.419 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/057 2023-08-26T09:38:51.419 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:38:51.421 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:51.440 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:38:51.440 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-08-26T09:38:51.605 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:38:51.609 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:38:51.609 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:52.517 INFO:teuthology.orchestra.run.smithi092.stdout:generic/058 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-08-26T09:38:52.521 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/058 2023-08-26T09:38:52.521 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/058 2023-08-26T09:38:52.521 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:38:52.524 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:52.542 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:38:52.543 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-08-26T09:38:52.997 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:38:53.002 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:38:53.003 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:53.140 INFO:teuthology.orchestra.run.smithi092.stdout:generic/059 [not run] this test requires a valid $SCRATCH_DEV 2023-08-26T09:38:53.143 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/059 2023-08-26T09:38:53.143 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/059 2023-08-26T09:38:53.143 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:38:53.145 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:53.174 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:38:53.174 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-08-26T09:38:53.341 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:38:53.345 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:38:53.345 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:54.257 INFO:teuthology.orchestra.run.smithi092.stdout:generic/060 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-08-26T09:38:54.261 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/060 2023-08-26T09:38:54.261 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/060 2023-08-26T09:38:54.261 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:38:54.263 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:54.286 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:38:54.287 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-08-26T09:38:54.739 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:38:54.743 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:38:54.744 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:55.648 INFO:teuthology.orchestra.run.smithi092.stdout:generic/061 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-08-26T09:38:55.652 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/061 2023-08-26T09:38:55.652 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/061 2023-08-26T09:38:55.652 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:38:55.653 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:55.678 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:38:55.678 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-08-26T09:38:56.139 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:38:56.143 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:38:56.143 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:56.263 INFO:teuthology.orchestra.run.smithi092.stdout:generic/062 [not run] this test requires a valid $SCRATCH_DEV 2023-08-26T09:38:56.265 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/062 2023-08-26T09:38:56.266 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/062 2023-08-26T09:38:56.266 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:38:56.268 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:56.294 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:38:56.294 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-08-26T09:38:56.460 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:38:56.464 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:38:56.464 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:57.372 INFO:teuthology.orchestra.run.smithi092.stdout:generic/063 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-08-26T09:38:57.376 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/063 2023-08-26T09:38:57.376 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/063 2023-08-26T09:38:57.376 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:38:57.378 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:57.400 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:38:57.401 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-08-26T09:38:57.857 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:38:57.862 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:38:57.862 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:57.982 INFO:teuthology.orchestra.run.smithi092.stdout:generic/064 [not run] this test requires a valid $SCRATCH_DEV 2023-08-26T09:38:57.986 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/064 2023-08-26T09:38:57.986 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/064 2023-08-26T09:38:57.986 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:38:57.988 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:58.006 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:38:58.006 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-08-26T09:38:58.167 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:38:58.171 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:38:58.171 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:58.304 INFO:teuthology.orchestra.run.smithi092.stdout:generic/065 [not run] this test requires a valid $SCRATCH_DEV 2023-08-26T09:38:58.308 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/065 2023-08-26T09:38:58.308 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/065 2023-08-26T09:38:58.308 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:38:58.310 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:58.332 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:38:58.332 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-08-26T09:38:58.496 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:38:58.501 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:38:58.501 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:58.638 INFO:teuthology.orchestra.run.smithi092.stdout:generic/066 [not run] this test requires a valid $SCRATCH_DEV 2023-08-26T09:38:58.642 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/066 2023-08-26T09:38:58.642 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/066 2023-08-26T09:38:58.642 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:38:58.644 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:58.671 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:38:58.672 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-08-26T09:38:58.834 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:38:58.838 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:38:58.838 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:58.985 INFO:teuthology.orchestra.run.smithi092.stdout:generic/067 [not run] this test requires a valid $SCRATCH_DEV 2023-08-26T09:38:58.988 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/067 2023-08-26T09:38:58.989 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/067 2023-08-26T09:38:58.989 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:38:58.991 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:59.016 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:38:59.017 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-08-26T09:38:59.180 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:38:59.184 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:38:59.184 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:59.322 INFO:teuthology.orchestra.run.smithi092.stdout:generic/068 [not run] this test requires a valid $SCRATCH_DEV 2023-08-26T09:38:59.327 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/068 2023-08-26T09:38:59.327 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/068 2023-08-26T09:38:59.327 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:38:59.328 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:59.346 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:38:59.346 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-08-26T09:38:59.508 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:38:59.513 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:38:59.513 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:59.630 INFO:teuthology.orchestra.run.smithi092.stdout:generic/069 [not run] this test requires a valid $SCRATCH_DEV 2023-08-26T09:38:59.634 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/069 2023-08-26T09:38:59.634 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/069 2023-08-26T09:38:59.634 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:38:59.636 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:38:59.655 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:38:59.655 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-08-26T09:38:59.818 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:38:59.822 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:38:59.822 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:39:03.268 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:39:03.271 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:39:33.328 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:39:33.331 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:40:02.060 INFO:teuthology.orchestra.run.smithi092.stdout:generic/070 63s 2023-08-26T09:40:02.065 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/070 2023-08-26T09:40:02.065 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:40:02.067 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:40:02.088 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:40:02.089 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-08-26T09:40:02.678 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:40:02.685 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:40:02.685 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:40:02.869 INFO:teuthology.orchestra.run.smithi092.stdout:generic/071 [not run] this test requires a valid $SCRATCH_DEV 2023-08-26T09:40:02.873 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/071 2023-08-26T09:40:02.873 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/071 2023-08-26T09:40:02.873 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:40:02.875 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:40:02.898 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:40:02.898 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-08-26T09:40:03.199 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:40:03.212 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:40:03.213 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:40:03.422 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:40:03.424 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:40:04.923 INFO:teuthology.orchestra.run.smithi092.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-08-26T09:40:04.927 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/072 2023-08-26T09:40:04.927 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/072 2023-08-26T09:40:04.927 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:40:04.929 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:40:04.950 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:40:04.950 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-08-26T09:40:05.213 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:40:05.218 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:40:05.218 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:40:05.416 INFO:teuthology.orchestra.run.smithi092.stdout:generic/073 [not run] this test requires a valid $SCRATCH_DEV 2023-08-26T09:40:05.420 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/073 2023-08-26T09:40:05.420 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/073 2023-08-26T09:40:05.421 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T09:40:05.422 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:40:05.441 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T09:40:05.442 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-08-26T09:40:05.713 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T09:40:05.717 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T09:40:05.718 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T09:40:33.516 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:40:33.522 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:41:03.855 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:41:03.857 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:41:34.466 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:41:34.471 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:42:04.561 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:42:04.565 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:42:34.683 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:42:34.687 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:43:04.812 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:43:04.814 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:43:35.100 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:43:35.104 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:44:05.713 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:44:05.716 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:44:35.803 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:44:35.806 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:45:05.872 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:45:05.881 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:45:36.067 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:45:36.069 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:46:06.336 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:46:06.340 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:46:36.434 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:46:36.441 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:47:06.630 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:47:06.633 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:47:36.782 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:47:36.785 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:48:06.975 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:48:06.977 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:48:37.050 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:48:37.052 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:49:07.114 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:49:07.124 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:49:37.233 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:49:37.241 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:50:07.370 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:50:07.379 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:50:37.493 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:50:37.511 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:51:07.620 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:51:07.631 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:51:37.774 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:51:37.777 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:51:44.473 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-08-26T09:51:44.472+0000 7f098cc42700 -1 bdev(0x55b3c43e8000 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2023-08-26T09:51:44.474 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-08-26T09:51:44.472+0000 7f0988c3a700 -1 bdev(0x55b3c43e8000 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2023-08-26T09:51:44.474 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-08-26T09:51:44.472+0000 7f098c441700 -1 bdev(0x55b3c43e8000 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2023-08-26T09:51:45.440 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-08-26T09:51:45.438+0000 7f0988c3a700 -1 bdev(0x55b3c43e8000 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2023-08-26T09:51:45.440 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-08-26T09:51:45.439+0000 7f0988439700 -1 bdev(0x55b3c43e8000 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2023-08-26T09:52:08.454 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:52:08.714 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:52:38.983 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:52:38.985 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:53:09.240 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:53:09.242 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:53:39.369 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:53:39.373 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:54:09.643 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:54:09.645 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:54:39.743 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:54:39.746 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:54:52.687 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-08-26T09:54:52.684+0000 7f0988c3a700 -1 bdev(0x55b3c43e8000 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2023-08-26T09:55:10.038 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:55:10.040 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:55:40.234 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:55:40.242 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:56:11.253 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:56:11.256 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:56:41.649 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:56:41.651 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:57:11.791 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:57:11.793 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:57:42.223 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:57:42.226 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:58:12.331 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:58:12.342 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:58:42.490 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:58:42.496 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:59:12.605 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:59:12.608 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:59:42.723 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T09:59:42.736 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:00:13.164 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:00:13.186 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:00:43.340 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:00:43.342 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:00:44.527 INFO:tasks.ceph.osd.3.smithi092.stderr:2023-08-26T10:00:44.526+0000 7f1d4043d700 -1 bdev(0x563709cac000 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2023-08-26T10:01:13.543 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:01:13.549 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:01:43.710 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:01:43.712 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:02:13.826 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:02:13.829 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:02:43.947 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:02:43.950 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:03:14.300 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:03:14.305 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:03:44.381 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:03:44.383 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:03:44.478 INFO:tasks.ceph.osd.1.smithi092.stderr:2023-08-26T10:03:44.477+0000 7f66830ce700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 198958) UID: 0 2023-08-26T10:03:44.478 INFO:tasks.ceph.osd.3.smithi092.stderr:2023-08-26T10:03:44.478+0000 7f1d5f090700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 198958) UID: 0 2023-08-26T10:03:44.480 INFO:tasks.ceph.osd.2.smithi092.stderr:2023-08-26T10:03:44.479+0000 7f896b89e700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 198958) UID: 0 2023-08-26T10:03:44.482 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-08-26T10:03:44.482+0000 7f09a808e700 -1 Fail to open '/proc/198958/cmdline' error = (2) No such file or directory 2023-08-26T10:03:44.482 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-08-26T10:03:44.482+0000 7f09a808e700 -1 received signal: Hangup from (PID: 198958) UID: 0 2023-08-26T10:05:53.410 INFO:tasks.ceph.osd.3.smithi092.stderr:2023-08-26T10:05:53.409+0000 7f1d3dc38700 -1 bdev(0x563709cac000 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2023-08-26T10:06:44.259 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:06:44.262 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:06:44.385 INFO:tasks.ceph.osd.3.smithi092.stderr:2023-08-26T10:06:44.386+0000 7f1d5f090700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 199274) UID: 0 2023-08-26T10:06:44.386 INFO:tasks.ceph.osd.2.smithi092.stderr:2023-08-26T10:06:44.386+0000 7f896b89e700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 199274) UID: 0 2023-08-26T10:06:44.387 INFO:tasks.ceph.osd.1.smithi092.stderr:2023-08-26T10:06:44.387+0000 7f66830ce700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 199274) UID: 0 2023-08-26T10:06:44.390 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-08-26T10:06:44.386+0000 7f09a808e700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 199274) UID: 0 2023-08-26T10:06:44.420 INFO:tasks.ceph.osd.5.smithi188.stderr:2023-08-26T10:06:44.420+0000 7f5b28c42700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 113048) UID: 0 2023-08-26T10:06:44.421 INFO:tasks.ceph.osd.7.smithi188.stderr:2023-08-26T10:06:44.420+0000 7f9e78279700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 113048) UID: 0 2023-08-26T10:06:44.422 INFO:tasks.ceph.osd.4.smithi188.stderr:2023-08-26T10:06:44.421+0000 7f1e0e376700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 113048) UID: 0 2023-08-26T10:06:44.422 INFO:tasks.ceph.osd.6.smithi188.stderr:2023-08-26T10:06:44.421+0000 7f13bbf05700 -1 Fail to open '/proc/113048/cmdline' error = (2) No such file or directory 2023-08-26T10:06:44.422 INFO:tasks.ceph.osd.6.smithi188.stderr:2023-08-26T10:06:44.421+0000 7f13bbf05700 -1 received signal: Hangup from (PID: 113048) UID: 0 2023-08-26T10:09:35.073 INFO:teuthology.orchestra.run.smithi092.stdout:generic/074 1770s 2023-08-26T10:09:35.086 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/074 2023-08-26T10:09:35.086 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T10:09:35.097 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T10:09:35.126 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T10:09:35.126 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-08-26T10:09:35.840 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T10:09:35.844 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T10:09:35.845 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T10:09:47.047 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:09:47.050 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:10:15.122 INFO:teuthology.orchestra.run.smithi092.stdout:generic/075 40s 2023-08-26T10:10:15.175 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/075 2023-08-26T10:10:15.175 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T10:10:15.177 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T10:10:15.198 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T10:10:15.199 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-08-26T10:10:15.693 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T10:10:15.697 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T10:10:15.697 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T10:10:15.816 INFO:teuthology.orchestra.run.smithi092.stdout:generic/076 [not run] this test requires a valid $SCRATCH_DEV 2023-08-26T10:10:15.819 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/076 2023-08-26T10:10:15.820 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/076 2023-08-26T10:10:15.820 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T10:10:15.821 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T10:10:15.841 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T10:10:15.842 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-08-26T10:10:16.005 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T10:10:16.010 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T10:10:16.010 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T10:10:17.445 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:10:17.448 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:10:18.856 INFO:teuthology.orchestra.run.smithi092.stdout:generic/077 [not run] this test requires a valid $SCRATCH_DEV 2023-08-26T10:10:18.859 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/077 2023-08-26T10:10:18.860 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/077 2023-08-26T10:10:18.860 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T10:10:18.861 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T10:10:18.878 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T10:10:18.878 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-08-26T10:10:19.045 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T10:10:19.049 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T10:10:19.050 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T10:10:19.194 INFO:teuthology.orchestra.run.smithi092.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-08-26T10:10:19.198 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/078 2023-08-26T10:10:19.198 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/078 2023-08-26T10:10:19.199 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T10:10:19.200 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T10:10:19.221 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T10:10:19.222 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-08-26T10:10:19.703 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T10:10:19.708 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T10:10:19.708 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T10:10:19.890 INFO:teuthology.orchestra.run.smithi092.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-08-26T10:10:19.894 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/079 2023-08-26T10:10:19.894 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/079 2023-08-26T10:10:19.894 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T10:10:19.896 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T10:10:19.918 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T10:10:19.920 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-08-26T10:10:20.089 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T10:10:20.093 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T10:10:20.093 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T10:10:22.268 INFO:teuthology.orchestra.run.smithi092.stdout:generic/080 2s 2023-08-26T10:10:22.272 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/080 2023-08-26T10:10:22.272 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T10:10:22.275 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T10:10:22.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T10:10:22.298 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-08-26T10:10:22.476 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T10:10:22.480 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T10:10:22.480 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T10:10:22.605 INFO:teuthology.orchestra.run.smithi092.stdout:generic/081 [not run] this test requires a valid $SCRATCH_DEV 2023-08-26T10:10:22.609 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/081 2023-08-26T10:10:22.609 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/081 2023-08-26T10:10:22.609 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T10:10:22.611 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T10:10:22.628 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T10:10:22.629 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-08-26T10:10:22.796 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T10:10:22.800 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T10:10:22.801 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T10:10:22.925 INFO:teuthology.orchestra.run.smithi092.stdout:generic/082 [not run] this test requires a valid $SCRATCH_DEV 2023-08-26T10:10:22.928 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/082 2023-08-26T10:10:22.928 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/082 2023-08-26T10:10:22.929 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T10:10:22.930 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T10:10:22.951 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T10:10:22.952 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-08-26T10:10:23.115 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T10:10:23.120 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T10:10:23.120 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T10:10:23.239 INFO:teuthology.orchestra.run.smithi092.stdout:generic/083 [not run] this test requires a valid $SCRATCH_DEV 2023-08-26T10:10:23.243 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/083 2023-08-26T10:10:23.244 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/083 2023-08-26T10:10:23.244 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T10:10:23.245 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T10:10:23.259 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T10:10:23.260 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-08-26T10:10:23.422 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T10:10:23.426 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T10:10:23.427 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T10:10:23.548 INFO:teuthology.orchestra.run.smithi092.stdout:generic/084 [not run] this test requires a valid $SCRATCH_DEV 2023-08-26T10:10:23.552 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/084 2023-08-26T10:10:23.552 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/084 2023-08-26T10:10:23.552 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T10:10:23.554 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T10:10:23.581 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T10:10:23.582 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-08-26T10:10:23.745 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T10:10:23.750 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T10:10:23.750 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T10:10:23.904 INFO:teuthology.orchestra.run.smithi092.stdout:generic/085 [not run] this test requires a valid $SCRATCH_DEV 2023-08-26T10:10:23.908 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/085 2023-08-26T10:10:23.908 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/085 2023-08-26T10:10:23.908 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T10:10:23.909 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T10:10:23.928 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T10:10:23.928 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-08-26T10:10:24.090 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T10:10:24.095 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T10:10:24.095 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T10:10:27.521 INFO:teuthology.orchestra.run.smithi092.stdout:generic/086 3s 2023-08-26T10:10:27.544 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/086 2023-08-26T10:10:27.545 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T10:10:27.546 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T10:10:27.633 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T10:10:27.634 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-08-26T10:10:28.691 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T10:10:28.695 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T10:10:28.695 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T10:10:29.000 INFO:teuthology.orchestra.run.smithi092.stdout:generic/087 0s 2023-08-26T10:10:29.005 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/087 2023-08-26T10:10:29.005 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T10:10:29.007 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T10:10:29.030 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T10:10:29.031 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-08-26T10:10:29.521 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T10:10:29.525 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T10:10:29.525 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T10:10:29.693 INFO:teuthology.orchestra.run.smithi092.stdout:generic/088 0s 2023-08-26T10:10:29.697 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/088 2023-08-26T10:10:29.698 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2023-08-26T10:10:29.699 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T10:10:29.722 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-26T10:10:29.723 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.LDx1v48xscxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-08-26T10:10:30.210 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph-fuse 2023-08-26T10:10:30.215 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-26T10:10:30.215 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-08-26T10:10:47.606 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:10:47.609 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:11:17.725 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:11:17.729 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:11:47.846 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:11:47.850 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:12:17.941 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:12:17.945 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:12:48.066 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:12:48.069 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:13:18.286 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:13:18.289 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:13:48.439 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:13:48.442 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:14:18.592 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:14:18.595 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:14:48.793 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:14:48.797 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:15:18.954 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:15:18.958 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:15:49.312 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:15:49.316 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:16:19.538 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:16:19.541 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:16:49.674 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:16:49.678 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:17:19.790 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:17:19.793 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:17:49.926 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:17:49.930 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:18:20.080 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:18:20.083 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:18:50.253 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:18:50.256 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:19:20.578 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:19:20.581 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:19:50.650 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:19:50.653 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:20:20.787 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:20:20.792 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:20:50.939 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:20:50.942 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:21:21.084 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:21:21.088 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:21:51.246 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:21:51.249 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:22:21.391 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:22:21.394 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:22:51.519 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:22:51.523 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:23:21.591 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:23:21.594 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:23:51.717 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:23:51.721 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:24:21.828 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:24:21.832 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:24:51.981 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:24:51.984 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:25:22.145 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:25:22.148 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:25:52.290 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:25:52.293 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:26:22.389 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:26:22.392 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:26:52.547 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:26:52.550 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:27:22.700 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:27:22.704 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:27:52.770 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:27:52.773 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:28:22.835 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:28:22.838 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:28:52.970 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:28:52.973 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:29:23.115 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:29:23.118 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:29:53.276 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:29:53.279 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:30:23.454 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:30:23.458 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:30:53.608 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:30:53.611 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:31:23.728 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:31:23.732 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:31:53.896 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:31:53.900 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:32:23.993 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:32:23.998 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:32:54.144 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:32:54.151 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:33:24.292 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:33:24.295 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:33:54.424 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:33:54.428 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:34:24.511 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:34:24.514 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:34:54.638 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:34:54.641 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:35:24.783 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:35:24.786 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:35:54.918 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:35:54.921 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:36:25.138 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:36:25.141 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:36:55.283 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:36:55.286 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:37:25.444 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:37:25.447 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:37:55.572 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:37:55.576 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:38:25.643 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:38:25.647 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:38:55.779 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:38:55.782 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:39:25.925 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:39:25.928 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:39:56.067 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:39:56.071 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:40:26.229 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:40:26.232 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:40:56.366 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:40:56.369 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:41:26.510 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:41:26.514 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:41:56.656 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:41:56.680 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:42:26.789 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:42:26.792 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:42:57.034 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:42:57.038 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:43:27.105 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:43:27.109 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:43:57.259 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:43:57.262 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:44:27.346 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:44:27.350 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:44:57.489 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:44:57.492 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:45:27.636 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:45:27.639 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:45:57.775 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:45:57.778 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:46:27.919 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:46:27.922 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:46:58.055 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:46:58.058 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:47:28.139 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:47:28.142 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:47:58.264 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:47:58.267 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:48:28.358 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:48:28.361 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:48:58.512 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:48:58.515 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:49:28.668 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:49:28.671 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:49:58.829 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:49:58.832 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:50:28.974 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:50:28.977 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:50:59.120 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:50:59.123 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:51:29.196 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:51:29.199 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:51:59.367 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:51:59.370 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:52:29.471 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:52:29.474 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:52:59.639 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:52:59.643 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:53:29.795 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:53:29.798 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:53:59.928 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:53:59.931 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:54:30.065 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:54:30.068 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:55:00.193 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:55:00.196 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:55:30.351 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:55:30.357 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:56:00.447 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:56:00.451 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:56:30.602 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:56:30.605 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:57:00.755 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:57:00.759 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:57:30.840 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:57:30.843 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:58:00.971 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:58:00.974 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:58:31.107 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:58:31.110 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:59:01.260 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:59:01.263 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:59:31.380 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T10:59:31.383 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:00:01.510 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:00:01.513 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:00:31.672 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:00:31.675 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:01:01.805 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:01:01.807 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:01:31.934 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:01:31.938 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:02:02.020 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:02:02.022 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:02:32.174 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:02:32.177 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:03:02.248 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:03:02.251 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:03:32.355 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:03:32.358 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:04:02.449 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:04:02.452 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:04:32.569 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:04:32.572 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:05:02.705 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:05:02.708 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:05:32.834 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:05:32.837 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:06:02.970 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:06:02.974 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:06:33.107 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:06:33.110 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:07:03.268 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:07:03.272 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:07:33.388 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:07:33.391 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:08:03.528 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:08:03.531 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:08:33.625 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:08:33.629 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:09:03.769 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:09:03.772 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:09:33.916 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:09:33.920 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:10:04.053 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:10:04.056 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:10:34.274 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:10:34.277 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:11:04.428 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:11:04.431 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:11:34.578 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:11:34.581 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:12:04.723 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:12:04.726 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:12:34.855 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:12:34.858 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:13:05.051 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:13:05.054 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:13:35.157 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:13:35.160 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:14:05.291 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:14:05.294 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:14:35.439 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:14:35.446 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:15:05.567 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:15:05.570 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:15:35.660 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:15:35.664 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:16:05.798 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:16:05.801 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:16:35.949 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:16:35.953 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:17:06.087 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:17:06.090 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:17:36.239 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:17:36.243 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:18:06.367 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:18:06.370 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:18:36.512 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:18:36.515 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:19:06.651 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:19:06.655 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:19:36.747 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:19:36.750 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:20:06.903 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:20:06.907 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:20:37.071 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:20:37.075 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:21:07.209 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:21:07.212 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:21:37.346 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:21:37.350 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:22:07.457 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:22:07.460 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:22:37.618 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:22:37.641 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:23:07.790 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:23:07.793 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:23:37.948 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:23:37.951 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:24:08.070 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:24:08.074 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:24:38.204 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:24:38.207 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:25:08.371 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:25:08.375 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:25:38.524 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:25:38.527 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:26:08.603 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:26:08.606 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:26:38.753 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:26:38.756 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:27:08.836 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:27:08.839 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:27:38.987 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:27:38.990 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:28:09.132 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:28:09.136 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:28:39.261 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:28:39.265 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:29:09.390 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:29:09.394 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:29:39.528 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:29:39.531 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:30:09.656 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:30:09.659 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:30:39.835 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:30:39.838 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:31:09.963 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:31:09.966 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:31:40.105 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:31:40.108 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:32:10.233 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:32:10.236 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:32:40.406 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:32:40.409 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:33:10.565 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:33:10.569 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:33:40.685 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:33:40.688 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:34:11.022 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:34:11.025 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:34:41.079 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:34:41.082 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:35:11.232 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:35:11.235 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:35:41.381 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:35:41.384 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:36:11.536 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:36:11.540 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:36:41.695 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:36:41.698 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:37:11.846 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:37:11.849 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:37:41.917 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:37:41.920 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:38:12.036 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:38:12.039 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:38:42.398 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:38:42.401 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:39:12.460 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:39:12.463 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:39:42.604 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:39:42.607 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:40:12.765 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:40:12.768 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:40:42.918 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:40:42.921 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:41:13.005 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:41:13.009 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:41:43.194 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:41:43.197 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:42:13.339 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:42:13.342 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:42:43.481 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:42:43.484 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:43:13.621 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:43:13.624 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:43:43.772 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:43:43.775 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:44:13.850 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:44:13.854 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:44:43.989 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:44:43.992 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:45:14.243 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:45:14.246 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:45:44.418 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:45:44.420 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:46:14.570 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:46:14.574 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:46:44.723 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:46:44.727 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:47:14.818 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:47:14.822 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:47:44.963 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:47:44.966 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:48:15.115 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:48:15.118 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:48:45.278 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:48:45.281 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:49:15.423 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:49:15.426 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:49:45.591 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:49:45.594 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:50:15.752 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:50:15.756 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:50:45.840 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:50:45.844 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:51:15.987 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:51:15.990 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:51:46.072 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:51:46.075 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:52:16.226 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:52:16.229 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:52:46.366 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:52:46.369 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:53:16.520 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:53:16.523 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:53:46.648 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:53:46.652 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:54:16.801 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:54:16.804 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:54:46.870 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:54:46.873 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:55:17.016 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:55:17.019 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:55:47.103 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:55:47.106 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:56:17.262 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:56:17.266 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:56:47.415 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:56:47.418 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:57:17.589 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:57:17.592 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:57:47.762 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:57:47.766 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:58:17.914 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:58:17.917 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:58:47.975 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:58:47.978 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:59:18.129 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:59:18.132 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:59:48.258 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T11:59:48.261 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:00:18.353 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:00:18.356 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:00:48.489 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:00:48.492 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:01:18.650 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:01:18.654 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:01:48.813 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:01:48.816 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:02:18.973 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:02:18.977 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:02:49.118 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:02:49.121 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:03:19.285 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:03:19.288 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:03:49.447 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:03:49.450 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:04:19.595 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:04:19.599 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:04:49.713 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:04:49.716 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:05:19.843 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:05:19.846 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:05:49.988 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:05:49.991 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:06:20.049 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:06:20.052 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:06:50.202 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:06:50.205 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:07:20.347 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:07:20.350 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:07:50.498 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:07:50.502 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:08:20.631 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:08:20.634 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:08:50.742 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:08:50.745 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:09:20.825 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:09:20.934 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:09:51.078 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:09:51.081 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:10:21.223 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:10:21.226 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:10:51.358 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:10:51.361 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:11:21.510 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:11:21.513 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:11:51.655 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:11:51.658 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:12:21.786 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:12:21.789 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:12:51.947 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:12:51.951 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:13:22.117 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:13:22.120 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:13:52.229 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:13:52.232 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:14:22.298 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:14:22.301 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:14:52.410 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:14:52.413 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:15:22.563 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:15:22.566 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:15:52.700 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:15:52.703 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:16:22.830 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:16:22.833 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:16:52.972 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:16:52.975 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:17:23.036 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:17:23.040 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:17:53.306 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:17:53.309 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:18:23.460 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:18:23.464 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:18:53.622 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:18:53.626 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:19:23.779 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:19:23.782 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:19:53.932 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:19:53.936 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:20:24.084 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:20:24.087 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:20:54.161 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:20:54.168 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:21:24.291 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:21:24.294 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:21:54.444 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:21:54.448 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:22:24.596 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:22:24.599 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:22:54.774 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:22:54.777 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:23:24.912 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:23:24.915 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:23:55.030 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:23:55.033 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:24:25.175 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:24:25.179 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:24:55.287 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:24:55.290 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:25:25.385 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:25:25.389 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:25:55.651 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:25:55.655 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:26:25.787 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:26:25.790 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:26:55.939 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:26:55.943 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:27:26.084 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:27:26.087 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:27:56.253 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:27:56.256 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:28:26.373 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:28:26.376 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:28:56.426 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:28:56.430 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:29:26.562 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:29:26.565 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:29:56.642 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:29:56.645 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:30:26.794 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:30:26.797 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:30:56.937 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:30:56.941 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:31:27.065 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:31:27.068 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:31:57.160 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:31:57.164 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:32:27.288 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:32:27.292 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:32:57.423 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:32:57.427 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:33:27.486 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:33:27.489 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:33:57.638 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:33:57.641 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:34:27.783 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:34:27.787 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:34:57.928 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:34:57.931 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:35:28.089 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:35:28.093 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:35:58.235 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:35:58.239 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:36:28.313 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:36:28.316 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:36:58.466 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:36:58.469 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:37:28.545 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:37:28.548 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:37:58.706 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:37:58.709 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:38:28.876 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:38:28.880 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:38:59.014 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:38:59.017 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:39:29.133 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:39:29.136 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:39:59.367 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:39:59.370 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:40:29.514 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:40:29.517 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:40:59.614 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:40:59.617 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:41:29.770 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:41:29.773 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:41:59.915 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:41:59.917 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:42:30.076 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:42:30.079 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:43:00.155 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:43:00.158 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:43:30.312 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:43:30.315 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:44:00.469 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:44:00.472 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:44:30.555 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:44:30.558 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:45:00.716 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:45:00.719 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:45:30.877 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:45:30.880 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:46:01.031 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:46:01.034 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:46:31.178 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:46:31.182 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:47:01.323 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:47:01.326 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:47:31.468 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:47:31.471 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:48:01.625 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:48:01.628 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:48:31.712 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:48:31.715 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:49:01.865 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:49:01.868 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:49:31.993 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:49:31.997 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:50:02.089 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:50:02.092 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:50:32.234 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:50:32.237 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:51:02.362 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:51:02.365 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:51:32.466 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:51:32.469 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:52:02.595 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:52:02.600 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:52:32.740 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:52:32.743 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:53:02.827 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:53:02.831 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:53:32.970 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:53:32.973 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:54:03.132 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:54:03.135 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:54:33.293 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:54:33.296 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:55:03.349 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:55:03.352 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:55:33.509 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:55:33.513 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:56:03.644 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:56:03.647 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:56:33.846 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:56:33.849 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:57:03.916 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:57:03.919 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:57:34.035 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:57:34.039 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:58:04.197 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:58:04.201 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:58:34.359 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:58:34.362 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:59:04.478 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:59:04.481 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:59:34.598 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T12:59:34.601 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:00:04.742 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:00:04.746 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:00:35.029 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:00:35.032 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:01:05.148 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:01:05.152 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:01:35.273 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:01:35.276 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:02:05.404 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:02:05.407 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:02:35.532 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:02:35.536 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:03:05.685 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:03:05.701 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:03:35.830 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:03:35.834 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:04:05.976 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:04:05.979 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:04:36.086 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:04:36.090 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:05:06.239 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:05:06.243 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:05:36.384 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:05:36.387 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:06:06.530 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:06:06.533 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:06:36.666 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:06:36.670 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:07:06.785 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:07:06.788 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:07:36.913 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:07:36.916 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:08:06.976 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:08:06.979 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:08:37.128 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:08:37.131 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:09:07.197 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:09:07.200 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:09:37.258 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:09:37.261 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:10:07.377 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:10:07.381 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:10:37.543 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:10:37.547 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:11:07.659 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:11:07.662 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:11:37.813 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:11:37.816 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:12:07.873 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:12:07.876 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:12:37.951 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:12:37.954 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:13:08.038 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:13:08.041 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:13:38.109 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:13:38.113 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:14:08.286 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:14:08.289 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:14:38.414 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:14:38.417 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:15:08.534 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:15:08.537 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:15:38.687 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:15:38.690 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:16:08.771 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:16:08.774 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:16:38.910 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:16:38.913 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:17:09.031 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:17:09.034 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:17:39.158 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:17:39.162 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:18:09.337 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:18:09.340 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:18:39.406 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:18:39.409 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:19:09.526 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:19:09.529 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:19:39.662 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:19:39.665 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:20:09.835 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:20:09.839 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:20:39.972 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:20:39.975 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:21:10.117 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:21:10.120 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:21:40.262 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:21:40.265 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:22:10.375 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:22:10.378 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:22:40.514 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:22:40.517 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:23:10.667 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:23:10.670 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:23:40.795 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:23:40.798 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:24:10.906 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:24:10.909 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:24:41.033 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:24:41.037 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:25:11.120 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:25:11.123 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:25:41.281 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:25:41.285 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:26:11.534 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:26:11.537 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:26:41.597 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:26:41.601 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:27:11.732 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:27:11.735 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:27:41.869 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:27:41.872 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:28:11.980 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:28:11.984 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:28:42.125 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:28:42.128 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:29:12.193 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:29:12.196 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:29:42.285 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:29:42.288 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:30:12.415 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:30:12.418 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:30:42.685 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:30:42.689 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:31:12.805 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:31:12.808 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:31:42.951 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:31:42.954 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:32:13.086 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:32:13.089 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:32:43.197 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:32:43.200 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:33:13.367 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:33:13.370 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:33:43.503 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:33:43.506 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:34:13.806 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:34:13.809 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:34:43.867 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:34:43.871 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:35:14.004 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:35:14.007 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:35:44.141 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:35:44.144 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:36:14.237 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:36:14.240 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:36:44.374 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:36:44.377 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:37:14.533 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:37:14.536 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:37:44.668 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:37:44.672 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:38:14.813 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:38:14.816 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:38:44.883 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:38:44.886 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:39:14.944 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:39:14.947 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:39:45.089 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:39:45.092 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:40:15.217 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:40:15.220 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:40:45.287 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:40:45.291 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:41:15.416 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:41:15.419 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:41:45.543 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:41:45.547 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:42:15.705 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:42:15.709 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:42:45.832 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:42:45.835 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:43:15.978 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:43:15.981 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:43:46.105 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:43:46.109 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:44:16.241 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:44:16.244 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:44:46.361 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:44:46.364 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:45:16.497 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:45:16.500 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:45:46.666 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:45:46.670 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:46:16.844 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:46:16.847 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:46:46.993 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:46:46.996 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:47:17.146 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:47:17.149 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:47:47.268 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:47:47.272 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:48:17.412 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:48:17.415 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:48:47.566 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:48:47.569 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:49:17.702 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:49:17.706 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:49:47.865 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:49:47.868 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:50:18.002 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:50:18.005 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:50:48.135 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:50:48.139 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:51:18.277 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:51:18.280 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:51:48.358 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:51:48.363 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:52:18.494 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:52:18.497 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:52:48.580 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:52:48.583 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:53:18.725 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:53:18.728 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:53:48.862 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:53:48.865 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:54:19.030 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:54:19.033 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:54:49.308 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:54:49.311 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:55:19.368 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:55:19.372 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:55:49.438 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:55:49.442 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:56:19.591 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:56:19.594 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:56:49.744 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:56:49.747 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:57:19.888 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:57:19.891 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:57:50.016 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:57:50.020 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:58:20.094 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:58:20.096 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:58:50.222 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:58:50.226 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:59:20.341 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:59:20.345 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:59:50.401 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T13:59:50.404 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:00:20.506 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:00:20.509 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:00:50.633 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:00:50.637 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:01:20.703 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:01:20.707 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:01:50.864 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:01:50.868 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:02:21.002 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:02:21.005 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:02:51.139 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:02:51.142 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:03:21.314 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:03:21.317 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:03:51.388 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:03:51.391 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:04:21.558 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:04:21.562 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:04:51.622 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:04:51.625 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:05:21.717 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:05:21.720 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:05:51.870 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:05:51.873 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:06:22.016 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:06:22.020 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:06:52.160 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:06:52.163 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:07:22.296 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:07:22.299 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:07:52.359 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:07:52.362 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:08:22.435 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:08:22.439 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:08:52.608 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:08:52.611 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:09:22.666 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:09:22.670 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:09:52.821 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:09:52.824 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:10:22.964 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:10:22.968 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:10:53.127 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:10:53.130 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:11:23.280 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:11:23.283 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:11:53.418 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:11:53.421 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:12:23.560 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:12:23.563 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:12:53.664 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:12:53.670 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:13:23.811 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:13:23.839 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:13:53.986 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:13:53.989 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:14:24.147 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:14:24.150 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:14:54.292 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:14:54.296 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:15:24.419 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:15:24.422 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:15:54.546 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:15:54.550 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:16:24.684 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:16:24.688 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:16:54.821 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:16:54.824 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:17:24.963 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:17:24.966 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:17:55.108 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:17:55.111 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:18:25.236 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:18:25.239 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:18:55.388 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:18:55.391 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:19:25.524 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:19:25.528 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:19:55.694 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:19:55.697 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:20:25.856 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:20:25.859 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:20:55.992 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:20:55.995 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:21:26.137 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:21:26.140 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:21:56.281 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:21:56.284 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:22:26.401 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:22:26.404 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:22:56.536 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:22:56.539 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:23:26.624 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:23:26.627 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:23:56.762 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:23:56.765 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:24:26.903 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:24:26.906 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:24:57.024 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:24:57.027 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:25:27.193 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:25:27.196 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:25:57.321 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:25:57.324 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:26:27.384 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:26:27.387 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:26:57.546 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:26:57.550 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:27:27.687 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:27:27.690 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:27:57.836 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:27:57.839 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:28:28.027 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:28:28.031 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:28:58.155 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:28:58.158 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:29:28.297 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:29:28.300 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:29:58.417 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:29:58.420 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:30:28.488 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:30:28.491 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:30:58.557 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:30:58.560 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:31:28.727 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:31:28.731 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:31:58.888 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:31:58.891 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:32:29.024 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:32:29.027 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:32:59.169 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:32:59.173 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:33:29.255 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:33:29.262 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:33:59.399 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:33:59.402 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:34:29.535 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:34:29.539 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:34:59.672 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:34:59.675 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:35:29.800 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:35:29.803 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:35:59.936 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:35:59.939 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:36:30.064 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:36:30.067 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:37:00.200 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:37:00.203 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:37:30.337 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:37:30.340 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:38:00.440 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:38:00.443 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:38:30.600 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:38:30.603 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:39:00.737 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:39:00.740 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:39:30.879 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:39:30.883 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:40:01.016 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:40:01.020 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:40:31.161 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:40:31.164 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:41:01.297 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:41:01.301 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:41:31.445 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:41:31.448 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:42:01.607 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:42:01.610 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:42:31.785 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:42:31.788 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:43:01.955 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:43:01.958 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:43:32.020 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:43:32.023 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:44:02.199 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:44:02.202 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:44:32.326 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:44:32.329 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:45:02.412 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:45:02.415 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:45:32.572 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:45:32.575 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:46:02.734 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:46:02.737 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:46:32.803 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:46:32.806 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:47:02.999 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:47:03.002 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:47:33.135 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:47:33.138 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:48:03.271 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:48:03.274 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:48:33.432 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:48:33.436 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:49:03.570 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:49:03.574 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:49:33.724 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:49:33.727 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:50:03.870 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:50:03.874 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:50:34.202 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:50:34.206 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:51:04.263 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:51:04.266 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:51:34.399 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:51:34.403 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:52:04.542 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:52:04.545 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:52:34.681 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:52:34.684 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:53:04.834 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:53:04.837 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:53:34.979 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:53:34.982 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:54:05.039 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:54:05.042 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:54:35.134 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:54:35.137 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:55:05.270 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:55:05.273 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:55:35.408 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:55:35.412 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:56:05.560 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:56:05.564 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:56:35.705 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:56:35.708 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:57:05.835 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:57:05.838 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:57:35.954 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:57:35.957 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:58:06.067 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:58:06.070 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:58:36.195 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:58:36.198 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:59:06.332 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:59:06.335 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:59:36.493 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T14:59:36.496 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:00:06.630 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:00:06.633 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:00:36.783 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:00:36.786 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:01:06.911 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:01:06.915 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:01:37.058 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:01:37.061 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:02:07.175 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:02:07.178 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:02:37.270 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:02:37.273 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:03:07.401 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:03:07.404 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:03:37.484 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:03:37.487 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:04:07.605 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:04:07.608 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:04:37.740 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:04:37.743 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:05:07.868 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:05:07.871 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:05:38.021 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:05:38.024 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:06:08.138 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:06:08.142 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:06:38.286 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:06:38.289 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:07:08.420 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:07:08.423 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:07:38.575 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:07:38.578 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:08:08.705 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:08:08.708 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:08:38.882 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:08:38.885 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:09:09.019 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:09:09.022 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:09:39.172 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:09:39.176 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:10:09.334 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:10:09.337 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:10:39.486 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:10:39.490 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:11:09.614 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:11:09.618 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:11:39.762 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:11:39.765 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:12:09.895 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:12:09.899 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:12:40.040 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:12:40.043 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:13:10.269 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:13:10.273 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:13:40.346 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:13:40.349 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:14:10.499 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:14:10.502 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:14:40.652 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:14:40.655 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:15:10.807 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:15:10.810 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:15:40.958 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:15:40.961 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:16:11.102 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:16:11.106 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:16:41.248 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:16:41.251 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:17:11.383 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:17:11.386 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:17:41.515 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:17:41.518 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:18:11.672 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:18:11.675 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:18:41.819 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:18:41.822 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:19:11.955 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:19:11.959 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:19:42.114 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:19:42.118 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:20:12.262 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:20:12.266 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:20:42.413 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:20:42.416 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:21:12.591 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:21:12.594 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:21:42.719 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:21:42.722 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:22:12.844 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:22:12.847 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:22:42.998 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:22:43.001 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:23:13.144 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:23:13.147 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:23:43.299 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:23:43.302 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:24:13.469 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:24:13.474 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:24:43.605 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:24:43.609 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:25:13.758 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:25:13.761 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:25:43.886 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:25:43.890 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:26:13.956 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:26:13.959 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:26:44.036 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:26:44.039 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:27:14.195 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:27:14.198 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:27:44.341 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:27:44.344 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:28:14.481 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:28:14.484 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:28:44.554 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:28:44.556 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:29:14.698 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:29:14.701 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:29:44.843 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:29:44.846 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:30:14.980 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:30:14.983 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:30:45.109 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:30:45.112 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:31:15.262 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:31:15.265 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:31:45.407 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:31:45.410 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:32:15.537 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:32:15.540 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:32:45.683 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:32:45.686 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:33:15.836 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:33:15.839 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:33:45.990 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:33:45.993 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:34:16.163 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:34:16.166 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:34:46.232 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:34:46.235 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:35:16.310 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:35:16.313 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:35:46.447 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:35:46.450 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:36:16.583 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:36:16.586 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:36:46.736 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:36:46.739 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:37:16.889 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:37:16.892 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:37:47.011 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:37:47.015 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:38:17.129 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:38:17.132 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:38:47.291 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:38:47.294 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:39:17.360 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:39:17.364 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:39:47.539 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:39:47.567 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:40:17.699 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:40:17.703 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:40:47.853 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:40:47.856 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:41:18.019 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:41:18.022 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:41:48.156 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:41:48.159 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:42:18.328 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:42:18.331 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:42:48.473 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:42:48.476 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:43:18.626 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:43:18.629 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:43:48.720 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:43:48.723 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:44:18.882 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:44:18.885 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:44:49.018 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:44:49.021 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:45:19.147 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:45:19.150 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:45:49.282 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:45:49.285 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:46:19.427 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:46:19.432 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:46:49.571 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:46:49.574 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:47:19.720 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:47:19.724 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:47:49.794 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:47:49.797 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:48:19.946 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:48:19.949 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:48:50.125 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:48:50.128 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:49:20.260 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:49:20.263 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:49:50.423 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:49:50.426 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:50:20.584 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:50:20.588 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:50:50.712 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:50:50.715 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:51:20.824 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:51:20.828 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:51:50.993 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:51:50.997 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:52:21.139 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:52:21.142 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:52:51.301 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:52:51.304 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:53:21.440 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:53:21.443 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:53:51.615 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:53:51.618 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:54:21.752 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:54:21.755 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:54:51.855 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:54:51.857 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:55:21.942 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:55:21.945 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:55:52.086 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:55:52.089 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:56:22.240 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:56:22.245 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:56:52.393 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:56:52.397 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:57:22.520 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:57:22.526 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:57:52.670 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:57:52.673 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:58:22.809 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:58:22.813 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:58:52.879 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:58:52.882 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:59:23.014 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:59:23.017 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:59:53.134 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T15:59:53.137 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:00:23.254 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:00:23.257 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:00:53.400 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:00:53.402 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:01:23.535 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:01:23.539 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:01:53.656 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:01:53.659 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:02:23.808 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:02:23.812 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:02:54.049 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:02:54.052 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:03:24.190 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:03:24.193 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:03:54.360 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:03:54.364 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:04:24.521 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:04:24.524 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:04:54.674 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:04:54.677 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:05:24.811 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:05:24.814 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:05:54.905 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:05:54.908 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:06:25.051 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:06:25.055 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:06:55.204 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:06:55.207 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:07:25.449 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:07:25.452 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:07:55.551 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:07:55.554 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:08:25.697 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:08:25.700 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:08:55.833 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:08:55.837 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:09:25.998 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:09:26.001 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:09:56.156 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:09:56.159 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:10:26.299 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:10:26.303 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:10:56.452 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:10:56.455 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:11:26.596 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:11:26.599 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:11:56.775 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:11:56.778 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:12:26.929 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:12:26.933 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:12:57.042 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:12:57.045 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:13:27.192 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:13:27.195 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:13:57.294 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:13:57.298 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:14:27.423 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:14:27.426 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:14:57.550 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:14:57.553 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:15:27.693 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:15:27.696 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:15:57.830 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:15:57.833 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:16:27.967 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:16:27.971 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:16:58.105 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:16:58.108 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:17:28.251 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:17:28.254 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:17:58.401 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:17:58.404 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:18:28.547 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:18:28.550 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:18:58.699 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:18:58.704 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:19:28.840 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:19:28.843 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:19:58.983 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:19:58.986 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:20:29.093 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:20:29.097 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:20:59.161 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:20:59.165 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:21:29.316 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:21:29.320 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:21:59.478 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:21:59.481 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:22:29.622 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:22:29.626 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:22:59.769 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:22:59.773 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:23:29.914 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:23:29.918 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:24:00.064 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:24:00.067 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:24:30.217 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:24:30.220 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:25:00.371 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:25:00.374 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:25:30.513 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:25:30.516 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:26:00.667 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:26:00.671 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:26:30.812 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:26:30.815 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:27:00.941 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:27:00.944 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:27:31.101 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:27:31.104 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:28:01.229 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:28:01.232 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:28:31.302 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:28:31.305 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:29:01.439 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:29:01.442 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:29:31.622 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:29:31.626 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:30:01.771 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:30:01.774 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:30:31.918 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:30:31.921 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:31:02.038 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:31:02.041 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:31:32.174 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:31:32.178 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:32:02.294 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:32:02.298 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:32:32.457 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:32:32.460 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:33:02.517 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:33:02.520 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:33:32.662 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:33:32.665 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:34:02.840 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:34:02.843 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:34:32.984 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:34:32.988 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:35:03.120 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:35:03.123 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:35:33.282 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:35:33.285 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:36:03.369 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:36:03.372 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:36:33.516 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:36:33.519 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:37:03.657 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:37:03.660 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:37:33.801 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:37:33.805 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:38:03.931 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:38:03.934 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:38:34.074 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:38:34.077 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:39:04.219 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:39:04.222 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:39:34.363 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:39:34.366 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:40:04.428 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:40:04.431 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:40:34.564 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:40:34.568 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:41:04.689 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:41:04.693 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:41:34.838 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:41:34.841 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:42:05.008 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:42:05.011 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:42:35.156 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:42:35.159 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:43:05.309 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:43:05.312 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:43:35.454 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:43:35.457 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:44:05.540 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:44:05.543 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:44:35.692 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:44:35.695 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:45:05.845 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:45:05.848 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:45:35.990 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:45:35.993 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:46:06.159 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:46:06.162 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:46:36.305 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:46:36.308 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:47:06.451 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:47:06.454 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:47:36.578 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:47:36.581 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:48:06.747 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:48:06.750 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:48:36.900 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:48:36.903 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:49:06.969 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:49:06.973 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:49:37.105 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:49:37.108 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:50:07.250 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:50:07.253 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:50:37.336 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:50:37.339 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:51:07.473 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:51:07.476 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:51:37.625 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:51:37.628 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:52:07.701 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:52:07.704 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:52:37.840 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:52:37.844 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:53:07.910 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:53:07.913 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:53:37.972 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:53:37.975 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:54:08.110 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:54:08.113 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:54:38.246 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:54:38.249 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:55:08.382 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:55:08.385 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:55:38.527 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:55:38.530 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:56:08.596 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:56:08.599 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:56:38.799 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:56:38.802 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:57:08.952 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:57:08.956 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:57:39.096 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:57:39.099 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:58:09.225 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:58:09.229 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:58:39.320 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:58:39.323 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:59:09.508 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:59:09.511 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:59:39.627 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T16:59:39.630 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:00:09.684 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:00:09.687 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:00:39.749 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:00:39.752 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:01:09.868 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:01:09.872 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:01:40.013 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:01:40.016 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:02:10.166 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:02:10.170 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:02:40.304 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:02:40.307 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:03:10.456 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:03:10.461 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:03:40.575 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:03:40.578 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:04:10.686 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:04:10.690 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:04:40.823 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:04:40.826 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:05:10.984 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:05:10.987 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:05:41.138 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:05:41.141 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:06:11.258 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:06:11.261 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:06:41.403 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:06:41.407 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:07:11.563 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:07:11.566 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:07:41.701 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:07:41.704 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:08:11.821 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:08:11.824 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:08:41.882 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:08:41.886 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:09:12.045 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:09:12.048 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:09:42.197 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:09:42.200 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:10:12.342 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:10:12.345 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:10:42.398 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:10:42.401 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:11:12.523 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:11:12.526 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:11:42.676 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:11:42.680 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:12:12.839 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:12:12.842 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:12:42.906 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:12:42.909 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:13:13.042 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:13:13.046 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:13:43.189 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:13:43.192 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:14:13.335 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:14:13.338 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:14:43.496 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:14:43.499 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:15:13.632 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:15:13.635 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:15:43.759 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:15:43.762 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:16:14.029 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:16:14.032 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:16:44.147 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:16:44.150 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:17:14.287 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:17:14.290 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:17:44.421 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:17:44.424 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:18:14.561 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:18:14.564 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:18:44.685 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:18:44.688 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:19:14.821 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:19:14.824 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:19:44.916 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:19:44.919 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:20:15.053 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:20:15.056 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:20:45.139 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:20:45.142 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:21:15.266 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:21:15.270 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:21:45.411 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:21:45.414 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:22:15.547 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:22:15.550 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:22:45.700 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:22:45.704 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:23:15.863 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:23:15.866 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:23:45.964 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:23:45.967 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:24:16.126 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:24:16.129 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:24:46.229 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:24:46.232 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:25:16.381 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:25:16.384 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:25:46.518 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:25:46.521 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:26:16.654 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:26:16.658 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:26:46.781 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:26:46.784 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:27:16.917 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:27:16.921 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:27:47.021 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:27:47.025 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:28:17.099 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:28:17.102 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:28:47.261 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:28:47.264 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:29:17.329 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:29:17.332 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:29:47.466 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:29:47.469 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:30:17.528 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:30:17.531 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:30:47.672 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:30:47.675 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:31:17.775 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:31:17.778 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:31:47.894 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:31:47.897 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:32:18.031 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:32:18.034 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:32:48.100 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:32:48.103 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:33:18.396 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:33:18.399 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:33:48.495 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:33:48.499 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:34:18.683 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:34:18.686 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:34:48.830 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:34:48.833 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:35:18.964 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:35:18.967 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:35:49.120 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:35:49.124 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:36:19.197 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:36:19.200 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:36:49.335 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:36:49.338 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:37:19.493 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:37:19.497 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:37:49.633 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:37:49.636 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:38:19.742 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:38:19.745 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:38:49.890 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:38:49.893 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:39:20.059 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:39:20.062 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:39:50.187 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:39:50.191 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:40:20.325 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:40:20.329 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:40:50.435 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:40:50.439 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:41:20.520 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:41:20.524 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:41:50.669 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:41:50.672 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:42:20.838 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:42:20.841 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:42:50.962 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:42:50.966 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:43:21.108 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:43:21.111 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:43:51.241 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:43:51.244 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:44:21.386 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:44:21.389 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:44:51.523 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:44:51.526 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:45:21.678 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:45:21.681 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:45:51.813 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:45:51.817 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:46:21.933 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:46:21.936 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:46:52.069 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:46:52.073 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:47:22.209 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:47:22.212 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:47:52.284 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:47:52.287 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:48:22.396 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:48:22.400 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:48:52.542 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:48:52.545 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:49:22.670 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:49:22.673 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:49:52.892 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:49:52.896 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:50:22.986 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:50:22.989 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:50:53.121 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:50:53.124 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:51:23.249 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:51:23.252 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:51:53.368 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:51:53.371 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:52:23.509 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:52:23.512 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:52:53.632 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:52:53.635 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:53:23.785 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:53:23.789 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:53:53.921 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:53:53.924 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:54:24.148 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:54:24.151 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:54:54.260 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:54:54.264 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:55:24.373 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:55:24.376 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:55:54.535 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:55:54.543 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:56:24.617 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:56:24.621 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:56:54.737 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:56:54.740 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:57:24.882 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:57:24.885 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:57:55.027 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:57:55.031 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:58:25.176 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:58:25.179 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:58:55.325 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:58:55.328 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:59:25.436 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:59:25.440 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:59:55.589 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T17:59:55.593 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:00:25.668 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:00:25.671 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:00:55.838 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:00:55.841 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:01:25.930 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:01:25.934 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:01:56.069 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:01:56.072 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:02:26.189 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:02:26.192 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:02:56.266 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:02:56.269 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:03:26.344 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:03:26.347 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:03:56.423 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:03:56.426 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:04:26.583 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:04:26.586 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:04:56.720 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:04:56.722 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:05:26.847 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:05:26.850 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:05:56.967 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:05:56.971 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:06:27.111 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:06:27.114 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:06:57.248 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:06:57.252 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:07:27.376 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:07:27.380 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:07:57.503 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:07:57.506 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:08:27.566 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:08:27.569 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:08:57.710 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:08:57.713 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:09:27.880 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:09:27.884 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:09:57.960 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:09:57.963 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:10:28.113 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:10:28.117 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:10:58.247 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:10:58.250 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:11:28.409 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:11:28.413 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:11:58.537 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:11:58.540 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:12:28.623 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:12:28.627 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:12:58.778 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:12:58.781 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:13:28.942 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:13:28.945 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:13:59.082 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:13:59.085 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:14:29.244 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:14:29.247 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:14:59.362 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:14:59.365 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:15:29.513 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:15:29.516 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:15:59.644 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:15:59.647 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:16:29.738 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:16:29.742 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:16:59.816 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:16:59.820 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:17:29.895 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:17:29.898 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:18:00.031 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:18:00.042 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:18:30.191 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:18:30.194 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:19:00.329 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:19:00.333 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:19:30.498 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:19:30.501 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:20:00.650 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:20:00.652 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:20:30.715 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:20:30.718 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:21:00.860 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:21:00.864 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:21:31.000 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:21:31.003 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:22:01.144 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:22:01.147 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:22:31.529 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:22:31.532 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:23:01.583 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:23:01.587 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:23:31.703 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:23:31.706 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:24:01.774 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:24:01.778 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:24:31.908 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:24:31.910 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:25:02.053 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:25:02.056 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:25:32.156 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:25:32.159 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:26:02.292 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:26:02.314 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:26:32.453 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:26:32.456 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:27:02.556 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:27:02.559 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:27:32.646 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:27:32.649 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:28:02.720 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:28:02.724 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:28:32.839 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:28:32.842 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:29:03.000 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:29:03.004 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:29:33.164 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:29:33.167 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:30:03.264 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:30:03.267 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:30:33.385 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:30:33.388 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:31:03.545 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:31:03.548 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:31:33.706 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:31:33.709 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:32:03.960 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:32:03.962 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:32:34.087 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:32:34.090 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:33:04.223 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:33:04.226 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:33:34.367 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:33:34.372 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:34:04.503 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:34:04.508 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:34:34.665 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:34:34.668 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:35:04.851 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:35:04.854 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:35:34.970 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:35:34.974 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:36:05.105 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:36:05.108 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:36:35.226 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:36:35.229 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:37:05.379 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:37:05.382 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:37:35.540 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:37:35.543 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:38:05.677 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:38:05.680 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:38:35.837 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:38:35.841 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:39:05.958 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:39:05.962 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:39:36.103 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:39:36.106 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:40:06.257 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:40:06.260 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:40:36.450 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:40:36.453 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:41:06.580 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:41:06.583 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:41:36.712 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:41:36.715 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:42:06.849 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:42:06.852 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:42:36.996 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:42:37.000 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:43:07.170 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:43:07.174 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:43:37.282 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:43:37.285 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:44:07.436 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:44:07.439 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:44:37.596 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:44:37.600 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:45:07.660 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:45:07.664 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:45:37.810 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:45:37.813 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:46:07.972 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:46:07.975 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:46:38.082 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:46:38.086 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:47:08.144 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:47:08.147 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:47:38.322 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:47:38.325 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:48:08.442 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:48:08.445 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:48:38.604 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:48:38.607 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:49:08.683 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:49:08.686 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:49:38.754 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:49:38.757 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:50:08.874 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:50:08.877 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:50:38.957 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:50:38.960 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:51:09.115 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:51:09.118 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:51:39.252 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:51:39.255 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:52:09.388 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:52:09.391 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:52:39.545 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:52:39.548 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:53:09.700 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:53:09.703 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:53:39.784 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:53:39.787 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:54:09.894 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:54:09.897 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:54:40.039 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:54:40.042 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:55:10.143 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:55:10.146 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:55:40.282 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:55:40.285 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:56:10.435 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:56:10.440 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:56:40.595 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:56:40.597 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:57:10.682 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:57:10.686 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:57:40.802 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:57:40.805 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:58:10.868 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:58:10.874 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:58:41.009 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:58:41.012 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:59:11.130 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:59:11.133 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:59:41.202 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T18:59:41.205 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:00:11.319 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:00:11.322 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:00:41.456 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:00:41.460 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:01:11.593 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:01:11.597 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:01:41.765 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:01:41.768 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:02:11.907 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:02:11.911 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:02:42.078 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:02:42.081 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:02:42.126 INFO:tasks.ceph.osd.4.smithi188.stderr:2023-08-26T19:02:42.125+0000 7f1e0e376700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 140436) UID: 0 2023-08-26T19:02:42.127 INFO:tasks.ceph.osd.5.smithi188.stderr:2023-08-26T19:02:42.125+0000 7f5b28c42700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 140436) UID: 0 2023-08-26T19:02:42.128 INFO:tasks.ceph.osd.7.smithi188.stderr:2023-08-26T19:02:42.125+0000 7f9e78279700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 140436) UID: 0 2023-08-26T19:02:42.128 INFO:tasks.ceph.osd.6.smithi188.stderr:2023-08-26T19:02:42.125+0000 7f13bbf05700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 140436) UID: 0 2023-08-26T19:04:52.418 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:04:52.422 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:05:22.594 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:05:22.597 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:05:52.723 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:05:52.727 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:06:22.858 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:06:22.861 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:06:53.003 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:06:53.006 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:07:23.155 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:07:23.158 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:07:53.283 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:07:53.286 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:08:23.528 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:08:23.531 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:08:53.664 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:08:53.667 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:09:23.800 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:09:23.803 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:09:53.860 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:09:53.863 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:10:23.940 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:10:23.944 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:10:54.035 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:10:54.038 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:11:24.097 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:11:24.102 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:11:54.233 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:11:54.236 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:12:24.385 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:12:24.388 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:12:54.505 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:12:54.508 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:13:24.650 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:13:24.653 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:13:54.802 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:13:54.805 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:14:24.872 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:14:24.875 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:14:55.063 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:14:55.066 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:15:25.220 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:15:25.223 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:15:55.347 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:15:55.350 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:16:25.417 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:16:25.420 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:16:55.566 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:16:55.570 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:17:25.706 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:17:25.709 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:17:55.858 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:17:55.862 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:18:25.982 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:18:25.985 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:18:56.120 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:18:56.123 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:19:26.252 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:19:26.255 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:19:56.377 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:19:56.380 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:20:26.507 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:20:26.511 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:20:56.653 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:20:56.656 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:21:26.796 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:21:26.801 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:21:56.942 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:21:56.946 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:22:27.104 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:22:27.107 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:22:57.258 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:22:57.262 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:23:27.366 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:23:27.369 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:23:57.470 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:23:57.473 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:24:27.623 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:24:27.626 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:24:57.767 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:24:57.770 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:25:27.920 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:25:27.923 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:25:58.073 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:25:58.076 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:26:28.217 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:26:28.220 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:26:58.379 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:26:58.383 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:27:28.516 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:27:28.518 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:27:58.697 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:27:58.700 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:28:28.846 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:28:28.849 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:28:58.974 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:28:58.978 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:29:29.110 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:29:29.113 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:29:59.263 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:29:59.266 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:30:29.399 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:30:29.403 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:30:59.553 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:30:59.557 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:31:29.615 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:31:29.618 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:31:59.767 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:31:59.770 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:32:29.912 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:32:29.915 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:33:00.048 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:33:00.051 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:33:30.184 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:33:30.187 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:34:00.361 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:34:00.364 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:34:30.432 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:34:30.435 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:35:00.501 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:35:00.504 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:35:30.654 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:35:30.657 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:36:00.802 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:36:00.805 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:36:30.926 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:36:30.929 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:37:01.078 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:37:01.081 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:37:31.232 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:37:31.236 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:38:01.359 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:38:01.363 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:38:31.487 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:38:31.490 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:39:01.616 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:39:01.619 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:39:31.793 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:39:31.796 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:40:01.929 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:40:01.932 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:40:32.099 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:40:32.102 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:41:02.244 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:41:02.247 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:41:32.305 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:41:32.308 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:42:02.441 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:42:02.445 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:42:32.562 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:42:32.572 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:43:02.641 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:43:02.646 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:43:32.719 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:43:32.723 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:44:02.820 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:44:02.823 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:44:32.964 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:44:32.967 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:45:03.118 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:45:03.121 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:45:33.280 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:45:33.283 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:46:03.399 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:46:03.402 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:46:33.481 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:46:33.484 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:47:03.606 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:47:03.609 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:47:33.733 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:47:33.736 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:48:03.903 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:48:03.907 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:48:34.040 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:48:34.043 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:49:04.167 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:49:04.171 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:49:34.304 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:49:34.307 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:50:04.424 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:50:04.427 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:50:34.576 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:50:34.580 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:51:04.745 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:51:04.748 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:51:34.890 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:51:34.893 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:52:04.952 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:52:04.955 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:52:35.106 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:52:35.109 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:53:05.260 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:53:05.263 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:53:35.377 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:53:35.380 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:54:05.521 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:54:05.524 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:54:35.654 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:54:35.657 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:55:05.802 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:55:05.805 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:55:35.981 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:55:35.985 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:56:06.120 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:56:06.123 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:56:36.259 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:56:36.262 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:57:06.398 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:57:06.401 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:57:36.525 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:57:36.528 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:58:06.654 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:58:06.657 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:58:36.791 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:58:36.794 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:59:06.861 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:59:06.864 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:59:37.046 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T19:59:37.049 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T20:00:07.174 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T20:00:07.182 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T20:00:37.326 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T20:00:37.330 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T20:01:07.429 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T20:01:07.433 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T20:01:37.566 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T20:01:37.569 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T20:02:07.696 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T20:02:07.699 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T20:02:37.830 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T20:02:37.834 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T20:03:07.902 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T20:03:07.905 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T20:03:37.987 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T20:03:37.991 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T20:04:08.140 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-26T20:04:08.142 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf